autopkg / arubdesu-recipes

Recipes for http://autopkg.github.io/autopkg/

AutoPkg

Latest release is here.

AutoPkg is an automation framework for macOS software packaging and distribution, oriented towards the tasks one would normally perform manually to prepare third-party software for mass deployment to managed clients.

These tasks typically involve at least several of the following steps:

• downloading an application and/or updates for it, usually via a web browser
• extracting them from a multitude of archive formats
• adding site-specific configuration
• adding sane versioning information
• "fixing" poorly-written installer scripts
• saving these modifications back to a compressed disk image or installer package
• importing these into a software distribution system like Munki, Jamf Pro, FileWave, etc.
• customizing the associated metadata for such a system with site-specific data, post-installation scripts, version info or other metadata

Often these tasks follow similar patterns for each individual application, and when managing many applications this becomes a daily task full of sub-tasks that one must remember (and/or maintain documentation for) about exactly what had to be done for a successful deployment of every update for every managed piece of software.

With AutoPkg, we define these steps in a "Recipe" file in plist or yaml format, run automatically instead of by hand, and shared with others.

Installation

Install the latest release.

AutoPkg requires macOS, and Git is highly recommended to have installed so that autopkg can use git to can manage recipe repositories. Knowledge of Git itself is not required.

AutoPkg is tested on the current macOS release. It may work on older releases, but is not actively tested on older releases.

Git can be installed via Apple's command-line developer tools package, which can be prompted for installation by simply typing 'git' in a Terminal window (OS X 10.9 or later).

Since AutoPkg 2.0, Python 2 is no longer supported. The installer linked above contains a bundled version of Python 3 and all needed dependencies.

Usage

A getting started guide is available here.

Frequently Asked Questions (and answers!) are here.

See the wiki for more documentation.

Discussion

Discussion of the use and development of AutoPkg is here.

arubdesu-recipes's Issues

Synergy.munki Recipe Error

When running the Synergy.munki recipe in AutoPkgr the following error is reported:
"No match found on URL: https://github.com/symless/synergy/releases"

Hip chat changed their update mechanism

Hey and thanks for your Munki recipe for HipChat.

Hip chat released a new version 4.03 that is not listen anymore here:

https://github.com/autopkg/arubdesu-recipes/blob/master/Atlassian/HipChat.download.recipe#L16

Check this URL:

https://www.hipchat.com/release_notes/mac

Perhaps you have time to fix this later on. Cheers :-D

MSOutlook - some pkginfo keys lost

Hello.

Some of the pkginfo keys (such as blocking_applications, update_for, etc.) get lost when running the MSOutlook Munki Recipe. By removing the pkginfo argument to the MunkiPkginfoMerger processor (see diff below) many of these issues are resolved, however my workaround is not quite correct because the version key in the resulting pkginfo file gets set to zero (presumably this version number is getting pulled out of the Outlook package itself). The application bundle version in the installs array is still correct (15.6). I have spoken with someone at Microsoft, and allegedly future release will have a real version number in the package receipt, so maybe this won't be a long term problem. In the interim, I'm not sure how to tweak the recipe so that it creates all of the keys (update_for and blocking applications are the biggies for us) and has the version information.

Thank you for a very useful recipe.

My attempted (and incomplete) fix:

--- MSOutlook.munki.recipe  2015-02-14 06:10:05.000000000 -0500
+++ MSOutlook.munki.recipe  2015-02-24 10:23:44.000000000 -0500
@@ -64,7 +64,7 @@
             <key>Processor</key>
             <string>EndOfCheckPhase</string>
         </dict>
-       <dict>
+   <dict>
             <key>Arguments</key>
             <dict>
                 <key>flat_pkg_path</key>
@@ -104,33 +104,6 @@
             <string>Merge input pkginfo and additional_pkginfo generated by MSLyncURLandUpdateInfoProvider</string>
             <key>Processor</key>
             <string>MunkiPkginfoMerger</string>
-            <key>Arguments</key>
-            <dict>
-                <key>pkginfo</key>
-                <dict>
-                    <key>installs</key>
-                    <array>
-                        <dict>
-                            <key>CFBundleIdentifier</key>
-                            <string>com.microsoft.Outlook</string>
-                            <key>CFBundleName</key>
-                            <string>Outlook</string>
-                            <key>CFBundleShortVersionString</key>
-                            <string>%version%</string>
-                            <key>CFBundleVersion</key>
-                            <string>%version%</string>
-                            <key>path</key>
-                            <string>/Applications/Microsoft Outlook.app</string>
-                            <key>type</key>
-                            <string>application</string>
-                            <key>version_comparison_key</key>
-                            <string>CFBundleShortVersionString</string>
-                        </dict>
-                    </array>
-                    <key>version</key>
-                    <string>%version%</string>
-                </dict>
-            </dict>
         </dict>
         <dict>
             <key>Arguments</key>

Looks like Lync has been updated...

Previous URL no longer available.

New URL: http://download.microsoft.com/download/5/0/0/500C7E1F-3235-47D4-BC11-95A71A1BA3ED/lync_14.1.1_150716.dmg

KB: http://www.microsoft.com/en-us/download/details.aspx?id=36517

Thanks.

Use of "munki_update_name" is confusing in MSOffice2016 munki recipes

This is probably a holdover from a copy-and-paste from Office2011 recipes, but:

As far as I can tell, so far "updates" for the Office 2016 apps are full installers, they are not "update" pkgs that must be installed on top of a previous "base" install.

munki_update_name seems to imply something different than the "name" for the item we're importing; IE Office2011_update is an update_for Office2011. Two different names here: Office2011_update and Office2011.

With the Office2016 apps (at least so far) there are no _update items, just the items themselves.

So I think it is confusing to have the name sometimes called "name" and sometimes called "munki_update_name"

Am I missing something?

Synergy recipes broken

Symless moved their downloads around, and there's no more direct link at /nightly

However, with a little processing this page might be useful: https://binaries.symless.com/

MSLync URL provider still going to version 14.10...

Took a brief look at this but didn't see how to fix it, but the MSLync URL is still pointing at 14.10...

Processing MSLync.munki.recipe...
Couldn't download http://download.microsoft.com/download/5/0/0/500C7E1F-3235-47D4-BC11-95A71A1BA3ED/lync_14.0.10_141024.dmg: HTTP Error 404: Not Found
Failed.

The following recipes failed:
MSLync.munki.recipe
Error in local.munki.MSLync: Processor: URLDownloader: Error: Couldn't download http://download.microsoft.com/download/5/0/0/500C7E1F-3235-47D4-BC11-95A71A1BA3ED/lync_14.0.10_141024.dmg: HTTP Error 404: Not Found

Nothing downloaded, packaged or imported.

Charles cannot configure your proxy settings while it is on a read-only volume

Issue Charles cannot configure your proxy settings while it is on a read-only volume" issue #26 seems to be back with Mac OS 10.15 Catalina (beta 7). I setup two new computers with Charles on 10.15. and when I launch I get this error. It seems to happen only when installing Charles on a new computer running the new OS, I did not have this problem when I upgraded a computer that already had Charles installed.

It seems there maybe some new volume protection feature in the new OS.

Synergy Repo Moved

Looks like the new DL URL should be

https://github.com/symless/synergy/releases

Thanks in advance!

Error: 2016SuiteSKUless munki

I get the error below when i run 2016SuiteSKUless Munki.

Processor: OfficeSuiteSKULessVersionProvider: Error: Can't download http://macadmins.software/latest.xml: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1076)>

This seems to be how to solve it but im not sure how to do that.

https://github.com/autopkg/autopkg/wiki/Migrating-Custom-Processors-to-Python-3#ssl-certificate_verify_failed-certificate-verify-failed-unable-to-get-local-issuer-certificate-_sslc1076

Mactracker.munki issue

Hi, it's seems that there is a problem with Mactracker.munki since few days.
When using command line "autopkg run Mactracker.munki", I got this message :

Processing Mactracker.munki...
Use of undefined key in variable substitution: u'pkgroot'
Traceback (most recent call last):
File "/usr/local/bin/autopkg", line 1334, in
sys.exit(main(sys.argv))
File "/usr/local/bin/autopkg", line 1328, in main
exit(subcommands[verb]'function')
File "/usr/local/bin/autopkg", line 1152, in run_recipes
autopackager.process(recipe)
File "/Library/AutoPkg/autopkglib/init.py", line 466, in process
self.env = processor.process()
File "/Library/AutoPkg/autopkglib/init.py", line 295, in process
self.main()
File "/Library/AutoPkg/autopkglib/DmgCreator.py", line 124, in main
"creation of %s failed: %s" % (self.env['dmg_path'], stderr))
UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 37: ordinal not in range(128)

Hope it helps you.
Regards,
Gildas

WWDC code signature verification failing

Hey Allister! I'm having trouble with the WWDC recipe, but I'm not sure how to resolve it.

$ autopkg run -v local.munki.WWDC
Processing local.munki.WWDC...
SparkleUpdateInfoProvider
SparkleUpdateInfoProvider: Version retrieved from appcast: 900
SparkleUpdateInfoProvider: User-facing version retrieved from appcast: 6.1
SparkleUpdateInfoProvider: Found URL https://github.com/insidegui/WWDC/releases/download/6.1/WWDC_v6.1.zip
URLDownloader
URLDownloader: Storing new Last-Modified header: Tue, 06 Nov 2018 13:32:04 GMT
URLDownloader: Storing new ETag header: "9b988f53fe2fee53901c21c3f87f2df8"
URLDownloader: Downloaded /Users/macadmin/Library/AutoPkg/Cache/local.munki.WWDC/downloads/WWDC-6.1.zip
EndOfCheckPhase
Unarchiver
Unarchiver: Guessed archive format 'zip' from filename WWDC-6.1.zip
Unarchiver: Unarchived /Users/macadmin/Library/AutoPkg/Cache/local.munki.WWDC/downloads/WWDC-6.1.zip to /Users/macadmin/Library/AutoPkg/Cache/local.munki.WWDC/WWDC/Applications
CodeSignatureVerifier
CodeSignatureVerifier: Verifying code signature...
CodeSignatureVerifier: Deep verification enabled...
CodeSignatureVerifier: Strict verification not defined. Using codesign defaults...
CodeSignatureVerifier: /Users/macadmin/Library/AutoPkg/Cache/local.munki.WWDC/WWDC/Applications/WWDC.app: bundle format is ambiguous (could be app or framework)
CodeSignatureVerifier: In subcomponent: /Users/macadmin/Library/AutoPkg/Cache/local.munki.WWDC/WWDC/Applications/WWDC.app/Contents/Frameworks/Sparkle.framework
Code signature verification failed. Note that all verifications can be disabled by setting the variable DISABLE_CODE_SIGNATURE_VERIFICATION to a non-empty value.
Failed.
Receipt written to /Users/macadmin/Library/AutoPkg/Cache/local.munki.WWDC/receipts/local.munki-receipt-20190228-134547.plist

The following recipes failed:
    local.munki.WWDC
        Error in local.munki.WWDC: Processor: CodeSignatureVerifier: Error: Code signature verification failed. Note that all verifications can be disabled by setting the variable DISABLE_CODE_SIGNATURE_VERIFICATION to a non-empty value.

The following new items were downloaded:
    Download Path                                                                  
    -------------                                                                  
    /Users/macadmin/Library/AutoPkg/Cache/local.munki.WWDC/downloads/WWDC-6.1.zip 

Some searching makes it look like it's an issue with how the developer is packaging the app (specifically, the bundle format is ambiguous (could be app or framework) portion).

Is there a good workaround for this issue besides disabling code signature verification?

Thanks!

Mike

ClipMenu.munki.recipe broken

Getting a curl failure:

The following recipes failed:
ClipMenu.munki.recipe
Error in local.munki.ClipMenu: Processor: URLDownloader: Error: Curl failure: The requested URL returned error: 404 Not Found (exit code 22)

Retain Overridden "NAME" in Office 2016 Munki Recipes?

If I create an override for an Office 2016 Munki recipe (say "MSExcel2016.munki.recipe") and set:

• The "NAME" to "Excel2016_update"
• Set the "display_name" to "Microsoft Excel Display Name"

when I run the overridden recipe I get a pkginfo file:

• Named "Excel_2016_Installer-15.9.plist"
• The "name" set to "Excel_2016_Installer"
• The "display_name" set to "Microsoft Excel Display Name" (e.g. it was successfully overridden, testing to make sure the override is being evaluated)

My expectation is that I'd get a pkginfo file:

• Named "Excel2016_update-15.9.plist"
• The "name" set to "Excel2016_update"

The Office 2011 recipe follows the latter example above--if I override the "name" of "MSOffice2011Updates.munki.recipe" and set it to "foo", I get a pkginfo file:

• Named "foo-14.5.0.plist"
• The "name" set to "foo"

My override file is below:

<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE plist PUBLIC "-//Apple//DTD PLIST 1.0//EN" "http://www.apple.com/DTDs/PropertyList-1.0.dtd">
<plist version="1.0">
<dict>
    <key>Identifier</key>
    <string>local.munki.MSExcel2016</string>
    <key>Input</key>
    <dict>
        <key>CULTURE_CODE</key>
        <string>0409</string>
        <key>MUNKI_REPO_SUBDIR</key>
        <string>apps</string>
        <key>NAME</key>
        <string>Excel2016_update</string>
        <key>VERSION</key>
        <string>latest</string>
        <key>display_name</key>
        <string>Microsoft Excel Display Name</string>
        <key>pkginfo</key>
        <dict>
            <key>blocking_applications</key>
            <array>
                <string>Microsoft Excel</string>
                <string>Microsoft Error Reporting</string>
                <string>Microsoft Auto Update</string>
            </array>
            <key>catalogs</key>
            <array>
                <string>testing</string>
            </array>
            <key>category</key>
            <string>Productivity</string>
            <key>developer</key>
            <string>Microsoft</string>
            <key>display_name</key>
            <string>%display_name%</string>
            <key>installs</key>
            <array>
                <dict>
                    <key>CFBundleIdentifier</key>
                    <string>com.microsoft.Excel</string>
                    <key>CFBundleName</key>
                    <string>Excel</string>
                    <key>path</key>
                    <string>/Applications/Microsoft Excel.app</string>
                </dict>
            </array>
            <key>minimum_os_version</key>
            <string>10.10.0</string>
        </dict>
    </dict>
    <key>ParentRecipe</key>
    <string>com.github.arubdesu.munki.MSExcel2016</string>
</dict>
</plist>

munki.LyncInstaller recipie failing...

99.999% sure that this is a microsoft changing things on us error...

autopkg run -vv MSLync.munki.recipe
Processing MSLync.munki.recipe...
WARNING: MSLync.munki.recipe is missing trust info and FAIL_RECIPES_WITHOUT_TRUST_INFO is not set. Proceeding...
MSLyncURLandUpdateInfoProvider
{'Input': {'culture_code': u'0409', 'version': u'latest'}}
MSLyncURLandUpdateInfoProvider: Found URL http://download.microsoft.com/download/5/0/0/500C7E1F-3235-47D4-BC11-95A71A1BA3ED/lync_14.4.1_160608.dmg
MSLyncURLandUpdateInfoProvider: Got update: 'Lync 14.4.1 Update'
MSLyncURLandUpdateInfoProvider: Additional pkginfo: {'minimum_os_version': '10.5.8', 'display_name': 'Lync 14.4.1 Update', 'description': '

This update fixes critical issues.

\n\n

For detailed information about this update, please visit the following Web site:

\n\n

http://go.microsoft.com/fwlink/?LinkId=328458

\n\n

For additional assistance, or to obtain a downloadable version of this update, visit the Microsoft Web site.

', 'name': u'MSLync'}
{'Output': {'additional_pkginfo': {'description': '

This update fixes critical issues.

\n\n

For detailed information about this update, please visit the following Web site:

\n\n

http://go.microsoft.com/fwlink/?LinkId=328458

\n\n

For additional assistance, or to obtain a downloadable version of this update, visit the Microsoft Web site.

',
'display_name': 'Lync 14.4.1 Update',
'minimum_os_version': '10.5.8',
'name': u'MSLync'},
'display_name': 'Lync 14.4.1 Update',
'pkg_name': 'Lync Installer.pkg',
'url': 'http://download.microsoft.com/download/5/0/0/500C7E1F-3235-47D4-BC11-95A71A1BA3ED/lync_14.4.1_160608.dmg'}}
URLDownloader
{'Input': {'url': 'http://download.microsoft.com/download/5/0/0/500C7E1F-3235-47D4-BC11-95A71A1BA3ED/lync_14.4.1_160608.dmg'}}
URLDownloader: No value supplied for CURL_PATH, setting default value of: /usr/bin/curl
URLDownloader: No value supplied for CHECK_FILESIZE_ONLY, setting default value of: False
Curl failure: The requested URL returned error: 404 Not Found (exit code 22)
Failed.
Receipt written to /Users/Shared/Autopkg/Cache/local.munki.MSLync/receipts/MSLync.munki-receipt-20170404-151047.plist

The following recipes failed:
MSLync.munki.recipe
Error in local.munki.MSLync: Processor: URLDownloader: Error: Curl failure: The requested URL returned error: 404 Not Found (exit code 22)

Bartender2 recipe failing: Can't open Sparkle feed

Dupe.

OfficeSuiteSKULessVersionProvider.py assumes o365 version for version number

Issue

Currently, this processor only checks for the latest version for the o365 tag. We were using this corresponding recipes for both for Office 2016 and recently for Office 2019. As it is now, though you may be specifying the correct REGION number for an older office product, the version that ends up being listed in the pkg name (as well as munki) is incorrect.

Applicable excerpt from processor below:

def get_version(self, FEED_URL):
        """Parse the macadmins.software/versions.xml feed for the latest O365 version number"""
        try:
            raw_xml = urllib2.urlopen(FEED_URL)
            xml = raw_xml.read()
        except BaseException as e:
            raise ProcessorError("Can't download %s: %s" % (FEED_URL, e))
        
        root = ET.fromstring(xml)
        latest = root.find('latest')
        for vers in root.iter('latest'):
             >> version = vers.find('o365').text <<
        return version

Resolution

It would be helpful to be able to specify which latest version tag to use to ensure the version number that's grabbed from macadmins.software matches the downloaded pkg installer app version given the supplied region #.

Proposed Solution

Add a required input variable to specify either o365, vl2019, or vl2016 for version gathering. This would have minimal impact on existing admins with overrides, only requiring an additional input variable be added.

If this is an acceptable proposal, I can test & create the PR.

2016SuiteSKUless Naming Issue

Just a minor extra period in the name; not sure how this will affect future runs…?

https://github.com/autopkg/arubdesu-recipes/blob/master/2016SuiteSKUless/2016SuiteSKULess..munki.recipe

santa recipe fails with new version to download

Just quick note the santa recipe currently seems to have an issue in "URLDownloader" to successful load the latest santa build.

At least seems not directly failing because of Santa versioning scheme changed to YYYY.X (current built is 2021.1) , I do see the GitHubReleasesInfoProvider does it's duty work well, hands over a working URL to the correct dmg:

https://github.com/google/santa/releases/download/2021.1/santa-2021.1.dmg

But in the following cadence the URLDownloader hangs for me.

GitHubReleasesInfoProvider
{'Input': {'github_repo': 'google/santa', 'include_prereleases': True}}
GitHubReleasesInfoProvider: No value supplied for CURL_PATH, setting default value of: /usr/bin/curl
GitHubReleasesInfoProvider: Selected asset 'santa-2021.1.dmg' from release 'v2021.1'
{'Output': {'release_notes': '### Notes\r\n'
                             '\r\n'
                             '+ Added an optional self-managed cache for '
                             'decision responses, which should help improve '
                             'performance when running Santa as a system '
                             'extension alongside another system extension '
                             '(#510). To enable this cache, set '
                             '`EnableSysxCache` to `<true/>` in your Santa '
                             'config profile.\r\n'
                             '+ Fixed `santactl/fileinfo` pulling embedded '
                             'Info.plist files from 32-bit sections of fat '
                             'binaries.\r\n'
                             '\r\n'
                             'The versioning scheme has also changed to YYYY.X',
            'url': 'https://github.com/google/santa/releases/download/2021.1/santa-2021.1.dmg',
            'version': '2021.1'}}
URLDownloader
{'Input': {'filename': 'santa.dmg',
           'url': 'https://github.com/google/santa/releases/download/2021.1/santa-2021.1.dmg'}}
URLDownloader: No value supplied for prefetch_filename, setting default value of: False
URLDownloader: No value supplied for CHECK_FILESIZE_ONLY, setting default value of: False
Traceback (most recent call last):
  File "/Library/AutoPkg/autopkglib/URLGetter.py", line 196, in execute_curl
    errors=errors,
  File "/Library/AutoPkg/Python3/Python.framework/Versions/Current/lib/python3.7/subprocess.py", line 512, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['/usr/bin/curl', '--silent', '--show-error', '--no-buffer', '--dump-header', '-', '--speed-time', '30', '--location', '--url', 'https://github.com/google/santa/releases/download/2021.1/santa-2021.1.dmg', '--fail', '--output', '/Users/head/Library/AutoPkg/Cache/local.munki.santa/downloads/tmpfq7h_y3t']' returned non-zero exit status 28.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/Library/AutoPkg/autopkglib/__init__.py", line 658, in process
    self.env = processor.process()
  File "/Library/AutoPkg/autopkglib/__init__.py", line 465, in process
    self.main()
  File "/Library/AutoPkg/autopkglib/URLDownloader.py", line 328, in main
    raw_headers = self.download_with_curl(curl_cmd)
  File "/Library/AutoPkg/autopkglib/URLGetter.py", line 204, in download_with_curl
    proc_stdout, proc_stderr, retcode = self.execute_curl(curl_cmd, text)
  File "/Library/AutoPkg/autopkglib/URLGetter.py", line 199, in execute_curl
    raise ProcessorError(e)
autopkglib.ProcessorError: Command '['/usr/bin/curl', '--silent', '--show-error', '--no-buffer', '--dump-header', '-', '--speed-time', '30', '--location', '--url', 'https://github.com/google/santa/releases/download/2021.1/santa-2021.1.dmg', '--fail', '--output', '/Users/head/Library/AutoPkg/Cache/local.munki.santa/downloads/tmpfq7h_y3t']' returned non-zero exit status 28.
  File "/Library/AutoPkg/autopkglib/__init__.py", line 658, in process
    self.env = processor.process()
Command '['/usr/bin/curl', '--silent', '--show-error', '--no-buffer', '--dump-header', '-', '--speed-time', '30', '--location', '--url', 'https://github.com/google/santa/releases/download/2021.1/santa-2021.1.dmg', '--fail', '--output', '/Users/head/Library/AutoPkg/Cache/local.munki.santa/downloads/tmpfq7h_y3t']' returned non-zero exit status 28.
Failed.
Receipt written to /Users/head/Library/AutoPkg/Cache/local.munki.santa/receipts/santa.munki-receipt-20210113-182606.plist

The following recipes failed:
    santa.munki.recipe
        Error in local.munki.santa: Processor: URLDownloader: Error: Command '['/usr/bin/curl', '--silent', '--show-error', '--no-buffer', '--dump-header', '-', '--speed-time', '30', '--location', '--url', 'https://github.com/google/santa/releases/download/2021.1/santa-2021.1.dmg', '--fail', '--output', '/Users/head/Library/AutoPkg/Cache/local.munki.santa/downloads/tmpfq7h_y3t']' returned non-zero exit status 28.

Nothing downloaded, packaged or imported.

HipChat versioning now includes build number

HipChat versioning now includes the build number, which is reflected in the filename HipChat-4.30.1-754.dmg. As this recipe does not take this into account, our end users are continually (at least 3 times a day) prompted with the following Software Update prompt as the newest version isn't being imported:

The filename is overwritten in the URLDownloader processor.

arubdesu-recipes/Atlassian/HipChat.download.recipe

Lines 27 to 28 in 0313910

	<key>filename</key>
	<string>%NAME%.dmg</string>

The Versioner processor in the recipe uses CFBundleShortVersionString and the build is listed in the CFBundleVersion.

arubdesu-recipes/Atlassian/HipChat.pkg.recipe

Line 55 in 0313910

<string>CFBundleShortVersionString</string>

I'm not exactly sure the best way to handle this and am trying to better understand how to write recipes. My thought process is if CFBundleShortVersionString already exists, then compare the CFBundleVersion, but I'm not sure how to do that or if that is even possible and a different approach needs to be taken.

MSLync.munki.recipe, MSLyncURLandUpdateInfoProvider.py broken?

I am getting an error with the MSLync.munki.recipe:

Error in local.munki.MSLync: Processor: MSLyncURLandUpdateInfoProvider: Error: not well-formed (invalid token): line 1, column 0

Any insight? Thanks for your time and for providing autopkg recipes to the community.

Missing tag on HipChat.download.recipe

WARNING: plist error for /Users/autopkg/Library/AutoPkg/RecipeRepos/com.github.autopkg.arubdesu-recipes/Atlassian/HipChat.download.recipe: Error Domain=NSCocoaErrorDomain Code=3840 "Close tag on line 58 does not match open tag string" UserInfo={NSDebugDescription=Close tag on line 58 does not match open tag string, kCFPropertyListOldStyleParsingError=Error Domain=NSCocoaErrorDomain Code=3840 "Malformed data byte group at line 1; invalid hex" UserInfo={NSDebugDescription=Malformed data byte group at line 1; invalid hex}}

Looks like the CodeSignitureVerifier requirement is missing the closing </string>. I would do a pull request but I don't appear to have permissions to do so.

Bartender 2 has a different Sparkle feed

A new paid upgrade for Bartender is out, and it adds compatibility with El Capitan. The Sparkle feed (http://www.macbartender.com/B2/updates/Appcast.xml) is different than v1.

Interested in creating a separate Bartender2.download recipe?

2016SuiteSKULess recipes misnomer

The 2016SuiteSKULess recipes in this repo download the current version of Office 365, which is equivalent to Office 2019. It is possible to obtain the 2016 versions by overriding REGION with the appropriate value, but the recipe will still name the package with the version number of the current Office 365 release. These issues have been fixed in the private repo versions (arubdesu/office-recipes), such that users who actually want Office 2016 should use those recipes instead. One could either rename these recipes to "365SuiteSKULess" or perhaps sunset them entirely, since there are now two alternatives for 365/2019 in addition to the ones in arubdesu/office-recipes.

switch to https causing LingonX.download to fail

Just putting this as an acknowledged issue, so far only tried adding user agent without success. Will track MacVim issue as well.

Issue with Synergy Munki Recipe

I'm getting "The following failures occurred" with the following recipe:
com.github.autopkg.arubdesu-recipes.munki.synergy

Message:
"Error in com.github.autopkg.arubdesu-recipes.munki.synergy: Processor: URLTextSearcher: Error: No match found on URL: http://synergy-project.org/nightly"

MSLync.install.recipe parent issue.

I noticed that the MSLync.install.recipe has the parent listed as
com.github.arubdesu.pkg.MSLync but I think it should be com.github.arubdesu.pkg.LyncInstaller

404 Not Found on MSLync.munki

The past few days I have seen a 404 Not found on the MSLync.munki recipe when attempting to download.

Hipchat Code Signature has changed

The code signature for Hipchat has changed, thus failing the download recipe.

The new signature is:

designated => identifier "com.hipchat.HipChat" and anchor apple generic and certificate leaf[subject.CN] = "Mac Developer: Build Agent (HGAXT6PX93)" and certificate 1[field.1.2.840.113635.100.6.2.1] /* exists */

Hip chat again - regarding #54 - 4d1dd43

Thanks for fixing #54, but now I get this error:

creating pkginfo for /Users/admin/Library/AutoPkg/Cache/com.github.arubdesu.munki.HipChat/HipChat.dmg failed: Could not find a supported installer item in /Users/admin/Library/AutoPkg/Cache/com.github.arubdesu.munki.HipChat/HipChat.dmg!

Error in local.munki.Sonos-dataJAR

Error in local.munki.Sonos-dataJAR: Processor: URLTextSearcher: Error: No match found on URL: http://www.sonos.com/support

Looks like they've made some changes to the download pages. Pull request incoming.

2016SuiteSKULess.munki.recipe

Should the references for 2016 get updated to 2019 since Office 2019 is released?

Office 2016 Recipes - missing munki_update_name argument

This is a relatively minor issue. I noticed that the NAME value I specified in the overrides for the MSExcel2016.munki, MSOneNote.munki, MSPowerPoint2016.munki and MSWord2016.munki recipes was being ignored.

I had to add munki_update_name to the MSOffice2016URLandUpdateInfoProvider Arguments list in the respective pkg recipes for these 4 products.

example change for the MSExcel2016 pkg recipe

--- MSExcel2016.pkg.recipe  2015-06-02 13:36:13.000000000 -0400
+++ MSExcel2016.pkg.recipe  2015-06-02 13:11:45.000000000 -0400
@@ -29,6 +29,8 @@
             <dict>
                 <key>product</key>
                 <string>Excel</string>
+                <key>munki_update_name</key>
+                <string>%NAME%</string>
             </dict>
         </dict>
         <dict>

Fluid.download.recipe Sparkle URL, Intent?

The Fluid.download.recipe Sparkle URL:

https://github.com/autopkg/arubdesu-recipes/blob/master/CelestialTeapotSoftware/Fluid.download.recipe#L14

of:

http://fluidapp.com/appcast/fluidapp.rss

Seems to be the Sparkle URL to update a finished Fluid app (e.g. "Gmail.com", "CNN.com", "Facebook.com") and not Fluid.app itself. The Fluid.app SUFeedURL is:

http://fluidapp.com/appcast/fluid1.rss

I'd fork and PR, but I'm not 100% sure of the intent of this recipe. I know as it stands now, the product of running Fluid.download.recipe is a FluidApp (i.e. not Fluid.app) that goes directly to Gmail.

Bartender2 recipe failing: Can't open Sparkle feed

Bartender's recipe has been failing for a while for me.

$ autopkg run -v com.github.arubdesu.pkg.Bartender
Processing com.github.arubdesu.pkg.Bartender...
SparkleUpdateInfoProvider
Can't open URL http://www.macbartender.com/updates/Appcast.xml
Failed.
Receipt written to /Users/elliot/Library/AutoPkg/Cache/com.github.arubdesu.pkg.Bartender/receipts/com.github.arubdesu.pkg-receipt-20151222-213328.plist

The following recipes failed:
    com.github.arubdesu.pkg.Bartender
        Error in com.github.arubdesu.pkg.Bartender: Processor: SparkleUpdateInfoProvider: Error: Can't open URL http://www.macbartender.com/updates/Appcast.xml

Nothing downloaded, packaged or imported.

This isn't a common SSL or user-agent error as far as I can tell. Something else is preventing SparkleUpdateInfoProvider from grabbing either v1 or v2 URLs.

Is it happening on your end too?

Question about tweaking MSLyncURLandUpdateInfoProvider.py

Allister,

I was wondering if you would be open to a PR to very slightly change the MSLyncURLandUpdateInfoProvider.py processor you have written for Lync. The update would just declare one more output variable, display_name, which would give the nicely formatted name of Lync 14.2.x Update as opposed to what we currently have to use, which is just Lync Installer.pkg. This poses an issue for us using the AbsoluteManageExport processor as it compares pkg names to that in the DB, and if it already exists, it assumes the pkg isn't new S.ice the pkg name is always Lync Installer.pkg, it never imports into AbMan. This new output variable would alleviate that by allowing us to rename the pkg in our .absolute recipe to be the %display_name% instead which would then change upon new updates.

I have the code updated, I believe its a total of about 5 new lines. Let me know your thoughts and I can submit a PR.

Thanks!

on last commit MSPowerPoint2016.pkg was broken

Product for MSOffice2016URLandUpdateInfoProvider now points to Word since last change 6 days ago. Whoops

Could not find parent recipe for MSLync.munki

Hi guy !

Since few days, I got this error message when trying to seek update for MS Lync.
Just try with another package from your recipes (Mactracker), but no issue.

This is what I have :
$ autopkg info MSLync.munki
Could not find parent recipe for MSLync.munki
Can't find recipe MSLync.munki, or it is invalid.

Same problem with run command :
$ autopkg run MSLync.munki
Could not find parent recipe for MSLync.munki
No valid recipe found for MSLync.munki

Hope this help !
Thx

MSLync & 404

Hi!

Microsoft has made some changes to Lync. Current recipe throwing 404.

https://gist.github.com/jlehikoinen/4a2054774e8d6edcf121

New 14.0.11 update KB: https://support.microsoft.com/en-us/kb/3037358

WWDC recipe broken

Hey! Looks like the WWDC recipe is broken. The recipe expects the download to be a zip, but alas, it's actually a DMG! As per:
https://raw.githubusercontent.com/insidegui/WWDC/master/Releases/appcast_v5.xml (<enclosure url="https://github.com/insidegui/WWDC/releases/download/7.3.3/WWDC_v7.3.3-1024.dmg" sparkle:version="1024" sparkle:shortVersionString="7.3.3" length="20486414" type="application/octet-stream" />)

Dropbox and JSSImporter..

I'm having trouble with the Dropbox jss recipe solely. How should I troubleshoot this issue?

Processing Dropbox.jss...
Failed.
Receipt written to /tmp/receipts/Dropbox-receipt-20140715-175938.plist

The following recipes failed:
Dropbox.jss
JSSImporter requires missing argument version

Nothing downloaded, packaged or imported.

Issue with 2016SuiteSKULess.download.recipe downloading the previous version

Hi

Thanks a lot for this recipe, I've found it really useful!

I stumbled over an issue recently, which looks to be on Microsoft's end.

The last two update cycles (I've only been using the recipe about that long), I've noticed that the installed version after the package has been applied does not match the version number on the package. If I go to my AutoPkg instance, delete the downloaded assets and rerun the recipe some time after the first download (this time about 9 hours after AutoPkg first downloaded what it thought was 15.35) it downloads the correct version.

I was able to corroborate that the effective version didn't match the listed version of the initial package by unpacking it and opening the PackageInfo file in one of the App packages.

I think what might be happening is the following: The OfficeSuiteSKULessVersionProvider checks for the most recent version and finds something new. Then the recipe goes to download the installer pkg. But there seems to be a gap between the moment Microsoft publishes the availability of a new version and the moment the available installer pkg is replaced with the new one. So the previous version gets downloaded. This is just a guess, but it fits the evidence.

Has anybody else seen this? If so, anybody have a good idea how to address it? If my suspicion is correct, then it would be enough for Microsoft to ensure that the downloadable version matches the published version...

Best regards, michael.

"Charles cannot configure your proxy settings while it is on a read-only volume"

Charles.app seems to require that the user who launches it have write access to its bundle. So installing it straight from your munki or pkg recipes produces the above error on first run. sudo chmod g+w /Applications/Charles.app seems to fix it.

Could we get that as a postinstall script in both the munki and pkg recipes? Or even better, adjust the mode of their respective payloads?

Office 2016 (word, powerpoint, excel) failing since between 1:36PM - 4:36PM CST May 14, 2015

We made no changes on our end.

Troubleshooting steps taken:
Made sure repo was up-to-date
Deleted the autopkg cache file for local.muni.MS*2016 (in my experience this often fixes things)
Recreated the pkg override and pruned it back down.

Here's the AutoPkg error message from the Jenkins logs (suspect section bold/italic at end):

[workspace] $ /bin/sh -xe /Users/Shared/Jenkins/tmp/hudson539233204667502287.sh

• /usr/local/bin/autopkg run MSWord2016.munki.recipe
  Processing MSWord2016.munki.recipe...
  Traceback (most recent call last):
  File "/usr/local/bin/autopkg", line 1469, in
  sys.exit(main(sys.argv))
  File "/usr/local/bin/autopkg", line 1463, in main
  exit(subcommands[verb]'function')
  File "/usr/local/bin/autopkg", line 1287, in run_recipes
  autopackager.process(recipe)
  File "/Library/AutoPkg/autopkglib/init.py", line 466, in process
  self.env = processor.process()
  File "/Library/AutoPkg/autopkglib/init.py", line 295, in process
  self.main()
  File "/Users/Shared/Autopkg/RecipeRepos/com.github.autopkg.arubdesu-recipes/MSOffice2016/MSOffice2016URLandUpdateInfoProvider.py", line 221, in main
  self.getInstallerinfo()
  File "/Users/Shared/Autopkg/RecipeRepos/com.github.autopkg.arubdesu-recipes/MSOffice2016/MSOffice2016URLandUpdateInfoProvider.py", line 209, in getInstallerinfo
  installs_items = self.getInstallsItems(item)
  File "/Users/Shared/Autopkg/RecipeRepos/com.github.autopkg.arubdesu-recipes/MSOffice2016/MSOffice2016URLandUpdateInfoProvider.py", line 100, in getInstallsItems
  "CFBundleShortVersionString": self.getVersion(item),
  File "/Users/Shared/Autopkg/RecipeRepos/com.github.autopkg.arubdesu-recipes/MSOffice2016/MSOffice2016URLandUpdateInfoProvider.py", line 117, in getVersion
  version_str = just_minor.group(2)
  AttributeError: 'NoneType' object has no attribute 'group'
  Build step 'Execute shell' marked build as failure

MSWord2016/PowerPoint2016.munki.recipe - Code signature verification failed.

Troubleshooting steps done
-Deleted Autopkg cache

Excel 2016 (15.10.1) worked but not PowerPoint or Word.

Error log from jenkins.

[workspace] $ /bin/sh -xe /Users/Shared/Jenkins/tmp/hudson4362364600791063023.sh

• /usr/local/bin/autopkg run MSWord2016.munki.recipe
  Code signature verification failed. Note that all verification can be disabled by setting the variable DISABLE_CODE_SIGNATURE_VERIFICATION to a non-empty value.
  Failed.
  Processing MSWord2016.munki.recipe...

The following recipes failed:
MSWord2016.munki.recipe
Error in local.munki.MSWord2016: Processor: CodeSignatureVerifier: Error: Code signature verification failed. Note that all verification can be disabled by setting the variable DISABLE_CODE_SIGNATURE_VERIFICATION to a non-empty value.

The following new items were downloaded:
/Users/Shared/Autopkg/Cache/local.munki.MSWord2016/downloads/Microsoft Word_Update.pkg
Build step 'Execute shell' marked build as failure

Santa error

Hey Allister!

I'm running into an issue with WWDC.munki - I get this error when running my override for the recipe:

 local.munki.WWDC
       com.github.arubdesu.shared/SantaCertSha requires missing argument expected_certsha

I rebuilt my override, but am still seeing the error. Not a huge deal (I don't think the WWDC app has been updated), but wanted to report it in case you haven't seen it yet.

Thanks!

Mike

others that are broken

besides hipchat, workshare, googleAppEngineLauncher, and MacID are tehBroke

2016SuiteSKULess.munki - urlopen error - SSL

When running the 2016SuiteSKULess.munki override, I get this:

srv-osx:~ admin$ /usr/bin/python /usr/local/bin/autopkg run --verbose --recipe-list ~/Library/Application\ Support/AutoPkgr/recipe_list.txt
Processing local.munki.2016SuiteSKULess...
OfficeSuiteSKULessVersionProvider
Can't download http://macadmins.software/latest.xml: <urlopen error EOF occurred in violation of protocol (_ssl.c:590)>

openSSL version

srv-osx:~ admin$ python -c "import ssl;print ssl.OPENSSL_VERSION"
OpenSSL 1.0.2p  14 Aug 2018

Python version

srv-osx:~ admin$ python
Python 2.7.15 (default, Oct  2 2018, 12:50:38) 
[GCC 4.2.1 Compatible Apple LLVM 9.0.0 (clang-900.0.39.2)] on darwin

Maybe the cause is the automatic redirection to HTTPS (SSL)?

If I try to execute what the script at https://github.com/autopkg/arubdesu-recipes/blob/master/2016SuiteSKUless/OfficeSuiteSKULessVersionProvider.py does, I do not get any error, the file is fetched without problems and can display it with print(xml).

AutoPkg latest running on macOS 10.12.6.

MSLync and Outlook need User-Agent in UpdateInfoProvider

HipChat is failing in AutoPkgr again. Thanks :-D

HipChat is making issues again sorry.

I get this every time I run the recipe:
"Unarchiving /Users/admin/Library/AutoPkg/Cache/com.github.arubdesu.munki.HipChat/downloads/HipChat.zip with ditto failed: ditto: Couldn't read PKZip signature"

Also I see that HipChat once again changed their version "mechanism" https://www.hipchat.com/release_notes/mac

"New: Updated app versioning to become more consistent across clients. We've gone from 4.0.12 to 4.24.0"

And version 4.0.12 won't automatically update itself, so I manually had to download 4.24.0

https://www.hipchat.com/downloads/latest/mac

Thanks