vivlabs / instaclone Goto Github PK

This tool is only tested on MacOS and Linux. It should be possible to test/port to Windows, but it would require a volunteer to help with this.

Doesn't seem like the .zip file is needed after unzipping the instaclone.

Thanks.

It should be possible to set most/all commands via command line to override the instaclone.yml settings. (Install type as symlink vs copy, for example.)

Not clear if this would be a big advantage, but perhaps worth considering all the details and perhaps using .tar.gz or .tar.bz2 instead of .zip.

Requirements on compression format:

• should be via a shell command (not Python's own libraries) for performance
• needs to be cross platform, including at least MacOS and Linux
• consider support for symlinks (probably needs to be customizable)
• avoid preserving other non-essential stuff like uid/gid, permissions, acls, etc.

These made it seem like zip was the best, but it has some issues too (#1).

Note zip is usually same implementation on MacOS and Linux, while tar is different on GNU vs BSD. Perhaps consider pax?

It'd be great to have an auto-purging feature, where specific artifacts are deleted if they're not used from cache for a given period of time. A bit like how Git garbage collects.

Something like max_age=7 (for 7 days) in the config file, ideally per resource.

This would require a way to track/modify last used time in the cache.

Had a situation where babel had transform issues because it was not reading the .babelrc file. Copying the .babelrc file to the instaclone'd symlink'd node_modules directory fixes it. It seems if you are using instaclone, you'll either have to copy .babelrc to the node_modules symlink as a post install/deploy or use the config directly if you are using a plugin like babel-loader in webpack.

rsync is much faster than Python (or most anything else) at deleting files, so use this for instaclone purge.

• Improve error message
• Default to current working directory?

Due to how npm creates the node_modules/.bin folder, unrolling symlinks breaks all node_modules/.bin.

Probably best to just preserve symlinks?

plumb an option through into _install_from_cache

We hit a case where instaclone ended up with a bad repo. Not sure how it happened, appears to be a partial tar unzip—maybe it didn't download properly/failed to unzip/was interrupted.

Maybe we should untar to a temporary folder and move once it's done.

Workaround: instaclone purge and try again.

Does everything that instaclone install does, but instead of symlinking, does an rsync (with deletes) on local node_modules.

This way I can use an instaclone as a starting point to do npm installs or upgrades and then do a new instaclone publish.

During decompression, the call to unzip on MacOS 10.10.3 fails since unzip doesn't support Zip64 (even though zip does!).

error:  expected central file header signature not found (file #66056).
  (please check that you have transferred or created the zipfile in the
  appropriate BINARY mode and that you have compiled UnZip properly)
error: Command '['unzip', '-q', '....$f2c6d5a9cb34d0b551ffff2e3761cd8cdd15200c-Darwin$/node_modules.zip']' returned non-zero exit status 3

http://superuser.com/questions/114011/extract-large-zip-file-50-gb-on-mac-os-x