tulios / nightcrawler_swift Goto Github PK

Today the cli output is very functional, it delivers what it has. It would be nice to have different formats (through a --format, for example) that offers some pretty outputs

The sync command would be improved if it was multithreaded, with an option to configure the maximum amount of threads.

Swift uses the term container and amazon S3 bucket, it would be nice to have both names to avoid any confusion

I guess we should fix this. It's related with multi_mime gem, and they not have a newer version. The last one is the version we're using - https://rubygems.org/gems/multi_mime

I created a related issue here: karlfreeman/multi_mime#5

It would be interesting to have the ability to filter items of the container, it should support the parameters prefix and delimiter as described in the OpenStack Swift documentation.

http://docs.openstack.org/api/openstack-object-storage/1.0/content/pseudo-hierarchical-folders-directories.html

When you use an invalid command the cli doesn't notify that is an error.

nswift abcd
# <blank line>

It would be nice to have the command to fetch the objects metadata, it could be found in the openstack swift docs in:

http://docs.openstack.org/api/openstack-object-storage/1.0/content/HEAD_showObjectMeta__v1__account___container___object__storage_object_services.html

curl example:

curl -k -v -XHEAD -H "X-Storage-Token: <token>" <adminURL>/<bucket>

curl -k -v -XHEAD -H "X-Storage-Token: <token>" <adminURL>/<bucket>/<object_path>

Buckets/containers may or may not be public. Given that, the download command should use the internal URL, and the endpoint URL exposed to be used by applications.

Some people prefer to store passwords and tokens as env variables, which is nice. It would be nice to support at least the password as a env variable. My sugestion is NSWIFT_PASSWORD.

Allow asset_max_age parameter to configure assets cache. It should send X-Object-Meta-Cache-Control:max-age= header when uploading the assets.

Hi!
Would love for it to be able to change region for providers that have multiple datacentres.

The authentication process returns the endpoints URLs, but it would be a good to feature to set them independently: admin URL, public URL and upload URL.

would be nice to be allowed to configure the timeout value

Return a different status code when raises an exception.

The cli stores a cache of the token to reuse as much as it can, but when you changes your configurations (for a different environment, for example) and that token is still valid you need to remove the cache file by yourself

Hi!

Since the release of Openstack Havana the preferred version of Identity to use is v3. Some cloud providers have now migrated to only supporting v3 for token generation to get support for domains.

Currently the Nightcrawler Swift does not work with providers that require support for Identity v3.

Would it be possible to add support for Identity v3 in this project as well?

Currently "verify_ssl" mode is set as false, it would be nice to configure it.

The CLI (nswift) when used with a wrong configuration file generate an invalid nswift_cache which causes miss configurations, it should remove the cache after an invalid request to authentication

From the time we have finished the issue #16 it would be nice to expose that feature through the cli interface. Something like:

nswift stat # shows the metadata of the bucket/container

nswift stat path/file.txt # shows the metadata of the object itself

It would be nice to override the default max-age, some assets require different times

Sometimes we just need to synchronize the already compiled assets, it would be nice to have one task that just synchronizes the public dir and another that precompiles the assets and synchronizes.

The public url is anything but not "friendly". We have some urls like:

http://my.host.env.company.com/v1/AUTH_some_sha1/bucket

It would be nice to get the public url of an object with a simple command, like:

nswift url-for robots.txt
# http://my.host.env.company.com/v1/AUTH_some_sha1/bucket/robots.txt

It would be nice to have a configuration, let's say retry, that would allow us to configure the number of times to retry the request before failing

It would be nice to have a command line tool (nswift) to help with those basic commands, something like:

nswift list
nswift upload ~/files/cat.jpg
nswift dowload another-cat.jpg > ~/files/better-cat.jpg
nswift delete cat.jpg
nswift sync ~/files/precious

It could read a .nswift file from user home with the credentials (and a default bucket/container) and allow to override the bucket/container, something like:

nswift list -b cyclops