wettenhj / mytardis-app-atom

MyTardis app for Atom consumption.

MyTardis Atom App

This app can be used to ingest datasets via Atom. Please see tests/atom_test for format examples.

To run tests, add

IS_SECURE = False MEDIA_ROOT = FILE_STORE_PATH

To tardis/test_settings.py first.

New metadata is ingested first, with data files being copied asynchronously afterwards.

Installation

Symlink this app into a MyTardis tardis/apps directory. The preferred name for the app is atom.

Configuration

Celery is used to schedule periodic file ingestion.

The atom_ingest.walk_feeds task takes a variable number of feeds and updates them. Here's an example for settings.py that checks two Picassa feeds every 30 seconds:

CELERYBEAT_SCHEDULE = dict(CELERYBEAT_SCHEDULE.items() + {
  "update-feeds": {
    "task": "atom_ingest.walk_feeds",
    "schedule": timedelta(seconds=30),
    "args": ('http://example.org/feed.atom',
             'http://example.test/feed.atom')
  },
}.items())

You must run celerybeat and celeryd for the scheduled updates to be performed. MyTardis provides a Procfile for this purpose, but you can run both adhoc with:

bin/django celeryd --beat

HTTP Basic password protection is available via settings.py in MyTardis:

REMOTE_SERVER_CREDENTIALS = [
  ('http://localhost:4272/', 'username', 'password')
]

In a production environment, you should combine HTTP Basic password protection with SSL for security.