docnow / awesome-social-media-archiving

Tools for helping you work with web platform archive downloads.

Awesome Archive Tools

Many social media and web platforms allow you to download your content as an archive. Some platforms have been doing this for some time, but many started doing it as a result of the European Union's General Data Protection Regulation (GDPR), specifically Article 15, which requires platforms to make data available to users in a "commonly used electronic form". While it's great we can download our own data, it's often made available in a raw format (JSON) that isn't terribly useful for most people.

Awesome Archive Tools is a list of tools that help you work with these platform archives. By platform we mean any web property that allows you to download your data as an "archive" (usually a zip file). By tool we mean anything that lets you do something useful with the downloaded data. Tools that let you scrape data from the web, or extract data from APIs are important, but are out of scope for this list.

If the platform archive contains a user-friendly viewer for the data you can indicate that here as well. Also welcome are links to guides, articles and other written material that help people use their downloaded data.

Contents

• Platforms
  • 23andMe
  • Basecamp
  • Google
  • Healthkit
  • Slack
  • Twitter
• Guides

23andMe

• genome-to-sqlite

Basecamp

• backpack-export-xslt

Google

• google-takeout-to-sqlite

Healthkit

• healthkit-to-sqlite

Slack

• jekyll-slack
• slack-export-viewer
• slack-export-viewer

Twitter

• twitter-to-sqlite

Guides

• Social Control Zine

awesome-social-media-archiving's Issues

Cross-link with awesome-web-archiving?

I'm also involved with the awesome list for web archiving and this pull request about Slack exports turned up. We decided it was out of scope, but recognised is a grey area.

Perhaps this is a place where these two Awesome Lists should cross-reference each other appropriately, so people who turn up on one can find their way to the other if that's appropriate?

Not sure how to do it though!?

Prep repo for anticipated PR to list of awesome lists

awesome-web-archiving just went through the procedure of meeting the conditions for inclusion in https://github.com/sindresorhus/awesome. Some of these conditions are easily met and revealed by awesome-line but cannot be PR'd, e.g., adding repo tags.

The output of the linter using current master (8a19a91):

% awesome-lint
✖ Linting

  README.md:1:1
  ✖   1:1  Headings should use atx                                      remark-lint:heading-style
  ✖   1:1  Missing Awesome badge after the main heading                 remark-lint:awesome-badge
  ✖   1:1  Git repository must be at least 30 days old                  remark-lint:awesome-git-repo-age
  ✖   1:1  The repository should have "awesome" as a GitHub topic       remark-lint:awesome-github
  ✖   1:1  The repository should have "awesome-list" as a GitHub topic  remark-lint:awesome-github
  ✖  24:1  Multiple Table of Contents lists found                       remark-lint:awesome-toc

  6 errors

A condition of awesome-archive-tools being added to awesome is that it be 30 days old (more info), so no rush, but it might be good to progressively keep the repo in check in anticipation.

Setting up a PR/commit hook to auto-lint might also facilitate this but again, is an admin task.