DavidBarrick/congress-scraper

A serverless scraping tool to fetch xml bills and transform them to JSON

★ 4Forks 0JavaScriptGitHub ↗Compare

README

congress-scraper

Public domain code that collects data about bills from the U.S. Congress.

This code has been ported to NodeJS from the unitedstates/congress project.

How To Run

  1. Install package dependencies
npm install
  1. Install Serverless Framework
npm install -g serverless
  1. Setup Serverless Framework With AWS Credentials https://www.serverless.com/framework/docs/providers/aws/guide/credentials/

  2. Deploy service

sls deploy
  1. Run bill fetcher
sls invoke -f fetchBills

This will start the download process. All XML and JSON data will be in an S3 bucket with a name starting with "congress-"

Contributors

DavidBarrick

Issues