andrix/usesthis-spider

Scrapy Spider to get the interviews of Uses this and they hardware / software info.

★ 4Forks 0PythonGitHub ↗Compare

README

Usesthis

Scrapy spider to get the interviews from The Setup : http://usesthis.com. The intention is to create some stats on Hardware / Software from the interviews, to be able to trends some products.

Usage

To output a json file:

:: scrapy crawl usesthis.com --set FEED_URI=usesthis.json --set FEED_FORMAT=json

Dependencies

Contributors

andrix

Issues