GitHubHelp

Tedko/smalldata

★ 0Forks 0PythonGitHub ↗Compare

README

smalldata

For anime_crawler_2ch and s1_vote_crawler

  1. Install and set up Scrapy: pip3 install scrapy
  2. cd into the folder
  3. Run crawler by scrapy crawl anicrawler
  4. Use -o to redirect output, e.g. scrapy crawl anicrawler -o a.json

For sina_crawler

  1. Install and set up Selenium: pip3 install selenium
  2. For drawing features, install and set up networkx: pip3 install networkx
  3. Run any written script, e.g. python3 find_reposts.py

For twitter_crawler

  1. Install and set up Selenium and tweepy: pip3 install selenium tweepy
  2. Run any wirtten script, e.g. python3 random_crawler.py

Contributors

locodaTedkoyisiliu

Issues