GitHubHelp

nowke/rvcespider

Crawler for RVCE Results Site

★ 0Forks 0PythonGitHub ↗Compare

README

RVCE Spider

Crawler for RVCE Results Site

Clone the Repository

$ git clone https://github.com/nowke/rvcespider.git

Create a virtualenv

$ mkvirtualenv rvcespider

Install dependencies

$ pip install -r requirements.txt

Create directories for storing results

$ mkdir jsons
$ mkdir ojson

Set the semesters to crawl in start_crawl.py

Semester = [1,5]

Start crawl

python start_crawl.py

JSON Files available in ojson folder

Contributors

nowke

Issues