thosuperman / social-media-site-crawler

A crawling script for social networks like facebook or twitter to crawl the posts of specific corporate pages.

Install

1. Install virtualbox and vagrant: sudo apt-get install virtualbox vagrant
2. You will find all the necessary programms to run the scripts in vagrant.
3. Use vagrant up to start vagrant
4. Use vagrant ssh to login to your virtual machine.
5. Use composer install in the command line to get the required packages.
6. On Facebook create a test app and set the constants APP_ID and APP_SECRET to the values you got from Facebook.

Execute

1. On the command line cd into the src folder of this repository.
2. Get a temporary access token from the official page.
3. Set the constant ACCESS_TOKEN in Crawler.php to the access token.
4. Paste a file named input.csv into the src folder containing the relevant page ids comma separated.
5. Run php -f Crawler.php.
6. A new file in src has been created named output.csv.