dawe35 / facebook-event-crawler

This is a python crawler, it saves the given facebook page's event details to mysql

Facebook event crawler

While facebook removed his events API, retrieving data became difficult. This library is crawling Facebook, and parsing all data from the UI. Sometimes that fails, so you need to be fault tolerant :)

Install:

1. Create a new non-used facebook account
2. Change the language to English/US! (That's important!) (https://www.facebook.com/settings?tab=language)
3. Create a new mysql database
4. Import the database.sql file
5. Add some page ids to the pages database table (the page id is on the link, for example facebook.com/PageId)

Config:

1. Copy CONFIG_DEFAULT.py to CONFIG.py cp CONFIG_DEFAULT.py CONFIG.py
2. Fill the empty fields below
3. Run! All records will be inserted to the 'events' table!

Setup geocode (optional):

If you need latitude and longitude codes for event places, use my Geo Cache library. This library is included as a submodule, so you just need to pull it (more):

cd Facebook-event-crawler
git submodule update --init --recursive

1. Setup the local or remote server
2. Setup Geo-cache/CONFIG.php
3. Edit Facebook-event-crawler/CONFIG.py

Enjoy!

Development

Want to contribute? Great! Please test a lot, before sending your pull request :)

Alternatives

This crawler is not too universal, so if you need to crawl anything else, I would recommend these:

Crawler	No coding required	Login feature	Open source & self hosted
Scrapy		✓	✓
ParseHub	✓	✓
Simple Scaper	✓	?