This repository fetches from Twitter, stores to MariaDB, and runs a Jupyter notebook to look through the data. Everything is run via Docker Compose.
- Run
docker-compose up
. - Go to
http://localhost:10000/lab
and enter the token shown in the Jupyter container output. - In the Jupyter lab, open the Jupyter notebook and follow any README instructions.
The data pipeline is in the flows
directory. We're using Prefect for data pipelining. You can edit the pipeline flow in main.py
.