vmussa / nbb-notebooks

A set of analytical notebooks on Novo Basquete Brasil (NBB), Brazil's main basketball league

Hello there!

My name is Vítor Mussa. I'm a brazilian software engineer currently working with microservices, messaging systems, and infrastructure (k8s) for data and ML applications at A de Agro.

• 📫 Feel free to reach me on:
  • @vitormussa on twitter
  • My profile on LinkedIn

nbb-notebooks's Issues

Scale scraper to collect data from all seasons

For now, our scraper only gets data of the last season according to the time of the execution of the code. It would be great if we could get the same data from every past season. To do so we might need to use a better solution than sending multiple sequential requests with requests and BeautifulSoup. A better solution might be to use ´Scrapy`, although it may involve another restructuring of the scraper's code.

Update cleaner.py to adjust to new scraping pipeline

Currently, our cleaner's code only does a few tricks, but also important. With the new scraping pipeline, it is necessary to adjust the cleaner to the new data.