amol-desai / boundaryline_public

Boundary Line

API for grabbing Cricket related data from various sources.

Cricket data is not available publicly and there are several enthusiasts who reinvent the wheel replicating each others' efforts to get data and build analytical tools and models on top of it. While some of this should still happen as it encourages novel approaches & research and because that is how science works, doing so in a coordinated fashion as a community will open up collaboration channels, free up bandwidth and resources for current contributors to contribute in a more impactful way to the sport, and lower the barrier for entry for new folks who want to contribute with the unique skills that they have in visualization, design, front end dev, databases, sports strategy, simulations and other as yet unimagined areas.

TBD: Extend this effort to maintaining an open source database so the scraping runs are non-redundant as well. TBD: This repo can also be used for modeling, analytics and other related items

boundaryline_public's Issues

Make scrapers object oriented

Currently the scrapers are a bunch of helper functions calling each other. Convert this into object oriented modules like a real API.
If we write better code now, there will be less tech debt and we will have less maintenance headaches in the future.

[Cricinfo] Add coverage for more teams in Cricinfo utils.py

https://github.com/amol-desai/BoundaryLine_public/blob/main/CricinfoScrapers/utils.py

has get_available_team_ids_statsguru() (

BoundaryLine_public/CricinfoScrapers/utils.py

Line 46 in 447981e

def get_available_team_ids_statsguru():

)

This currently only getting statsguru exposed teams. We should add coverage for all teams on the site.

[Hawkeye] Get relevant match ids instead of looping through a range and trying

Currently there is no good way to get all match ids for completed games. So, folks have to loop through a range of numbers and see if there is an associated match id.

We can instead use the following links to get relevant match_ids

https://cricketapi-icc.pulselive.com/fixtures?matchTypes=TEST&tournamentTypes=I%2CWI&teamTypes=MEN&matchStates=C&page=0&pageSize=300&sort=desc

https://cricketapi.platform.iplt20.com//fixtures?tournamentIds= 22399&pageSize=100

For additional inspiration, see https://github.com/alittlefitness/bounceR/blob/main/R/matches.R

Thanks to @alittlefitness for bounceR and to @SachinSidhamwar for the pointer

Glossary for columns returned by hawkeye scraper

Is there any glossary that explains the columns in the data frame returned by the hawkeye scraper? Particularly the trajectory element columns?

[Cricinfo] Get player data

Scrape player page into a dataframe

Method get_data_from_soup missing from statsguru_scraper.py

The code breaks as this method is called but never defined.

[Cricinfo] Scrape match metadata from match_id

This is data that shows up at the bottom of the match page such as ground, umpires etc.