Mobility data stopped on April 5th about data

[owahltinez]

Google's mobility website was updated only a few hours ago, the PDF reports need to be converted to CSV and then the data can be ingested

[owahltinez]

Reopening this issue, since the data is still stale in the upstream source

[ssugar]

I've tried to get the pastelsky code working again. Forked it and with minimal changes have the April 11 reports pulling in and processing.

If you change your fetch_mobility url to something like this:
https://ssugar.github.io/covid-19-mobility-tracker/output/VN/mobility.json

Repo with my latest changes is here: https://github.com/ssugar/covid-19-mobility-tracker

then we can have data up to April 11th. I've done a few basic spot checks and it looks ok.

I should be able to keep the data pulls happening if pastelsky is less responsive. FYI- I have submitted my minimal code changes back to pastelsky as a pull request.

[ssugar]

@owahltinez - looks like Google's added a global csv file to their site, so all the reverse-engineering of the pdfs is no longer necessary:
https://www.gstatic.com/covid19/mobility/Global_Mobility_Report.csv

[owahltinez]

Thank you for the PR! I merged it for now. I will look into integrating the proper CSV file tomorrow / later this week.

[ssugar]

Sounds good. Thanks for all the great work on this :)

[owahltinez]

The official data source is now in the repo, although it appears to be updated sporadically and is always 1-2 weeks behind...