sjors / crush_curve Goto Github PK

Or perhaps just if you call it before todays data is published.

Workaround is to re-fetch all historical data:

rake data:fetch[true]

Hoi Sjors,

Net vers gecloned, maar het loopt vast op de rake data:fetch.
PostgreSQL-error:

2020-10-03 14:46:51.981 CEST [350] ERROR:  null value in column "municipality_id" violates not-null constraint
2020-10-03 14:46:51.981 CEST [350] DETAIL:  Failing row contains (2, null, 2020-03-13 00:00:00, null, null, null, 2020-10-03 12:46:51.980269, 2020-10-03 12:46:51.980269, null, f, f).
2020-10-03 14:46:51.981 CEST [350] STATEMENT:  INSERT INTO "cases" ("day", "created_at", "updated_at") VALUES ($1, $2, $3) RETURNING "id

Rake nagenoeg vergelijkbaar natuurlijk:

# rake data:fetch
Downloading CSV...
Parsing CSV...
Processing records...
rake aborted!
ActiveRecord::NotNullViolation: PG::NotNullViolation: ERROR:  null value in column "municipality_id" violates not-null constraint
DETAIL:  Failing row contains (2, null, 2020-03-13 00:00:00, null, null, null, 2020-10-03 12:46:51.980269, 2020-10-03 12:46:51.980269, null, f, f).
/usr/local/lib/ruby/gems/2.7.0/gems/activerecord-6.0.3.2/lib/active_record/connection_adapters/postgresql_adapter.rb:675:in `exec_params'
/usr/local/lib/ruby/gems/2.7.0/gems/activerecord-6.0.3.2/lib/active_record/connection_adapters/postgresql_adapter.rb:675:in `block (2 levels) in exec_no_cache'
/usr/local/lib/ruby/gems/2.7.0/gems/activesupport-6.0.3.2/lib/active_support/dependencies/interlock.rb:48:in `block in permit_concurrent_loads'

...

Heb de DB al eens gedropt en opnieuw aangemaakt plus de gesuggereerde rails db:migrate gedraaid.
Ik heb alleen dit als aanwijzing: https://github.com/Sjors/crush_curve/blob/master/db/schema.rb#L19

Draai op macOS Mojave, met PostgreSQL 12.4, rake 13.0.1 maar heb niet de indruk dat het een versie probleem van de software is op dit moment.

Enig idee? Bij voorbaat dank!

@Sjors Is there a reason the site is no longer available? I personally liked it very much.
Resolving / checking DNS doesn't come up with an A (or AAAA) address.

$ host www.pletdecurve.nl
Host www.pletdecurve.nl not found: 3(NXDOMAIN)

reference data for instance from
https://www.metatopos.eu/provincies_eu.php

RIVM publishes a CSV with individual cases and the date of testing, since the start of the epidemic. This is better than the daily totals, because it doesn't result in negative case counts if there's a correction.

The only problem is that the data is per GGD region, not per municipality. So it can only be used at the province level (the file conveniently has a Province column).

Using this data on the landing page would paint a more accurate picture of national trends, so it's probably worth the discrepancy with the province page, which has more fine grained but less accurate data.

https://data.rivm.nl/covid-19/COVID-19_casus_landelijk.csv

The Esri feed contains historical data, but it tends to be published later than the RIVM data. On June 1 it wasn't published at all.

RIVM data only contains the current day, but they seem quite punctual.

We should attempt to fetch RIVM data and fall back to Esri for historical gaps.

Geprobeerd om alles PopOS! 20.04 LTS (ID_Like: ubuntu debian) op localhost werkend te krijgen. Gaf wat problemen.

update ruby van 2.7.0 naar 2.7.1
uitleg op https://www.itzgeek.com/post/how-to-install-ruby-on-rails-on-ubuntu-20-04/

bundle install
gaf eerst foutmelding voor pg 1.2.3

heb toen eerst handmatig

sudo apt-get install libpq-dev
geïnstalleerd.

Toen gingen alle bundle dingen goed.

rake db:seed

geeft nog een foutmelding:

PG::ConnectionBad: FATAL: role "mijnusername" does not exist

rails s

werkt wel maar localhost:3000 riep

PG:ConnectionBad.
Could  not connect to server: no such file or directory. ise the server running locally and acception connections in Unix domain socket var/run/postgresql 5432 ?

sudo service postgresql start

lost dat op. Maar dan blijft ook daar

FATAL: role 'mijnusername" does not exist.

En toen heb ik het opgegegeven. Ben niet heel goed met ruby ook verder.

Probably need to update some code to handle weekly instead of daily stats. I might compress historical data into weekly numbers as well.

Error code: SSL_ERROR_PROTOCOL_VERSION_ALERT
in Firefox, Chrome en Edge voor pletdecurve.nl

(en git clone op Ubuntu proberen te draaien geeft ook fouten. Jammer, want erg handige site!)