dchud / osha-dedupe Goto Github PK

In order to make the repo more accessible to readers of a blog post about "scaling dedupe with Postgres" we should do a bit of reorganization:

1. Move data samples (training, csv, etc.) to a fixtures directory
2. Expand the README.md with instructions
3. Provide a setup script that downloads data and configures Postgres
4. Maybe provide a simpler configuration.

Hi, I'm the author of dedupe and Benjamin told me you were having some trouble getting it work for you.

Could you provide some more documentation on how to get everything setup.

I got to this point:

> python pgdedupe.py 
Traceback (most recent call last):
  File "pgdedupe.py", line 288, in <module>
    main(args)
  File "pgdedupe.py", line 88, in main
    c.execute('SELECT COUNT(*) AS count FROM %s' % SOURCE_TABLE)
  File "/home/fgregg/public/osha-dedupe/.env/lib/python3.4/site-packages/psycopg2/extras.py", line 223, in execute
    return super(RealDictCursor, self).execute(query, vars)
psycopg2.ProgrammingError: relation "records" does not exist
LINE 1: SELECT COUNT(*) AS count FROM records