Run PostgreSQL integration tests in CI about etlhelper

[leorudczenko]

I believe I've managed to get the workflow to work with a postgres image, here is the latest test run:

https://github.com/BritishGeologicalSurvey/etlhelper/actions/runs/5965566004/job/16183282865

Many of the tests are hitting an ERROR because the environment variables are not set in the GitHub workflow:
etlhelper.exceptions.ETLHelperConnectionError: Password environment variable (TEST_PG_PASSWORD) is not set

I do not have permissions to modify these, @volcan01010 can you update these appropriately?

Moreover, since we are including sqlite3 tests, this error has come up again too:
etlhelper.exceptions.ETLHelperConnectionError: Could not import sqlite3 module required for SQLite connections. Check Python configuration - this should be part of Standard Library.

This stackoverflow post is the closest thing I have found to our sqlite3 problem, but it isn't what we need I don't think:
https://stackoverflow.com/questions/72165451/pytest-is-failing-on-github-actions-but-succeeds-locally

Some answers to this post may be more relevant:
https://stackoverflow.com/questions/19530974/how-can-i-add-the-sqlite3-module-to-python

[volcan01010]

For the SQLite issue, we may need to just skip the SQLite tests for now. The PostgreSQL ones cover more of the logic anyway.

For the PostgreSQL, we can hard-code the environment variables into the CI config YAML. It is only a disposable test database so we don't need to keep them secret. The values are:

env:
  POSTGRES_DB: etlhelper
  POSTGRES_USER: etlhelper_user
  POSTGRES_PASSWORD: etlhelper_pw
  POSTGRES_HOST: postgis

For the PostGIS container, we should specify this version: postgis/postgis:15-3.4

[leorudczenko]

Well we've progressed from one issue to another! Now most of the tests are passing, but many are failing due to this:

etlhelper.exceptions.ETLHelperConnectionError: Error connecting to DbParams(host='localhost', port='5432', dbname='etlhelper', user='etlhelper_user', dbtype='PG') via dbapi: connection to server at "localhost" (::1), port 5432 failed: Connection refused
	Is the server running on that host and accepting TCP/IP connections?

You can see the workflow run here: https://github.com/BritishGeologicalSurvey/etlhelper/actions/runs/5977922960/job/16218951792

[volcan01010]

Closing this as has been merged into for_v1.