luk4z7 / logres

Distributed logs system PostgreSQL to MongoDB, catch all query in your database locally or in production and push your logs for centralized database NoSQL

Distributed logs system PostgresSQL to MongoDB

Installation

go get github.com/luk4z7/logres

Configuration

configure your postgres for work with logs type csv

vim /etc/postgresql/9.2/main/postgresql.conf

like this:

#------------------------------------------------------------------------------
# ERROR REPORTING AND LOGGING
#------------------------------------------------------------------------------

# - Where to Log -

log_destination = 'csvlog'              # Valid values are combinations of
# stderr, csvlog, syslog, and eventlog,
# depending on platform.  csvlog
# requires logging_collector to be on.

# This is used when logging to stderr:
logging_collector = on                  # Enable capturing of stderr and csvlog
# into log files. Required to be on for
# csvlogs.
# (change requires restart)

if do you like prefer change the directive log_statement for log all type of query, errors, warning, etc ...

log_statement = 'all'                 # none, ddl, mod, all

Restart your postgresql

/etc/init.d/postgresql restart

Configure your environment

logres --config

and then execute the --run

logres --run

logres's Issues

Create and publish a docker image

It would be great if we could have a docker image of this project published on docker hub to easily integrate it to our pipeline.