voodoologic / docker-fluentd-kibana

Docker image for log analytics using Fluentd, Elasticsearch and Kibana

Docker-Fluentd-Kibana

Log analitycs using Fluentd, Elasticsearch and Kibana

This container comes built with Fluentd for log processing, Elasticsearch for log storeage and Kibana for log analytics. Nginx is also installed and configured for Kibana. Supervisord is used for Nginx, Fluentd, and Elasticsearch.

After installing you can visit http://localhost to view the Kibana web interface. Fluentd will be running and accepting messages on port 24224. You can then start posting messages to Fluentd and they will be saved in Elasticsearch.

Exposed ports

• 80 Nginx http
• 9200 Elasticsearch http
• 9300 Elasticsearch transport
• 24224 Fluentd

Nginx is confirgured to proxy elastic search port 9200 to 80 which avoids some proxies blocking high ports. Kibana comes shipped with a config to use port 80 for elastic search so its ready to go.

Default command

Supervisord - Start Nginx, Elasticsearch, and Fluentd in the foreground with supervisord.

Volumes

• /data - Elasticsearch
• /var/log - Nginx, Fluentd, Elasticsearch

Running the image

First step is to pull the image:

docker pull hbussell/docker-fluentd-kibana

Run the image:

Note you may want to change the volume -v parameter to set a different data directory used by Elasticsearch.

sudo docker run -p 9200:9200 -p 9300:9300 -p 24224:24224 -p 80:80 -v /data:/data  --name docker_fluentd_kibana_inst -i -t hbussell/docker-fluentd-kibana:docker-fluentd-kibana

Running with systemd:

• copy to systemd.fluentd-kibana.service to /etc/systemd/system
• sudo systemctl enable /etc/systemd/system/systemd.fluentd-kibana.service
• sudo systemctl start systemd.fluentd-kibana.service