isabella232 / datadog-log-agent

Old version of the log-agent, now part of https://github.com/DataDog/datadog-agent

datadog-log-agent

This repository is deprecated

datadog-log-agent collects logs and submits them into datadog's infrastructure. This repository is no longer maintained as its code has been merged to datadog-agent, see logs-agent for more information.

Structure

logagent reads the config files, and instanciates what's needed. Each log line comes from a source (e.g. file, network), and then enters one of the available pipeline - decoder -> processor -> sender -> auditor

Tailer tails a file and submits data to the processors

Listener listens on local network and submits data to the processors

Decoder converts bytes arrays into messages

Processor updates the messages, filtering, redacting or adding metadata, and submits to the forwarder

Forwarder submits the messages to the intake, and notifies the auditor

Auditor notes that messages were properly submitted, stores offsets for agent restarts

How to run

• rake deps
• rake build
• setup config files
• ./build/logagent --ddconfig pkg/logagent/etc/datadog.yaml --ddconfd pkg/logagent/etc/conf.d/