Comments (7)
We have created an issue in Pivotal Tracker to manage this. You can view the current status of your issue at: https://www.pivotaltracker.com/story/show/103775358.
from loggregator-release.
Hi @voelzmo
You are right. The syslog forwarding configuration is configured to forward logs to external syslog drains for components. The actual syslog forwarding in this case is not done by the loggregator system, but by rsyslog. Only the configuration is part of the loggregator.
The description though is for application logs. Syslog drains for applications can be configured on a per-application basis and doppler servers are responsible for forwarding the logs to the respective syslog drains.
Does that help?
from loggregator-release.
In addition to this, we also have a story to document how to configure syslog drains for components in our backlog. I hope that covers your question.
from loggregator-release.
Dear @roxtar thanks for clearing that up. From the image linked in the Readme.md it wasn't clear to me that this only refers to application logs. You find other CF components such as Router and API in this picture as well. Their log, however, are taking a different path to an external drain, if I understand that correctly.
The entire text in https://github.com/cloudfoundry/loggregator#architecture could probably mention which parts apply to the logs of all CF components, and which parts relate to CF applications only. There is always a bit confusion around which logs are available through the firehose, which are going through doppler, and where we might experience message loss, for example.
Thanks for adding the task to document configuration of external syslog drains. While we are using external drains for applications as well as system components already, I wasn't sure about the actual flow of data in both cases.
Has this been a deliberate decision to keep the two flows separate and are are there any plans to maybe have doppler take care of an external drain for infrastructure logs as well?
from loggregator-release.
We will change the README to make it clear. We have talked about component logs flowing through loggregator but we haven't scheduled that yet.
from loggregator-release.
Hey @voelzmo -
There have been plans to to have loggregator handle infrastructure logs for awhile; as usual, the challenge is prioritizing an ideal solution once you have a passable one, and making sure the reliability was there.
We're rapidly catching up to it on the priority list though; watch this space.
Erik
from loggregator-release.
Diagram updated to show only app logs.
from loggregator-release.
Related Issues (20)
- Trafficcontroller keeps connections open after slow consumers events HOT 2
- how to get rlp certs from another deployment? HOT 3
- doppler.outgoing_port is unused HOT 2
- Intel permission to use Intel confidential data in the Arch dependency HOT 6
- Port vulnerabilities detected HOT 5
- update loggregator-release to include prometheus 2.12.0 HOT 12
- too much dns request on cf-deployment , via loggregator 106.x HOT 19
- RLP Gateway keeps sending data to dropped connections HOT 3
- Traffic Controller emits a large number of unneeded DNS queries HOT 1
- RLP won't shut down sometimes HOT 2
- log-api memory consumption HOT 12
- Consuming logs via the V2 Firehose will show reduced performance HOT 1
- Logs should be sent in a highly available manner that is evenly spread across Dopplers HOT 2
- Bionic stemcell: "killall" behaves differently HOT 8
- The test script is outdated HOT 1
- throughputlb is deprecated HOT 2
- Branch matching in github actions isn't working HOT 3
- Feature Proposal support OpenTelemetry on syslog drains HOT 5
- Module still redirects to archived `loggregator` repo
- Bump ginkgo to v2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from loggregator-release.