Comments (14)
Would be nice to have a logDriver
option to integrate with ECS (Fargate or EC2) directly and eliminate the need for the fluentbit side car. Ideally the otel-collector should be a one stop shop for telemetry, metrics, and logging.
from aws-otel-community.
Hi @mhausenblas I was curious to know the status of logging for ADOT. I was checking the OTEL status page for Logging and it seems like overall it is stable (with event api being experimental) Thanks in advance.
from aws-otel-community.
Thanks for your feedback @pstephens and this is certainly on our long-term roadmap (2023).
from aws-otel-community.
@dluongiop good news: we're about to add it. Give it a few more days and you can use it, first behind a feature gate and the plan is by end of year to make it generally available.
from aws-otel-community.
After only 3 short years, here we go: https://aws.amazon.com/about-aws/whats-new/2023/11/logs-support-aws-distro-opentelemetry/
from aws-otel-community.
from what I can tell - ADOT supports logging on the exporter side. on the receiver side, it currently lacks integration with native aws services (eg. EKS-add on, Lambda layers, etc)
from aws-otel-community.
ADOT at this point does not support logs in GA. The fact that there are certain components in the collector that support the logs signal type doesn't change the fact. We plan logs support by end of year but until then please be aware that logs are not GA and hence not supported.
from aws-otel-community.
Is there a possibility that ADOT can include this exporter or similar feature from collector-contrib? We currently use the contrib branch because ADOT doesn't have a way to export logs to cloudwatch otherwise.
https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/exporter/awscloudwatchlogsexporter
from aws-otel-community.
Excellent! Thank you.
from aws-otel-community.
Update: with today's v0.34.0 release you can now use the Filelog receiver and CloudWatch Logs exporter behind a feature gate. Please test and let us know!
from aws-otel-community.
@mhausenblas Thank you for the update. I am about to try it out. Is there anything I must configure to be able to use the Cloudwatch Log exporter that's behind the feature gate?
from aws-otel-community.
@mhausenblas I've figured out to use the feature gate on the command line.
Note for other people: pass "--feature-gates=adot.exporter.awscloudwatchlogs" argument to the collector.
from aws-otel-community.
The awscloudwatchlogs is working well so far for my needs. The current version seems to be correlating the awsxray traces with logs nicely without any additional tweaks. When I was using the collector-contrib with the awsxray exporter and awscloudwatchlogs exporter, it was not correlating the traces with logs unless I use a transform to write a new field in the log such as my example below:
{
"body": "Blah blah",
"severity_number": 5,
"severity_text": "DEBUG",
"flags": 1,
"trace_id": "65206d6cb21cf3db383cc34fad3687fb",
"span_id": "c81b4daa0c424437",
"attributes": {
"trace_id_xray": "1-65206d6c-b21cf3db383cc34fad3687fb"
},
"resource": {
"service.name": "example.service",
"telemetry.sdk.language": "cpp",
"telemetry.sdk.name": "opentelemetry",
"telemetry.sdk.version": "1.9.1"
}
}
from aws-otel-community.
@dluongiop thanks a lot for your feedback and indeed the instructions on how to use it are in the accompanying launch blog post, my bad.
from aws-otel-community.
Related Issues (20)
- Use "Amazon EKS Amazon ECR private repositories" instead of public.ecr.aws for EKS ADOT Addon HOT 7
- How we can send metrics to the collector from things we can't put an endpoint on HOT 1
- Invalid xray traceid when exporting otlp traces HOT 1
- Go sample app: Support for configurable otlp endpoint HOT 3
- couldn't determine metrics port from configuration
- Enable tracing from Step Functions to flow to Open Telemetry Collector HOT 2
- .NET framework versions issues HOT 1
- Adding a Sample Example for FAST API Instrumentation in sample-apps folder HOT 1
- scrape_interval configuration to be updated while creating ADOT add on in EKS HOT 3
- Support for JavaScript auto-instrumentation HOT 1
- Build sample applications at PR Build TIme
- Manual tracing for auto-instrumentation-enabled Lambda fuctions HOT 7
- Service name is too arbitrary HOT 3
- attributes processor in ADOT lambda layer HOT 7
- Prevent AMP from collecting EKS cluster metrics (30$ per day)
- How to execute command within aws-otel-collector container such as shell commands to get information inside the container? HOT 1
- opentelemetry-operator-webhook-service HOT 1
- error 403 forbidden
- ADOT Collector/instrumentation not creating X-Ray spans on ECS Fargate, NodeJS app HOT 1
- Adding processors to the configuration-values.json file HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from aws-otel-community.