open-o11y / aws-o11y-good-practices Goto Github PK

Write the Using AWS Distro for OpenTelemetry in EKS to ingest metrics into AMP recipe.

We should show all three options as follows, for the telemetry:

1. Using ADOT
2. Using GCA
3. Using a stripped-down Prometheus instance

Based on Using OpenTelemetry Collector for Logs on K8s, create a recipe for EKS.

This recipe will walk you through the process of instrumenting a Java Spring Boot application and ingesting metrics into a Prometheus instance running on EKS.Then we're using Grafana to visualize the metrics. Configure Prometheus Alerting Rules to generate test alerts on the metrics collected. Alertmanager sends alert notifications to SNS. SNS messages are then forwarded to the SQS queue to build any analytical use cases.

We should show all three options as follows, for the telemetry:

• Using https://aws-otel.github.io/docs/getting-started/java-sdk
• Using Amazon Managed Service for Prometheus (AMP)
• Using Amazon Managed Service for Grafana (AMG)
• Using a stripped-down Prometheus instance (self managed)
• Using a stripped-down Grafana instance (self maanged)
• Using OpenTelemetry Java Instrumentation Libraries
• Using Prometheus SNS forwarder
• Using sending SNS notifications to SQS

Add the following as [EXTERNAL] into the respective category (if not already included, that is, check for dupes):

Blog posts

• https://aws.amazon.com/blogs/opensource/aws-distro-for-opentelemetry-adds-statsd-and-java-support/
• https://aws.amazon.com/blogs/big-data/getting-started-with-trace-analytics-in-amazon-elasticsearch-service/
• https://aws.amazon.com/blogs/opensource/metrics-collection-from-amazon-ecs-using-amazon-managed-service-for-prometheus/
• https://aws.amazon.com/blogs/opensource/setting-up-cross-account-ingestion-into-amazon-managed-service-for-prometheus/
• https://aws.amazon.com/blogs/database/build-proactive-database-monitoring-for-amazon-rds-with-amazon-cloudwatch-logs-aws-lambda-and-amazon-sns/
• https://aws.amazon.com/blogs/opensource/integrating-identity-providers-such-as-onelogin-ping-identity-okta-and-azure-ad-to-sso-into-aws-managed-service-for-grafana/
• https://aws.amazon.com/blogs/opensource/set-up-cross-region-metrics-collection-for-amazon-managed-service-for-prometheus-workspaces/
• https://aws.amazon.com/blogs/mt/getting-started-amazon-managed-service-for-prometheus/
• https://aws.amazon.com/blogs/opensource/configuring-grafana-cloud-agent-for-amazon-managed-service-for-prometheus/

Examples

• https://github.com/aws-samples/amazon-ecs-firelens-examples#fluent-bit-examples
• https://github.com/aws-samples/amazon-ecs-firelens-examples
• https://github.com/aws-samples/amazon-eks-fluent-logging-examples

Workshops

• https://observability.workshop.aws/
• https://aesworkshops.com/
• EKS workshop:
  • https://www.eksworkshop.com/intermediate/230_logging/
  • https://www.eksworkshop.com/intermediate/240_monitoring/
  • https://www.eksworkshop.com/intermediate/245_x-ray/
  • https://www.eksworkshop.com/intermediate/246_monitoring_amp_amg/
  • https://www.eksworkshop.com/intermediate/250_cloudwatch_container_insights/
• ECS workshop:
  • https://ecsworkshop.com/container_insights/
• https://workshops.aws/