melodyyangaws Goto Github PK

amazon-kinesis-analytics-taxi-consumer

Sample Apache Flink application that can be deployed to Kinesis Analytics for Java. It reads taxi events from a Kinesis data stream, processes and aggregates them, and ingests the result to an Amazon Elasticsearch Service cluster for visualization with Kibana.

apache-kyuubi-for-emr-on-eks

Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.

arc

Arc is an opinionated framework for defining data pipelines which are predictable, repeatable and manageable.

aws-emr-best-practices

A best practices guide for using AWS EMR. The guide will cover best practices on the topics of cost, performance, security, operational excellence, reliability and application specific best practices across Spark, Hive, Hudi, Hbase and more.

aws-emr-containers-best-practices

Best practices and recommendations for getting started with Amazon EMR on EKS.

aws-emr-utilities

aws-service-catalog-reference-architectures

Sample CloudFormation templates and architecture for AWS Service Catalog

cdk-examples

AWS CDK Examples Repository

data-engineering-for-aws-immersion-day

Lab Instructions for Data Engineering Immersion Day

deploy

Example deploy scripts to run Arc jobs on ephemeral cloud compute.

docker

These are the official Dockerfiles for https://hub.docker.com/r/triplai

eks-spark-benchmark

Performance optimization for Spark running on Kubernetes

eks-workshop

AWS Workshop for Learning EKS

eks-workshop-sample-api-service-go

Sample Kubernetes service used in the EKS Workshop CI/CD CodePipeline module

eksctl

The official CLI for Amazon EKS

emr-on-eks-cost-tracking-solution

emr-on-eks-hdfs

emr-remote-shuffle-service

emr-serverless-samples

Example code for running Spark and Hive jobs on EMR Serverless.

emr-spark-benchmark

emr-stream-demo

flink

Apache Flink

guidance-for-sql-based-etl-solution

A solution that provides declarative data processing capability, and workflow orchestration automation to help your business users (such as analysts and data scientists) access their data and create meaningful insights without the need for manual IT processes.

hive-emr-on-eks

hive-metastore-chart

jam-challenge-spark-on-eks

karpenter-emr-on-eks

kinesis-sql

Kinesis Connector for Structured Streaming

kubernetes-hdfs

Repository holding configuration files for running an HDFS cluster in Kubernetes

remoteshuffleservice

Remote shuffle service for Apache Spark to store shuffle data on remote servers.