subhamay-cloudworks / 0001-tarius-cft

AWS Serverless Real Time Data Load to DynamoDB using Python Lambda and S3 Event Source Mapping and creating the stack using AWS CloudFormation.

Hi there 👋, I am Subhamay Bhattacharyya, 3x AWS Certified and a AWS Cloud Enthusiast

• 🔭 I'm currently working on AWS SAM, CloudFormation, Serverless and Terraform projects
• 🌱 I'm currenly learning Terraform, SAM and Serverless Framework
• 👯 I’m looking to collaborate on ...
• 🤔 I’m looking for help with Kubernetes
• 💬 Ask me about my upcoming projects
• 📫 How to reach me : [email protected]
• 😄 Pronouns: ...
• ⚡ Fun fact: Love to play cuddle my cats Samsung and Thomas.

Languages and Tools:

 

CF - CloudFormation : TF - HashiCorp Terraform : SAM - AWS Serverless Application Model : SLS - Serverless Framework

ETL Patterns

Seq#	Project#	Project Name	Description	Status	CF	SAM	SLS	TF
1	0001	Tarius	AWS Serverless Real Time Data Load to DynamoDB.	$${\color{green}Complete}$$	✅	✅	✅	✅
2	0005	Taurus	Creating a Lambda Layer and adding the same to a Lambda function.	❌	❌	✅	✅	✅
3	0007	Pisces	S3 Cross Region / Cross Account Replication.	$${\color{green}Complete}$$	✅	🚫	🚫	✅
4	0018	Sunflowers	Accessing a S3 bucket in one AWS Acount (Account-A) from a Lambda function in another AWS Account(Account-B).	❌	✅	🚫	🚫	🚫
4	0032	Allium	Creating a S3 Bucket with Lifecycle Policy Configuration using Terraform.	❌	❌	❌	❌	✅
5	0032	Allium	Creating a S3 Bucket with Lifecycle Policy Configuration using Terraform.	❌	❌	❌	❌	✅
6	0088	Decumaria	Enable CloudTrail Trail for DynamoDB data events.	❌	❌	❌	❌	❌
7	0089	Delphinium	Scheduling a Lambda function using EventBridge to send an email every day using SES and a pre-signed URL of an image .	❌	❌	❌	❌	✅
8	0090	Detuzia	Creating an audit table for a DynamoDB table using CloudTrail, Kinesis Data Stream, Lambda, S3, Glue and Athena	❌	✅	❌	❌	❌

Glue Job Patterns

Seq#	Project#	Project Name	Description	Status	CF	SAM	SLS	TF

Step Function Patterns

Seq#	Project#	Project Name	Description	Status	CF	SAM	SLS	TF
1	0070	Chicory	Manage a Batch Job (AWS Batch, Amazon SNS)	❌	❌	❌	🟡	❌
2			Manage a Container Task (Amazon ECS, Amazon SNS)	❌	❌	❌	❌	❌
3	0069	Celosia	Transfer Data Records (Lambda, DynamoDB, Amazon SQS)	$${\color{green}Complete}$$	✅	✅	✅	✅
4	0071	Chionodoxa	Poll for Job Status (Lambda, AWS Batch)	❌	❌	❌	🟡	❌
5	0086	Daylily	A Step Function Demo using SNS (Simple Notification Service) and Wait state.	❌	❌	✅	✅	✅
6	0038	Bellflower	Callback Pattern Example (Amazon SQS, Amazon SNS, Lambda)	🟡	✅	✅	✅	❌
7	0072	Chrysanthemum	Manage an Amazon EMR Job	❌	❌	❌	🟡	🟡
8			Start a Workflow within a Workflow (Step Functions, Lambda)	❌	❌	❌	❌	❌
9	0063	Carnation	Dynamically process data with a Map state	❌	✅	❌	❌	❌
10			Train a Machine Learning Model	❌	❌	❌	❌	❌
11			Tune a Machine Learning Model	❌	❌	❌	❌	❌
12			Process High-Volume Messages from Amazon SQS (Express Workflows)	❌	❌	❌	❌	❌
13	0087	Dandelion	Selective Checkpointing Example (Express Workflows)	❌	❌	❌	🟡	❌
14			Build an AWS CodeBuild Project (CodeBuild, Amazon SNS)	❌	❌	❌	❌	❌
15			Preprocess data and train a machine learning model	❌	❌	❌	❌	❌
16			Lambda orchestration example	❌	❌	❌	❌	❌
17			Start an Athena query	❌	❌	❌	❌	❌
18			Execute multiple queries (Amazon Athena, Amazon SNS)	❌	❌	❌	❌	❌
19			Query large datasets (Amazon Athena, Amazon S3, AWS Glue, Amazon SNS)	❌	❌	❌	❌	❌
20			Keep data up to date (Amazon Athena, Amazon S3, AWS Glue)	❌	❌	❌	❌	❌
21			Manage an Amazon EKS cluster	❌	❌	❌	❌	❌
22			Make a call to API Gateway	❌	❌	❌	❌	❌
23			Call a microservice with API Gateway	❌	❌	❌	❌	❌
24			Send a custom event to EventBridge	❌	❌	❌	❌	❌
25			Invoke Synchronous Express Workflows	❌	❌	❌	❌	❌
26			Run ETL/ELT workflows using Amazon Redshift	❌	❌	❌	❌	❌
27			Use Step Functions and AWS Batch with error handling	❌	❌	❌	❌	❌
28			Fan out an AWS Batch job	❌	❌	❌	❌	❌
29			AWS Batch with Lambda	❌	❌	❌	❌	❌