terratenney / aws-tools

Some of my tools and sample code for building with AWS.

aws-tools

Some tools and sample code I created for building with AWS.

Most of the Python scripts support multi accounts and regions.

For running Python scripts

# Create and activate virtual env (optional)
virtualenv env -p python3.8
. env/bin/activate

# Install the required packages
pip install -r requirements.txt

# Optional
source .aliases

For running shell scripts

pip install -r requirements-cli.txt

---

Useful Links

• CDK v1 and v2
• CloudFormation
• Serverless
• ECS, EKS, container-based development
• AWS SDKs and CLIs
• Security
• Chaos Engineering
• Networking
• Visualisation
• Closing account
• Other AWS useful tools
• Data sources
• Other tools
• Best Practices Guides
• Workshops
• kyhau/aws-notebook

---

CDK

Description	Repo/Link
AWS CDK (Cloud Development Kit)	aws/aws-cdk
AWS CDK for Kubernetes (cdk8s)	awslabs/cdk8s
AWS CDK Assume Role Credential Plugin	aws-samples/cdk-assume-role-credential-plugin
AWS Solutions Constructs	awslabs/aws-solutions-constructs
CDK Patterns	cdk-patterns/serverless
Serverless Stack Toolkit (SST) (extension of AWS CDK)	serverless-stack/serverless-stack
Awesome CDK	kolomied/awesome-cdk
kyhau/cdk-examples (CDK v1 and v2)	kyhau/cdk-examples

CloudFormation

Description	Repo/Link
AWS CloudFormation CLI (cfn)	aws-cloudformation/aws-cloudformation-cli
AWS CloudFormation Guard (cfn-guard)	aws-cloudformation/cloudformation-guard
AWS CloudFormation Handling Region parity	aws-samples/aws-cloudformation-region-parity
AWS CloudFormation Linter (cfn-lint)	aws-cloudformation/cfn-python-lint
AWS CloudFormation Macros	aws-cloudformation/aws-cloudformation-macros
AWS CloudFormation Registry (public/private extensions/modules)	User Guide
AWS CloudFormation Resource Provider Python Plugin	aws-cloudformation/cloudformation-cli-python-plugin
AWS CloudFormation Resources and Projects	aws-cloudformation/awesome-cloudformation
AWS CloudFormation Sample Templates	awslabs/aws-cloudformation-templates
AWS CloudFormation Template Flip (cfn-flip)	awslabs/aws-cfn-template-flip
AWS predefined CloudWatch metric filters and alarms	CloudWatch_Alarms_for_CloudTrail_API_Activity.zip
AWSUtility::CloudFormation::CommandRunner	aws-cloudformation/aws-cloudformation-resource-providers-awsutilities-commandrunner
CloudMapper	duo-labs/cloudmapper
CloudFormer	CloudFormer for creating templates from existing AWS resources
Former2 generates CloudFormation / Terraform / Troposphere templates from existing AWS resources	iann0036/former2

Serverless

Description	Repo/Link
Amazon API Gateway Serverless Developer Portal	awslabs/aws-api-gateway-developer-portal
AWS Chalice - Python Serverless Microframework for AWS	aws/chalice
AWS Lambda Builders (Python library, the brains behind sam build)	aws/aws-lambda-builders
AWS Lambda Developer Guide	awsdocs/aws-lambda-developer-guide
AWS Lambda Extensions API	specification
AWS Lambda Extensions sample projects	aws-samples/aws-lambda-extensions
AWS Lambda Logs API	specification
AWS Lambda Powertools	awslabs/aws-lambda-powertools-python
AWS Lambda Power Tuning	alexcasalboni/aws-lambda-power-tuning
AWS Lambda Python Runtime Interface Client	aws/aws-lambda-python-runtime-interface-client
AWS Lambda Runtime API	specification
AWS Lambda Runtime Interface Emulator	aws/aws-lambda-runtime-interface-emulator
AWS Serverless Application Model (SAM)	awslabs/serverless-application-model
AWS Serverless Application Model (SAM) CLI	awslabs/aws-sam-cli
AWS Serverless Application Model (SAM) Examples	awslabs/serverless-application-model/examples/
Cookiecutter SAM for Python Lambda functions	aws-samples/cookiecutter-aws-sam-python
AWS Serverless Patterns (SAM, CDK)	aws-samples/serverless-patterns
AWS Serverless Application Repository	AWS Serverless Application Repository
AWS Step Functions Data Science SDK (Python)	aws/aws-step-functions-data-science-sdk-python
A sandboxed local environment that replicates the live AWS Lambda environment	lambci/docker-lambda
LocalStack	localstack/localstack
LocalStack AWS CLI (awslocal)	ocalstack/awscli-local
Serverless Framework	serverless/serverless
Serverless Components	serverless/components
Serverless Components CLI	serverless/cli
Serverless Patterns Collection (SAM, CDK)	serverlessland.com/patterns
Serverless Stack (SST) (extension of CDK)	serverless-stack/serverless-stack
Stelligent mu (a tool for managing your microservices platform)	stelligent/mu
Zappa Serverless Python	Miserlou/Zappa
Serverless Microservice Patterns for AWS	Blog post

ECS, EKS, Container-based development

Description	Repo/Link
Amazon ECR Docker Credential Helper	awslabs/amazon-ecr-credential-helper
Amazon ECS CLI v2	aws/amazon-ecs-cli-v2
Amazon ECS Exec	Using ECS Exec to access containers on Fargate and EC2
Amazon EKS CLI	weaveworks/eksctl
Amazon EKS-vended aws-iam-authenticator	Amazon EKS-vended aws-iam-authenticator
Amazon EKS-vended kubectl	Amazon EKS-vended kubectl
AWS App2Container	Containerize a Java or .NET app
AWS Controllers for Kubernetes (ACK)	aws/aws-controllers-k8s
AWS Copilot CLI - containerize apps on ECS/Fargate	aws/copilot-cli
AWS EBS CSI Driver on Kubernetes	kubernetes-sigs/aws-ebs-csi-driver
AWS EKS Charts	aws/eks-charts
AWS Fargate Fast AutoScaler (with CDK)	aws-samples/aws-fargate-fast-autoscaler
AWS Node Termination Handler	aws/aws-node-termination-handler
Docker CLI plugin for ECS	docker/ecs-plugin
A simple terminal UI for both docker and docker-compose	jesseduffield/lazydocker

AWS SDKs and CLIs

Description	Repo/Link
Amazon CloudWatch Embedded Metric Format Client Library (Python)	awslabs/aws-embedded-metrics-python
Amazon Ion Python	amzn/ion-python
Authorization Lambda@Edge (Node.js)	aws-samples/authorization-lambda-at-edge
AutoML Toolkit for Deep Learning	awslabs/autogluon
AWS Amplify CLI	aws-amplify/amplify-cli
AWS Amplify Flutter	aws-amplify/amplify-flutter
AWS Cloud Digital Interface (CDI) Software Development Kit (SDK)	aws/aws-cdi-sdk
AWS CLI	aws/aws-cli
AWS CLI interactive productivity booster (aws-shell)	awslabs/aws-shell
AWS Config Rules Development Kit (RDK) CLI	awslabs/aws-config-rdk
AWS Config Rules Development Kit (RDK) Library (Python)	awslabs/aws-config-rdklib
AWS DynamoDB Encryption Client (Python)	aws/aws-dynamodb-encryption-python
AWS EC2 ENI Utilities (ec2-net-utils)	aws/ec2-net-utils
AWS EFS Utilities (efs-utils)	aws/efs-utils
AWS Elastic Beanstalk CLI	aws/aws-elastic-beanstalk-cli
AWS Encryption SDK (Python)	aws/aws-encryption-sdk-python
AWS Encryption SDK CLI	aws/aws-encryption-sdk-cli
AWS IoT Greengrass Core SDK (Python)	aws/aws-greengrass-core-sdk-python
AWS IoT Device SDK (Python)	aws/aws-iot-device-sdk-python
AWS ParallelCluster (enhanced version of CfnCluster)	aws/aws-parallelcluster
AWS SageMaker SDK (Python)	aws/sagemaker-python-sdk
AWS SaaS Boost	awslabs/aws-saas-boost
AWS Tools for Microsoft VSTS	AWS Tools for Microsoft Visual Studio Team Services
AWS Tools for PowerShell	AWS Tools for PowerShell
AWS Tools and sample code provided by AWS Premium Support	awslabs/aws-support-tools
AWS Trusted Advisor Tools	aws/Trusted-Advisor-Tools
AWS X-Ray Daemon	aws/aws-xray-daemon
awscii - render predefined AWS graphs in ASCII art	mhlabs/awscii-cli
AWS X-Ray SDK (Python)	aws/aws-xray-sdk-python
bash-my-aws	bash-my-universe/bash-my-aws
coldsnap - command-line tool that uses the EBS direct APIs to upload and download snapshots	awslabs/coldsnap
Neptune Graph Notebook (Python)	aws/graph-notebook
kubectl	kubernetes/kubectl

Security

Description	Repo/Link
AWS Exposable Resources	SummitRoute/aws_exposable_resources
AWS Security Documentation by Category	docs.aws.amazon.com/security
AWS Security Reference Architecture (AWS SRA)	docs.aws.amazon.com/prescriptive-guidance/latest/security-reference-architecture/
A Secure Cloud - Repository of customizable AWS security configurations and best practices	asecure.cloud/
Open source tools for AWS security	toniblyx/my-arsenal-of-aws-security-tools
AWS IAM Policy Simulator	IAM Policy Simulator Console
AWS Managed Policies (list/monitor)	z0ph/aws_managed_policies
AWS Policy Generator	AWS Policy Generator
AWS Security Benchmark	awslabs/aws-security-benchmark
AWS Security Hub Multiaccount Scripts	awslabs/aws-securityhub-multiaccount-scripts
AWS Shield Engagement Lambda	https://s3.amazonaws.com/aws-shield-lambda/ShieldEngagementLambda.pdf
AWS WAF Security Automations	awslabs/aws-waf-security-automations
Automated Incident Response with SSM	aws-samples/automated-incident-response-with-ssm
Import AWS Config Findings into AWS Security Hub	aws-samples/aws-securityhub-config-integration
amazon-detective-multiaccount-scripts	aws-samples/amazon-detective-multiaccount-scripts
AWS Self-Service Security Assessment tool	awslabs/aws-security-assessment-solution
aws-securityhub-to-email	aws-samples/aws-securityhub-to-email
aws-securityhub-to-slack	aws-samples/aws-securityhub-to-slack
cloud-custodian	cloud-custodian/cloud-custodian
CloudGoat	RhinoSecurityLabs/cloudgoat
git-secrets	awslabs/git-secrets
Pacu an open source AWS exploitation framework	RhinoSecurityLabs/Pacu
Redboto	elitest/Redboto
Endgame: Creating Backdoors in AWS	hirajanwin/endgame

Chaos Engineering

Description	Repo/Link
AWS SSM Chaos Runner	amzn/awsssmchaosrunner
Chaos Injection for AWS resources using Amazon SSM Run Command and Automation	adhorn/chaos-ssm-documents

Networking

Description	Repo/Link
AWS Network Firewall CFN templates	aws-samples/aws-networkfirewall-cfn-templates
AWS CIDR Finder	aws-samples/aws-cidr-finder
Serverless Transit Network Orchestrator	awslabs/serverless-transit-network-orchestrator
TGW (Transit Gateway) Migrator Tool	TGW Migrator Tool
TGW Route Limits Monitoring	aws-samples/how-to-monitor-tgw-route-limits-using-serverless-architecture
TGW to solve overlapping CIDRs	aws-samples/aws-transit-gateway-overlapping-cidrs

Closing account

Description	Repo/Link
How do I close my AWS account?	How do I close my AWS account?
aws-nuke Remove all resources from an AWS account	rebuy-de/aws-nuke

Other AWS useful tools

Description	Repo/Link
Amazon DynamoDB NoSQL Workbench	NoSQL Workbench for Amazon DynamoDB
Amazon Honeycode	builder.honeycode.aws
AWS Auto Scaling Custom Resources	aws/aws-auto-scaling-custom-resource
AWS Deployment Framework (ADF)	awslabs/aws-deployment-framework
AWS Distributed Load Testing	awslabs/distributed-load-testing-on-aws
AWS Glue ETL Code Samples	aws-samples/aws-glue-samples
AWS Glue Libs	awslabs/aws-glue-libs
AWS Instance Scheduler	AWS Instance Scheduler
AWS Multi Account Viewer	awslabs/aws-multi-account-viewer
AWS Perspective	awslabs/aws-perspective
AWS Proton Sample Templates	aws-samples/aws-proton-sample-templates
AWS Proton Sample Fargate Templates	aws-samples/aws-proton-sample-fargate-service
awslimitchecker	jantman/awslimitchecker

Data sources

Description	Repo/Link
Registry of Open Data on AWS	registry.opendata.aws
Landset 8 satellite imagery of all land on Earth	registry.opendata.aws/landsat-8, landsatonaws.com

Other tools

Description	Repo/Link
CNCF Cloud Native Interactive Landscape	landscape.cncf.io
Awesome Hacking	Hack-with-Github/Awesome-Hacking
FastAPI	tiangolo/fastapi
OpenFaaS	openfaas/faas
Regex tester and debugger: PHP, PCRE, Python, Golang and JavaScript	regex101.com
Subnet Calculator - MxToolbox	mxtoolbox.com

Best Practices Guides

• Security Overview of AWS Lambda: An In-Depth Look at AWS Lambda Security, AWS, JAN 2021
• Amazon EKS Best Practices Guide for Security, AWS
• Best practices for working with Amazon Aurora Serverless, AWS, 27 NOV 2020
• Tagging Best Practices, AWS, DEC 2018

Workshops

• workshops.aws
• Amplify Days ANZ
• App Mesh Workshop
• Asynchronous Messaging Workshop
• CDK Workshop
• CI/CD for Serverless Applications Workshops
• Networking Immersion Day
• One Observability Workshop
• Redshift Immersion Workshop
• Serverless Security Workshop
• Service Catalog Tools Workshop
• Spot Instances Workshops
• Spot Instances with EKS Workshops
• VPC Endpoint Workshop
• Well-Architected Labs