6dvd9 Goto Github PK

airflow-autoscaling-ecs

Airflow Deployment on AWS ECS Fargate Using Cloudformation

airflow-boilerplate

A complete development environment setup for working with Airflow

airflow-dags

This is a repo for my peers in Toronto, that are curious on how Apache Airflow work. I have uploaded some DAGs that I created for reference.

airflow-diagrams

Auto-generated Diagrams from Airflow DAGs. 🔮 🪄

airflow-ms-teams-operator

Airflow operator that can send messages to MS Teams

amazon-redshift-utils

Amazon Redshift Utils contains utilities, scripts and view which are useful in a Redshift environment

analyzing-and-visualizing-data-with-power-bi

SolutionSheet

aushare

For ASX share market data interface and analysis

awesome-apache-airflow

Curated list of resources about Apache Airflow

aws

This repository consists of useful links for study materials for those aspiring carrer in AWS

cookbook

The Data Engineering Cookbook

csvsplit

Split CSV based on a column in the file

csvsplit-1

Split a single-row csv based on a pattern

csvsplitter

python large csv file splitter by column

data-modelling-dend

Data Modelling for Sparkifydb

data_engineering_nd

datascience_toolbox

This and that for Data Science

dataset_loaders

A collection of dataset loaders

datax

dbt-learn-dancam

dbt playground

essential-math-for-data-analysis

Uploaded the final result and solution for the whole class.

gitops-foundations-app-2892009

GitOps Foundations

gitops-foundations-env-2892009

GitOps Foundations

go-cloud

The Go Cloud Development Kit (Go CDK): A library and tools for open cloud development in Go.

hadoop-book

Example source code accompanying O'Reilly's "Hadoop: The Definitive Guide" by Tom White

ibm-data-science-specialization-coursera

Data Science has been ranked as one of the hottest professions and the demand for data practitioners is booming. This Professional Certificate from IBM is intended for anyone interested in developing skills and experience to pursue a career in Data Science or Machine Learning. This program consists of 9 courses providing you with latest job-ready skills and techniques covering a wide array of data science topics including: open source tools and libraries, methodologies, Python, databases, SQL, data visualization, data analysis, and machine learning. You will practice hands-on in the IBM Cloud using real data science tools and real-world data sets. It is a myth that to become a data scientist you need a Ph.D. This Professional Certificate is suitable for anyone who has some computer skills and a passion for self-learning. No prior computer science or programming knowledge is necessary. We start small, re-enforce applied learning, and build up to more complex topics. Upon successfully completing these courses you will have done several hands-on assignments and built a portfolio of data science projects to provide you with the confidence to plunge into an exciting profession in Data Science. In addition to earning a Professional Certificate from Coursera, you will also receive a digital Badge from IBM recognizing your proficiency in Data Science.

indian-equity-portfolio-summarizer

At the comfort of terminal command prompt, get the summary reports for each stock as well as the whole equity portfolio with information about realized and unrealized(holding) gains/losses split into short term and long term. It also calculates taxable capital gain for your long term capital gains that need grandfathering. All you need to have is a list of your portfolio transactions in a CSV file. Most brokerage websites allow you to download the list of transactions as a CSV.

local-aws-spark-zeppelin-stack

AWS LocalStack + Spark Cluster + Zeppelin [Docker]

pyecharts

🎨 Python Echarts Plotting Library

spark-basic-structure

Example of one possible way of structuring a Spark application