sgouda0412 Goto Github PK

data-engineering-on-gcp

ETL Pipeline using Cloudcomposer, Apache Airflow, Google cloud Storage,Big query on GCP

data-engineering-with-aws

Data Engineering with AWS, Published by Packt

data-engineering-with-databricks-english

data-engineering-zoomcamp

Free Data Engineering course!

data-lake-using-spark

Developed an ETL pipeline for a Data Lake that extracts data from S3, processes the data using Spark, and loads the data back into S3 as a set of dimensional tables. Lake Processing: Spark

data-model-drift

Managing Data and Model Drift with Azure Machine Learning

data-pipe-lining-tools

data-pipeline-airflow-on-awsredshift

A demo for creating a simple data warehouse ETL pipeline on AWS with Airflow

data-pipeline-aws

Data Pipeline on AWS

data-pipeline-python

Implementation of simple Data Pipeline using Python. This repo is used as demo in my workshop at DE-Kita Whatsapp Group

data-science-question-answer

A repo for data science related questions and answers

data-science-template

Template for a data science project

data-science-utilities

The utilities for data science.

data-structures-algorithms-i

Here I'll post code for various DSA problems that were covered by me

data_engineer_resources

Udacity Data Engineer Nanodegree

data_lake_bronzetogold

data_pipeline_project

data_project

data_science_blogs

A repository to keep track of all the code that I end up writing for my blog posts.

database-schema-examples

Relational database schema examples, including table creation scripts (DDL SQL) for popular database systems (MySQL, Derby, H2, etc).

databricks-notebooks

datacamp-data-engineer-with-python-course

datacamp Data Engineer with Python course. 73 hours/ 19 Courses /2 Skill Assessments

datacamp_introduction_to_airflow

This is a memo to share what I have learnt in Apache Airflow

dataengineering

A repo to track data engineering projects

datalake-airflow-tickit

datapipelines-airflow-book

dataproc-spark-processing

Contains PySpark jobs to do batch processing from GCS to BigQuery & GCS to GCS and also bash script to perform end to end Dataproc process from creating cluster, submitting jobs and delete cluster.

datawarehousing-automation-with-gcp-airflow

dba-scripts

A collection of scripts I use for managing and troubleshooting MS SQL server

dbt_data_transformation_validation

the objective of this project is to implement data transformations and validation using DBT