View Code? Open in Web Editor
NEW
This project forked from mharty3/data_engineering_zoomcamp_2022
Shell 0.34%
Python 26.03%
HCL 1.16%
Jupyter Notebook 70.93%
Dockerfile 1.55%
data_engineering_zoomcamp_2022's Introduction
Data Engineering Zoomcamp 2022
- Data Lakes
- Data Pipeline Orchestration with Airflow
- Basics of Data Warehousing and Big Query
- Ingesting data into BQ Data Warehouse with Airflow
- Optimizing performance and cost with partitioning and clustering in BQ
- Machine Learning in BQ
- ETL vs ELT
- dbt basics
- transformations in the data warehouse and dbt Cloud
- dbt Project Repo
- Dashboards in Google Data Studio
- Batch vs Streaming
- Installing Spark
- Spark SQL and DataFrames
- Spark Internals