marcustap Goto Github PK

avro2parquet

Hadoop MapReduce tool to convert Avro data files to Parquet format.

awesome-data-engineering

A curated list of data engineering tools for software developers

awesome-python

A curated list of awesome Python frameworks, libraries, software and resources

azure-acs-mongodb-demo

Demo project showing how to deploy MongoDB on the Azure Container Services (ACS) with Kubernetes

azure-datafactory

azure-sdk-for-python

This repository is for active development of the Azure SDK for Python. For consumers of the SDK we recommend visiting our public developer docs at https://docs.microsoft.com/en-us/python/azure/ or our versioned developer docs at https://azure.github.io/azure-sdk-for-python.

cookbook

The Data Engineering Cookbook

covid19-br

Dados diários mais recentes do coronavírus por município brasileiro

covid19-data-lake

data-engineering-book

Accumulated knowledge and experience in the field of Data Engineering

data-engineering-nanodegree

Projects done in the Data Engineering Nanodegree by Udacity.com

data-modeling-with-postgresql

databricks-data-journey-brasil

Repositório com as demonstrações e dados compartilhadas durante os webinars do Databricks Journey Brasil

design-patterns-python

hielo-template

Projeto construído para treino de desenvolvimento web

jogo-da-forca

Simples jogo da forca criado utilizando Python

learning-apache-spark

Notes on Apache Spark (pyspark)

learning-spark-sql

Learning Spark SQL, published by Packt

learningpyspark

Code base for the Learning PySpark book (in preparation)

projects

Over 100 projects to complete for practice Python. Fork for learn any new programming language

projetoengenhariadedados

Projeto prático proposto como encerramento do curso Engenharia de Dados: Domine BigData! Utilizando SQL, python, pyspark e MongoDB

projetointegrado

O objetivo do projeto foi, apresentar o quadro socioeconômico de nosso País, baseado no consumo de dados por APIs e repositórios públicos, disponibilizados pelo governo federal, em formato resumido de um Dashboard dimensional.

skytrax-data-warehouse

A full data warehouse infrastructure with ETL pipelines running inside docker on Apache Airflow for data orchestration, AWS Redshift for cloud data warehouse and Metabase to serve the needs of data visualizations such as analytical dashboards.

sql-2-afternoon

A sql afternoon project to solidify using more intermediate queries.

udacity-data-engineering-projects

Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake development.