himewel Goto Github PK

airflow_celery_workers

Airflow 2.0 configuration with Celery Executor based on Docker containers with Postgres and Redis broker plus Flower and Webserver UI

airport_streaming

A visualization of ANAC open database builded with Apache Airflow, PySpark, Docker, Terraform and GCP

aws-serverless

Event driven data pipeline processing data from S3 to Athena with Lambda functions, SQS queues, Glue metastore/jobs

cartolafc

Football scouts from Cartola FC at a data lake with data warehouse and dashboard

cats_and_dogs

The classic cats and dogs image classification with Keras and Tensorflow

covid19retail

Covid19 and Iowa Liquor Sales analysis at BigQuery using dbt, Airflow, Marquez, Google Cloud and other modern data stack tools

engage

Streaming change data capture from SQL Server to MongoDB, Redis and Hadoop with Debezium and Spark Streaming

ftp-server

gcp-terraform-airflow

Infrastructure of Airflow with Celery workers builded with Terraform resources based on GCP Compute Engine VM Instances

get_audio

github-sink

Silly extraction and parsing of data from Github API to sinks like Console, File, MongoDB and Kafka

himewel

himewel.github.io

Minimal landing page for developers

ifood-data

Ifood data wrangling with Apache Airflow and Apache Spark running on Kubernetes

java-virtual-machine

Hardware description of a JVM with a reduced set of instructions implemented in VHDL

kind-airflow

Apache Airflow helm chart environment running on local kubernetes (kind) with docker abstraction

portfolio-dados-rais

scala-fp

Functional programming fundamentals with Scala and Cats =^.^=

scala-projects

A project to store my fundamentals study in Scala

sentiment-analysis

Sentiment analysis with pre trained FastText model, with a Flask API and multiple deploy options in Google Cloud

startup

trending-explorer

Extraction and data wrangling from Twitter API with Apache Airflow, PySpark and DeltaLake

trip-analysis

BigQuery data ingestion using PubSub and Cloud Functions

voc-person-detection

YOLO-Tiny and YOLO-Tiny + XNOR-Net person detection with Pascal VOC 2007 and 2012 datasets

weather_gather

INMET weather data extraction, structuring and visualization with Docker, Apache Airflow, BigQuery and Apache Superset.

weather_pubsub

Weather data ingested in Kafka broker and processed with Spark Streaming

yolowell

A set of hardware architectures to build a co-design of convolutional neural networks inference at FPGA devices