kattsonbastos / devops-journey-aws-dio

Kattson Bastos

This repo presents some skills and practical projects I've been working on since I started my journey in the IT and data fields.

_{A Data Lover in the realm of ML and Data Engineering, DevOps and IT in general.}

🔗 Links

• 
• 

Data Engineering:

1. Streaming Pipeline with Apache Beam and Dataflow

Building a streaming data pipeline to load real-time users data into Big Query so the marketing and analytics teams can work on products offering and customer segmentation for faster business value generation.

Skills: GCP, Dataflow, Apache Beam, Pub/Sub, Terraform, Big Query.

2. Daily Covid 19 ELT With Modern Data Stack

Our team was asked to implement a simple ELT pipeline in order to provide daily Covid 19 data to the BI team so they workk on their analytics and take decisions.

Skills: Airflow, Dbt, Snowflake, Airbyte, Docker

Data Science:

1. Store Sales Prediction

Building an end-to-end solution for a six weeks sales forecast of a pharmacy chain using Machine Learning. The predictions can be accessed by a bot on Telegram.

Skills: Machine Learning, Time Series, Heroku, API, Bot

2. Prioritizing Customers for Insurance Cross-Sell (Ongoing)

Predicting whether or not the customer would be interested in auto insurance so the sales can be optimized.

Skills: Machine Learning, Heroku, API, Streamlit

3. Cardiovascular Disease Detection (Ongoing)

Building a Machine Learning Model to detect cardiovascular disease in early stages leverage the diagnostic precision made by health professionals.

Skills: Machine Learning, Heroku, API, Streamlit

Data Anaysis / Insights:

1. Education Dataset Analysis (Brazilian ENADE)

Analyzing data from a brazilian performance's valuation of students. The analysis is focused on the state of Bahia.

Skills: Data Visualization, Data Processing

2. Analysis of Election Data

Analyzing data from Vitoria da Conquista - Ba's 2020 elections. The focus is on the economic and the social profile of candidates.

Skills: Data Visualization, Data Processing

---