galvsoliveira,Gustavo Alves de Oliveira,github

Hi👋, I'm Gustavo. I'm a MSc Physicist and Data Engineer!

👋 I’m a Physicist (MSc) with 5 years of programming experience and a strong background in mathematics and statistics. I specialize in writing/optimizing complex SQL queries and building Pipelines with Airflow, Docker, CI/CD and dbt core. I also have expertise in web scraping, cloud services (AWS), data warehouses, and machine learning models. I'm always eager to learn new skills and technologies to deliver data-driven solutions for business teams.

🛠️ Skills:

Languages: Python, SQL, MATLAB, Fortran, LaTeX.
Web Scraping: Python (beautifulsoup, selenium).
Data Engineering: Python (ETL), Airflow, DBT, Docker, REST API, GraphQL API, CI/CD, Kafka.
Cloud and Data Warehouse: AWS, SQL (Athena/Snowflake), Redash, Metabase, Redshift.
Data Manipulation: Python (numpy/pandas), SQL.
Data Visualization: Python (matplotlib/seaborn), Power BI/Redash/Metabase.
Machine Learning: Python (scikit-learn), NLP, regression, classification, clustering, association.

💭 If you can’t do something, start asking the right questions.

If you have any questions or feedback, please email me at [email protected]

Gustavo Alves de Oliveira's Projects

airflow-postgres-etl

In this project, I perform batch ETL on CSV files using Airflow and Postgres within Docker containers.

dbt-project-development-test

Neste projeto, desenvolvo um projeto ELT com Python, dbt e SQLite do zero. A configuração do repositório é facilitada com Shell, Poetry e ASDF.

ds_geoprofit_analysis

Este projeto tem como objetivo realizar uma análise dos bairros da cidade de São Paulo para estimar o faturamento, classificar o potencial e segmentar os bairros de acordo com a renda e idade, a fim de identificar aqueles com maior aderência ao público-alvo de uma empresa alimentícia.

human-resources-analytics

Projeto de Data Science end-to-end de análise da retenção e previsão de turnover de funcionários de uma empresa. Ferramentas utilizadas: Python, scikit-learn, MySQL Server, Docker, MinIO, Airflow, Streamlit.

nubank-etl

Nubank pdf to csv with treatment

python-pdm-production-level-repository-template

This repository is a template for a production-level Python repository with PDM and pre-commit hooks with asdf as versions manager. PDM is a poetry-like dependency manager with some improvements in performance and more advantages.

python-poetry-production-level-repository-template

This repository is a template for a production-level Python repository with Poetry and pre-commit hooks with asdf as versions manager.

smokers-prediction-interview

Projeto de Data Science de previsão de fumantes com deploy do modelo para um webapp do streamlit. Ferramentas utilizadas: Python, scikit-learn, Streamlit.