iammustafatz / etl-using-luigi

This repository contains an ETL (Extract, Transform, Load) pipeline implemented using Luigi, a Python package for building data pipelines. The pipeline extracts data from a CSV file hosted on a GitHub repository, performs some cleaning and transformation steps, and then loads the data into a SQLite database table.

Hi, I'm Mustafa! 👋

👩‍💻 I'm currently working as Data Engineer

🧠 graduated B.Sc.Computer Science - Gold Medalist and Pursuing Masters in Data Engineering

🤔 studying, exploring and working on codes

💬 Ask me anything via Linkedin

📫 living in Chennai...

🚀 About Me

As an Indian-based Data Engineer and Web Developer, I specialize in creating efficient data pipelines and designing websites using the MERN stack, with a particular emphasis on React.js. I am passionate about exploring new technologies and tools that enhance my work quality and efficiency. I pay close attention to detail and approach every project with a meticulous mindset to ensure that the end product meets the highest standards...

🛠 Skills

Javascript, HTML, CSS, React.js, Next.js, React Native, Python, Flask, SQL, Pyspark, Airflow, Mlflow, Tableau, Hive, Luigi...

Related

Here are some related projects

ETL using Luigi , Whatsapp Data Analysis , MSSQL Database on railway ticket system , GE Aviation KPI Dashboard , Netflix Action Adventures Report , Tata Data visualization Intern - CMO and CEO Dashboard

Contributions

Sellers are always welcome!

TFT Traders , Web Cheap , Loanspad , SMC

Please adhere to Fiverr for sales.

Showcases