himanitawade Goto Github PK

449-exercise3

acm-csuf-discord-bot

algorithms

A collection of algorithms and data structures

apacheflink-salesanalytics

This repository contains an end-to-end data engineering project using Apache Flink, focused on performing sales analytics. The project demonstrates how to ingest, process, and analyze sales data, showcasing the capabilities of Apache Flink for big data processing.

certifications

Data Engineering

cerulean-bee

changecapture-e2e

This project shows how to capture changes from postgres database and stream them into kafka

clustering-a-sensor-network

container-ship-weight-maximization

course_recommendation_system

cpsc449-project1

Back-End API for Game

cpsc449project1

crane-problem

dbt-bigquery-crash-course

A deep dive into the powerful combination of DBT and BigQuery, the game-changers in modern data engineering.

emr-for-data-engineers

This project demonstrates the use of Amazon Elastic Map Reduce (EMR) for processing large datasets using Apache Spark. It includes a Spark script for ETL (Extract, Transform, Load) operations, AWS command line instructions for setting up and managing the EMR cluster, and a dataset for testing and demonstration purposes.

ivy

The Unified AI Framework

japan-visa-data-engineering

This project provides an end-to-end data processing and visualization of visa numbers in Japan using PySpark and Plotly. The spark clusters are set up within a Docker container on Azure.

java-projects

portfolio

project-lawnmover

realtimestreamingengineering

This project serves as a comprehensive guide to building an end-to-end data engineering pipeline using TCP/IP Socket, Apache Spark, OpenAI LLM, Kafka and Elasticsearch. It covers each stage from data acquisition, processing, sentiment analysis with ChatGPT, production to kafka topic and connection to elasticsearch.

redditdataengineering

This project provides a comprehensive data pipeline solution to extract, transform, and load (ETL) Reddit data into a Redshift data warehouse. The pipeline leverages a combination of tools and services including Apache Airflow, Celery, PostgreSQL, Amazon S3, AWS Glue, Amazon Athena, and Amazon Redshift.

titanenrollapp

vegitizer

web-back-end-project2

web-back-end-project4

web-backend-project3