stefen-taime Goto Github PK

llm-rag-mtl-public-hospital

Ce projet développe un modèle de type Retrieve-Augment-Generate (RAG) pour répondre aux questions en utilisant les données publiques des avis laissés sur Google pour des hôpitaux à Montréal

master-airflow

big data, the ability to extract, transform, and store data from the web into different storage systems like MongoDB, PostgreSQL, MinIO, and Elasticsearch is a crucial skill for developers and data scientists

master-elasticsearch

Setting Up and Querying Elasticsearch with Python and Streamlit

mastodon-stream

mastr-data-engineer

modern-data-pipeline

reating a modern data pipeline using a combination of Terraform, AWS Lambda and S3, Snowflake, DBT, Mage AI, and Dash.

modern-data-stack

moderndataengineerpipeline

Building a Robust Data Pipeline: Integrating Proxy Rotation, Kafka, MongoDB, Redis, Logstash, Elasticsearch, and MinIO for Efficient Web Scraping

mongoelasticmigrator

This tool migrates data from MongoDB collections to Elasticsearch indices. It's built using Rust and supports configurable migrations.

multilabel

simple machine learning projet

myubereats_datapipeline

Building a Modern Uber Eats Data Pipeline

nifi-etl-data-pipeline

This post will demonstrate the creation of a containerized data engineer environment using Docker Stacks.

open-source-data

This repository contains structured datasets in various categories

openday

osm-python-tools

A library to access OpenStreetMap related services

projet_data

Utilizing of open source technologies for the implementation of a data pipeline

py-tasks

Automatização de pequenos processos em python

pyjsoncsv

convert_json_to_csv

railway-station-streaming

real-time-data-pipeline-snake-game

Dynamic Snake Game: Unleashing Real-Time Streaming Analytics with Redis, Kafka, Flink, ClickHouse & Chart.js in an Online Snake Game via Flask API

real-time-data-processing-and-analysis-with-kafka-connect-ksql-elasticsearch-and-flask

The project aims to demonstrate how to work with real-time data using Kafka, KSQL, Elasticsearch, and Flask. It shows how to perform joins on Kafka topics, ingest data into Elasticsearch using Kafka Connect, and build a REST API to provide real-time metrics to end-users.

real-time-extraction-transformation-and-exposure-architecture-for-rail-data

we are thrilled to announce our new PoC project aimed at providing a complete real-time extraction, transformation, and exposure architecture for the new provincial transportation systems.

realtime-race-mapper

In this rendition, Elastic and Kibana have been replaced with the powerful Splunk, MQTT has been swapped out for ActiveMQ, and instead of the traditional Kafka, we’ve integrated Confluent Cloud.

sample_dbt_project

The goal of this dbt project is to analyze music streaming data to determine listening trends, user preferences and popular genres. The project consists of SQL templates, tests and macros to transform and verify the data

scalable-rss-feed-pipeline

In this article, we'll walk through how to build a scalable ETL pipeline using Apache Airflow, Kafka, and Python, Mongo and Flask

spark-app

stefen-taime

Config files for my GitHub profile.

stream-ingestion-redpanda-minio

In this article, you will learn how to set up a real-time data processing and analytics environment using Docker, MySQL, Redpanda, MinIO, and Apache Spark.

streaming-sales-generator

Streaming Synthetic Sales Data Generator: Streaming sales data generator for Apache Kafka, written in Python

tdd

Developpement piloté par des test