Let’s collaborate to build data solutions that drive business success! 🌐💻

As a seasoned Data Engineer with a passion for innovation, I specialize in developing robust and scalable pipelines, ensuring the seamless flow of data for real-time insights and operational efficiency. Whether it's preventing losses with instant anomaly detection or personalizing customer experiences on the fly, I excel in crafting data solutions that drive competitive advantage.

• Real-Time Pipelines: Designing and optimizing pipelines for real-time data ingestion and processing.
• Streaming Technologies: Leveraging Kafka, Apache Flink, and Apache Spark Streaming for continuous data processing.
• Data Processing: Expertise in ETL processes, reducing extraction time and enabling near real-time analytics.
• Universal Data Lakehouse Architecture: Implementing architectures like Apache Hudi and Delta Lake for unified batch and stream processing.

• Contributed to customer retention analytics initiatives, enabling businesses to tailor strategies in real time for enhanced customer satisfaction and loyalty.
• Assisted clients in supply chain analytics, optimizing processes for improved efficiency and cost savings.
• Spearheaded the development of real-time data pipelines, saving significant time and enabling faster decision-making.
• Pioneered ETL processes for near real-time analytics, reducing data delays and improving operational efficiency.
• Led the implementation of ML models for fraud detection, achieving high accuracy and substantial cost savings.

• Finance: Real-time fraud detection, algorithmic trading, personalized financial products.
• Retail: Dynamic pricing, inventory optimization, personalized recommendations.
• Manufacturing: Predictive maintenance, process optimization, real-time quality control.
• Healthcare: Patient monitoring, early disease detection, personalized treatment plans.

• Programming: Python, SQL, Java, Shell Scripting, and Javascript
• Hadoop CLuster: Spark, Hadoop, Hive, Sqoop, Flume, Pig and Cassandra.
• Databases: MySQL, PostgreSQL, MongoDB, Cassandra, Clickhouse and Redis.
• Cloud Platforms: GCP, Azure and AWS.
• Moder Data Stack: Databricks, Snowflake, dbt, Metabase, dlthubs, RisingWave, Mageai, Airflow.
• Real-Time Data Stack: Kafka, Redpanda, Flink, Pinot, Spark Streaming, debezium.
• Datalakehouse: Apache Hudi, Apache Iceberg, Deltalake.
• Dashboarding: PowerBI, Metabase, Looker, Tableau.
• Data Modelling and DataWarehousing.

Client Projects

• Real-time Supply Chain Analytics
• Customer Retention Analytics
• Coffee Sales Analytics

Personal Projects

• Olympic Near Real-Time Pipeline
• Real-time Monitoring Dezoomcamp
• [Formula One Analytics]
• Real Time Monitoring World Human Emotions
• Retail Data Project
• Ecommerce Sales Anaytics
• NYC Data Project
• Rising Clickhouse Kafa
• Spark Streaming

• Bachelor of Science in Data Science & Applications, IIT Madras (Sept 2021 - Present)

• Datatalksclub Data Engineering Zoomcamp (April 2024) Show Credential
• Microsoft Azure Data Engineer Associate Certified (Sept 2023) Show Credential
• Ineuron Big Data Masters 2.0 Bootcamp (April 2023) Show Credential

• Achieved 1st Position in Data Engineering Zoomcamp 2024 out of 1500+ Industry Professionals around the Globe. (April 2024)
• National-level Smart India Hackathon Winner for Building a Cloud Burst Predictor. (Sept 2023)
• Authored a research paper on groundwater potential zones, demonstrating analytical skills. (Sept 2023)
• Achieved 7th Rank in Ineuron Big Data Masters 2.0 Bootcamp out of 600+ talented professionals. (April 2023)

Let’s collaborate to build real-time data solutions that drive business success! 🌐💻

Ready to leverage your data deluge into a real-time advantage? Let's connect!

• Schedule a Free Consultation: Coming Soon
• Connect on LinkedIn: LinkedIn
• Follow me on Twitter: Coming Soon

The result? You get:

• Faster Time to Insights: React to opportunities and threats instantly.
• Improved Decision-Making: Base your decisions on real-time data, not intuition.
• Increased Operational Efficiency: Identify and address issues before they escalate.
• Enhanced Customer Satisfaction: Personalize experiences and build stronger relationships.