dmkarthiksrini / mapreduce

This objective behind this is to learn MapReduce Model within the Hadoop Framework that is used to access big data stored in the Hadoop File System (HDFS).

🥷 About Me

I'm a Data Engineer with a background in Application Engineering, Data & Infrastructure Management and Automation at Amazon. Currently, a student at 🏫 Brunel University studying 🎓Master of Science in Data Science and Analytics.

🛠 Skills

Core Skills: Exploratory Data Analysis, Machine Learning, ETL Data Pipeline, AWS Services S3, DynamoDB, Redshift

👨‍💻Tech Stack

• Python & R Programming - Pandas, NumPy, SciPy, Sic-Kit Learn, Seaborn, MatploLib, ggplotLib, Tensorflow

• Data Management - Docker, Hadoop, Scala, Airflow, Kafka, Terraform, GCP

• Miscellaneous Technologies - Regular Expression, Git, Excel, DROOLS, Xpath, Linux

• Previously Worked on AWS services like SQS, SNS, Redshift, EC2, SWF & ELK (Elastic Search, Logstash & Kibana)

Currently..

• 📜 I’m currently learning: ML flow management tools, and Building Data Pipeline for the NY Taxi Data Analysis.
• 🔭 I’m currently working on: Identifying a Better problem for the Post Grad Thesis & Venturing to start writing Blogs on the Tech issues & Learning
• 🤝 I'm happy to collaborate on projects in automation and AI, interested in working/Knowing more about Data Engineering) in different Fields. 🧨
• 🔁 Whether I'm in a new city or not, I make it a point to attend a tech meetup once a month, to meet great minds and PyData meetup is something I never miss.

🔗 Links