spratiher9 / jumpspark

JumpSpark - A modern cookiecutter template for pyspark projects with batteries included.

Featured on README
Featured on coderjojo/create-profile-readme.

Hiya, the name's Souvik!🐱‍💻 I'm a Python Developer and Data Engineer (Customer Success America) at . I like to develop projects that are unique and quirky.

I also like watching anime and reading manga in my free time too. ٩(●ᴗ●)۶

• Languages: Python, SQL, GoLang 🚀
• Back-End: FastAPI, GraphQL, PostGreSQL, MongoDB, CockroachDB, Neo4J 🛸
• CI/CD: Azure Devops, GitHub Actions ♻
• Framework: Hadoop, Apache Spark, Hive, Solace, Kafka 🧬
• Cloud: Microsoft Azure ☁
• OS: Ubuntu, Windows 💻

I have recently started working on various open source projects also. Two of the most notable ones are:

• databrickslabs/tempo
• Tanzanite-lpu/tgl-2.0

Download stats of some of my libraries:

• Netplot :
• SeedrAPI :
• SparkDataset :
• Sparkora :
• Exelog :
• Valido :
• Bajra :

Scroll down!!!

---

Socials:

---

Projects:

• Netplot🏁 : A small-lightweight 3D renderer of Tensorflow/Keras Neural Networks using only matplotlib and numpy.
• NewNuggets📰 : A news feed web app based on Google News API and Streamlit.
• Seedr-Client🛸 : Asynchronous + Synchronous python wrapper of the Seedr.cc service.
• SparkDataset📑 : Easy Instant access to over 750+ Standard datasets in the form of Spark Dataframes.
• Sparkora🤖 : Powerful rapid automatic EDA and feature engineering library with a very easy to use API.
• Exelog🩺 : Meticulous logging for Apache Spark applications end to end from driver to executors.
• Valido🛠 : Pyspark dataframe based workflow validator.
• Bajra🎲 : A no-setup plug and play raw SQL ORM for PostGreSQL and MySQL.
• More things cooking..🐱‍🏍

📊 Stats