hhio618 / dbscan-pysprak

Spark-based dbscan clustering algorithm from scratch

Hi there 👋

Thanks for visiting my GitHub!

Welcome! I'm Homayoun, a dynamic developer with a knack for quickly mastering new technologies. I specialize in automating tasks to boost productivity and streamline processes. With a versatile skill set across multiple domains, I thrive on learning and adapting to new challenges. If you're looking for a developer who can efficiently tackle new challenges and contribute to impactful projects, you're in the right place. Let's create something amazing together!

Educational Background

• Master of Science in Computer Science (AI Engineering)
• Bachelor in Software Engineering

Current Passion

🔭 Currently, I am merging my AI knowledge with blockchain expertise to create solutions that benefit humanity's future. I'm actively participating in Dorahacks hackathons and would love to have you as a teammate!

NFT Awards

Here are some of my NFT accolades:

GitPOAP: 2022 Next.id Contributor	GitPOAP: 2021 Gitcoin.co Web Contributor	GitPOAP: 2020 Gitcoin.co Web Contributor

Mentionable Projects

Here are some of the projects I've worked on:

Repository	Description	Skills/Platforms
Bitcloud-live	A PaaS based on Kubernetes operators (mostly private repos)	Networking & Security, Kubernetes, Golang, DevOps, Ansible, Containers, Infrastructure
Tellor Node	Tellor blockchain node in Golang (now archived)	Blockchain, Ethereum, Golang
Arklib	Ark-Builders core library	Rust
Golem-CI	Mentioned in this Golem Network blog post	Python
WNFS Utils	Original contributor of the project	Rust, IPFS, DAG
WNFS Android	rs-wnfs library interface for Android devices (original contributor)	Rust+Kotlin
WNFS iOS	rs-wnfs library interface for Apple devices (original contributor)	Rust+Swift
Bluzelle-Py	A Python client for the Bluzelle network	Python
HumanCaptcha Telegram Bot	One of the main contributors (RIP)	Python
Diadata Contributions	Contributions as a bounty hunter	Golang
Go-Fula Project	Decentralized file storage	Golang, IPFS, Blockchain, Networking

Feel free to explore my repositories and projects. I'm always open to collaboration and new opportunities. Let's make something incredible together!

dbscan-pysprak's Issues

Calculating D_min sub code and the subsequent code snippet is not working

D_min is not executing properly and it is giving some error like this:
Py4JJavaError: An error occurred while calling z:org.apache.spark.api.python.PythonRDD.collectAndServe.
: org.apache.spark.SparkException: Job aborted due to stage failure: Task 7 in stage 23.0 failed 1 times, most recent failure: Lost task 7.0 in stage 23.0 (TID 55, localhost, executor driver): org.apache.spark.api.python.PythonException: Traceback (most recent call last):
Can you please give me a solution