ansahmohammad / gesture-scroll

An accessibility tool to scroll the pages using gestures

Hello world !🌥️,
I'm AnsahMohammad 👨‍💻

• 🧠 Currently learning RUST🦀
• 💻 SWE Intern at Google LLC
• 🍀 interested in Building apps
• 📍 CSE Undergrad at NIT Surat

💻 Tech Stack:

---

🌐 Socials:

     

---

Extras:

Profile Views

gesture-scroll's Issues

Model Refinement

Increase the Training set,
add more varieties for better accuracy > 90

Encapsulation

What is the expected enhancement?

Encapsulation of the scroller.py so that developers can directly import the library and integrate the tool into their application straightforward

Add Pytest

Add Tests and integrate with Github Actions to scan PRs

Abstract:
Add tests for model scanning.

1. Import the model
2. Run the image from local storage
3. Ensure that error doesn't occur

Code Linting

Add a Linting workflow to enforce code style using Pylint

expected enhancement:

• Adding of Pylint workflow
• Update the code style accordingly

Tracking stabilisation

The gesture tracking encounters bugs due to fast analysis of each and every frame, destabilizing the process and causing more errors. To resolve this, we can decrease the frame intake and update the algorithm for smooth gesture tracking.

Gestures Tutorial

Add Documentation on various Gestures viz; UP, DOWN, Neutral, Activation

Expected Change :

• Create a markdown file or add in the current md file
• Add images of various gestures

Add a Beep after activation

What is the expected behavior?

Add a beep sound after the activation to let users know that the App is ready to read gestures

GUI

Create a User Interface for navigation and ease of Use

Rough Idea:
create an executable file that can start or stop the tool

Document data_gen.py

Write documentation for the Data Generator data_gen.py

Troubleshoot

Add troubleshooting for webcam failure when other devices are using it

Activation Gesture

Introduce a Gesture to activate or deactivate the tool without stopping it manually

Will need to achieve the following

• Update the Model
• Updating the scroller.py algorithm for tracking