yashk2000 / hand-detection

Android application which uses Mediapipe to detect hands in a live stream from a phone camera📱

Hand-Detection

This is an Android application which uses Mediapipe to detect hands in a live stream from a phone camera.

In order to run the app, clone it.

git clone https://github.com/yashk2000/Hand-Detection.git`

In order to run Mediapipe apps using gradle, we need to build an aar for the desired graph being used. Follow the steps metioned here to build and aar. Once the aar is made, keep it in the libs folder, app/src/main/libs/.

Then open the app in android studio. To get the app running, android-ndk also needs to be setup. Once that is setup from the settings, menu the app can be built successfully.

The app uses the phone GPU to detect hands in real time with a good accuracy.

The APK can be downloaded directly and installed from the APK folder in the repo.

Here is how the app looks in action:

hand-detection's Issues

how to build AAR

hi,

I tried instructions below in order to run your code.
https://google.github.io/mediapipe/getting_started/android_archive_library.html

But I was not able to build the arr on windows 10. I have the envionment setup but the bazel command throws
target names may not contain ''

I also tried installing your APK, that failed too.

Can you please provide bit more details on how to generate the ARR on windows.

I have an issue when I install application after camera access, app crashed, error: not found ValidatedGraphConfig

2021-09-29 21:36:51.191 6151-6203/? E/native: E20210930 09:36:51.191642 6203 graph.cc:470] ValidatedGraphConfig Initialization failed.
No registered object with name: HandDetectionSubgraph; Unable to find Calculator "HandDetectionSubgraph"
No registered object with name: DetectionsToRenderDataCalculator; Unable to find Calculator "DetectionsToRenderDataCalculator"
No registered object with name: RectToRenderDataCalculator; Unable to find Calculator "RectToRenderDataCalculator"
No registered object with name: AnnotationOverlayCalculator; Unable to find Calculator "AnnotationOverlayCalculator"
2021-09-29 21:36:51.196 6151-6203/? D/GlThread: Stopping GL thread ExternalTextureConverter
2021-09-29 21:36:51.198 6151-6203/? E/AndroidRuntime: FATAL EXCEPTION: ExternalTextureConverter
Process: com.yashk2000.handdetection, PID: 6151
com.google.mediapipe.framework.MediaPipeException: not found: ValidatedGraphConfig Initialization failed.
No registered object with name: HandDetectionSubgraph; Unable to find Calculator "HandDetectionSubgraph"
No registered object with name: DetectionsToRenderDataCalculator; Unable to find Calculator "DetectionsToRenderDataCalculator"
No registered object with name: RectToRenderDataCalculator; Unable to find Calculator "RectToRenderDataCalculator"
No registered object with name: AnnotationOverlayCalculator; Unable to find Calculator "AnnotationOverlayCalculator"
at com.google.mediapipe.framework.Graph.nativeStartRunningGraph(Native Method)
at com.google.mediapipe.framework.Graph.startRunningGraph(Graph.java:324)
at com.google.mediapipe.components.FrameProcessor.startGraph(FrameProcessor.java:553)
at com.google.mediapipe.components.FrameProcessor.maybeAcceptNewFrame(FrameProcessor.java:421)
at com.google.mediapipe.components.FrameProcessor.onNewFrame(FrameProcessor.java:439)
at com.google.mediapipe.components.ExternalTextureConverter$RenderThread.renderNext(ExternalTextureConverter.java:403)
at com.google.mediapipe.components.ExternalTextureConverter$RenderThread.lambda$onFrameAvailable$0$ExternalTextureConverter$RenderThread(ExternalTextureConverter.java:338)
at com.google.mediapipe.components.-$$Lambda$ExternalTextureConverter$RenderThread$IXJjtE68JMV2CMJNQcFYhTUqhj8.run(Unknown Source:4)
at android.os.Handler.handleCallback(Handler.java:808)
at android.os.Handler.dispatchMessage(Handler.java:101)
at android.os.Looper.loop(Looper.java:166)
at com.google.mediapipe.glutil.GlThread.run(GlThread.java:141)