darkmatter18 / whatsthere

Pytorch based Android app, which classifies images using MobileNet-V2 model, takes image using CameraX API

WhatsThere

Installation Guideline

An Android Application, which can sense and classify objects in Real time.

The App is created using the concepts of Deep Learning and Artificial Neural Networks. WhatsThere is a great example, that how Artificial Intelligence can do a lot without human interference.

Features

1. The App can sense 1000 different kinds of objects, from Keyborads to Dog Bread
2. The App has a Flash On/Off button, so the app can see clearly at night.
3. The Camera Focus is automatically adjusted, so you don't have to bother to focus any object.

Last but not least

4. The App is so light weight and can do it's job very precisely even in VERY LOW SPECS Device.

Technology

• The App is created for and only for Android, 2 minutes of silence for other platforms
• To power-up the Deep Neural Network, the App uses PyTorch
• Written in Shuddh JAVA
• Uses CameraX to Capture frames

Neural Network

• The App uses the pretrained MobileNet-v2 model as it's classifier backend

Example Images

Maintainer

Arkadip Bhattacharya

Need help? Feel free to contact me @ [email protected]

whatsthere's Issues

Improve documentation

• Improve README.md
• Add More details and user guidelines

Please read the CONTRIBUTING.md for more help

Improve CONTRIBUTING.md

• Work on CONTRIBUING.md

You can take help from https://github.com/react-auth-kit/react-auth-kit/blob/master/CONTRIBUTING.md

Dependency Dashboard

This issue lists Renovate updates and detected dependencies. Read the Dependency Dashboard docs to learn more.

Rate-Limited

These updates are currently rate-limited. Click on a checkbox below to force their creation now.

• chore(deps): update dependency gradle to v6.9.4
• fix(deps): update dependency org.pytorch:pytorch_android to v1.13.1
• fix(deps): update dependency org.pytorch:pytorch_android_torchvision to v1.13.1
• chore(deps): update actions/checkout action to v4
• chore(deps): update actions/setup-java action to v4
• chore(deps): update dependency gradle to v8
• fix(deps): update dependency com.android.tools.build:gradle to v8
• fix(deps): update dependency org.pytorch:pytorch_android to v2
• fix(deps): update dependency org.pytorch:pytorch_android_torchvision to v2
• 🔐 Create all rate-limited PRs at once 🔐

Open

These updates have all been created already. Click a checkbox below to force a retry/rebase of any.

• fix(deps): update dependency androidx.test.ext:junit to v1.1.5
• fix(deps): update dependency androidx.appcompat:appcompat to v1.6.1
• fix(deps): update dependency androidx.camera:camera-camera2 to v1.3.3
• fix(deps): update dependency androidx.camera:camera-core to v1.3.3
• fix(deps): update dependency androidx.camera:camera-extensions to v1.3.3
• fix(deps): update dependency androidx.camera:camera-lifecycle to v1.3.3
• fix(deps): update dependency androidx.camera:camera-view to v1.3.3
• fix(deps): update dependency androidx.constraintlayout:constraintlayout to v2.1.4
• fix(deps): update dependency androidx.test.espresso:espresso-core to v3.5.1
• fix(deps): update dependency com.android.tools.build:gradle to v7.4.2
• Click on this checkbox to rebase all open PRs at once

Detected dependencies

github-actions

.github/workflows/android.yml

• actions/checkout v2
• actions/setup-java v2

gradle

gradle.properties

settings.gradle

build.gradle

• com.android.tools.build:gradle 7.0.4

app/build.gradle

• androidx.appcompat:appcompat 1.2.0
• androidx.constraintlayout:constraintlayout 2.0.4
• junit:junit 4.13.2
• androidx.test.ext:junit 1.1.2
• androidx.test.espresso:espresso-core 3.3.0
• androidx.camera:camera-camera2 1.0.0-beta11
• androidx.camera:camera-core 1.0.0-beta11
• androidx.camera:camera-core 1.0.0-beta11
• androidx.camera:camera-extensions 1.0.0-alpha18
• androidx.camera:camera-lifecycle 1.0.0-beta11
• androidx.camera:camera-view 1.0.0-alpha15
• org.pytorch:pytorch_android 1.10.0
• org.pytorch:pytorch_android_torchvision 1.7.0

gradle-wrapper

gradle/wrapper/gradle-wrapper.properties

• gradle 6.1.1

---

• Check this box to trigger a request for Renovate to run again on this repository

Migration to Kotlin

Have you ever thought about migrating JAVA Based code to Kotlin? If so I like to take it up

Improve Installation.md

• Change this file
• Rename to INSTALLATION.md
• Make a detailed description.
• Change the main README, so that it can point to the new INSTALLATION.md
• Please check for the Play protect warning in your device, if there is no warning, don't add the existing 4th and 5th step.

Happy Contributing 🎉🎊

at androidx.camera.

D/UseCaseAttachState: All use case: [androidx.camera.core.ImageAnalysis-363243cc-9dfa-4221-a621-f07e9ad2455d225614689, androidx.camera.core.Preview-688c94fe-d026-4a9e-b7fe-eb2e30b843f9107609800] for camera: 0
D/UseCaseAttachState: Active and attached use case: [androidx.camera.core.ImageAnalysis-363243cc-9dfa-4221-a621-f07e9ad2455d225614689] for camera: 0
E/AndroidRuntime: FATAL EXCEPTION: main
Process: com.arkadip.whatsthere, PID: 7361
java.lang.NoSuchMethodError: No virtual method getCamera()Landroidx/camera/core/Camera; in class Landroidx/camera/core/SurfaceRequest; or its super classes (declaration of 'androidx.camera.core.SurfaceRequest' appears in /data/data/com.arkadip.whatsthere/code_cache/.overlay/base.apk/classes.dex)
at androidx.camera.view.PreviewView.lambda$createSurfaceProvider$1$PreviewView(PreviewView.java:240)
at androidx.camera.view.-$$Lambda$PreviewView$n1PRP3s6fDboGjmt9Yty7nYrFM0.onSurfaceRequested(Unknown Source:2)
at androidx.camera.core.Preview.lambda$sendSurfaceRequestIfReady$1(Preview.java:389)
at androidx.camera.core.-$$Lambda$Preview$cQQSNpTD_vzDR540rq5dmfARJz4.run(Unknown Source:4)
at android.os.Handler.handleCallback(Handler.java:938)
at android.os.Handler.dispatchMessage(Handler.java:99)
at android.os.Looper.loop(Looper.java:223)
at android.app.ActivityThread.main(ActivityThread.java:7656)
at java.lang.reflect.Method.invoke(Native Method)
at com.android.internal.os.RuntimeInit$MethodAndArgsCaller.run(RuntimeInit.java:592)
at com.android.internal.os.ZygoteInit.main(ZygoteInit.java:947)
D/Camera2CameraImpl: {Camera@a06afe[id=0]} Resetting Capture Session

How to train your own model？

How to train your own model？
I want to train the model myself to make it more accurate in identifying certain types of objects.