Comments (4)
Deepstack, and the other models in Frigate as far as I can see, work with pre-defined and pre-trained labels. So it can never detect a hedgehog, because it has no concept of what a hedgehog could be, because there was no hedgehog in the training labels.
Zero-shot models are only given the categories at execution time, and can work with things that they've never seen before - similar to large-language models. Broadly, a zero-shot model knows that a hedgehog is a small spiky spherical mammal, so when it sees a picture of a hedgehog it can give the right answer - even if the training data didn't contain any hedgehog pictures and only included picture of things that were either small or spiky or spherical or mammals.
I'm going to mess around with using zero-shot models in Frigate. There's no IRC, discord, reddit, email, or other contact/community details I could see - so a GitHub issue it is. I know Frigate is MIT licensed, so technically I don't need to tell you, but I thought it'd be nice to say something (and might save me a bunch of time if it was trivially impossible for some reason). Plus if there was anyone else who has/is/will try this it might be useful to cooperate.
from frigate.
Frigate already works with deepstack (CodeProject.AI) so that would work for many cases, Frigate also supports using any model you like as long as it is compatible with the detector of your choosing. I am not sure what exactly the request is here
from frigate.
https://www.reddit.com/r/frigate_nvr/
Additional tags are coming Eventually™ but I also am interested in more generalized detection for wildlife, so if you get it working definitely write something up.
from frigate.
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
from frigate.
Related Issues (20)
- Wrong description HOT 1
- Memory usage increases after "Detection appears to be stuck. Restarting detection process..." HOT 2
- option to include bounding boxes/motion boxes on export HOT 4
- Add possibility to leave jsmpeg fullscrean without pressing ESC for touchscreens HOT 1
- Change Events > Cameras > Show all to Show all / Hide all HOT 3
- When launching a review alert/detection, apply pre/post record buffers to video clip HOT 5
- Feature Req: Historic Motion Box Event Scanning (Willing to Pay) HOT 1
- FFMPEG is crashing the intel NUC due to memory stranded at 100% HOT 1
- Option to only run recording ffmpeg process during an event HOT 3
- Reduce the video player format HOT 1
- partition the snapshots into cameras and dates
- Possibility to trigger a recording via an external call (maybe REST?) HOT 1
- can /tmp/cache and /dev/shm use same mount? HOT 1
- Adopt system stats to specific platforms HOT 3
- Configure initial detect/record/snaphsot/audio states, or keep them across restarts HOT 1
- Storage Overview Breakout: Recordings vs Events vs Snapshots vs Saved HOT 1
- Start Frigate even with an invalid config to make editing the config less painful HOT 1
- [Detector Support]: rpi5+haos+coral m.2 not detected HOT 3
- [UI] Ability to zoom the timeline HOT 24
- [UI] Screen to solve the goal "why was this review item created"
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from frigate.