Comments (4)
Hi @skeegan,
While AlvaAR includes all the essential subroutines for NFT image tracking as part of its SLAM algorithm, they are primarily designed for SLAM within the library and are not specifically optimized for NFT image tracking. To achieve your goal, you can follow these rough steps:
- Feature Detection/Extraction: Use Harris corners to identify and extract unique feature points from a reference image.
- Feature Descriptors: Apply ORB descriptors to describe these unique features.
- Process Camera Frames: Repeat steps 1 and 2 for each camera frame to detect features and match them with the target image features.
- Select Good Matches: Use k-NN (k-nearest neighbors) to filter and keep only the good matches.
- Pose and Orientation: Find homography using RANSAC, calculate the corners, and use solvePnP with these corners to obtain rotation and translation vectors.
- Camera Projection Matrix: Create and send this matrix to your 3D environment (Three.js, Babylon, AFrame, etc.).
- Render and Update: Overlay and dynamically update digital content in your application based on the camera projection matrix.
- Continuous Tracking and Updates: Continuously track the target image and update the overlay as needed.
If you check out the library's code, you'll find that all these subroutines are present, though with a focus on SLAM rather than NFT image tracking.
I'm considering adding this feature in the future. In the meantime, you might find these additional resources, complementing what ThorstenBux suggested, helpful:
OpenCv, AR.js, martins-js, Object tracking using Homography in OpenCV
from alvaar.
Hi mate, can't answer your question but jsartoolkit or mindar are two libs for image tracking on the web.
from alvaar.
thanks @ThorstenBux
They're interesting libraries. Do you know of any others that can enable 3D object tracking in Javascript?
from alvaar.
Many thanks @alanross . Your response was very thorough and helpful
from alvaar.
Related Issues (20)
- build error HOT 14
- how to use with a-frame? HOT 8
- How can I enable multiple users to see the same object in the same physical location at a later time? HOT 2
- How to combine VPS and AlvaAR so that it can be used as indoor navigation? HOT 1
- eigen and ceres emcmake error HOT 1
- Uncaught (in promise) RuntimeError: memory access out of bounds HOT 1
- May I inquire about how to integrate an indicator for plane detection?
- Example using just an index.html HOT 7
- Errors during libs build HOT 1
- eigen download link is dead
- simd and threads are both supported by Mobile Safari, enable streaming instantiation HOT 1
- the axes, units and orientations are incoherent
- Is this project abandoned? HOT 5
- Wasmer build ?
- Is this coordinate system integrated with the coordinate system of the physical world?Are the coordinates of threejs in millimeters?
- Is there any way place an object on click HOT 3
- Created a react-three-fibre R3F example HOT 8
- Problem with building dependencies and project HOT 3
- Hello, may I ask a question? HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from alvaar.