Comments (6)
Hello! Are you conducting experiments with data that you directly possess? That's impressive.
I'd like to try 3D reconstruction with my own data as well and was wondering if I could seek some advice.
The BundleSDF website mentioned that depth, color, and mask images in PNG format, along with the camera intrinsic matrix, should suffice. So, I prepared those and attempted to run it, but encountered an error.
I'm starting to think that perhaps point cloud data is necessary. The reason being, in the milk example, there was a point cloud text file named 13985298.ply. How did you prepare your input data?
from bundlesdf.
Hello! Are you conducting experiments with data that you directly possess? That's impressive.
I'd like to try 3D reconstruction with my own data as well and was wondering if I could seek some advice.
The BundleSDF website mentioned that depth, color, and mask images in PNG format, along with the camera intrinsic matrix, should suffice. So, I prepared those and attempted to run it, but encountered an error.
I'm starting to think that perhaps point cloud data is necessary. The reason being, in the milk example, there was a point cloud text file named 13985298.ply. How did you prepare your input data?
Hey there!
In my knowledge there is no need for any point cloud file, I would suggest you to really check that all folders are named correctly as the milk example, that rgb files have the same name as their respective masks and depth images, and that you provide a copy of the first frame mask named "mask.png". What is really necessary is: /rgb /depth /masks /cam_K.txt and /mask.png
I am recording my own dataset using a Kinect Azure camera, and I transform the depth images to match the rgb images calibration. I get the masks using MiVOS because I had problems running the suggested method on my machine.
I suggest you to open a different issue for your own error message if you still do not find the solution to it. Have fun!
from bundlesdf.
Oh!! Thank you for your help! I didn't locate the mask.png in the directory that you said. I will do that.
In my case, I got the masks images by using FastSAM Algorithm. Thank you !
from bundlesdf.
BundleSDF should work pretty well on synthetic data. For debugging, to begin with, increase debug level higher for more verbose loggings. You can then check if the feature matching makes sense.
from bundlesdf.
Hello, I have been testing BundleSDF on Blenderproc generated images and I still encounter problems.
Since I have been using a standard script for the bop challenge train data generation I believe the camera calibration matrix has to be correct. I modified the above script to generate contiguous images rather than scattered ones.
To make it run I have to set zfar = 7 (or more), even if the object is way closer in the captures; from the gui the pose axis are very small, forming a point, and at time it has to generate the first 3d reconstruction mesh it goes in a "limbo" saying "[bundlesdf.py] Getting mesh". Increasing the debug level has not been helpful.
When changing the camera calibration matrix increasing the focal length values I can see from the pose axis get bigger, and then unfortunately my gpu goes out of memory for generating the 3d mesh.
Is there available a synthetic dataset as example that I can test for BundleSDF? Something like the real milk dataset...
from bundlesdf.
you shouldn't change the camera intrinsic as that will hurt the performance. If you want to increase the size of the viz axis, change the "scale" and "thickness" here.
Also, what size is the dinosaur, seems very big? There are some params in the current implementation that assumes the size of a common daily-life object. If your simulation asset is overly big, consider rescale it.
from bundlesdf.
Related Issues (20)
- How can I make mask images from my custom rgb data? HOT 1
- How to replicate inference speed mentioned in paper? HOT 1
- cp: cannot stat 'nerf_with_bundletrack_online/image_step_*.png': No such file or directory HOT 1
- Adding Segmentation Wrapper HOT 1
- How make custom data? HOT 16
- Pose file missing: {video_dir} HOT 3
- after ransac, frame 229 and 151 has too few matches HOT 7
- Update README and Add Crucial Information
- [WARNING] batch has 0 intersections!! HOT 1
- Error while Building bash build.sh HOT 1
- ImportError: libQt5Core.so.5: cannot open shared object : my_cpp HOT 1
- error setting up docker container HOT 5
- If I run custom data, how many RGBs and depths do I need? HOT 1
- error running run_custom.py on milk dataset. HOT 7
- When run_custom.py, No CUDA GPUs are available HOT 1
- connection reset by peer HOT 1
- run_custom.py stops executing after processing a few images in BundleSDF Docker environment
- GPU requirements to run Bundle SDF HOT 1
- Unable to build docker HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from bundlesdf.