GithubHelp home page GithubHelp logo

Comments (8)

lvmingzhe avatar lvmingzhe commented on September 1, 2024 2

I solve this problem by following thien94/orb_slam3_ros#7 (comment)
change RGB.DepthMapFactor to 1.0 in TUM<version>.yaml

from nerf_bridge.

javieryu avatar javieryu commented on September 1, 2024 1

Looks like your images are grey scale? Maybe this has something to do with it?

Can you give some more details on your setup?

Also, due to issues with the Nerfstudio Viewer there is no easy way to update the image locations in the viewer as they come in. So while images and poses are being added to the training set they may not appear in the viewer.

from nerf_bridge.

Eric-Ho-Matrix avatar Eric-Ho-Matrix commented on September 1, 2024

Looks like we are facing the same problem. My implementation also have this prob, Nerfstudio basically stuck at the first several images and I also cannot get a fairly good model.

from nerf_bridge.

bharath-k1000 avatar bharath-k1000 commented on September 1, 2024

Hi, I am also facing the same issue. The input image stream is not graycaled for me but i am getting the same result in viewer. the topic /camera/color/image_raw has rgb image data and is written correctly in the .json file.

I am using an an Intel realsense d435 rgbd camera (no imu).

image

Orbslam3 seems to be working fine seeing the the features that are tracked and the pointcloud. But nerf generation seems to be stuck.

  • ros 1
  • ubuntu 20.04.

from nerf_bridge.

bharath-k1000 avatar bharath-k1000 commented on September 1, 2024

UPDATE:
Issue was resolved by changing the camera parameters in the .json file.

from nerf_bridge.

lvmingzhe avatar lvmingzhe commented on September 1, 2024

I'm sorry for replying in a closed issue, because I encountered the same problem. The dataset comes from tum_rgbd_dataset_freiburg1_xyz, and I used thien94 orb_slam3_ros for pose estimation, configuring the corresponding ns_orb3_tum.json

{
	"fx": 525.0,
    	"fy": 525.0,
    	"cx": 319.5,
    	"cy": 239.5,
    	"k1": 0.0,
    	"k2": 0.0,
    	"k3": 0.0,
    	"p1": 0.0,
    	"p2": 0.0,
    	"H": 480,
    	"W": 640,
	"image_topic": "/camera/rgb/image_color",
	"pose_topic": "/orb_slam3/camera_pose"
}

After then , I continue to run by step 1 .

roslaunch orb_slam3_ros tum_rgbd.launch

step 2 .

rosbag play ~/data/rgbd_dataset_freiburg1_xyz.bag

step 3.

python ros_train.py --method_name ros_nerfacto --data /home/hello/code/nerf_bridge/ns_orb3_tum.json --pipeline.datamanager.data_update_freq 1.0

finally got this result looks not good.
Screenshot from 2023-11-01 12-19-09

could you please give me some suggestions? Thanks.

from nerf_bridge.

Augusthyq avatar Augusthyq commented on September 1, 2024

UPDATE: Issue was resolved by changing the camera parameters in the .json file.

Sorry, I have encountered the same problem. How you change your json file?

from nerf_bridge.

javieryu avatar javieryu commented on September 1, 2024

@Augusthyq Happy to help if you can open up a new issue, and include your setup details.

from nerf_bridge.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.