Official PyTorch code of DeepPanoContext: Panoramic 3D Scene Understanding with Holistic Scene Context Graph and Relation-based Optimization (ICCV 2021 Oral).
Well done for the excellent work, I got the predicted result after following the demo instructions, and I wander to get the 3D interactive result as https://chengzhag.github.io/publication/dpc/ shows, which tool can I use plz
DATA: use Update data - Since iGibson has gone through a major update, their dataset download link has been updated. Please download the dataset here and follow the README to put the dataset into right places.
PROBLEM: Follow the README file. Run Training and Testing - First Stage - Save First Stage Outputs - CUDA_VISIBLE_DEVICES=0 WANDB_MODE=dryrun python main.py configs/first_stage_igibson.yaml --mode qtest --weight out/layout_estimation/<layout_estimation_id>/model_best.pth.
An error has occurred:
raise ValueError('all input arrays must have the same shape')
ValueError: all input arrays must have the same shape
When i run python project.py build i get above message.
I reinstalled libgl1-mesa-glx and checked whether it is installed by apt-get list --installed but still there's no libGL.so.1.2.0 in /usr/lib/x86_64-linux-gnu
I tried to change versions with export MESA_GL_VERSION_OVERRIDE, export MESA_GLSL_VERSION_OVERRIDE, export MESA_GLES_VERSION_OVERRIDE but it didn't work.
And i don't have 'shader' folder in '/root/anaconda3/envs/Pano3D/lib/python3.7/site-packages/gibson2/render/mesh_renderer'
My environment is docker container of remote server.
This work is so excellent! I'm curious about how to obtain the results of total3d and im3d, as the layout they generate is a cuboid. Also, whether I can train total3d and im3d with current codes, or may you share their results? I want to learn how to combine several single-view results into a panoramic one.
The provided links in the readme contain model weights for the detector, layout estimation, and relation_scene_gcn modules, as well as the total3D weights.
Would it be possible to also provide the weights for the LIEN, LDIF and BEN modules?
PermissionError: [Errno 13] Permission denied: '/home/anusree16/Dental/panorama diagnosis and 3D recon/DeepPanoContext-main/condaenv.syr0t84d.requirements.txt'
I looked into the code base and found that the 2D detector pipeline is unavailable.
I can see a comment that "Please follow Demo section to download weights for detector before we release full fine-tuning code for detector."
Is there any timeline for this?
If not is it possible for you to explain the steps if we want to upgrade it from detection or mask-rcnn to something else? @chengzhag