GithubHelp home page GithubHelp logo

chengzhag / deeppanocontext Goto Github PK

View Code? Open in Web Editor NEW
86.0 4.0 12.0 77.72 MB

Official PyTorch code of DeepPanoContext: Panoramic 3D Scene Understanding with Holistic Scene Context Graph and Relation-based Optimization (ICCV 2021 Oral).

Home Page: https://chengzhag.github.io/publication/dpc/

License: MIT License

Python 100.00%
panorama ldif sgcn rgcn gcn deep-learning pytorch

deeppanocontext's People

Contributors

chengzhag avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar

deeppanocontext's Issues

Code run stuck at project build

It doesn't show any error. But while running project.py build command, it is getting stuck for long after giving the admin password.

Save First Stage Outputs, ValueError: all input arrays must have the same shape

ENV:conda env create -f environment.yaml

DATA: use Update data - Since iGibson has gone through a major update, their dataset download link has been updated. Please download the dataset here and follow the README to put the dataset into right places.

PROBLEM: Follow the README file. Run Training and Testing - First Stage - Save First Stage Outputs - CUDA_VISIBLE_DEVICES=0 WANDB_MODE=dryrun python main.py configs/first_stage_igibson.yaml --mode qtest --weight out/layout_estimation/<layout_estimation_id>/model_best.pth.
An error has occurred:
raise ValueError('all input arrays must have the same shape')
ValueError: all input arrays must have the same shape

How do I need to solve this problem?
Thank you.

Run on Colab

Hi, I am trying to run DPC on google colab, but it is just not working, can you please give a notebook that is running DPC on colab.

libGL.so.1.2.0

스크린샷 2022-04-12 오후 3 00 31

When i run python project.py build i get above message.
I reinstalled libgl1-mesa-glx and checked whether it is installed by apt-get list --installed but still there's no libGL.so.1.2.0 in /usr/lib/x86_64-linux-gnu

how could i solve it?

GLSL 4.5 is not supported

Hello, i got problem when i run rendering.

message is like this.
스크린샷 2022-05-08 오후 6 03 20

I tried to change versions with export MESA_GL_VERSION_OVERRIDE, export MESA_GLSL_VERSION_OVERRIDE, export MESA_GLES_VERSION_OVERRIDE but it didn't work.

And i don't have 'shader' folder in '/root/anaconda3/envs/Pano3D/lib/python3.7/site-packages/gibson2/render/mesh_renderer'

My environment is docker container of remote server.

Could you help me?

How to obtain the results of Total3d and Im3d?

This work is so excellent! I'm curious about how to obtain the results of total3d and im3d, as the layout they generate is a cuboid. Also, whether I can train total3d and im3d with current codes, or may you share their results? I want to learn how to combine several single-view results into a panoramic one.

Model weights for LIEN, LDIF and BEN modules

The provided links in the readme contain model weights for the detector, layout estimation, and relation_scene_gcn modules, as well as the total3D weights.

Would it be possible to also provide the weights for the LIEN, LDIF and BEN modules?

Many thanks!

Plans to release 2D detector code with fine tuning?

I looked into the code base and found that the 2D detector pipeline is unavailable.
I can see a comment that "Please follow Demo section to download weights for detector before we release full fine-tuning code for detector."

Is there any timeline for this?
If not is it possible for you to explain the steps if we want to upgrade it from detection or mask-rcnn to something else?
@chengzhag

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.