GithubHelp home page GithubHelp logo

hybridstereonet's Introduction

HybridStereoNet

This repository contains the code for our MICCAI 2022 paper Deep Laparoscopic Stereo Matching with Transformers [arXiv]

alt text

Requirements

Environment

  1. Python 3.8.*
  2. CUDA 10.0
  3. PyTorch
  4. TorchVision

Install

Create a virtual environment and activate it.

conda create -n hybristereo python=3.8
conda activate hybristereo

The code has been tested with PyTorch 1.6 and Cuda 10.2.

conda install pytorch=1.6.0 torchvision=0.7.0 cudatoolkit=10.2 -c pytorch
conda install matplotlib path.py tqdm
conda install tensorboard tensorboardX
conda install scipy scikit-image opencv

Install Nvidia Apex

Follow the instructions here. Apex is required for mixed precision training. Please do not use pip install apex - this will not install the correct package.

Dataset

To evaluate/train our network, you will need to download the required datasets.

Prediction

You can evaluate a trained model using prediction.sh for each dataset, that would help you generate *.png or *.pfm images correspoding to different datasets.

sh predict_scared.sh
sh predict_davinci.sh

Evaluate Tool

Use the file 'main_all.m' in eval folder to evaluate your model. Download our pre-trained model via this link: snapshot.

Acknowledgements

Citing

If you find this code useful, please consider to cite our work.

@inproceedings{cheng2022laparoscopic,
  title={Deep Laparoscopic Stereo Matching with Transformers},
  author={Cheng, Xuelian and Zhong, Yiran and Harandi, Mehrtash and Drummond, Tom and Wang, Zhiyong and Ge, Zongyuan},
  booktitle={MICCAI},
  year={2022}
}

hybridstereonet's People

Contributors

xueliancheng avatar

Stargazers

Sissi avatar sx123 avatar  avatar mings avatar ZhangAng avatar  avatar  avatar  avatar  avatar ZhaohuaiLiang avatar yuhan avatar

Watchers

Zongyuan Ge avatar Yiran Zhong avatar  avatar

hybridstereonet's Issues

mean depth error for scared2019

Did you calculate the mean depth error for scared2019 just using the disparity ground truth and estimated disparity map from HybridStereoNet? I think it is really hard to transfer the disparity back to depth for scared dataset :(

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.