owang / bilateralvideosegmentation

Implementation of Bilateral Space Video Segmentation [Maerki et al CVPR 2016]

BilateralVideoSegmentation

By Oliver Wang
[email protected]

This is a personal reimplementation of the method proposed in Bilateral Space Video Segmentation [Maerki et al. 2016]. Importantly, it was written for clarity of understanding, and is totally unoptimized (i.e. IT'S SLOW and uses a LOT of memory). Furthermore, it only partially implements the published method, featuring only multi-linear interpolation. For realistic timing and results to compare against, please refer to the material included in the original publication.

All code provide here is to be used for research purposes only. For questions regarding commercial use, including licensing rights and IP, you must contact the owner; The Walt Disney Company.

Note: If you use this software, please cite the following work:

Bilateral Space Video Segmentation
Nicolas Maerki, Federico Perazzi, Oliver Wang, Alexander Sorkine-Hornung
2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)

GRAPHCUT

This method also uses a third party GraphCut library. Please refer to the webpage for the most up to date information.

DATA

The datasets included originate from the FBMS-59 dataset. The datasets are provided only for research purposes and without any warranty. When using the BMS-26 or FBMS-59 in your research work, you should cite the appropriate papers in the link above.

C++ Implementation

Scott Wehrwein implemented a version of BVS in C++ for his project on foreground/background segmentation. You can find it here.

bilateralvideosegmentation's Issues

Implement three measures

Hello ,did you use the official code to calculate Region Similarity and Contour Accuracy? If so,I have a question about the official code "jaccard.py" file and the "f_boundary.py" file.But I don't know what the input parameters of the db_eval_iou function of the'jaccard.py'file and 'db_eval_boundary' function of the 'f_boundary.py' file should be? Thank you!

Pytorch version

Hello ,Are you going to implement it with pytorch? Because I am not very familiar with matlab, so I would like to ask if you have a pytorch version?Thank you!