How to get evaluation results for DAVIS2016, YouTube2018 and MOSE? about sam-pt

[m43]

Hi! Thanks for your interest. You can download those datasets as described here. Then, you can run the VOS experiments as described here. To finally get the evaluation results/scores on the datasets you mentioned, upload the zipped results from the output folder (e.g., the eval_D17_val.zip) to the relevant evaluation server. At the time of writing this, the evaluation servers can be accessed at: YouTube-VOS 2018, MOSE 2023.

For DAVIS 2016, there is no online evaluation server, but I have now added support within this codebase. Please refer to
the evaluator script here as well as the snippet here. Note that the requirements.txt have been updated as well, so you might want to run pip install -r requirements.txt for the DAVIS 2016 evaluator to work.

[jameslahm]

Thank you!