researchmm / sttn Goto Github PK

On a single RTX 3090. Is there a param I can adjust to make this work?

Thanks

Thank you for making this code available, it works great, however it downsamples the input to 432x240 as shown here:

w, h = 432, 240
ref_length = 20
neighbor_stride = 5
default_fps = 24

This obviously downsamples the output as well, resulting in a lower resolution result.

Can I run this on full size (HD, 4kUHD) videos and output the same resolution as input?

Can you also please explain what ref_length and neighbor_stride do, and when to change these values?

Thank you!

I tried to change the value of w and h in test.py file,but it returns me a RuntimeError.

can anyone explain why is it happening?
Thank you

Hi,

Could you share the code of calculating Ewarp? Thanks a lot.

Hello

I tried to make a model with the same performance as the model you shared.

As shown in the paper, New model was trained using youtube-vos data. (500000 iter)

after training, The model was trained using DAVIS data. (500000 iter)

Nevertheless, The trained model performs worse than the pre-shared model.

Why is the performance different? Are there any additional tunings that are not listed in the paper?

If there were any additional tunings, I'd like to know.

Best regards,
Son

@1900zyh @Sy-Zhang How can I train your model on the custom dataset, given that, I have a video folder and specific mask folder for every frame for each video? How to prepare the dataset for training?

hi there,

May I ask something about your data preparation? The structure of youtube-vos dataset is not like what you described in your project. There are folders for different video clips and no zip files. Do we need to compress each folders into zip files? Can you share the data preparation code for this? Thanks.

I trained several hundred sequence frames from a single video, and after running it overnight, it's only at 9514/500000.

Hello,

I am looking for the Davis-2018 from your link but all the datasets there do not have zip files. Currently, you code does not work for the Davis datasets.

Is it because they remove the Davis-2018 dataset, or is it because the link was incorrect? Either way, can you please check it.

Thanks,
Anh

i want ask the question about sample_length.
in your paper ,the sample_length is set 10，but in your code the sample_length is set 10 in the file "youtube-vos.json".

can you tell me what should i understand it ?

Hello, thanks for sharing your code.

I tried to fine-tune from pretrained model that you provide.
But I also need netD, optimG and optimD.

Can I get other models as well?

I am having this error, can anyone explain why is it happening?
Thank you

Hi,

I am trying to fine-tune your youtube-vos checkpoint on a custom dataset. I tried to resume training but the .pth file only contains the netG data. As a result of loading only the generator and initialising a new discriminator the training collapses instantly. I believe I require netD, optimD, and optimG from your training runs. Could you provide these?

Thank you very much for your time.