what is the video_source.json in /dataset/lmdb_dataset.py about coclr

[junmin98]

thank you!

[TengdaHan]

Sorry, it was my fault. I will update this part of the code later.

for UCF101, this video_source.json is a dictionary of source_name: source_id, like:

{"v_ApplyEyeMakeup_g01": 0, 
"v_ApplyEyeMakeup_g02": 1, 
"v_ApplyEyeMakeup_g03": 2,
...
"v_YoYo_g25": 2524}

The order doesn't matter, as long as you save it in json, and always use the same json file.

The purpose is to handle the "sibling videos" in UCF101 (and HMDB51) dataset, where the given 13K video clips are actually cropped from only 2.5K source videos. For InfoNCE (instance-discrimination like loss), isolating the 'sibling videos' makes more sense.

This process is not necessary, it's just for my ablation study in experiments. Also not necessary of Kinetics as each video is from a unique source.

You can create such a json file to continue. Or you can directly load the frames like https://github.com/TengdaHan/DPC/blob/master/dpc/dataset_3d.py, there is no difference.