pavancm / greed Goto Github PK

Hello, Pavan.

I'm trying to reproduce cross-dataset test results for LIVE-VQA and CSIQ datasets from article "ST-GREED: Space-Time Generalized Entropic Differences for Frame Rate Dependent Video Quality". To do this I use code from repo and pretrained on LIVE-YT-HFR database model from repository ("model_params/bior22.model" and "model_params/bior22_params.mat").
I predicted scores and calculate SROCC for LIVE-VQA and CSIQ datasets. Results are shown in Table 1:

Table 1. SROCC for LIVE VQA and CSIQ datasets.

Despite the fact that we use the same code and model for cross-dataset test you can see our results differ from article noticeable.
Could you help and specify what we are doing in a wrong way? Code, csv files and instructions to reproduce our results in my repository.

Hello, Pavan.

I tried to reproduce results for GREED-bior2.2 model for individual frame rates on the LIVE-YT-HFR dataset (Table II from article "ST-GREED: Space-Time Generalized Entropic Differences for Frame Rate Dependent Video Quality). To do this I used code from repo and pretrained on LIVE-YT-HFR database model from repository ("model_params/bior22.model" and "model_params/bior22_params.mat").
I predicted scores and calculated SROCC for each frame rate group, results shown in Table 1.

Table 1. SROCC for individual frame rates on the LIVE-YT-HFR dataset

According the Table 1. model from repository shows better results then reported in a article. I guess it happened bacause I used for measurements model trained on full dataset. Please, clarify which model did you use (trained on full dataset or only part of them) to predict scores for experiment on individual frame rates?

Hi, The question is not about your code... sorry.

I'm reading your paper and your asset is really great!

I'm trying to study by some datasets, but recently... the old dataset like live-vqa or live-mobile or csiq-vqa can not be downloaded...

Somehow, there may some live download link and can you share it? thx.