adymaharana / storyviz Goto Github PK

To author,

First of all, on behalf of our lab member who published the original Pororo dataset (K.M. Kim), we very much appreciated that this dataset is still alive and being researched.

We are trying to reproduce your achievement. However, struggling to find mimicking your best performing setting.

Is there any way to receive your best-performing checkpoint file or detailed settings?

Of course, If you don't mind. I hope it is possible.

Your work inspired us to a generative model for story visualization on a realistic drama dataset.

Best wishes,

Hello, I hope your research goes well. 😀

I am trying to evaluate the metrics that you proposed for my model.

I have read your paper. However, I am asking you to double-check.
(my results seem a bit odd and off the scale, that's why 😢)

1. I presume that the "character F1" score represents the "micro avg" of F1 score outputs from your eval_clasifier.py code? Am I correct?
2. also, "Frame accuracy" represents "eval Image Exact Match Acc" outputs from your eval_classifier.py code?
3. are BLEU 2 and BLEU 3 scores scaled by 100? I have tested your translate.py code with my generated images, and I've got about 0.04-ish scores. are the BLEU scores you reported multiplied by 100?
4. Lastly, It is unclear about the R-precision evaluation method. Do I require to train your code (H-DAMSM)? if so, when is the right time to stop the training and benchmark my model?
5. To fair comparison, is it possible to be provided your H-DAMSM pretrained weight?

I am currently stuck on the R-precision evaluation using H-DAMSM. So, I was thinking of utilizing the recent CLIP R-Precision instead, but I am leaving this issue to avoid a fair comparison issue.

Hi, thank you for your nice work!
Currently, I've been reproducing your paper.

I think you're using label(crnn_code) and glove embeddings(zmc_code, m_image) to create the images in your implementation.
But I can't find explanation about this part in your paper.

Can you give me more explanation for this part?

Hi!

I've been trying to reproduce results from your code, especially H-DAMSM.
I've trained DAMSM using the code on GitHub and done eval, but I only get 2.38 ~ 2.4.
Would it be possible for you to upload the pretrained weight to use for eval_damsm?
Thanks.

Hello,

I am trying to publish a survey paper, and I would like to use a picture from your paper. If you allow, I will use it with proper citation to your work.