yunseokjang / tgif-qa Goto Github PK

View Code? Open in Web Editor NEW

166.0 10.0 31.0 28.22 MB

Repository for our CVPR 2017 and IJCV: TGIF-QA

Home Page: https://arxiv.org/abs/1704.04497

Python 99.74% Shell 0.26%

tgif-qa cvpr2017 snuvl

tgif-qa's People

Contributors

Stargazers

Watchers

tgif-qa's Issues

Why count answer zero is changed to one

I happen to notice that you use max(count_answer, 1) here code/gifqa/data_util/tgif.py#L561 but don't know why.

If one gif contains no action mentioned in question, the answer should be 0, right? Is there any reason changing them to 1?

Error in vocabulary build_word_vocabulary

There is some issue with the shape of GloVe Embeddings.

Traceback (most recent call last):
File "main.py", line 85, in
train_dataset.load_word_vocabulary()
File "/scratch/tgif-qa/code/gifqa/data_util/tgif.py", line 252, in load_word_vocabulary
self.build_word_vocabulary()
File "/scratch/tgif-qa/code/gifqa/data_util/tgif.py", line 235, in build_word_vocabulary
glove_matrix[i,:] = w_embed
ValueError: could not broadcast input array from shape (384) into shape (300)

Many gifs became still image while downloading from tumblr website

Hey, I found many gifs (more than 400) became still image on the tumblr website. Could you please provide those gifs for me? I tried to download the full dataset you provided on google drive, but always fail in the middle.
Here is the list:

tumblr_nqa8kpJ28P1r0hymco1_500
tumblr_nqa92zfUuY1uo2r7co1_400
tumblr_nqab0wzoyq1t98cbqo1_400
tumblr_nqjl8p68Ft1uz4ineo1_400
tumblr_npw3h65qN71twysaxo1_500
tumblr_nouxzfHgR11tkjp94o1_400
tumblr_nowxhfreoz1uwapufo1_400
tumblr_nowxr7kf0X1smq60jo1_400
tumblr_npmrt3kO7F1txf2foo1_1280
tumblr_npdhmsfayB1u5ml0wo1_400
tumblr_nr05tkyNtE1t0064ko1_400
tumblr_nox1smukOI1uvg7kmo1_400
tumblr_npmzcaH9bz1tswawvo1_250
tumblr_nranz7Vvkl1raisoho1_400
tumblr_nqcfca6hFy1tcrtyjo1_1280
tumblr_nqcfxbwMGn1up5kzbo1_400
tumblr_nq633lMPQh1rnuzruo1_400
tumblr_np1fcoFOlv1uvji5qo1_400
tumblr_nozo2ff5g41uuaoa4o1_400
tumblr_npg7ozUkys1s4vbbto1_400
tumblr_nnwtgqZpuf1s6co56o1_1280
tumblr_nqs4h273St1u6xdzqo1_500
tumblr_np8k98KT2M1sj72eqo1_500
tumblr_np8kp4JDUN1uqszayo1_400
tumblr_non3inR37F1u70170o1_1280
tumblr_nog61m2k0d1uvusqco1_400
tumblr_nog6bvL1G81stry9wo1_400
tumblr_nog7op1khd1smkeb0o1_400
tumblr_nparxho0yg1uxqfano1_400
tumblr_np8xlxduuI1txfzvjo1_400
tumblr_npwhkgv0Ua1uyrxm6o1_1280
tumblr_npyi2u0bA31uyv03qo1_1280
tumblr_nrcp0gkfgL1uatiybo1_400
tumblr_nrffoq0mbD1tvfaxko1_250
tumblr_np4u6wzN371u8z861o1_500
tumblr_nqicu5p0fZ1txltu2o1_1280
tumblr_nqiczmKcFb1ti0zpvo1_400
tumblr_nqwo12bqAS1ua5q7mo1_400
tumblr_nqegtcoxIf1tmlv8uo1_500
tumblr_nqehfbLHhN1upuvato1_1280
tumblr_nprpm1WJLb1uxtn9jo1_400
tumblr_nporxaxbV71qg93wno1_500
tumblr_nq1w4yaqVJ1tts6nbo1_400
tumblr_noi766KBk11uu34ubo1_400
tumblr_nn91q1Yoa01uqzp8co1_500
tumblr_nr5z5kk0O21tgwi2no1_500
tumblr_nr61n6fLpi1sgol7yo1_500
tumblr_nnn4nnCdCF1uo6n5uo1_400
tumblr_nqqe0dUvZR1qzrn3do1_1280
tumblr_npmkkzNLfT1s13fhgo1_400
tumblr_npl2lhUenz1u06vd6o1_400
tumblr_nnwyjbyYgb1u7mcn7o1_400
tumblr_nolqbkpbUm1slkecdo1_1280
tumblr_nolr6euiBS1qlxr0ao1_500
tumblr_noir64SdLq1teaksdo1_500
tumblr_no7hrxy62A1uv9g67o1_500
tumblr_np717e457z1uwcbj4o1_500
tumblr_np72g1BTQz1ts2x08o1_400
tumblr_nq40aiJUda1t0064ko1_400
tumblr_nq41nwwBso1tiib1xo1_1280
tumblr_nqfdo5ccsp1qzybkjo1_1280
tumblr_nrfvc7XSb21ub2dnbo1_400
tumblr_np48tpIwuX1rkmw6go1_400
tumblr_nrimlu2e2b1ua1d3fo1_1280
tumblr_nq5z0cwIMk1tq0lgpo1_400
tumblr_no8omsLz1x1tc0mj3o1_400
tumblr_no8or63Msj1uo8ec3o1_1280
tumblr_now750NfPA1utp7lmo1_1280
tumblr_nqrkoxkasJ1t0064ko1_400
tumblr_no48ouf2pp1ushktro1_500
tumblr_noym6cnA5o1uwe1o1o1_500
tumblr_nq6eunR08d1uy0bo0o1_250
tumblr_nqlzy9MurZ1urinkoo1_1280
tumblr_nnzsaas2KB1utchhuo1_400
tumblr_npppobGReE1uy0yxso1_1280
tumblr_np63hahUN91uoremho1_500
tumblr_np63mztSih1trl78to1_400
tumblr_np2n3mRwXM1u9jjryo1_250
tumblr_nnxzyiwUF61rg5eyuo1_250
tumblr_nnxm8rgd1w1uult4po1_500
tumblr_nq2beylTG61tjyg1po1_400
tumblr_nof2egfi8z1snivu4o1_400
tumblr_nnxp53v0w01uult4po1_500
tumblr_nogzp5lV3l1s8ggjbo1_500
tumblr_noh2a8LRmw1qc6osco1_500
tumblr_noh5mmIdrN1qit4lao1_400
tumblr_noh79e1MbL1rlga9no1_400
tumblr_nqzga64u6f1uyh3jfo1_500
tumblr_nqzi9iG59o1u3ipolo1_500
tumblr_nqhx471OUV1sejiemo1_250
tumblr_nqhx6fiVQD1sejiemo1_250
tumblr_nqi1dl9P8E1riy28ao1_500
tumblr_nqi1mbyaPO1shch57o1_400
tumblr_np2hjt1K7P1u80ayeo1_400
tumblr_nqj4l01AgJ1uot34no1_500
tumblr_nqjlycaM8o1uzpxafo1_400
tumblr_noivj0AoU81sy2xtuo1_1280
tumblr_np67ocMEEZ1u11fcoo1_500
tumblr_np7zpfSrai1u9rhv2o1_400
tumblr_np82fl4PhA1t5c60so1_1280
tumblr_np82o2gsN21tq0lgpo1_250
tumblr_nqd0saY9331qg25mto1_1280
tumblr_nnwc0csXPL1utrmmco1_400
tumblr_npax48inl61tf42s3o1_400
tumblr_nrh018oP161uyh3jfo1_500
tumblr_nrh40e4A8g1u7wuaxo1_250
tumblr_npgfwo7iDj1uxvg2vo1_500
tumblr_nqiohqvizm1unphlzo1_400
tumblr_nqioxjv5qd1sju1lao1_400
tumblr_nnw0biFvqH1uqvgl9o1_500
tumblr_no500z0twd1rbeu21o1_500
tumblr_nqbxjqQyLr1rw3i65o1_540
tumblr_no5cojtMzA1rma2i5o1_500
tumblr_nq3p0uFnTE1sqkwx4o1_500
tumblr_nq3qf4WRTo1ttvngao1_400
tumblr_npt8wnCwZb1s98rodo1_1280
tumblr_nqg9ypO5Im1syzglso1_400
tumblr_nnulmeESVw1qmvdldo1_1280
tumblr_nnunhrJl321u4f3j0o1_540
tumblr_nqnu7yB49O1uvfrymo1_500
tumblr_nqvsiiyvVP1svbxxro1_400
tumblr_nqvwbzv5Qe1unjpw8o1_1280
tumblr_np0hekkwPr1ut94sdo1_1280
tumblr_np0hff02An1uwcuefo1_400
tumblr_np0hneMrSV1upuq3uo1_400
tumblr_npbwdbjrrp1ur6n5ro1_1280
tumblr_npbdp6bcaJ1uuzepto1_540
tumblr_npbei88cpA1ssanfxo1_1280
tumblr_npw5k7PQNQ1u2h47bo1_1280
tumblr_nov02kT1xH1u8uc8no1_500
tumblr_nov07gwT1k1sm8v7ko1_540
tumblr_notrgvZmX91urtap0o1_1280
tumblr_nr0u0kubW91r8gz6wo1_400
tumblr_nr0w51AI8n1ur7v4wo1_400
tumblr_no95i8C1ti1s2dc17o1_500
tumblr_no7w1navuU1r3h6fpo1_1280
tumblr_no7wqm3NxU1sazxqfo1_540
tumblr_nop6o7rdub1u2t292o1_500
tumblr_np7fh58gpz1sgspq1o1_1280
tumblr_nr6ue8Gysf1uax109o1_400
tumblr_npyfceJ8OM1uqie69o1_400
tumblr_np2xurbKbe1rkr23zo1_1280
tumblr_nodncmZjlN1u7d548o1_250
tumblr_np0ql1O83a1uwibuqo1_400
tumblr_np0qpwyFyt1r034fqo1_500
tumblr_nobgglzsfL1u2jj66o1_1280
tumblr_np0tbioGZB1ttb2lto1_400
tumblr_np0uonyUu41upjtcxo1_500
tumblr_nnuotnTHxq1tf1c9jo1_1280
tumblr_nqysynFSaF1u77qp2o1_400
tumblr_nox02wWInU1u49y74o1_400
tumblr_npiqcl2sKG1t1hh1xo1_500
tumblr_nolk2pABbf1uw2x5mo1_400
tumblr_nollsdsfZs1sm6bgxo1_400
tumblr_nq454sbls61sq33zgo1_400
tumblr_nqrdi3oioz1uwrx44o1_400
tumblr_nqdrddlD8j1usym2ao1_1280
tumblr_npykfaJyuX1uxg9xuo1_400
tumblr_nnxllqXTxD1rsstuso1_400
tumblr_nou8akLGpU1uuldj2o1_1280
tumblr_nr2gcleOTe1r0k4v3o1_400
tumblr_nqumc52Qye1r8241no1_1280
tumblr_nqwv431H7o1uwm3j4o1_1280
tumblr_no5wjgSdX81r9u6tio1_400
tumblr_nokcmgzVGP1uw2k22o1_1280
tumblr_nokguxjlIw1slghnno1_1280
tumblr_nrdqk77T591tee40mo1_500
tumblr_nq92uaE0Ws1u97vumo1_500
tumblr_nr8ss4tZby1upmupqo1_400
tumblr_nr8t7vGhSs1r0oc8oo1_400
tumblr_nr9b5hJxSx1tkfl8so1_400
tumblr_nqld7thvBM1s4s664o1_250
tumblr_notls4djIA1uvf4upo1_540
tumblr_nqmn90unbd1sq46e5o1_500
tumblr_nozj65EqE61sar5kpo1_400
tumblr_nozrevSeu31t9t6t8o1_500
tumblr_npzm7diHSy1rb8azao1_400
tumblr_nqycwaN0Fr1u3sbalo1_1280
tumblr_nr4jhuUm6W1tv83v7o1_400
tumblr_nnr48qR3nk1unabzvo1_500
tumblr_nq20nqCox81swxwrio1_250
tumblr_noxzqn5lci1ti9japo1_250
tumblr_nqbg3vRgWa1qcbf4ko1_500
tumblr_no19jclKZB1trhwemo1_500
tumblr_nokuphzOet1usrn2oo1_1280
tumblr_nokwnxdqgJ1u4ud27o1_400
tumblr_nprjpqx0jr1u6z7i8o1_400
tumblr_nprkfzdYJ71rfwqzdo1_250
tumblr_nokxr9v5P31tzux1fo1_400
tumblr_np5aeisynX1ursvqzo1_250
tumblr_noz20tVYIb1sm8v7ko1_400
tumblr_np4i92IYCt1urperso1_500
tumblr_nntudtAaa81s6ooqoo1_400
tumblr_nrj3ihiSvs1u2xxbqo1_1280
tumblr_np9uiw7hro1r924z0o1_400
tumblr_np9vipnxMF1urniueo1_1280
tumblr_nqlep4zKF61uzy6gko1_400
tumblr_nqh7k8DjpP1qjxwfko1_400
tumblr_nqh8bfUsKo1uykzwfo1_1280
tumblr_npy3h9OiQ41tflhxqo1_400
tumblr_nnykedg4vt1rn0z6wo1_500
tumblr_nognswAtum1stry9wo1_400
tumblr_nn0wlydgs81spn3uuo1_1280
tumblr_npom22SXGD1uqjbbzo1_500
tumblr_npij1bVNFB1qa6eu8o1_400
tumblr_np73ksLFto1up2gfro1_1280
tumblr_npdyds3mz21s4ethvo1_250
tumblr_np2u2b9eiK1ro0b43o1_400
tumblr_np2wcmCk9N1uukdnyo1_500
tumblr_npd6ecq8ww1u70170o1_1280
tumblr_nqa0feJ26O1uz195qo1_250
tumblr_nqqjbyMaDd1u06vd6o1_400
tumblr_nqebh7fsYa1uysa2ko1_500
tumblr_nnjr55Sew61rih249o1_1280
tumblr_noa179XO571s6ooqoo1_400
tumblr_nnyc2hd2dK1qdalrdo1_400
tumblr_nri9eoiO4W1ub5mxzo1_1280
tumblr_noar3qE9K51uv3xsqo1_400
tumblr_nqz29cznTG1ua9421o1_1280
tumblr_nqz2rd3kpm1ur7v4wo1_400
tumblr_noy1x3C0V11u4sgz6o1_540
tumblr_nocpx0jJvu1qjqfp9o1_540
tumblr_noc9geoczx1sooindo1_400
tumblr_nrdqwaTjai1tdpxx5o1_400
tumblr_nrdutikHSx1rqqgwvo1_250
tumblr_nq7z3tOyfB1tiwzhgo1_400
tumblr_nnzn0mUdZ51u7wgb5o1_500
tumblr_nre2dtB8up1sb4xq3o1_500
tumblr_noncxqWEEB1takfp9o1_400
tumblr_nqrobgulEs1re33kmo1_500
tumblr_noj3k2xFsP1u68mfwo1_500
tumblr_nor4t9DHFT1u8ypt9o1_400
tumblr_np189opV7g1u3umtco1_400
tumblr_np18n1Zurh1ttb2lto1_500
tumblr_np12zwjszw1u2qf2vo1_540
tumblr_nnspxto6IE1unratto1_400
tumblr_no5amocSCm1s7uggpo1_400
tumblr_no5bdczvSh1u70170o1_1280
tumblr_nqesuz7X9R1sy7j45o1_500
tumblr_npq3thHo5S1uo8loqo1_500
tumblr_nqlksbvbeD1shvaeko1_400
tumblr_nqlktjsBpR1shvaeko1_400
tumblr_nqlkzce30U1shvaeko1_1280
tumblr_nog36fPGeC1tt3ftxo1_540
tumblr_no52aowzox1tt7td8o1_500
tumblr_no53ugbHL61uvps8zo1_1280
tumblr_no5608VhHc1tgym8oo1_400
tumblr_nohkwrLfBs1ttb2lto1_500
tumblr_npvnj342GZ1qkwecbo1_1280
tumblr_no1mk7jC1j1tte9oio1_250
tumblr_np9671Zarr1qznhdjo1_500
tumblr_np96a0eGo61ux9jido1_1280
tumblr_nptoirr6Me1ux9jido1_1280
tumblr_nptsxeDxko1ux9jido1_1280
tumblr_npnb10DaOf1u8892fo1_500
tumblr_npnd6xHr331t1simuo1_500
tumblr_nq0fj1zpNg1uo3vbto1_400
tumblr_npvewb06H01ti4lp9o1_400
tumblr_nnv08x3fSe1uuvdemo1_500
tumblr_nq79aizJK41u835uxo1_250
tumblr_nqnddn2uoH1shvaeko1_540
tumblr_nqogvkdmyx1s3lk8no1_500
tumblr_nqoi7ncYqo1spdvygo1_1280
tumblr_nmx75bnnEM1qduelco1_1280
tumblr_npzqokrmw91s95u3zo1_500
tumblr_npzronrVMY1u66yx8o1_500
tumblr_nobdkvZm1S1u68mfwo1_400
tumblr_nqjuk8ssUF1sfdocho1_500
tumblr_np6gvu5QX21tkpyreo1_1280
tumblr_npocif4CCm1syc98fo1_1280
tumblr_nopspuF2Jg1tqqv0to1_400
tumblr_nrhn6zwlEr1sanuypo1_540
tumblr_nq16mlAxiu1r7nemso1_400
tumblr_nq17llk2YT1uxdlnuo1_400
tumblr_nq17ueZtBz1s4k0fvo1_1280
tumblr_noejztaoSQ1uor0a9o1_400
tumblr_no210tsXYI1uustmho1_250
tumblr_noqbgzPPKy1uqjd48o1_400
tumblr_nr46r1Zrlu1s1d6t0o1_250
tumblr_npr751fIwq1u9dtmbo1_500
tumblr_npyvbgaBg61u3d2byo1_400
tumblr_noxl9kTfEI1u5s46jo1_400
tumblr_noxlbh3ULj1u5s46jo1_400
tumblr_nql2xt5ygM1uvfrymo1_1280
tumblr_nqg5vnGn1w1s9rf43o1_540
tumblr_nr4hcmYFmH1qiccsao1_250
tumblr_no033iSCZx1uukv0po1_1280
tumblr_no07er1Yha1tjxvtio1_500
tumblr_npsxjeU8ce1s1qebao1_1280
tumblr_nqvfd5OGQa1t06nsto1_400
tumblr_nq5l82WOKa1uyyysvo1_400
tumblr_nolo01Ziyk1qazfvuo1_1280
tumblr_nolojmhtzU1sqc2mro1_500
tumblr_nok4aigsr11tj9klzo1_500
tumblr_nq6rconZPJ1tok87ko1_400
tumblr_nqco3jFSF81uw00xxo1_400
tumblr_nr7jo1ffwm1rpq318o1_1280
tumblr_nqcy30Sisb1rxqsz9o1_100
tumblr_nqdjucbnhq1tsvcp0o1_250
tumblr_nq8qkwsCRV1unmhjqo1_400
tumblr_npccvpffm31spckwqo1_250
tumblr_npy6sanymx1u879vqo1_540
tumblr_nnyggjT0it1trb8sgo1_1280
tumblr_nqu7nbSRoQ1taw097o1_400
tumblr_nr6k6aa1Pd1spbv5go1_400
tumblr_no4czdLnmS1tnjsjuo1_1280
tumblr_nqdkj0pnGP1tep87wo1_1280
tumblr_nqkd9cXsgj1sd2bbjo1_1280
tumblr_nor29wdCtB1rxflw5o1_500
tumblr_npwlnebOjO1t0mit8o1_400
tumblr_m354soOAOa1ruihdoo1_1280
tumblr_no3x882i1f1u9ac4mo1_500
tumblr_norn6lYGG91uvqdo0o1_1280
tumblr_nqqbkgtUNI1uzwezco1_400
tumblr_nqqcj7OjiE1s3lk8no1_400
tumblr_npq9w2jwBr1t34lv1o1_1280
tumblr_np5w6bOVR51qjl2ero1_400
tumblr_nok7dvLEZQ1uw2vw2o1_400
tumblr_nqx07iAMJx1utuahso1_400
tumblr_no0tcjD1qk1rw8qrqo1_400
tumblr_npx4dmCaFp1rvzeseo1_1280
tumblr_npot3fkPzJ1rhxpnlo1_500
tumblr_noo161Popf1sb8yrbo1_1280
tumblr_npk14upd9J1u2jj66o1_250
tumblr_npt2v37xOb1urgccyo1_500
tumblr_nq2w5drOgK1rstl54o1_400
tumblr_np0k80S6HA1u4rbixo1_1280
tumblr_nqbawrQvKb1s38mcio1_400
tumblr_nqbb0pGYku1uz3smwo1_500
tumblr_no3fpqFDEO1tf5mi6o1_400
tumblr_nrdncmoCpe1ualu96o1_400
tumblr_nnxr3cggLG1twl8nio1_400
tumblr_not2ym8p3q1svr970o1_400
tumblr_nrkh4se9Hc1sobwxho1_400
tumblr_np8ubgzGD61up2gfro1_1280
tumblr_npp0x9OhYp1rnq7bdo1_250
tumblr_nq5s6r5i1K1tfolcco1_250
tumblr_npub6kWZCf1tklsdto1_1280
tumblr_nn4l5wIVR61tfw7jko1_500
tumblr_nr2x4b9fvR1uxhvxvo1_500
tumblr_noc4si23uS1rmkne0o1_1280
tumblr_nqi52jvH8Z1r1c0dgo1_500
tumblr_nqo9lqTOAR1r3upeoo1_400
tumblr_noeau6NlNH1sb01bko1_1280
tumblr_noemu6lD091qjvxb6o1_1280
tumblr_nofymz3rWS1u7ab97o1_500
tumblr_nq5mn9We8r1uq9gv1o1_400
tumblr_nq5mx9vUiY1upu2teo1_400
tumblr_nq5ouiq3Ub1sf48t6o1_400
tumblr_nqn0x0UXMh1tc7o0io1_400
tumblr_nocn7vsUKO1u66yx8o1_1280
tumblr_nocnl22VaN1upghyto1_1280
tumblr_npdysqRzec1r4c4nxo1_400
tumblr_np9e24htxP1qcifk3o1_250
tumblr_no7tba48ea1s29852o1_540
tumblr_no7te7Yl6F1uq31tfo1_500
tumblr_nqr8fvbChQ1u0ql9oo1_500
tumblr_nqra6zCLTW1uziz01o1_500
tumblr_nozf3m1Tg01uwcp6so1_400
tumblr_no9vymHbVZ1s6ooqoo1_400
tumblr_nqmakaFv8M1u5ztyeo1_400
tumblr_nogu4mpgZ61u919odo1_500
tumblr_npsdjsGPDw1qgijzxo1_250
tumblr_npse0rkOip1tq0lgpo1_500
tumblr_nqy208PG8y1qjqfp9o1_540
tumblr_np8g17BQFX1rmr8uvo1_400
tumblr_nnwhxfEZnX1svsdz7o1_250
tumblr_nnwim83Mr01tcatgyo1_1280
tumblr_nq23zwU3Ro1us31coo1_400
tumblr_nrjddwWAuk1tjp76ho1_400
tumblr_nrjdm7kPnx1s1fidvo1_400
tumblr_nq1glqEfta1qj8eq4o1_400
tumblr_noyvx0fh9K1s3ojtko1_1280
tumblr_nor8ojN1vx1u80ayeo1_400
tumblr_norbpuuzGX1uw9lnzo1_400
tumblr_npzvuvyaMc1uyxp8zo1_400
tumblr_npzww7ERSE1t4azjzo1_400
tumblr_npzos5UBS81rw64pgo1_400
tumblr_npjgiqpFYY1rg2ligo1_250
tumblr_npdn3rrE1A1uwmv9po1_500
tumblr_npdnztW5De1uu79wmo1_400
tumblr_nnp8dwy1kt1qzccaro1_500
tumblr_nqxrq2ObHU1upic9lo1_1280
tumblr_nqtb0mxfM71tr3sg9o1_400
tumblr_npuen7g2w61ri27aeo1_1280
tumblr_npelz9zE4s1r08yr2o1_500
tumblr_npuxvmFUL31uqie69o1_400
tumblr_npw8s5z2za1uq31tfo1_500
tumblr_npw9e6n2EJ1r90hqfo1_400
tumblr_npwa58BuFX1tx0b60o1_540
tumblr_noiez5sPNW1u58xl4o1_500
tumblr_nqpx5lxZtM1uxz3pbo1_500
tumblr_nrd9hvQXHJ1rh68cao1_500
tumblr_nnxednmKx01t19najo1_400
tumblr_nqmxjb2OKQ1uqbcmgo1_400
tumblr_nqmyapsaUc1uzz9q8o1_1280
tumblr_nofiupp70K1tsywajo1_250
tumblr_npe2tbd4wg1s0m6leo1_500
tumblr_no566xiPbF1ttvor4o1_500
tumblr_mwz8q5WtT21qee466o1_250
tumblr_nq6ttztf9F1qa1bnlo1_500
tumblr_nq6u0rdxSH1qa1bnlo1_1280
tumblr_nq6wpo4pVR1uyiqd8o1_400
tumblr_np5xgkCaJK1ux3e2ho1_400
tumblr_np5xm6R9qE1u3ip9ho1_500
tumblr_nrlnmqTlPA1u0b1kuo1_400
tumblr_nqcuzo6KYC1uz3hfeo1_400
tumblr_npvyptEozV1u2jj66o1_1280
tumblr_nq7nckIS4C1snjf80o1_400
tumblr_nq7lrnCxsN1u5ohito1_540
tumblr_nq7mfoV9Jy1r4s31lo1_250
tumblr_np77tfSwNa1u8kmwno1_400
tumblr_nr1i4zIMKR1t2v351o1_500
tumblr_nqkub69eSX1tmghzto1_500
tumblr_np2jdrO6rN1tkihe4o1_400
tumblr_np2kznrccR1uwljzfo1_400
tumblr_np2mtpkXRe1tkihe4o1_540
tumblr_nq4o42DXzt1uwqu6jo1_500
tumblr_nomy7hR1lE1tkpyreo1_1280
tumblr_nphufwyDme1tuqjo9o1_400
tumblr_nq3i2enFA31uy8b5ro1_400
tumblr_nq46ixZ6Lq1sq33zgo1_400
tumblr_nq46quON9R1qfdg2no1_500
tumblr_nqpk0giSxT1sqw8wno1_400
tumblr_np6wysgtST1r2hfi0o1_400
tumblr_npgv8y4CeK1uro515o1_400
tumblr_npbk1yrWCm1shl3xko1_500
tumblr_npbm9l1VUW1ur9sj4o1_400
tumblr_np3embnvHS1r52xubo1_400
tumblr_nrct4deUSD1uxqn7xo1_500
tumblr_nc4r8vGoPs1tqhudmo1_640
tumblr_nqqo9kXA4M1uyxg0lo1_250
tumblr_noch808AgN1s5t003o1_400
tumblr_nqvntvnjPM1s1wc6xo1_500
tumblr_np3ota8qWD1tn6walo1_400
tumblr_npfg4xYbVL1qhk1cso1_400
tumblr_nq9eqtDm4j1tvecxko1_400
tumblr_nqobhzHHAj1u7v2s5o1_500
tumblr_nn1safZwXS1tolgrno1_1280
tumblr_noglav9aBh1u919odo1_500
tumblr_noglcxLWHX1r46xhwo1_1280
tumblr_nq6cm7LQkP1ss7zg4o1_400
tumblr_np444gaw7E1u6elf8o1_400
tumblr_novuazVMYn1rd31gho1_500
tumblr_nq80wo4X731utml12o1_400
tumblr_no01buzG0U1rk7npjo1_1280
tumblr_npjj5uu8Ud1sf85ako1_500
tumblr_npjjpseAoN1rs0uvho1_400
tumblr_npjjymV8Ya1rs0uvho1_400
tumblr_npjm1lbzYF1tdedjao1_500
tumblr_nnvm3lTElX1u26trro1_400
tumblr_nq6hoefYGn1uyifgmo1_500
tumblr_nq3ac4XZbw1usy98wo1_400
tumblr_nptlvpGyDE1s0tdy3o1_500
tumblr_nrac3pChUQ1qjbg9so1_1280
tumblr_nr7z61zzSu1shch57o1_500
tumblr_nphkmlqYsX1ux9jido1_1280
tumblr_nqcqz2YAhT1rhedj8o1_1280
tumblr_nr9srdtux31ua5o1co1_400
tumblr_nr9vzzkhjF1uvcrq6o1_250
tumblr_nnk8lxuPSo1qj25y0o1_400
tumblr_nrcfacRDfD1upn56ro1_500
tumblr_nmzcvijxWS1t2osofo1_400
tumblr_nqrhgeuxkd1r38rcho1_500

안녕하세요, 코드를 실행해 보려고 하다가 문제가 생겨서 연락드립니다.

안녕하세요, Tgif-qa 논문을 읽고, 코드를 직접 돌려보고자 하는 학생입니다.

DataSet을 받고, 환경을 똑같이 만들었다고 생각해서

Training을 돌리려고 했었는데, flag부분에서 막혀서 연락드립니다.

flag에서 image_feature_net부분에서, Unknown command 에러가 발생하는데, 해결할 수 있는 방법이 있을까요?

답변 주시면 감사하겠습니다. ( _ _)

Why the result is different from paper?

The results in the READEME.md are quite different from those in the paper. Why?

What optimizations have been made in the code?

Could you release the code with the current version tensorflow.

Tensorflow v0.10 is quite old for now. It is hard to set v0.10 tensorflow environment. Could you release the code of current version tensorflow just like tensorflow v1.3.0 or 1.4.0. Thank you.

What is the model size of the st-vqa model

Hello, thank you for your great work.
We are doing research upon your projects and we are doing comparisons of model size/trainable parameter size/.
Since the code is based on Python2 and rather old tensorflow, I fail to run the code.
So I wonder if you have ever recorded the model size of your model?
Please inform me if you have. Thank you very much!

Unable to open object

odd gif_name in the dataset

line 24944 of Train_count_question.csv has peculiar gif_name and I couldn't find it in TGIF-Release dataset.

tumblr_npCOUNT7hA9g1utewr4o1_250 How many times does the man look around ? 0 COUNT28222 7569

Alternative way to download the dataset?

Hey, is there an alternative way to download the dataset (e.g. separate it into several part)? Downloading a 123G file from google drive is really frustrating for the network problem.
By the way, does the file in the google drive contain the newly added GIFs you mentioned in the README file? Or maybe you only added QA pairs on fixed GIFs?

Code to extract video representation

Hi @YunseokJANG, Thanks for your excellent code. Can you release the code to extract video representation?

asdf

ValueError: setting an array element with a sequence.

Traceback (most recent call last):
File "main.py", line 279, in
main()
File "main.py", line 118, in main
model, model_params = init_model()
File "main.py", line 274, in init_model
model.build_graph(video, video_mask, question, question_mask, answer, train_flag)
File "/scratch/tgif-qa/code/gifqa/models/count_models.py", line 97, in build_graph
self.vid_initial_state = tf.zeros([self.batch_size, self.video_cell.state_size])
File "/home/ubuntu/anaconda2/lib/python2.7/site-packages/tensorflow/python/ops/array_ops.py", line 1441, in zeros
shape = ops.convert_to_tensor(shape, dtype=dtypes.int32, name="shape")
File "/home/ubuntu/anaconda2/lib/python2.7/site-packages/tensorflow/python/framework/ops.py", line 836, in convert_to_tensor
as_ref=False)
File "/home/ubuntu/anaconda2/lib/python2.7/site-packages/tensorflow/python/framework/ops.py", line 926, in internal_convert_to_tensor
ret = conversion_func(value, dtype=dtype, name=name, as_ref=as_ref)
File "/home/ubuntu/anaconda2/lib/python2.7/site-packages/tensorflow/python/framework/constant_op.py", line 229, in _constant_tensor_conversion_function
return constant(v, dtype=dtype, name=name)
File "/home/ubuntu/anaconda2/lib/python2.7/site-packages/tensorflow/python/framework/constant_op.py", line 208, in constant
value, dtype=dtype, shape=shape, verify_shape=verify_shape))
File "/home/ubuntu/anaconda2/lib/python2.7/site-packages/tensorflow/python/framework/tensor_util.py", line 384, in make_tensor_proto
nparray = np.array(values, dtype=np_dt)

Where can I get the 'tgif-new-group.tsv' file?

A serious problem on TGIF-QA dataset

I only use the answer information and get very high accuracies (over 90%) on two Multi-Choice tasks (Action and Transition).

I used four different codes (HGA, LAD-Net, HCRN, ours) to investigate the problem and the result are consistent. I only use the candidate answers information. In details, I generate a vector for each candidate (word embedding + RNNs). Then, I sum all the candidate answer vectors to generate an answer representation and I fuse it with each candidate vector. Finally, I use a classifier to predict the answer probabilities.

I notice that you collect the ground-truth answer by workers and generate other candidates by starting with selecting different verbs. The similarities of these verbs with the verb from the answer phrase are smaller than the 50th percentile. The pattern between the ground-truth answer and other candidates is certain. So, I only select the first word (verb) of the each answer option and the result is similar. I think I have found a way to trigger the failure mode of the dataset.

Mismatched Q&A pairs and GIF datasets

Hello,

Thank you for your excellent work!

When I download the tgif-qa dataset, which includes approximately 124G of GIF files(9 zip splits) and some csv files with question and answer pairs, I find some gif_name in the csv files can't be found in the GIFs dataset. such as the
tumblr_nk172bbdPI1u1lr18o1_250 in the Test_action_question.csv.

Meanwhile, some tgif file can't be found in the csv file, such as the tumblr_l5zke1pg6r1qzzqaxo1_500.gif.

Have you ever encountered this problem?
I downloaded the wrong data set ?

Error in the script save-frames.sh

Hi @YunseokJANG,

Thanks for your great work.
But when I use the script 'save-frames.sh' for extracting frames, a huge number of duplicated frames are produced for some gifs , such as 'tumblr_npe0ojjyfp1u2w06yo1_250.gif',
'tumblr_no15754JCM1tgouwlo1_250.gif'.
I have replaced the line "ffmpeg -i "$file" "$destination/%d.jpg";" in the script with "ffmpeg -i "$file" -vsync 0 "$destination/%d.jpg" to remove duplicated frames, but I do not know whether this modification is exactly correct.
So, I think it is necessary to let you know this issue.

Look forward to your reply!

Recommend Projects

React

A declarative, efficient, and flexible JavaScript library for building user interfaces.
Vue.js

🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript

TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
TensorFlow

An Open Source Machine Learning Framework for Everyone
Django

The Web framework for perfectionists with deadlines.
Laravel

A PHP framework for web artisans
D3

Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

javascript

JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
web

Some thing interesting about web. New door for the world.
server

A server is a program made to process requests and deliver data to clients.
Machine learning

Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Visualization

Some thing interesting about visualization, use data art
Game

Some thing interesting about game, make everyone happy.

Recommend Org

Facebook

We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft

Open source projects and samples from Microsoft.
Google

Google ❤️ Open Source for everyone.
Alibaba

Alibaba Open Source for everyone
D3

Data-Driven Documents codes.
Tencent

China tencent open source team.

Jobs

Jooble