Yaya Shi's Projects
A repositsory of common methods, datasets, and tasks for video research
Evaluation scripts for the 2019 machine translation quality estimation shared task
R-C3D pytorch implementation
Unofficial pytorch implementation for Self-critical Sequence Training for Image Captioning; py3 version in py3 branch (it actually should be compatible to both py2 and py3)
Config files for my GitHub profile.
PyTorch utilities and models for Visual-Semantic tasks
An implementation of the Spearman's Rank Correlation Coefficient in python
Semantic Propositional Image Caption Evaluation
Repository for paper: Saliency-Based Spatio-Temporal Attention for Video Captioning
Code for "Learning to summarize from human feedback"
Reinforcement learning in text generation with transformers
Implementation "Timeception for Complex Action Recognition". Accepted as Oral Presentation at CVPR 2019
Temporal Segment Networks (TSN) in PyTorch
UniVSE implementation on Python3
pytorch implementation of video captioning
MSR-VTT download code and Study of frame rate effects on MSR-VTT dataset
Our paper was published in the proceedings of ACM Multimedia 2017 (MM' 17) .
Long video text summarization
MTLE method, winner of the Large Scale Movie Description Challenge (LSMDC) 2017 - Video Description Task.
Code for the ICCV 2019 Paper "Generating Diverse and Descriptive Image Captions Using Visual Paraphrases"
Use various large-scale models to extract video and text embeddigs