xuyw1997 / mat

MAT

Code for paper ``Memory-Augmented Transformer for Efficient End-to-End Video Grounding''

Data preparation

ActivityNet Captions

Check this web page and fill this form to get raw videos

Charades-STA

download RGB frames from here

TACoS

Check this web page and fill in this form to get raw videos

from raw videos to frames

run extract_frames.sh

Train

run python run_net.py --cfg=configs/xxx --train note that you need to replace the data paths in the configuration file with your own