thu-bpm / promu

Source code of paper:"Prompt Me Up: Unleashing the Power of Alignments for Multimodal Entity and Relation Extraction".

PROMU

The source code of paper "Prompt Me Up: Unleashing the Power of Alignments for Multimodal Entity and Relation Extraction"

Installation

For training, a GPU is recommended to accelerate the training speed.

PyTroch

The code is based on PyTorch 1.6+. You can find tutorials here.

Dependencies

The dependencies are summarized in the file requirements.txt.

You can install these dependencies like this:

pip3 install -r requirements.txt

You also need to install Horovod and Apex

Usage

• Run the full model on NewsCLIPpings dataset with default hyperparameter settings
  

sh run.sh

Data Download

• NewsCLIPpings: Automatic Generation of Out-of-Context Multimodal Media (access)
  

promu's Issues

Code repository expired

Dear authors,

I go through your ACL2023 paper "Multimodal Relation Extraction with Cross-Modal Retrieval and Synthesis" and find the repository link is unavailable. could u provide a new one for this? Thanks a lot :).

No such file or directory: 'src/configs/pretrain.json'

Hi, I meet this bug when I run in the run. sh, "No such file or directory: 'SRC/configs/pretrain json", excuse me , how to obtain this"pretrain.json"?