henghuiding / grefcoco

A benchmark dataset for GRES and GREC [CVPR2023 Highlight]

Hi there 👋

• 🔭 Researcher woking on Computer Vision and Artificial Intelligence
• 🌎 Shanghai, China

Links:

Website

Google Scholar

grefcoco's Issues

Unclear in 'file_name' in grefs(unc).json file?

Some items are formatted as {file_name}.jpg, others are in {file_name}_{number}.jpg

For example:

1. 'ref_id' = 200000 -> 'file_name': 'COCO_train2014_000000388882.jpg'
2. 'ref_id' = 0 -> 'file_name': 'COCO_train2014_000000581857_16.jpg'

Can you explain this? Or should we just skip the last number in the 'file_name' if it appears?

Thanks.

Dataset downoad links are not working.

Hi,

I noticed that the download links for the dataset are not working. It would be greatly appreciated if you could take a moment to fix it. Thanks in advance!

The number of expressions on gRefCOCO

Dear author,

Thanks for the valuable and interesting work :).
To be clear, I kindly ask why the number of expressions of "gref(unc).json" is "259,859", not "278,232" as your paper states.
Even though I know that it is not crucial for your amazing work, I just ask for the details in order to refer your dataset precisely.

Kind regards

help for inference

No such file or directory: 'mdetr_annotations/finetune_grefcoco_val.json'

F1_score 就是论文里面的 Pr@(F1=1, IoU≥0.5)吗？

作者好，看计算过程，应该 F1_score 就是论文里面的 Pr@(F1=1, IoU≥0.5)？想确认下？我们正在使用你的数据集和评测指标

关于标注的一些疑问

作者好，非常感谢你提供的新标注。我可视化分析了下你提供的数据，我有两个疑问：

1. 为何有些图片文件名带有 _x 的后缀？ 我看你在之前 issue 里面回复是说参考 RefCOCO的，但是我可视化了 RefCOCO 数据集没有发现他有 _x 的后缀？你能给出一个例子吗？

2. 为何有些 bbox 没有文本？很奇怪。有些文本没有 bbox 这个是合理的，但是为啥有些图片有 bbox 没有文本？这是啥任务？

来自图片 COCO_train2014_000000002567.jpg 标注可视化：

你看最右边的那个图，有 bbox 但是没有文本，你能解释下为啥吗