What are the prompts during training? about recognize-anything

[xinyu1205]

Please refer to recognize-anything/models/openset_utils.py multiple_templates. We follow [1].

[1] Zang Y, Li W, Zhou K, et al. Open-vocabulary detr with conditional matching[C]//Computer Vision–ECCV 2022: 17th European Conference, Tel Aviv, Israel, October 23–27, 2022, Proceedings, Part IX. Cham: Springer Nature Switzerland, 2022: 106-122.

[Qinying-Liu]

I appreciate your prompt response. I've noticed that the prompt templates in openset_utils.py seem to be designed primarily for noun tags. However, the tag list in ram_tag_list.txt contains some adjective and verb tags that seem incompatible with these templates, resulting in potentially illogical prompts like "a photo of my red." Could you please explain this discrepancy?

[xinyu1205]

We did not consider this. I think you are right, designing different prompts for tags with different part of speech is highly likely to improve the performance of the model.