maxi-w / clip-sam Goto Github PK

Traceback (most recent call last):
  File "/home/tina/Desktop/CLIP-SAM-main/main.py", line 48, in <module>
    def retriev(elements: list[Image.Image], search_text: str) -> int:
TypeError: 'type' object is not subscriptable

Following your tutorial, I went to the step of directly running main.ipynb, but the above error occurred. Please advise me on how to solve this bug. Thank you very much!

Your work is very good!
Simple and effective.

For your information, there is another solution from the explainability of CLIP.

Our work can achieve text to mask with SAM: https://github.com/xmed-lab/CLIP_Surgery
This is work is in the aspect of CLIP's explainability. It's able to guide SAM to achieve text to mask without manual points.
Besides, it enhances many open-vocabulary tasks, like segmentation, multi-label classification, multimodal visualization.

This is the jupyter demo:
https://github.com/xmed-lab/CLIP_Surgery/blob/master/demo.ipynb

This is our segmentation results:

This is our heatmap:

I optimized the code based on the provided code, fully using OpenCV Python, and optimized the functions within it.my github: https://github.com/qsd-github/sam-clip-opencv