Is it able to segment unseen object? about esanet

[mona0809]

Every pixel in the image will be assigned a label, even if it does not fit the true category. Box is even one of the categories the model was trained on.

[JANGSOONMYUN]

@mona0809 Thank you for your reply. Ok I will test it.

[danielS91]

Even if each pixel is assigned to one of the known classes, the network might still be able to detect unknown objects with some height on the ground. During tests in real-world applications, we observed that the floor class is detected quite robustly and might help to find objects on the ground (see our video).

I am not sure whether this helps you. However, if your example above is your application scenario, give it a try.

[JANGSOONMYUN]

@danielS91 Thank you.
I checked the NYUV2 dataset and there is 'void' in the classes. If there is unseen object detected, is it classified as 'void' ?

[mona0809]

Void is ignored during training. You could try to train with void but there is no guarantee that every unkown object will be classified as void. As void is very versatile it is hard to learn a representation.

[JANGSOONMYUN]

@mona0809 I see. Maybe I should train the model with additional dataset and see the result.
I appreciate.