MLKit running on GPU? about mlkit

[SilverDestiny]

Which ML Kit feature are you using? ML Kit is mostly running on CPU

[arianaa30]

MLKit vision. I want to use the segmentation model.

[SilverDestiny]

Which segmentation feature? Subject or selfie segmentation?

[arianaa30]

Selfie Segmentation. In Android

[ai-plays]

Hi arianaa30,

Selfie Segmentation is running on CPU only.

The only ML Kit feature with GPU acceleration today is Pose Detection. Please see more details here https://developers.google.com/ml-kit/vision/pose-detection/android#hardware_config

[arianaa30]

Oh I didn't expect it at all. It's a TF model..why not using the gpu delegate to run? Please consider adding this option as a feature.

[ai-plays]

There are actually some other complications that when running on GPU, a feature may be slower, less accurate than CPU or even result in crashes. It varies on different devices.

For Selfie Segmentation, it is already using multi-thread CPU acceleration today.