GPU inference and manipulation

Which Khadas SBC do you use?

VIM 3 Pro

Which system do you use? Android, Ubuntu, OOWOW or others?


Which version of system do you use? Khadas official images, self built images, or others?

Khadas official


Please describe your issue below:

This one is not formally an issue, but I would like to know whether there are existing tools to perform neural network inference on GPU on the Khadas VIM 3 (not on NPU).

If there are no such tools available, any starting point in terms of doc and explanations are very welcome @Frank :slight_smile:

Thank you.

@justbob You can’t run it on the GPU without a tool like this, you can run it on the CPU if you’re not running on the NPU, but it’s obviously not a good choice