GPU inference and manipulation

VIM3
1

Which Khadas SBC do you use?

VIM 3 Pro

Which system do you use? Android, Ubuntu, OOWOW or others?

Ubuntu

Which version of system do you use? Khadas official images, self built images, or others?

Khadas official

vim3-ubuntu-20.04-gnome-linux-4.9-fenix-1.1.1-220725-emmc.img

Please describe your issue below:

This one is not formally an issue, but I would like to know whether there are existing tools to perform neural network inference on GPU on the Khadas VIM 3 (not on NPU).

If there are no such tools available, any starting point in terms of doc and explanations are very welcome @Frank :slight_smile:

Thank you.

2

@justbob You can’t run it on the GPU without a tool like this, you can run it on the CPU if you’re not running on the NPU, but it’s obviously not a good choice