Provision for running on CPU/GPU

VIM3
1

Hi,

I was able to run inference on the NPU and it works great. Is there any provision for running models on the khadas VIM3’s CPU or GPU specifically without using the NPU? (ex: support for using ARM NN SDK)

2

@johndoe If you want run in CPU, you can directly install platforms such as tensorflow, which can run directly on the cpu, but the arm64 version is very rare. GPU needs to be specially adapted. Currently, there is no way to use it. Even AMD GPUs have very poor support

1 Like
3

Got you. Thanks @Frank for the prompt resolution