NPU acceleration for onnx models

Which Khadas SBC do you use?

VIM3 A311D

Which system do you use? Android, Ubuntu, OOWOW or others?


Which version of system do you use? Khadas official images, self built images, or others?


Please describe your issue below:

I have onnx model for Object Detection, which I want to run on NPU to get the acceleration. Is there any way to run this model on NPU something like [‘CPUExecutionProvider’], without converting it to .nb ?

Can you please guide on this.

Hello @Chetan_Deshmukh ,

You can try to use OpenCV DNN. It can run model without conversion.

Here is the related document.
OpenCV DNN Usage [Khadas Docs]

1 Like

Thank you @Louis-Cheng-Liu for your informative response.