NPU acceleration for onnx models

VIM3
#1

Which Khadas SBC do you use?

VIM3 A311D

Which system do you use? Android, Ubuntu, OOWOW or others?

Ubuntu

Which version of system do you use? Khadas official images, self built images, or others?

gnome

Please describe your issue below:

I have onnx model for Object Detection, which I want to run on NPU to get the acceleration. Is there any way to run this model on NPU something like [‘CPUExecutionProvider’], without converting it to .nb ?

Can you please guide on this.
@Louis-Cheng-Liu
@numbqq

#2

Hello @Chetan_Deshmukh ,

You can try to use OpenCV DNN. It can run model without conversion.

Here is the related document.
OpenCV DNN Usage [Khadas Docs]

1 Like
#3

Thank you @Louis-Cheng-Liu for your informative response.