NPU documentation and tools

[kaishi]

Rockchip 3399pro also uses Verisilicon NPU IP,.
Is A311D NPU performance better than RK3399Pro?
Toybrick has released conversion tools library, rknn for ubuntu. Can this tool be used for A311D’s ubuntu system?

Thanks,

[numbqq]

Simple NPU demo on VIM3 Ubuntu Bionic

Preparation You need to flash ubuntu image V190830. Update kernel You need to update the kernel to add NPU module support. khadas@Khadas:~$ sudo -i root@Khadas:~# apt-get update root@Khadas:~# apt-get upgrade root@Khadas:~# echo galcore >> /etc/modules root@Khadas:~# sync root@Khadas:~# reboot After reboot, you can check whether the NPU module exist or not. root@Khadas:~# lsmod | grep galcore galcore 442368 0 If you find the galcore module, indicate that the NPU module is loa…

[numbqq]

Toybrick has released conversion tools library, rknn for ubuntu. Can this tool be used for A311D’s ubuntu system?

We also have the model convert tool, we’ll release the tool when the licence issue is resolved.

[rofly]

I was wondering if the architecture of the A311D is compatible in some way with Qualcomm’s Hexagon. If it is we could use Xiaomi Mace framework for AI, it has excellent performance even compared to tflite.

[kaishi]

Any update of the date which tools/documentation will be available?

Thanks,

[Frank]

@kaishi

Simple NPU demo on VIM3 Ubuntu Bionic

Preparation You need to flash ubuntu image V190830. Update kernel You need to update the kernel to add NPU module support. khadas@Khadas:~$ sudo -i root@Khadas:~# apt-get update root@Khadas:~# apt-get upgrade root@Khadas:~# echo galcore >> /etc/modules root@Khadas:~# sync root@Khadas:~# reboot After reboot, you can check whether the NPU module exist or not. root@Khadas:~# lsmod | grep galcore galcore 442368 0 If you find the galcore module, indicate that the NPU module is loa…

[kaishi]

Frank,

I already tried it and it works on my system. However, I am more interested to use other NN models which needs a conversion tool and API documentation.

Thanks,

[Gouwa]

Hi @kaishi
Please sent an email to hello@khadas.com with the project information, and we will reply you by email.

Due to the license limited, currently we still cannot release the NPU toolkit in public.

BTW, our team are training a model and let the VIM3 to recognition all our Khadas products, we will release the model when it ready.

Good day!

[kaishi]

Gouwa

It will be nice if you can release mobilenet-ssd so I can benchmark performance of A311D s RK3399PRO while I am waiting for tool release.

Thanks,

[Jack.Zhu]

When will you release your NPU toolkit? Can’t wait anymore.

[Gouwa]

Yes, it’s ready, but still not available in public at the moment.

Please write a email to hello@khadas.com with your project information, as we will reply you by email.

Good day!

[comdet]

Hi I just wrote an email request for toolkit to hello@khadas.com (my email is comdet.p@gmail.com) but no any response. We want to test our AI racing car to compare with Jetson Nano but Vim3 not provide any information about NPU.

[kaishi]

Gouwa,

It is not reasonable to ask a user to send an email to hello@khadas.com.

The right to handle this is your company should let users know when this tool/documentation will be available and ask them to wait. Unfortunately, your company has not been able to provide a date so far.

Thanks,

[Jack.Zhu]

Can’t agree more. Without toolkit ad document, VIM3 is just another raspberry pi.

[alex_alex]

I agree
I bought the Vim3 to use the NPU!
Which linux image is advised if I want to use the NPU?

[blitzfr1]

Same here. Waiting for the NPU doc and examples before buying boards.

[Gouwa]

Processing.

Sorry for the late response.

[Gouwa]

We will finally release the toolkit in public, but it just take a few more days for that

For the users who want to get the the NPU toolkit and documents earlier, have to apply by email first.

Good day!

[alex_alex]

Hi Gouwa,

which email?

[larrylart]

I bought two vim 3 pro and also I’m interested in the NPU toolkit/documentation, both for bench-marking and implementation in my projects. I’ll follow up with an email.