NPU documentation and tools

VIM3
1

When will this info and tool be available?
My main usage of VIM3 is for deep learning.
Thanks,
Kaishi

2 Likes
2

@kaishi It will take some time. Please wait patiently.We are dealing with it

1 Like
3

Any idea when this will be available?

Thanks,

4

Hi @kaishi
Actually, as the Amlogic A311D use the Verisilicon NPU IP, and they require each clients to sign the NDA with Verisilicon to get a KEY ID for each project first, then they will release the toolkit and documentations.

We still try to simply the process for VIM3 users, but it might take some time, we will update more here in the next few days.

4 Likes
5

Any news on this topic? Also who will be providing the integration with TensorFlow? Does this come with the Verisilicon Toolkit or will you build an extension that allows TensorFlow to make use of the NPU through Verisilicon’s toolkit?

6

Rockchip 3399pro also uses Verisilicon NPU IP,.
Is A311D NPU performance better than RK3399Pro?
Toybrick has released conversion tools library, rknn for ubuntu. Can this tool be used for A311D’s ubuntu system?

Thanks,

7
8

We also have the model convert tool, we’ll release the tool when the licence issue is resolved.

9

I was wondering if the architecture of the A311D is compatible in some way with Qualcomm’s Hexagon. If it is we could use Xiaomi Mace framework for AI, it has excellent performance even compared to tflite.

10

Any update of the date which tools/documentation will be available?

Thanks,

11

@kaishi

12

Frank,

I already tried it and it works on my system. However, I am more interested to use other NN models which needs a conversion tool and API documentation.

Thanks,

13

Hi @kaishi
Please sent an email to hello@khadas.com with the project information, and we will reply you by email.

Due to the license limited, currently we still cannot release the NPU toolkit in public.

BTW, our team are training a model and let the VIM3 to recognition all our Khadas products, we will release the model when it ready.

Good day!

14

Gouwa

It will be nice if you can release mobilenet-ssd so I can benchmark performance of A311D s RK3399PRO while I am waiting for tool release.

Thanks,

15

When will you release your NPU toolkit? Can’t wait anymore. :upside_down_face:

16

Yes, it’s ready, but still not available in public at the moment.

Please write a email to hello@khadas.com with your project information, as we will reply you by email.

Good day!

17

Hi I just wrote an email request for toolkit to hello@khadas.com (my email is comdet.p@gmail.com) but no any response. We want to test our AI racing car to compare with Jetson Nano but Vim3 not provide any information about NPU.

18

Gouwa,

It is not reasonable to ask a user to send an email to hello@khadas.com.

The right to handle this is your company should let users know when this tool/documentation will be available and ask them to wait. Unfortunately, your company has not been able to provide a date so far.

Thanks,

3 Likes
19

Can’t agree more. Without toolkit ad document, VIM3 is just another raspberry pi.:upside_down_face:

2 Likes
20

I agree
I bought the Vim3 to use the NPU!
Which linux image is advised if I want to use the NPU?

1 Like