NPU Demo from the Toolkit works well for Yolo. Many frameworks can be converted using acuity toolkit, there is an example of custom Yolo Model here
I tried it and I could not make other network models work. There are no examples for transforming any common networks like MobileNet. If I run the three conversion scripts in the SDK, by default, “nbg_unify_mobilenet_tf” is created. However, there is no information on how to transform this into model code in the amu_npu_app and build them successfully. Where can I find this information about creating demo mobilenet code similar to yolo?
@Vignesh_Raja SSD model can’t convert with convert tools . You need to remove the input layer and output layer, then you can convert it . After convert it , you need to implement the input and output layers yourself in your code.
Thanks for the quick reply. I see, any documentation on how to work with SSD model?
The conversion scripts did worked with regular “mobilenet_v1.pb”. By default, there is even in folder called “normal_case_demo” under acuity-toolkit in aml_npu_sdk_6.4.3. This seems to be the converted mobilenet model. I have attached the link here
Therefore I asked how can I get from here to have executable demo file like “detect_demo_x11_usb” (quite similar to Yolo Demos).
I see these are the models that NN can be supported. It would be really helpful if there are documentation on how to convert each of them (especially if there are any differences in conversion like SSD) and deploy them. And, are they any converted models .nb and .so files that can be open-sourced?
Thank you for the advice
I made from the site that you threw the “Compilation method”, but then I can not understand how to run since the instructions are completely different files. Could you briefly describe your sequence of actions?
$ ./person_detect_640x384_picture ./person_detect_88.nb < path to jpeg file>
$ ./person_detect_640x384_camera ./person_detect_88.nb < path to camera node>
Note
Make sure you have OpenCV 3.4 installed because the “nnSDK” library looks for this. You can make it work for OpenCV4.2 but then change the API at few places where OpenCV are used in the code.
Thank you so much @Frank and @Vignesh_Raja for your help.
I removed the aml-npu and installed it again and there were fewer errors, but I solved the problem with opencv by building it through cmake files and a demo from here How to Compile and Use Amlogic NN Api demo | Khadas Documentation it started to run.
Please tell me what should be the next steps if I want to learn how to run my neural network on NPU? I have seen further chapters of the manual show how to get tmfile, but even if I do this, then I do not understand how to use it. I also saw the code for quantizing and converting the model in the engine tools, but there are examples for the same functionality in am_npu_sdk. Which one should I use?
@Vignesh_Raja hello , about the new nn api , there is a big change, so the old demo can no longer be used . So you need to push the leaet release demo code . But it just suppport image_classify_224x224. others I will fixup it and faceback there
Oh, I see. When can we except a new sample code for person detection?
It would be nice to get the release notes of the new changes in the nn api. And also have one stable aml-npu version where we could revert back.
From next time, is storing libnnsdk.so locally instead of Debian will help although I am wondering about other dependencies of nnsdk which will be still in debian?
