I have a ubuntu app that need opencl、opengl and npu ability. We want to run it in vim3.
it works in following 3 steps:
recv image from uvc/mipi camera, do some transform and send result to vision ipc. this steps mainly run in opencl and cpu.
another process recv image from vision ipc,then do model predict with npu, result will be send to msg queue.
user gui process recv image from vision ipc and result from npu model predicts, use opengl to render and display result in x window.
In last two days, I have do some study in ubuntu 4.9 kernel and mainline. Found that:
4.9 kernel, opencl and npu work well, but opengl can only work in fbdev mode, not x window. It’s a pity.
mainline kernel, mesa related stuff work well when do opengl job, but not support opencl hardware accelerate. Also npu in mainline kernel not work(including Segmentation fault for image_classify_224x224, Segmentation fault for tengine lite when doing prerun_graph_multithread).
I do want to use vim3 and had put lot of energy in this platform. But today I do really confuse.
So would you please share some light with me?
Thanks very much.
@ideafold The latest version of NPU no longer maintains amlogic nn api, tengine needs to wait for the official tengine version to be updated to us. What can be used on the latest NPU is KSNN and the original API
We no longer maintain amlogic nn api, so the latest version no longer has this library
The version on our board is the official customized version of tengine, so we need to wait for the official update of tengine. We are considering using the community version, but not currently, so the latest driver cannot use tengine temporarily. If you want to transplant the community version yourself, then You can try. I suggest you use raw api or ksnn