NPU models inside docker container on VIM3

VIM3
1

Hi All

Is it possible to run the NPU models inside a docker container on VIM3? [Similar to accessing nvidia GPUs from within docker]? If yes, how do I go about setting up? The docker command line etc.

Thanks
&
Regards

1 Like
2

@skpvim3 Theoretically, it’s OK, but there are too many things to do. You need to adapt the kernel version of the image, and then install a lot of drivers. At the same time, docker also needs to occupy a part of resources. I think it’s too heavy for vim3, or seriously leads to efficiency decline. Even if it can be used, the effect is much worse than that of direct use

3

@Frank thanks for the quick response!

Is there any place I can find out the list of drivers required to support NPU, e.g. in the Khadas kernel tree or so? My application needs this capability, even if takes some hit on the performance!

Thanks
&
Regards

4

Here is the NPU drivers.

5

Were you able to run docker on VIM3?
Can you please share performance statistics?

6

@KD_1993

https://docs.khadas.com/linux/vim3/Watchdog.html

You can follow this doc