Can tengine-libs_1.4-dev_arm64.deb work in ubuntu mainline kernel?

VIM3
#1

http://dl.khadas.com/repos/debs/vim3/focal/tengine-libs_1.4-dev_arm64.deb

I run an app with aml-npu_6.4.6.2.5.3.2_arm64.deb and tengine-libs_1.4-dev_arm64.deb
it failed. with message:
W [vsi_nn_SortGraphNode:1278]Unprocessed node 22
W [vsi_nn_SetupGraph:621]Sort graph nodes failure.
Tengine Fatal: Pre-run subgraph(2) on TIMVX failed.
Tengine: Scheduler(sync) prerun failed.
Prerun multithread graph failed.

dmesg show:
[ 487.907169] galcore: module is from the staging directory, the quality is unknown, you have been warned.
[ 487.909093] npu_version: 2
[ 487.909227] Galcore version 6.4.6.2.5.3.2
[ 507.781580] ------------[ cut here ]------------
[ 507.781591] WARNING: CPU: 2 PID: 5528 at is_valid_gup_flags+0x18/0x28
[ 507.781604] Modules linked in: galcore(C) fuse rfcomm zram zsmalloc hci_uart btqca btsdio btbcm bluetooth ecdh_generic ecc governor_simpleondemand khadas_mcu_fan panfrost rtc_hym8563 gpu_sched gpio_pca953x ir_nec_decoder meson_vdec(C) videobuf2_dma_contig rc_khadas v4l2_mem2mem videobuf2_memops rtc_meson_vrtc meson_ir videobuf2_v4l2 videobuf2_common gpio_keys_polled brcmfmac brcmutil cfg80211 rfkill ip_tables x_tables
[ 507.781651] CPU: 2 PID: 5528 Comm: track_uint8_t_a Tainted: G C 5.16.0-rc2 #1.0.9
[ 507.781656] Hardware name: Khadas VIM3 (DT)
[ 507.781658] pstate: 40000005 (nZcv daif -PAN -UAO -TCO -DIT -SSBS BTYPE=–)
[ 507.781662] pc : is_valid_gup_flags+0x18/0x28
[ 507.781665] lr : get_user_pages+0x1c/0x50
[ 507.781668] sp : ffff800012793890
[ 507.781669] x29: ffff800012793890 x28: ffff00002d60b600 x27: 0000000000000000
[ 507.781674] x26: ffff00004290ac00 x25: ffff000010750600 x24: ffff000001daee80
[ 507.781679] x23: 0000000000025800 x22: ffff00002d60b600 x21: 0000ffff74176040
[ 507.781683] x20: ffffffffffffffff x19: 0000000000000026 x18: 0000000000000000
[ 507.781688] x17: 0000000000000000 x16: 0000000000000000 x15: 0000ffffc26c42d8
[ 507.781692] x14: 0000000000000000 x13: 0000000000000000 x12: 0000000000000000
[ 507.781695] x11: 0000000000000000 x10: ffff00002d60b600 x9 : 0000000000000000
[ 507.781699] x8 : ffff000010750800 x7 : 0000000000000000 x6 : 0000ffff74176000
[ 507.781703] x5 : 0000000000010001 x4 : 0000000000000000 x3 : ffff000010750600
[ 507.781707] x2 : 0000000000010001 x1 : 0000000000000026 x0 : 0000000000010001
[ 507.781712] Call trace:
[ 507.781714] is_valid_gup_flags+0x18/0x28
[ 507.781717] _UserMemoryAttach+0x7a8/0xd28 [galcore]
[ 507.781742] gckOS_WrapMemory+0xb8/0x2a0 [galcore]
[ 507.781762] gckVIDMEM_NODE_WrapUserMemory+0x1bc/0x2b8 [galcore]
[ 507.781782] gckKERNEL_Dispatch+0x284/0x16d8 [galcore]
[ 507.781802] gckDEVICE_Dispatch+0x84/0x1c0 [galcore]
[ 507.781821] drv_ioctl+0x324/0x490 [galcore]
[ 507.781840] __arm64_sys_ioctl+0x94/0xd8
[ 507.781845] invoke_syscall+0x44/0x108
[ 507.781850] el0_svc_common.constprop.0+0x50/0x1a0
[ 507.781854] do_el0_svc+0x24/0x88
[ 507.781856] el0_svc+0x20/0x90
[ 507.781862] el0t_64_sync_handler+0xb0/0xb8
[ 507.781865] el0t_64_sync+0x1a0/0x1a4
[ 507.781869] —[ end trace 3f5f2d34055e0022 ]—
[ 507.781897] ------------[ cut here ]------------
[ 507.781898] galcore ff100000.galcore: DMA addr 0x0001000000000040+4032 overflow (mask ffffffffff, bus limit 0).
[ 507.781906] WARNING: CPU: 2 PID: 5528 at dma_direct_map_sg+0x298/0x2b0
[ 507.781915] Modules linked in: galcore(C) fuse rfcomm zram zsmalloc hci_uart btqca btsdio btbcm bluetooth ecdh_generic ecc governor_simpleondemand khadas_mcu_fan panfrost rtc_hym8563 gpu_sched gpio_pca953x ir_nec_decoder meson_vdec(C) videobuf2_dma_contig rc_khadas v4l2_mem2mem videobuf2_memops rtc_meson_vrtc meson_ir videobuf2_v4l2 videobuf2_common gpio_keys_polled brcmfmac brcmutil cfg80211 rfkill ip_tables x_tables
[ 507.781951] CPU: 2 PID: 5528 Comm: track_uint8_t_a Tainted: G WC 5.16.0-rc2 #1.0.9
[ 507.781954] Hardware name: Khadas VIM3 (DT)
[ 507.781956] pstate: 40000005 (nZcv daif -PAN -UAO -TCO -DIT -SSBS BTYPE=–)
[ 507.781959] pc : dma_direct_map_sg+0x298/0x2b0
[ 507.781962] lr : dma_direct_map_sg+0x298/0x2b0
[ 507.781966] sp : ffff8000127937f0
[ 507.781967] x29: ffff8000127937f0 x28: ffff00000f0f5000 x27: ffffffffffffffff
[ 507.781972] x26: ffff000000262410 x25: ffff8000126ce564 x24: 0000000000000000
[ 507.781976] x23: 0000000000000000 x22: 0000000000000001 x21: fffffc0000000000
[ 507.781980] x20: ffff800012106cf8 x19: 0000000000000026 x18: 0000000000000020
[ 507.781985] x17: 667265766f203233 x16: 30342b3034303030 x15: 3030303030303031
[ 507.781989] x14: 00000000000004c3 x13: ffff00002d60ba48 x12: 00000000ffffffea
[ 507.781993] x11: ffff8000125b6a38 x10: ffff8000125869f8 x9 : ffff800012586a50
[ 507.781997] x8 : 000000000002ffe8 x7 : c0000000ffffdfff x6 : 0000000000000001
[ 507.782001] x5 : ffff0000baf91710 x4 : 0000000000000000 x3 : 0000000000000027
[ 507.782004] x2 : 0000000000000023 x1 : ae39d135d2fb1c00 x0 : 0000000000000000
[ 507.782008] Call trace:
[ 507.782010] dma_direct_map_sg+0x298/0x2b0
[ 507.782013] __dma_map_sg_attrs+0x28/0x80
[ 507.782017] dma_map_sg_attrs+0x10/0x28
[ 507.782020] _UserMemoryAttach+0x87c/0xd28 [galcore]
[ 507.782041] gckOS_WrapMemory+0xb8/0x2a0 [galcore]
[ 507.782061] gckVIDMEM_NODE_WrapUserMemory+0x1bc/0x2b8 [galcore]
[ 507.782081] gckKERNEL_Dispatch+0x284/0x16d8 [galcore]
[ 507.782100] gckDEVICE_Dispatch+0x84/0x1c0 [galcore]
[ 507.782119] drv_ioctl+0x324/0x490 [galcore]
[ 507.782138] __arm64_sys_ioctl+0x94/0xd8
[ 507.782142] invoke_syscall+0x44/0x108
[ 507.782146] el0_svc_common.constprop.0+0x50/0x1a0
[ 507.782149] do_el0_svc+0x24/0x88
[ 507.782152] el0_svc+0x20/0x90
[ 507.782156] el0t_64_sync_handler+0xb0/0xb8
[ 507.782160] el0t_64_sync+0x1a0/0x1a4
[ 507.782163] —[ end trace 3f5f2d34055e0023 ]—
[ 507.782165] [galcore]: import_page_map: dma_map_sg failed
[ 507.808901] [galcore]: import_page_map: dma_map_sg failed
[ 519.168828] [galcore]: import_page_map: dma_map_sg failed
[ 519.177310] [galcore]: import_page_map: dma_map_sg failed
[ 519.179047] [galcore]: import_page_map: dma_map_sg failed
[ 519.180725] [galcore]: import_page_map: dma_map_sg failed
[ 519.181629] [galcore]: import_page_map: dma_map_sg failed
[ 519.188204] [galcore]: import_page_map: dma_map_sg failed
[ 519.190711] [galcore]: import_page_map: dma_map_sg failed

#2

当前预装的版本与现在的npu版本不匹配。你可以自己从Tengine那边重新编译库。

#3

Thanks for your reply.
if I use Tengine-lite-v1.4-amlogic, which version tim vx source code should I use?

#4

TIM-vx aarch64_A311D_6.4.8/lib/的galcore.ko and libGAL.so was compiled in 4.9 kernel.

tengine-lite can be successfully compiled with TIM-vx aarch64_A311D_6.4.8, but run failed.

image
image999×750 164 KB

#5

Now I have two options:

  1. ask tim vx release a package compiled in kernel 5.16
  2. use aml-npu_6.4.6.2.5.3.2_arm64.deb to compile tengine + tim vx. I had try, failed. As some function needs by tengine + tim vx not in libs in aml-npu_6.4.6.2.5.3.2_arm64.deb. such as vxBatchGemmNode.

@numbqq do you have any suggestion?
Thanks

1 Like