Failure enumerating USB devices through Hub - device descriptor read/64, error -71

I made a custom PCB based on the M2.X extension board to use only M2 key B to connect to a modem

However when I plug my modem I get errors in dmesg:

[ 3437.521997] usb 1-1-port3: attempt power cycle
[ 3438.066077] hub 1-1:1.0: hub_ext_port_status failed (err = -71)
[ 3438.333906] usb 1-1.3: new high-speed USB device number 104 using xhci-hcd
[ 3438.333962] usb 1-1.3: Device not responding to setup address.
[ 3438.541936] usb 1-1.3: Device not responding to setup address.
[ 3438.749898] usb 1-1.3: device not accepting address 104, error -71
[ 3438.829905] usb 1-1.3: new high-speed USB device number 105 using xhci-hcd
[ 3438.830006] usb 1-1.3: Device not responding to setup address.
[ 3439.037950] usb 1-1.3: Device not responding to setup address.
[ 3439.245904] usb 1-1.3: device not accepting address 105, error -71
[ 3439.246678] usb 1-1.3: the parent's name is 1-1
[ 3439.246734] usb 1-1-port3: Device no response
[ 3439.253764] usb 1-1-port3: unable to enumerate USB device
[ 4132.533935] hub 1-1:1.0: hub_ext_port_status failed (err = -71)
[ 4132.801893] usb 1-1.3: new high-speed USB device number 106 using xhci-hcd
[ 4132.882028] usb 1-1.3: device descriptor read/64, error -71
[ 4133.009938] hub 1-1:1.0: hub_ext_port_status failed (err = -71)
[ 4133.277930] usb 1-1.3: device descriptor read/64, error -71
[ 4133.465906] usb 1-1.3: new high-speed USB device number 107 using xhci-hcd
[ 4133.545977] usb 1-1.3: device descriptor read/64, error -71
[ 4133.654567] usb 1-1-port3: cannot reset (err = -71)
[ 4133.921928] usb 1-1.3: device descriptor read/64, error -71
[ 4134.030026] usb 1-1-port3: attempt power cycle
[ 4134.633910] usb 1-1.3: new high-speed USB device number 108 using xhci-hcd
[ 4134.654437] usb 1-1.3: device descriptor read/8, error -71
[ 4134.782260] usb 1-1.3: device descriptor read/8, error -71
[ 4134.969960] usb 1-1.3: new high-speed USB device number 109 using xhci-hcd
[ 4134.970092] usb 1-1.3: Device not responding to setup address.
[ 4135.177933] usb 1-1.3: Device not responding to setup address.
[ 4135.385910] usb 1-1.3: device not accepting address 109, error -71
[ 4135.386691] usb 1-1.3: the parent's name is 1-1
[ 4135.386749] usb 1-1-port3: Device no response
[ 4135.393729] usb 1-1-port3: unable to enumerate USB device

Does anyone know where the problem is ?

Do I have to do something in software to enable connection on M.2 port ?

Thanks

I’m aware that -71 is protocol error and I did check that DP and DM are correctly connected

I saw in the schematic of vim3 https://dl.khadas.com/Hardware/VIM3/Schematic/VIM3_V12_Sch.pdf

Modem M.2 key B port connect to Khadas usb hub on HUB_DM3 and HUB_DP3 which operates with VCC5V while the modem port powered with 3.3V.

Is there any config that has to be done here ?

Thank you very much