VIM3L PCIe support with kernel 5.4

Does any one have bring up the PCIe interface on VIM3L with kernel 5.4 ? I have backported the PCIe controller driver support from linux upsteam kernel 5.7 to Android meson kernel 5.4 and build the images with AOSP Android 12_r2, the PCIe interface can work fine with khadas VIM3 board, but if I use the same code to build image for VIM3L, the PCIe interface can’t bring up and it always reboot when read PCIe host controller register, does any one see the same isse ? thanks