UPDATE: Ubuntu 25.10 completely fixed this issue. This fix is NOT required for Ubuntu 25.10
Skip to solution
https://www.youtube.com/watch?v=_36yNWw_07g
TLDR: You got PCIe resource allocation error. Why? I don't know. It does not happen with my RTX3060. Maybe RTX50 series is just bad for eGPU.
You just bought your RTX50xx GPU, plug in it in your eGPU dock and connect the Thunderbolt cable to your laptop. You installed the driver and ready to run some LLM. It should work, right?
Nah. nvidia-smi shows NVIDIA-SMI has failed because it couldn't communicate with the NVIDIA driver. Make sure that the latest NVIDIA driver is installed and running. If you open dmesg you will get a bunch of error:
[ 1734.194863] thunderbolt 0-1: new device found, vendor=0x8086 device=0x11
[ 1734.194869] thunderbolt 0-1: Adaptertek Tamales2 85W test
[ 1734.451832] thunderbolt 0-0:1.1: new retimer found, vendor=0x8087 device=0x15ee
[ 1734.565778] pcieport 0000:00:07.0: pciehp: Slot(3): Card present
[ 1734.687758] pci 0000:01:00.0: [8086:15ef] type 01 class 0x060400 PCIe Switch Upstream Port
[ 1734.687812] pci 0000:01:00.0: PCI bridge to [bus 00]
[ 1734.687823] pci 0000:01:00.0: bridge window [io 0x0000-0x0fff]
[ 1734.687828] pci 0000:01:00.0: bridge window [mem 0x00000000-0x000fffff]
[ 1734.687842] pci 0000:01:00.0: bridge window [mem 0x00000000-0x000fffff 64bit pref]
[ 1734.687859] pci 0000:01:00.0: enabling Extended Tags
[ 1734.688018] pci 0000:01:00.0: supports D1 D2
[ 1734.688019] pci 0000:01:00.0: PME# supported from D0 D1 D2 D3hot D3cold
[ 1734.688157] pci 0000:01:00.0: PTM enabled, 4ns granularity
[ 1734.688210] pci 0000:01:00.0: 8.000 Gb/s available PCIe bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:07.0 (capable of 31.504 Gb/s with 8.0 GT/s PCIe x4 link)
[ 1734.688409] pci 0000:01:00.0: Adding to iommu group 14
[ 1734.690634] pci 0000:01:00.0: bridge configuration invalid ([bus 00-00]), reconfiguring
[ 1734.690768] pci 0000:02:01.0: [8086:15ef] type 01 class 0x060400 PCIe Switch Downstream Port
[ 1734.690805] pci 0000:02:01.0: PCI bridge to [bus 00]
[ 1734.690814] pci 0000:02:01.0: bridge window [io 0x0000-0x0fff]
[ 1734.690818] pci 0000:02:01.0: bridge window [mem 0x00000000-0x000fffff]
[ 1734.690833] pci 0000:02:01.0: bridge window [mem 0x00000000-0x000fffff 64bit pref]
[ 1734.690853] pci 0000:02:01.0: enabling Extended Tags
[ 1734.691008] pci 0000:02:01.0: supports D1 D2
[ 1734.691009] pci 0000:02:01.0: PME# supported from D0 D1 D2 D3hot D3cold
[ 1734.691287] pci 0000:02:01.0: Adding to iommu group 15
[ 1734.691383] pci 0000:02:02.0: [8086:15ef] type 01 class 0x060400 PCIe Switch Downstream Port
[ 1734.691420] pci 0000:02:02.0: PCI bridge to [bus 00]
[ 1734.691429] pci 0000:02:02.0: bridge window [io 0x0000-0x0fff]
[ 1734.691433] pci 0000:02:02.0: bridge window [mem 0x00000000-0x000fffff]
[ 1734.691450] pci 0000:02:02.0: bridge window [mem 0x00000000-0x000fffff 64bit pref]
[ 1734.691470] pci 0000:02:02.0: enabling Extended Tags
[ 1734.691620] pci 0000:02:02.0: supports D1 D2
[ 1734.691620] pci 0000:02:02.0: PME# supported from D0 D1 D2 D3hot D3cold
[ 1734.691878] pci 0000:02:02.0: Adding to iommu group 16
[ 1734.691973] pci 0000:02:04.0: [8086:15ef] type 01 class 0x060400 PCIe Switch Downstream Port
[ 1734.692013] pci 0000:02:04.0: PCI bridge to [bus 00]
[ 1734.692022] pci 0000:02:04.0: bridge window [io 0x0000-0x0fff]
[ 1734.692025] pci 0000:02:04.0: bridge window [mem 0x00000000-0x000fffff]
[ 1734.692040] pci 0000:02:04.0: bridge window [mem 0x00000000-0x000fffff 64bit pref]
[ 1734.692060] pci 0000:02:04.0: enabling Extended Tags
[ 1734.692211] pci 0000:02:04.0: supports D1 D2
[ 1734.692211] pci 0000:02:04.0: PME# supported from D0 D1 D2 D3hot D3cold
[ 1734.692469] pci 0000:02:04.0: Adding to iommu group 17
[ 1734.692564] pci 0000:01:00.0: PCI bridge to [bus 02-2a]
[ 1734.692583] pci 0000:02:01.0: bridge configuration invalid ([bus 00-00]), reconfiguring
[ 1734.692593] pci 0000:02:02.0: bridge configuration invalid ([bus 00-00]), reconfiguring
[ 1734.692603] pci 0000:02:04.0: bridge configuration invalid ([bus 00-00]), reconfiguring
[ 1734.692710] pci 0000:03:00.0: [10de:2d04] type 00 class 0x030000 PCIe Legacy Endpoint
[ 1734.692787] pci 0000:03:00.0: BAR 0 [mem 0x00000000-0x03ffffff]
[ 1734.692792] pci 0000:03:00.0: BAR 1 [mem 0x00000000-0x0fffffff 64bit pref]
[ 1734.692797] pci 0000:03:00.0: BAR 3 [mem 0x00000000-0x01ffffff 64bit pref]
[ 1734.692800] pci 0000:03:00.0: BAR 5 [io 0x0000-0x007f]
[ 1734.692803] pci 0000:03:00.0: ROM [mem 0x00000000-0x0007ffff pref]
[ 1734.692890] pci 0000:03:00.0: Enabling HDA controller
[ 1734.693059] pci 0000:03:00.0: PME# supported from D0 D3hot
[ 1734.693170] pci 0000:03:00.0: VF BAR 0 [mem 0x00000000-0x0003ffff 64bit pref]
[ 1734.693171] pci 0000:03:00.0: VF BAR 0 [mem 0x00000000-0x0003ffff 64bit pref]: contains BAR 0 for 1 VFs
[ 1734.693176] pci 0000:03:00.0: VF BAR 2 [mem 0x00000000-0x0fffffff 64bit pref]
[ 1734.693177] pci 0000:03:00.0: VF BAR 2 [mem 0x00000000-0x0fffffff 64bit pref]: contains BAR 2 for 1 VFs
[ 1734.693181] pci 0000:03:00.0: VF BAR 4 [mem 0x00000000-0x01ffffff 64bit pref]
[ 1734.693182] pci 0000:03:00.0: VF BAR 4 [mem 0x00000000-0x01ffffff 64bit pref]: contains BAR 4 for 1 VFs
[ 1734.693464] pci 0000:03:00.0: 8.000 Gb/s available PCIe bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:00:07.0 (capable of 504.112 Gb/s with 32.0 GT/s PCIe x16 link)
[ 1734.693595] pci 0000:03:00.0: Adding to iommu group 18
[ 1734.693644] pci 0000:03:00.0: vgaarb: bridge control possible
[ 1734.693645] pci 0000:03:00.0: vgaarb: VGA device added: decodes=io+mem,owns=none,locks=none
[ 1734.693652] i915 0000:00:02.0: vgaarb: VGA decodes changed: olddecodes=io+mem,decodes=none:owns=io+mem
[ 1734.693720] pci 0000:03:00.1: [10de:22eb] type 00 class 0x040300 PCIe Endpoint
[ 1734.693798] pci 0000:03:00.1: BAR 0 [mem 0x00000000-0x00003fff]
[ 1734.694126] pci 0000:03:00.1: Adding to iommu group 18
[ 1734.696646] pci 0000:02:01.0: PCI bridge to [bus 03-2a]
[ 1734.696664] pci_bus 0000:03: busn_res: [bus 03-2a] end is updated to 16
[ 1734.696783] pci 0000:17:00.0: [8086:15f0] type 00 class 0x0c0330 PCIe Endpoint
[ 1734.696860] pci 0000:17:00.0: BAR 0 [mem 0x00000000-0x0000ffff]
[ 1734.696886] pci 0000:17:00.0: enabling Extended Tags
[ 1734.697107] pci 0000:17:00.0: supports D1 D2
[ 1734.697108] pci 0000:17:00.0: PME# supported from D0 D1 D2 D3hot D3cold
[ 1734.697424] pci 0000:17:00.0: Adding to iommu group 19
[ 1734.697534] pci 0000:02:02.0: PCI bridge to [bus 17-2a]
[ 1734.697553] pci_bus 0000:17: busn_res: [bus 17-2a] end is updated to 17
[ 1734.697636] pci 0000:02:04.0: PCI bridge to [bus 18-2a]
[ 1734.697652] pci_bus 0000:18: busn_res: [bus 18-2a] end is updated to 2a
[ 1734.697658] pci_bus 0000:02: busn_res: [bus 02-2a] end is updated to 2a
[ 1734.697664] pci 0000:02:01.0: bridge window [io 0x1000-0x1fff] to [bus 03-16] add_size 1000
[ 1734.697667] pcieport 0000:00:07.0: Assigned bridge window [mem 0x6000000000-0x601bffffff 64bit pref] to [bus 01-2a] cannot fit 0x30000000 required for 0000:02:01.0 bridging to [bus 03-16]
[ 1734.697669] pci 0000:02:01.0: bridge window [mem 0x00000000-0x000fffff 64bit pref] to [bus 03-16] requires relaxed alignment rules
[ 1734.697670] pci 0000:02:01.0: bridge window [mem 0x10000000-0x27ffffff 64bit pref] to [bus 03-16] add_size c100000 add_align 10000000
[ 1734.697672] pcieport 0000:00:07.0: Assigned bridge window [mem 0x74000000-0x801fffff] to [bus 01-2a] cannot fit 0x6000000 required for 0000:02:01.0 bridging to [bus 03-16]
[ 1734.697673] pci 0000:02:01.0: bridge window [mem 0x00000000-0x000fffff] to [bus 03-16] requires relaxed alignment rules
[ 1734.697674] pci 0000:02:01.0: bridge window [mem 0x04000000-0x080fffff] to [bus 03-16] add_size 3f00000 add_align 4000000
[ 1734.697675] pcieport 0000:00:07.0: Assigned bridge window [mem 0x6000000000-0x601bffffff 64bit pref] to [bus 01-2a] cannot fit 0x100000 required for 0000:02:02.0 bridging to [bus 17]
[ 1734.697676] pci 0000:02:02.0: bridge window [mem 0x00000000-0x000fffff 64bit pref] to [bus 17] requires relaxed alignment rules
[ 1734.697677] pcieport 0000:00:07.0: Assigned bridge window [mem 0x74000000-0x801fffff] to [bus 01-2a] cannot fit 0x100000 required for 0000:02:02.0 bridging to [bus 17]
[ 1734.697678] pci 0000:02:02.0: bridge window [mem 0x00000000-0x000fffff] to [bus 17] requires relaxed alignment rules
[ 1734.697679] pcieport 0000:00:07.0: Assigned bridge window [mem 0x6000000000-0x601bffffff 64bit pref] to [bus 01-2a] cannot fit 0x100000 required for 0000:02:04.0 bridging to [bus 18-2a]
[ 1734.697680] pci 0000:02:04.0: bridge window [mem 0x00000000-0x000fffff 64bit pref] to [bus 18-2a] requires relaxed alignment rules
[ 1734.697681] pci 0000:02:04.0: bridge window [mem 0x00100000-0x001fffff 64bit pref] to [bus 18-2a] add_size 100000 add_align 100000
[ 1734.697682] pcieport 0000:00:07.0: Assigned bridge window [mem 0x74000000-0x801fffff] to [bus 01-2a] cannot fit 0x100000 required for 0000:02:04.0 bridging to [bus 18-2a]
[ 1734.697683] pci 0000:02:04.0: bridge window [mem 0x00000000-0x000fffff] to [bus 18-2a] requires relaxed alignment rules
[ 1734.697684] pci 0000:02:04.0: bridge window [mem 0x00100000-0x001fffff] to [bus 18-2a] add_size 100000 add_align 100000
[ 1734.697685] pci 0000:01:00.0: bridge window [io 0x1000-0x3fff] to [bus 02-2a] add_size 1000
[ 1734.697686] pcieport 0000:00:07.0: Assigned bridge window [mem 0x6000000000-0x601bffffff 64bit pref] to [bus 01-2a] cannot fit 0x20000000 required for 0000:01:00.0 bridging to [bus 02-2a]
[ 1734.697688] pci 0000:01:00.0: bridge window [mem 0x00000000-0x000fffff 64bit pref] to [bus 02-2a] requires relaxed alignment rules
[ 1734.697688] pcieport 0000:00:07.0: Assigned bridge window [mem 0x6000000000-0x601bffffff 64bit pref] to [bus 01-2a] cannot fit 0x30000000 required for 0000:01:00.0 bridging to [bus 02-2a]
[ 1734.697689] pci 0000:01:00.0: bridge window [mem 0x00000000-0x000fffff 64bit pref] to [bus 02-2a] requires relaxed alignment rules
[ 1734.697690] pci 0000:01:00.0: bridge window [mem 0x10000000-0x281fffff 64bit pref] to [bus 02-2a] add_size c200000 add_align 10000000
[ 1734.697691] pci 0000:01:00.0: bridge window [mem 0x02000000-0x07ffffff] to [bus 02-2a] add_size 6000000 add_align 4000000
[ 1734.697696] pci 0000:01:00.0: bridge window [mem size 0x24400000 64bit pref]: can't assign; no space
[ 1734.697697] pci 0000:01:00.0: bridge window [mem size 0x24400000 64bit pref]: failed to assign
[ 1734.697699] pci 0000:01:00.0: bridge window [mem 0x74000000-0x7fffffff]: assigned
[ 1734.697700] pci 0000:01:00.0: bridge window [io size 0x4000]: can't assign; no space
[ 1734.697701] pci 0000:01:00.0: bridge window [io size 0x4000]: failed to assign
[ 1734.697702] pci 0000:01:00.0: bridge window [mem 0x6000000000-0x60181fffff 64bit pref]: assigned
[ 1734.697702] pci 0000:01:00.0: bridge window [mem 0x74000000-0x7fffffff]: assigned
[ 1734.697703] pci 0000:01:00.0: bridge window [io size 0x3000]: can't assign; no space
[ 1734.697704] pci 0000:01:00.0: bridge window [io size 0x3000]: failed to assign
[ 1734.697705] pci 0000:01:00.0: bridge window [mem 0x6000000000-0x60181fffff 64bit pref]: failed to expand by 0xc200000
[ 1734.697706] pci 0000:01:00.0: bridge window [mem 0x6000000000-0x60181fffff 64bit pref]: failed to add c200000
[ 1734.697708] pci 0000:02:01.0: bridge window [mem 0x6000000000-0x60081fffff 64bit pref]: assigned
[ 1734.697709] pci 0000:02:01.0: bridge window [mem 0x74000000-0x742fffff]: assigned
[ 1734.697709] pci 0000:02:02.0: bridge window [mem 0x74300000-0x743fffff]: assigned
[ 1734.697710] pci 0000:02:02.0: bridge window [mem 0x6008200000-0x60082fffff 64bit pref]: assigned
[ 1734.697711] pci 0000:02:04.0: bridge window [mem 0x74400000-0x782fffff]: assigned
[ 1734.697712] pci 0000:02:04.0: bridge window [mem 0x6008300000-0x60084fffff 64bit pref]: assigned
[ 1734.697712] pci 0000:02:01.0: bridge window [io size 0x2000]: can't assign; no space
[ 1734.697713] pci 0000:02:01.0: bridge window [io size 0x2000]: failed to assign
[ 1734.697714] pci 0000:02:02.0: bridge window [io size 0x1000]: can't assign; no space
[ 1734.697714] pci 0000:02:02.0: bridge window [io size 0x1000]: failed to assign
[ 1734.697715] pci 0000:02:04.0: bridge window [io size 0x1000]: can't assign; no space
[ 1734.697716] pci 0000:02:04.0: bridge window [io size 0x1000]: failed to assign
[ 1734.697717] pci 0000:02:01.0: bridge window [io size 0x1000]: can't assign; no space
[ 1734.697717] pci 0000:02:01.0: bridge window [io size 0x1000]: failed to assign
[ 1734.697718] pci 0000:02:02.0: bridge window [io size 0x1000]: can't assign; no space
[ 1734.697719] pci 0000:02:02.0: bridge window [io size 0x1000]: failed to assign
[ 1734.697719] pci 0000:02:04.0: bridge window [io size 0x1000]: can't assign; no space
[ 1734.697720] pci 0000:02:04.0: bridge window [io size 0x1000]: failed to assign
[ 1734.697722] pci 0000:03:00.0: BAR 1 [mem size 0x10000000 64bit pref]: can't assign; no space
[ 1734.697722] pci 0000:03:00.0: BAR 1 [mem size 0x10000000 64bit pref]: failed to assign
[ 1734.697723] pci 0000:03:00.0: VF BAR 2 [mem size 0x10000000 64bit pref]: can't assign; no space
[ 1734.697724] pci 0000:03:00.0: VF BAR 2 [mem size 0x10000000 64bit pref]: failed to assign
[ 1734.697725] pci 0000:03:00.0: BAR 0 [mem size 0x04000000]: can't assign; no space
[ 1734.697726] pci 0000:03:00.0: BAR 0 [mem size 0x04000000]: failed to assign
[ 1734.697726] pci 0000:03:00.0: BAR 3 [mem 0x6000000000-0x6001ffffff 64bit pref]: assigned
[ 1734.697742] pci 0000:03:00.0: VF BAR 4 [mem 0x6002000000-0x6003ffffff 64bit pref]: assigned
[ 1734.697749] pci 0000:03:00.0: ROM [mem 0x74000000-0x7407ffff pref]: assigned
[ 1734.697750] pci 0000:03:00.0: VF BAR 0 [mem 0x6004000000-0x600403ffff 64bit pref]: assigned
[ 1734.697757] pci 0000:03:00.1: BAR 0 [mem 0x74080000-0x74083fff]: assigned
[ 1734.697761] pci 0000:03:00.0: BAR 5 [io size 0x0080]: can't assign; no space
[ 1734.697762] pci 0000:03:00.0: BAR 5 [io size 0x0080]: failed to assign
[ 1734.697763] pci 0000:03:00.0: BAR 1 [mem size 0x10000000 64bit pref]: can't assign; no space
[ 1734.697764] pci 0000:03:00.0: BAR 1 [mem size 0x10000000 64bit pref]: failed to assign
[ 1734.697765] pci 0000:03:00.0: BAR 0 [mem size 0x04000000]: can't assign; no space
[ 1734.697765] pci 0000:03:00.0: BAR 0 [mem size 0x04000000]: failed to assign
[ 1734.697766] pci 0000:03:00.0: BAR 3 [mem 0x6000000000-0x6001ffffff 64bit pref]: assigned
[ 1734.697781] pci 0000:03:00.0: ROM [mem 0x74000000-0x7407ffff pref]: assigned
[ 1734.697782] pci 0000:03:00.1: BAR 0 [mem 0x74080000-0x74083fff]: assigned
[ 1734.697787] pci 0000:03:00.0: BAR 5 [io size 0x0080]: can't assign; no space
[ 1734.697788] pci 0000:03:00.0: BAR 5 [io size 0x0080]: failed to assign
[ 1734.697789] pci 0000:03:00.0: VF BAR 4 [mem 0x6002000000-0x6003ffffff 64bit pref]: assigned
[ 1734.697795] pci 0000:03:00.0: VF BAR 2 [mem size 0x10000000 64bit pref]: can't assign; no space
[ 1734.697796] pci 0000:03:00.0: VF BAR 2 [mem size 0x10000000 64bit pref]: failed to assign
[ 1734.697797] pci 0000:03:00.0: VF BAR 0 [mem 0x6004000000-0x600403ffff 64bit pref]: assigned
[ 1734.697804] pci 0000:02:01.0: PCI bridge to [bus 03-16]
[ 1734.697809] pci 0000:02:01.0: bridge window [mem 0x74000000-0x742fffff]
[ 1734.697813] pci 0000:02:01.0: bridge window [mem 0x6000000000-0x60081fffff 64bit pref]
[ 1734.697821] pci 0000:17:00.0: BAR 0 [mem 0x74300000-0x7430ffff]: assigned
[ 1734.697825] pci 0000:02:02.0: PCI bridge to [bus 17]
[ 1734.697831] pci 0000:02:02.0: bridge window [mem 0x74300000-0x743fffff]
[ 1734.697834] pci 0000:02:02.0: bridge window [mem 0x6008200000-0x60082fffff 64bit pref]
[ 1734.697841] pci 0000:02:04.0: PCI bridge to [bus 18-2a]
[ 1734.697847] pci 0000:02:04.0: bridge window [mem 0x74400000-0x782fffff]
[ 1734.697850] pci 0000:02:04.0: bridge window [mem 0x6008300000-0x60084fffff 64bit pref]
[ 1734.697857] pci 0000:01:00.0: PCI bridge to [bus 02-2a]
[ 1734.697863] pci 0000:01:00.0: bridge window [mem 0x74000000-0x7fffffff]
[ 1734.697866] pci 0000:01:00.0: bridge window [mem 0x6000000000-0x60181fffff 64bit pref]
[ 1734.697873] pcieport 0000:00:07.0: PCI bridge to [bus 01-2a]
[ 1734.697875] pcieport 0000:00:07.0: bridge window [io 0x4000-0x4fff]
[ 1734.697877] pcieport 0000:00:07.0: bridge window [mem 0x74000000-0x801fffff]
[ 1734.697878] pcieport 0000:00:07.0: bridge window [mem 0x6000000000-0x601bffffff 64bit pref]
[ 1734.697881] PCI: No. 2 try to assign unassigned res
[ 1734.697881] release child resource [mem 0x74000000-0x7407ffff pref]
[ 1734.697882] release child resource [mem 0x74080000-0x74083fff]
[ 1734.697883] pci 0000:02:01.0: resource 14 [mem 0x74000000-0x742fffff] released
[ 1734.697884] pci 0000:02:01.0: PCI bridge to [bus 03-16]
[ 1734.697887] release child resource [mem 0x6000000000-0x6001ffffff 64bit pref]
[ 1734.697888] release child resource [mem 0x6002000000-0x6003ffffff 64bit pref]
[ 1734.697888] release child resource [mem 0x6004000000-0x600403ffff 64bit pref]
[ 1734.697889] pci 0000:02:01.0: resource 15 [mem 0x6000000000-0x60081fffff 64bit pref] released
[ 1734.697890] pci 0000:02:01.0: PCI bridge to [bus 03-16]
[ 1734.697899] pcieport 0000:00:07.0: resource 13 [io 0x4000-0x4fff] released
[ 1734.697900] pcieport 0000:00:07.0: PCI bridge to [bus 01-2a]
[ 1734.697902] pci 0000:02:01.0: bridge window [io 0x1000-0x1fff] to [bus 03-16] add_size 1000
[ 1734.697904] pci 0000:01:00.0: Assigned bridge window [mem 0x6000000000-0x60181fffff 64bit pref] to [bus 02-2a] cannot fit 0x18000000 required for 0000:02:01.0 bridging to [bus 03-16]
[ 1734.697905] pci 0000:02:01.0: bridge window [mem 0x00000000-0x081fffff 64bit pref] to [bus 03-16] requires relaxed alignment rules
[ 1734.697906] pci 0000:01:00.0: Assigned bridge window [mem 0x6000000000-0x60181fffff 64bit pref] to [bus 02-2a] cannot fit 0x20000000 required for 0000:02:01.0 bridging to [bus 03-16]
[ 1734.697907] pci 0000:02:01.0: bridge window [mem 0x00000000-0x081fffff 64bit pref] to [bus 03-16] requires relaxed alignment rules
[ 1734.697907] pci 0000:02:01.0: bridge window [mem 0x10000000-0x21ffffff 64bit pref] to [bus 03-16] add_size 2100000 add_align 10000000
[ 1734.697909] pci 0000:01:00.0: Assigned bridge window [mem 0x74000000-0x7fffffff] to [bus 02-2a] cannot fit 0x6000000 required for 0000:02:01.0 bridging to [bus 03-16]
[ 1734.697910] pci 0000:02:01.0: bridge window [mem 0x00000000-0x002fffff] to [bus 03-16] requires relaxed alignment rules
[ 1734.697911] pci 0000:01:00.0: Assigned bridge window [mem 0x74000000-0x7fffffff] to [bus 02-2a] cannot fit 0x8000000 required for 0000:02:01.0 bridging to [bus 03-16]
[ 1734.697912] pci 0000:02:01.0: bridge window [mem 0x00000000-0x002fffff] to [bus 03-16] requires relaxed alignment rules
[ 1734.697913] pci 0000:01:00.0: bridge window [io 0x1000-0x3fff] to [bus 02-2a] add_size 1000
[ 1734.697914] pcieport 0000:00:07.0: bridge window [io 0x1000-0x3fff] to [bus 01-2a] add_size 1000
[ 1734.697917] pcieport 0000:00:07.0: bridge window [io 0x4000-0x7fff]: assigned
[ 1734.697918] pci 0000:01:00.0: bridge window [io 0x4000-0x7fff]: assigned
[ 1734.697920] pci 0000:02:01.0: bridge window [mem size 0x0c000000 64bit pref]: can't assign; no space
[ 1734.697921] pci 0000:02:01.0: bridge window [mem size 0x0c000000 64bit pref]: failed to assign
[ 1734.697922] pci 0000:02:01.0: bridge window [mem size 0x04100000]: can't assign; no space
[ 1734.697922] pci 0000:02:01.0: bridge window [mem size 0x04100000]: failed to assign
[ 1734.697923] pci 0000:02:01.0: bridge window [io 0x4000-0x5fff]: assigned
[ 1734.697924] pci 0000:02:02.0: bridge window [io 0x6000-0x6fff]: assigned
[ 1734.697925] pci 0000:02:04.0: bridge window [io 0x7000-0x7fff]: assigned
[ 1734.697926] pci 0000:02:01.0: bridge window [mem size 0x0c000000 64bit pref]: can't assign; no space
[ 1734.697927] pci 0000:02:01.0: bridge window [mem size 0x0c000000 64bit pref]: failed to assign
[ 1734.697928] pci 0000:02:01.0: bridge window [mem size 0x04100000]: can't assign; no space
[ 1734.697928] pci 0000:02:01.0: bridge window [mem size 0x04100000]: failed to assign
[ 1734.697930] pci 0000:03:00.0: BAR 1 [mem size 0x10000000 64bit pref]: can't assign; no space
[ 1734.697930] pci 0000:03:00.0: BAR 1 [mem size 0x10000000 64bit pref]: failed to assign
[ 1734.697931] pci 0000:03:00.0: BAR 0 [mem size 0x04000000]: can't assign; no space
[ 1734.697932] pci 0000:03:00.0: BAR 0 [mem size 0x04000000]: failed to assign
[ 1734.697933] pci 0000:03:00.0: BAR 3 [mem size 0x02000000 64bit pref]: can't assign; no space
[ 1734.697933] pci 0000:03:00.0: BAR 3 [mem size 0x02000000 64bit pref]: failed to assign
[ 1734.697934] pci 0000:03:00.0: VF BAR 4 [mem size 0x02000000 64bit pref]: can't assign; no space
[ 1734.697935] pci 0000:03:00.0: VF BAR 4 [mem size 0x02000000 64bit pref]: failed to assign
[ 1734.697935] pci 0000:03:00.0: ROM [mem size 0x00080000 pref]: can't assign; no space
[ 1734.697936] pci 0000:03:00.0: ROM [mem size 0x00080000 pref]: failed to assign
[ 1734.697937] pci 0000:03:00.0: VF BAR 0 [mem size 0x00040000 64bit pref]: can't assign; no space
[ 1734.697938] pci 0000:03:00.0: VF BAR 0 [mem size 0x00040000 64bit pref]: failed to assign
[ 1734.697938] pci 0000:03:00.1: BAR 0 [mem size 0x00004000]: can't assign; no space
[ 1734.697939] pci 0000:03:00.1: BAR 0 [mem size 0x00004000]: failed to assign
[ 1734.697940] pci 0000:03:00.0: BAR 5 [io 0x4000-0x407f]: assigned
[ 1734.697945] pci 0000:03:00.0: BAR 1 [mem size 0x10000000 64bit pref]: can't assign; no space
[ 1734.697946] pci 0000:03:00.0: BAR 1 [mem size 0x10000000 64bit pref]: failed to assign
[ 1734.697946] pci 0000:03:00.0: BAR 0 [mem size 0x04000000]: can't assign; no space
[ 1734.697947] pci 0000:03:00.0: BAR 0 [mem size 0x04000000]: failed to assign
[ 1734.697948] pci 0000:03:00.0: BAR 3 [mem size 0x02000000 64bit pref]: can't assign; no space
[ 1734.697948] pci 0000:03:00.0: BAR 3 [mem size 0x02000000 64bit pref]: failed to assign
[ 1734.697949] pci 0000:03:00.0: ROM [mem size 0x00080000 pref]: can't assign; no space
[ 1734.697950] pci 0000:03:00.0: ROM [mem size 0x00080000 pref]: failed to assign
[ 1734.697950] pci 0000:03:00.1: BAR 0 [mem size 0x00004000]: can't assign; no space
[ 1734.697951] pci 0000:03:00.1: BAR 0 [mem size 0x00004000]: failed to assign
[ 1734.697952] pci 0000:03:00.0: VF BAR 4 [mem size 0x02000000 64bit pref]: can't assign; no space
[ 1734.697952] pci 0000:03:00.0: VF BAR 4 [mem size 0x02000000 64bit pref]: failed to assign
[ 1734.697953] pci 0000:03:00.0: VF BAR 0 [mem size 0x00040000 64bit pref]: can't assign; no space
[ 1734.697954] pci 0000:03:00.0: VF BAR 0 [mem size 0x00040000 64bit pref]: failed to assign
[ 1734.697955] pci 0000:02:01.0: PCI bridge to [bus 03-16]
[ 1734.697957] pci 0000:02:01.0: bridge window [io 0x4000-0x5fff]
[ 1734.697971] pci 0000:02:02.0: PCI bridge to [bus 17]
[ 1734.697974] pci 0000:02:02.0: bridge window [io 0x6000-0x6fff]
[ 1734.697979] pci 0000:02:02.0: bridge window [mem 0x74300000-0x743fffff]
[ 1734.697983] pci 0000:02:02.0: bridge window [mem 0x6008200000-0x60082fffff 64bit pref]
[ 1734.697990] pci 0000:02:04.0: PCI bridge to [bus 18-2a]
[ 1734.697992] pci 0000:02:04.0: bridge window [io 0x7000-0x7fff]
[ 1734.697997] pci 0000:02:04.0: bridge window [mem 0x74400000-0x782fffff]
[ 1734.698001] pci 0000:02:04.0: bridge window [mem 0x6008300000-0x60084fffff 64bit pref]
[ 1734.698008] pci 0000:01:00.0: PCI bridge to [bus 02-2a]
[ 1734.698010] pci 0000:01:00.0: bridge window [io 0x4000-0x7fff]
[ 1734.698015] pci 0000:01:00.0: bridge window [mem 0x74000000-0x7fffffff]
[ 1734.698019] pci 0000:01:00.0: bridge window [mem 0x6000000000-0x60181fffff 64bit pref]
[ 1734.698026] pcieport 0000:00:07.0: PCI bridge to [bus 01-2a]
[ 1734.698027] pcieport 0000:00:07.0: bridge window [io 0x4000-0x7fff]
[ 1734.698029] pcieport 0000:00:07.0: bridge window [mem 0x74000000-0x801fffff]
[ 1734.698031] pcieport 0000:00:07.0: bridge window [mem 0x6000000000-0x601bffffff 64bit pref]
[ 1734.698682] pcieport 0000:01:00.0: enabling device (0000 -> 0003)
[ 1734.698873] pcieport 0000:02:01.0: enabling device (0000 -> 0001)
[ 1734.699007] pcieport 0000:02:01.0: pciehp: Slot #1 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise+ Interlock- NoCompl+ IbPresDis- LLActRep+
[ 1734.699290] pcieport 0000:02:02.0: enabling device (0000 -> 0003)
[ 1734.699465] pcieport 0000:02:04.0: enabling device (0000 -> 0003)
[ 1734.699587] pcieport 0000:02:04.0: pciehp: Slot #4 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise+ Interlock- NoCompl+ IbPresDis- LLActRep+
[ 1734.699823] pci 0000:03:00.1: extending delay after power-on from D3hot to 20 msec
[ 1734.699887] pci 0000:03:00.1: D0 power state depends on 0000:03:00.0
[ 1734.700083] snd_hda_intel 0000:03:00.1: Disabling MSI
[ 1734.700087] snd_hda_intel 0000:03:00.1: Handle vga_switcheroo audio client
[ 1734.700108] pci 0000:17:00.0: enabling device (0000 -> 0002)
[ 1734.700299] xhci_hcd 0000:17:00.0: xHCI Host Controller
[ 1734.700302] xhci_hcd 0000:17:00.0: new USB bus registered, assigned bus number 5
[ 1734.701526] xhci_hcd 0000:17:00.0: hcc params 0x200077c1 hci version 0x110 quirks 0x0000000200009810
[ 1734.701663] snd_hda_intel 0000:03:00.1: GPU sound probed, but not operational: please add a quirk to driver_denylist
[ 1734.701907] xhci_hcd 0000:17:00.0: xHCI Host Controller
[ 1734.701908] xhci_hcd 0000:17:00.0: new USB bus registered, assigned bus number 6
[ 1734.701910] xhci_hcd 0000:17:00.0: Host supports USB 3.1 Enhanced SuperSpeed
[ 1734.701940] usb usb5: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.14
[ 1734.701941] usb usb5: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 1734.701942] usb usb5: Product: xHCI Host Controller
[ 1734.701943] usb usb5: Manufacturer: Linux 6.14.0-32-generic xhci-hcd
[ 1734.701944] usb usb5: SerialNumber: 0000:17:00.0
[ 1734.702014] hub 5-0:1.0: USB hub found
[ 1734.702022] hub 5-0:1.0: 2 ports detected
[ 1734.702112] usb usb6: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 6.14
[ 1734.702114] usb usb6: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 1734.702116] usb usb6: Product: xHCI Host Controller
[ 1734.702116] usb usb6: Manufacturer: Linux 6.14.0-32-generic xhci-hcd
[ 1734.702117] usb usb6: SerialNumber: 0000:17:00.0
[ 1734.702200] hub 6-0:1.0: USB hub found
[ 1734.702207] hub 6-0:1.0: 2 ports detected
[ 1734.757854] nvidia-nvlink: Nvlink Core is being initialized, major device number 508
[ 1734.761716] nvidia 0000:03:00.0: enabling device (0000 -> 0001)
[ 1734.761804] NVRM: This PCI I/O region assigned to your NVIDIA device is invalid:
NVRM: BAR0 is 0M @ 0x0 (PCI:0000:03:00.0)
[ 1734.761855] nvidia 0000:03:00.0: probe with driver nvidia failed with error -1
[ 1734.761906] NVRM: The NVIDIA probe routine failed for 1 device(s).
[ 1734.761907] NVRM: None of the NVIDIA devices were initialized.
[ 1734.762359] nvidia-nvlink: Unregistered Nvlink Core, major device number 508
- Dell Inspiron 7630 Plus with
i7-13700H - TH3P4G3 eGPU dock (Thunderbolt 3)
- RTX5060Ti 16GB
UPDATED: new method, no longer randomly crash.
Use lspci -tv (and lspci -vvvv) to find the PCIe bridge of your GPU. Here is the output on my laptop (Intel Raptor Lake with intergrated Thunderbolt controller):
$ lspci -tv
-[0000:00]-+-00.0 Intel Corporation Raptor Lake-P 6p+8e cores Host Bridge/DRAM Controller
+-02.0 Intel Corporation Raptor Lake-P [Iris Xe Graphics]
+-04.0 Intel Corporation Raptor Lake Dynamic Platform and Thermal Framework Processor Participant
+-06.0 Intel Corporation RST VMD Managed Controller
+-07.0-[01-2a]----00.0-[02-2a]--+-01.0-[03-16]--+-00.0 NVIDIA Corporation Device 2d04
| | \-00.1 NVIDIA Corporation Device 22eb
| +-02.0-[17]----00.0 Intel Corporation JHL7440 Thunderbolt 3 USB Controller [Titan Ridge DD 2018]
| \-04.0-[18-2a]--
+-08.0 Intel Corporation GNA Scoring Accelerator module
+-0d.0 Intel Corporation Raptor Lake-P Thunderbolt 4 USB Controller
+-0d.2 Intel Corporation Raptor Lake-P Thunderbolt 4 NHI #0
+-0e.0 Intel Corporation Volume Management Device NVMe RAID Controller Intel Corporation
+-12.0 Intel Corporation Alder Lake-P Integrated Sensor Hub
+-14.0 Intel Corporation Alder Lake PCH USB 3.2 xHCI Host Controller
+-14.2 Intel Corporation Alder Lake PCH Shared SRAM
+-14.3 Intel Corporation Raptor Lake PCH CNVi WiFi
+-15.0 Intel Corporation Alder Lake PCH Serial IO I2C Controller #0
+-15.1 Intel Corporation Alder Lake PCH Serial IO I2C Controller #1
+-16.0 Intel Corporation Alder Lake PCH HECI Controller
+-1f.0 Intel Corporation Raptor Lake LPC/eSPI Controller
+-1f.3 Intel Corporation Raptor Lake-P/U/H cAVS
+-1f.4 Intel Corporation Alder Lake PCH-P SMBus Host Controller
\-1f.5 Intel Corporation Alder Lake-P PCH SPI Controller
-[10000:e0]---06.0-[e1]----00.0 Sandisk Corp PC SN740 NVMe SSD (DRAM-less)In my case, it's 0000:01:00.0. You can see it on lspci -tv as 01.0-[03-16] and on lspci -vvvv it appears as:
0000:01:00.0 PCI bridge: Intel Corporation JHL7440 Thunderbolt 3 Bridge [Titan Ridge DD 2018] (rev 06) (prog-if 00 [Normal decode])
Subsystem: Intel Corporation Device 0000
Physical Slot: 3
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
Latency: 0
Interrupt: pin A routed to IRQ 16
IOMMU group: 14
Bus: primary=01, secondary=02, subordinate=2a, sec-latency=0
I/O behind bridge: 5000-7fff [size=12K] [16-bit]
Memory behind bridge: 74000000-7fffffff [size=192M] [32-bit]
Prefetchable memory behind bridge: 4100000000-413fffffff [size=1G] [32-bit]
Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-
BridgeCtl: Parity- SERR+ NoISA- VGA- VGA16- MAbort- >Reset- FastB2B-
PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
Capabilities: [80] Power Management version 3
Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=375mA PME(D0+,D1+,D2+,D3hot+,D3cold+)
Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
Capabilities: [88] MSI: Enable- Count=1/1 Maskable- 64bit+
Address: 0000000000000000 Data: 0000
Capabilities: [ac] Subsystem: Intel Corporation Device 0000
Capabilities: [c0] Express (v2) Upstream Port, IntMsgNum 0
DevCap: MaxPayload 128 bytes, PhantFunc 0
ExtTag+ AttnBtn- AttnInd- PwrInd- RBE+ SlotPowerLimit 0W TEE-IO-
DevCtl: CorrErr- NonFatalErr- FatalErr- UnsupReq-
RlxdOrd+ ExtTag+ PhantFunc- AuxPwr- NoSnoop+
MaxPayload 128 bytes, MaxReadReq 512 bytes
DevSta: CorrErr- NonFatalErr- FatalErr- UnsupReq- AuxPwr+ TransPend-
LnkCap: Port #3, Speed 8GT/s, Width x4, ASPM L1, Exit Latency L1 <2us
ClockPM- Surprise- LLActRep- BwNot- ASPMOptComp+
LnkCtl: ASPM Disabled; LnkDisable- CommClk+
ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
LnkSta: Speed 2.5GT/s (downgraded), Width x4
TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
DevCap2: Completion Timeout: Not Supported, TimeoutDis- NROPrPrP- LTR+
10BitTagComp- 10BitTagReq- OBFF Not Supported, ExtFmt- EETLPPrefix-
EmergencyPowerReduction Not Supported, EmergencyPowerReductionInit-
FRS-
AtomicOpsCap: Routing-
DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-
AtomicOpsCtl: EgressBlck-
IDOReq- IDOCompl- LTR+ EmergencyPowerReductionReq-
10BitTagReq- OBFF Disabled, EETLPPrefixBlk-
LnkCap2: Supported Link Speeds: 2.5-8GT/s, Crosslink- Retimer- 2Retimers- DRS-
LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-
Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
Compliance Preset/De-emphasis: -6dB de-emphasis, 0dB preshoot
LnkSta2: Current De-emphasis Level: -3.5dB, EqualizationComplete- EqualizationPhase1-
EqualizationPhase2- EqualizationPhase3- LinkEqualizationRequest-
Retimer- 2Retimers- CrosslinkRes: unsupported
Capabilities: [50] Capability ID 0x15 [0000]
Capabilities: [100 v1] Device Serial Number d8-df-24-a9-ea-e9-07-00
Capabilities: [200 v1] Advanced Error Reporting
UESta: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP-
ECRC- UnsupReq- ACSViol- UncorrIntErr- BlockedTLP- AtomicOpBlocked- TLPBlockedErr-
PoisonTLPBlocked- DMWrReqBlocked- IDECheck- MisIDETLP- PCRC_CHECK- TLPXlatBlocked-
UEMsk: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP-
ECRC- UnsupReq- ACSViol- UncorrIntErr- BlockedTLP- AtomicOpBlocked- TLPBlockedErr-
PoisonTLPBlocked- DMWrReqBlocked- IDECheck- MisIDETLP- PCRC_CHECK- TLPXlatBlocked-
UESvrt: DLP+ SDES- TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+
ECRC- UnsupReq- ACSViol- UncorrIntErr+ BlockedTLP- AtomicOpBlocked- TLPBlockedErr-
PoisonTLPBlocked- DMWrReqBlocked- IDECheck- MisIDETLP- PCRC_CHECK- TLPXlatBlocked-
CESta: RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr- CorrIntErr- HeaderOF-
CEMsk: RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr+ CorrIntErr- HeaderOF-
AERCap: First Error Pointer: 00, ECRCGenCap- ECRCGenEn- ECRCChkCap- ECRCChkEn-
MultHdrRecCap- MultHdrRecEn- TLPPfxPres- HdrLogCap-
HeaderLog: 00000000 00000000 00000000 00000000
Capabilities: [300 v1] Virtual Channel
Caps: LPEVC=0 RefClk=100ns PATEntryBits=1
Arb: Fixed- WRR32- WRR64- WRR128-
Ctrl: ArbSelect=Fixed
Status: InProgress-
VC0: Caps: PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-
Arb: Fixed+ WRR32- WRR64- WRR128- TWRR128- WRR256-
Ctrl: Enable+ ID=0 ArbSelect=Fixed TC/VC=ff
Status: NegoPending- InProgress-
Capabilities: [400 v1] Power Budgeting <?>
Capabilities: [500 v1] Vendor Specific Information: ID=1234 Rev=1 Len=100 <?>
Capabilities: [600 v1] Vendor Specific Information: ID=8086 Rev=2 Len=04c <?>
Capabilities: [700 v1] Secondary PCI Express
LnkCtl3: LnkEquIntrruptEn- PerformEqu-
LaneErrStat: 0
Capabilities: [800 v1] Latency Tolerance Reporting
Max snoop latency: 0ns
Max no snoop latency: 0ns
Capabilities: [a00 v1] L1 PM Substates
L1SubCap: PCI-PM_L1.2+ PCI-PM_L1.1+ ASPM_L1.2+ ASPM_L1.1+ L1_PM_Substates+
PortCommonModeRestoreTime=0us PortTPowerOnTime=10us
L1SubCtl1: PCI-PM_L1.2- PCI-PM_L1.1- ASPM_L1.2- ASPM_L1.1-
T_CommonMode=0us LTR1.2_Threshold=0ns
L1SubCtl2: T_PwrOn=10us
Capabilities: [b00 v1] Precision Time Measurement
PTMCap: Requester+ Responder+ Root-
PTMClockGranularity: Unimplemented
PTMControl: Enabled+ RootSelected-
PTMEffectiveGranularity: 4ns
Kernel driver in use: pcieport
Enter root shell using su - (it WILL NOT work with sudo if you run the commands directly with sudo; but you can create a shell script and sudo that script, that's what I did).
Run these commands to detach the PCIe bridge and rescan the bus (remember to replace 0000\:00\:01.0) with the ID you found above; you need to escape the address string btw):
echo 1 > /sys/bus/pci/devices/0000\:00\:01.0/remove
echo 1 > /sys/bus/pci/rescanAfter that, your eGPU will start working as expected. You can verify using dmesg and nvidia-smi. I run LLM on this and the performance is the same or better than Windows.
Yes, but
- I'm lazy to do so;
- I don't plug eGPU in all the time;
Sometimes the command will freeze, so running this on every boot automatically is not good.FIXED.
Yes it does. In fact if you hotplug the eGPU when Windows already boot, it will detatch and recan the whole bus. In my case, WiFi always disappear for a while when I hotplug my eGPU on Windows.