Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Intel X710-TM4 nics not found #731

Closed
loood opened this issue Aug 31, 2022 · 26 comments · Fixed by #801
Closed

Intel X710-TM4 nics not found #731

loood opened this issue Aug 31, 2022 · 26 comments · Fixed by #801

Comments

@loood
Copy link

loood commented Aug 31, 2022

I'm using ipxe.iso to boot a Supermicro A+ Server 1124US-TNRP which uses a Intel X710-TM4. ipxe doesn't seem to see the intel nics. Wanted to find out if those nics are suppose to be supported or what I can do to help get those supported?

@mcb30
Copy link
Member

mcb30 commented Aug 31, 2022

What are the PCI vendor:device IDs for this NIC?

@NiKiZe
Copy link
Contributor

NiKiZe commented Aug 31, 2022

Also verify that you are using the latest version of iPXE. (And post the version number to verify)

@loood
Copy link
Author

loood commented Sep 1, 2022

Here is the lspci output with vendor:device info for the nics

~ # lspci -nn | grep -i intel
44:00.0 Ethernet controller [0200]: Intel Corporation Device [8086:15ff] (rev 02)
44:00.1 Ethernet controller [0200]: Intel Corporation Device [8086:15ff] (rev 02)
44:00.2 Ethernet controller [0200]: Intel Corporation Device [8086:104e] (rev 02)
44:00.3 Ethernet controller [0200]: Intel Corporation Device [8086:104e] (rev 02)
~ #

Output of ipxe version

iPXE 1.21.1+ (gc5af4) -- Open Source Network Boot Firmware -- https://ipxe.org
Features: DNS HTTP iSCSI TFTP SRP AoE EFI Menu

@stappersg

This comment was marked as abuse.

@mcb30
Copy link
Member

mcb30 commented Sep 1, 2022

@loood Thanks for confirming the IDs and version. Could you please try building with DEBUG=intelxl:3 and report the complete output that you get?

@loood
Copy link
Author

loood commented Sep 2, 2022

Recompiled today with the DEBUG=intelxl:3. This is the output:

iPXE initialising devices...INTELXL 0x9e922910 PF 7 using port 3 queues [0x07ff-0x07ff]
INTELXL 0x9e922910 could not enable MSI-X: No such file or directory (https://ipxe.org/2dcc408e)
INTELXL 0x9e922910 PF 7 using port 3 queues [0x07ff-0x07ff]
INTELXL 0x9e922910 could not enable MSI-X: No such file or directory (https://ipxe.org/2dcc408e)
INTELXL 0x9e922910 PF 7 using port 3 queues [0x07ff-0x07ff]
INTELXL 0x9e922910 could not enable MSI-X: No such file or directory (https://ipxe.org/2dcc408e)
INTELXL 0x9e922910 PF 7 using port 3 queues [0x07ff-0x07ff]
INTELXL 0x9e922910 could not enable MSI-X: No such file or directory (https://ipxe.org/2dcc408e)
ok



iPXE 1.21.1+ (ga8012) -- Open Source Network Boot Firmware -- https://ipxe.org
Features: DNS HTTP iSCSI TFTP SRP AoE EFI Menu

Then it continued on unsuccessfully with the rest of the ipxe script

@stappersg

This comment was marked as abuse.

@loood
Copy link
Author

loood commented Sep 2, 2022

Hi! The output from git log --oneline | grep 9dfcdc0 is:

9dfcdc04 [intelxl] Update list of PCI IDs

The build script I have does a git clone each time in a clean space.

I rebuilt it with DEBUG=intelxl:3,pcimsix and this is the output:

iPXE initialising devices...INTELXL 0x9e921910 PF 7 using port 3 queues [0x07ff-0x07ff]
MSI-X 0x9e921950 has 129 vectors for 0000:44:00.0
MSI-X 0x9e921950 table could not find BAR3
INTELXL 0x9e921910 could not enable MSI-X: No such file or directory (https://ipxe.org/2dcc408e)
INTELXL 0x9e921910 PF 7 using port 3 queues [0x07ff-0x07ff]
MSI-X 0x9e921950 has 129 vectors for 0000:44:00.1
MSI-X 0x9e921950 table could not find BAR3
INTELXL 0x9e921910 could not enable MSI-X: No such file or directory (https://ipxe.org/2dcc408e)
INTELXL 0x9e921910 PF 7 using port 3 queues [0x07ff-0x07ff]
MSI-X 0x9e921950 has 129 vectors for 0000:44:00.2
MSI-X 0x9e921950 table could not find BAR3
INTELXL 0x9e921910 could not enable MSI-X: No such file or directory (https://ipxe.org/2dcc408e)
INTELXL 0x9e921910 PF 7 using port 3 queues [0x07ff-0x07ff]
MSI-X 0x9e921950 has 129 vectors for 0000:44:00.3
MSI-X 0x9e921950 table could not find BAR3
INTELXL 0x9e921910 could not enable MSI-X: No such file or directory (https://ipxe.org/2dcc408e)
ok



iPXE 1.21.1+ (ga8012) -- Open Source Network Boot Firmware -- https://ipxe.org
Features: DNS HTTP iSCSI TFTP SRP AoE EFI Menu

@stappersg

This comment was marked as abuse.

@loood
Copy link
Author

loood commented Sep 2, 2022

Tried DEBUG=intelxl:3,pcimsix:3 but there was no difference in output.

@mcb30
Copy link
Member

mcb30 commented Sep 2, 2022

@loood Thank you for the debug output. The values being read from the card are very strange: PF 7, port 3, queues 0x7ff-0x7ff, BAR 3. All of these values represent all bits being set (within the bit width of the relevant field). It looks as though every single MMIO read from the card is returning 0xffffffff.

You are using UEFI, so it's possible that the platform firmware is providing a broken translation table or similar. As a quick test: if the server supports booting in legacy BIOS mode, could you try that?

@mcb30
Copy link
Member

mcb30 commented Sep 2, 2022

@loood Could you please also try (in UEFI mode) DEBUG=intelxl:3,pcimsix,efi_pci:3?

@loood
Copy link
Author

loood commented Sep 5, 2022

Here is the output for DEBUG=intelxl:3,pcimsix,efi_pci:3

iPXE initialising devices...EFIPCI 0000:00:00.0 (1022:1480 class 060000) has no driver
EFIPCI 0000:00:00.2 (1022:164f class 080600) has no driver
EFIPCI 0000:00:01.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:00:02.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:00:03.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:00:04.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:00:05.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:00:07.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:00:07.1 (1022:1484 class 060400) has no driver
EFIPCI 0000:01:00.0 (1022:148a class 130000) has no driver
EFIPCI 0000:01:00.2 (1022:1498 class 108000) has no driver
EFIPCI 0000:00:08.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:00:08.1 (1022:1484 class 060400) has no driver
EFIPCI 0000:02:00.0 (1022:1485 class 130000) has no driver
EFIPCI 0000:02:00.2 (1022:1498 class 108000) has no driver
EFIPCI 0000:02:00.3 (1022:148c class 0c0330) has no driver
EFIPCI 0000:00:14.0 (1022:790b class 0c0500) has no driver
EFIPCI 0000:00:14.3 (1022:790e class 060100) has no driver
EFIPCI 0000:00:18.0 (1022:1650 class 060000) has no driver
EFIPCI 0000:00:18.1 (1022:1651 class 060000) has no driver
EFIPCI 0000:00:18.2 (1022:1652 class 060000) has no driver
EFIPCI 0000:00:18.3 (1022:1653 class 060000) has no driver
EFIPCI 0000:00:18.4 (1022:1654 class 060000) has no driver
EFIPCI 0000:00:18.5 (1022:1655 class 060000) has no driver
EFIPCI 0000:00:18.6 (1022:1656 class 060000) has no driver
EFIPCI 0000:00:18.7 (1022:1657 class 060000) has no driver
EFIPCI 0000:00:19.0 (1022:1650 class 060000) has no driver
EFIPCI 0000:00:19.1 (1022:1651 class 060000) has no driver
EFIPCI 0000:00:19.2 (1022:1652 class 060000) has no driver
EFIPCI 0000:00:19.3 (1022:1653 class 060000) has no driver
EFIPCI 0000:00:19.4 (1022:1654 class 060000) has no driver
EFIPCI 0000:00:19.5 (1022:1655 class 060000) has no driver
EFIPCI 0000:00:19.6 (1022:1656 class 060000) has no driver
EFIPCI 0000:00:19.7 (1022:1657 class 060000) has no driver
EFIPCI 0000:20:00.0 (1022:1480 class 060000) has no driver
EFIPCI 0000:20:00.2 (1022:164f class 080600) has no driver
EFIPCI 0000:20:01.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:20:02.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:20:03.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:20:03.1 (1022:1483 class 060400) has no driver
EFIPCI 0000:21:00.0 (1e0f:0007 class 010802) has no driver
EFIPCI 0000:20:03.2 (1022:1483 class 060400) has no driver
EFIPCI 0000:22:00.0 (1e0f:0007 class 010802) has no driver
EFIPCI 0000:20:03.3 (1022:1483 class 060400) has no driver
EFIPCI 0000:23:00.0 (1e0f:0007 class 010802) has no driver
EFIPCI 0000:20:03.4 (1022:1483 class 060400) has no driver
EFIPCI 0000:24:00.0 (1e0f:0007 class 010802) has no driver
EFIPCI 0000:20:04.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:20:05.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:20:07.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:20:07.1 (1022:1484 class 060400) has no driver
EFIPCI 0000:25:00.0 (1022:148a class 130000) has no driver
EFIPCI 0000:25:00.2 (1022:1498 class 108000) has no driver
EFIPCI 0000:20:08.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:20:08.1 (1022:1484 class 060400) has no driver
EFIPCI 0000:26:00.0 (1022:1485 class 130000) has no driver
EFIPCI 0000:26:00.1 (1022:1486 class 108000) has no driver
EFIPCI 0000:26:00.2 (1022:1498 class 108000) has no driver
EFIPCI 0000:26:00.3 (1022:148c class 0c0330) has no driver
EFIPCI 0000:40:00.0 (1022:1480 class 060000) has no driver
EFIPCI 0000:40:00.2 (1022:164f class 080600) has no driver
EFIPCI 0000:40:01.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:40:01.1 (1022:1483 class 060400) has no driver
EFIPCI 0000:41:00.0 (1a03:1150 class 060400) has no driver
EFIPCI 0000:42:00.0 (1a03:2000 class 030000) has no driver
EFIPCI 0000:40:01.3 (1022:1483 class 060400) has no driver
EFIPCI 0000:43:00.0 (1b21:1142 class 0c0330) has no driver
EFIPCI 0000:40:01.4 (1022:1483 class 060400) has no driver
EFIPCI 0000:44:00.0 (8086:15ff class 020000) has driver "x710-10gt-b"
EFIPCI 0000:44:00.0 (8086:15ff class 020000) has driver "x710-10gt-b"
EFIPCI 0000:44:00.0 (8086:15ff class 020000) has driver "x710-10gt-b"
EFIPCI 0000:44:00.0 found range [c9000000,ca900000) -> [c9000000,ca900000)
EFIPCI 0000:44:00.0 found range [c4000000,c8100000) -> [c4000000,c8100000)
EFIPCI 0000:44:00.0 c7000000+200000 -> c7000000
EFIPCI 0000:44:00.0 could not enable DAC: Error 0x7f10e083 (https://ipxe.org/7f10e083)
INTELXL 0x9ea1b910 PF 7 using port 3 queues [0x07ff-0x07ff]
MSI-X 0x9ea1b950 has 129 vectors for 0000:44:00.0
MSI-X 0x9ea1b950 table could not find BAR3
INTELXL 0x9ea1b910 could not enable MSI-X: No such file or directory (https://ipxe.org/2dcc408e)
EFIPCI 0000:44:00.0 could not probe driver "x710-10gt-b": No such file or directory (https://ipxe.org/2dcc408e)
EFIPCI 0000:44:00.0 (8086:15ff class 020000) has driver "x710-10gt-b"
EFIPCI 0000:44:00.0 found range [c9000000,ca900000) -> [c9000000,ca900000)
EFIPCI 0000:44:00.0 found range [c4000000,c8100000) -> [c4000000,c8100000)
EFIPCI 0000:44:00.0 00000000+200000 is not within root bridge address space
EFIPCI 0000:44:00.0 could not probe driver "x710-10gt-b": No such device (https://ipxe.org/2ccb4087)
EFIPCI 0000:44:00.1 (8086:15ff class 020000) has driver "x710-10gt-b"
EFIPCI 0000:44:00.1 (8086:15ff class 020000) has driver "x710-10gt-b"
EFIPCI 0000:44:00.1 (8086:15ff class 020000) has driver "x710-10gt-b"
EFIPCI 0000:44:00.1 found range [c9000000,ca900000) -> [c9000000,ca900000)
EFIPCI 0000:44:00.1 found range [c4000000,c8100000) -> [c4000000,c8100000)
EFIPCI 0000:44:00.1 c6000000+200000 -> c6000000
EFIPCI 0000:44:00.1 could not enable DAC: Error 0x7f10e083 (https://ipxe.org/7f10e083)
INTELXL 0x9ea1b910 PF 7 using port 3 queues [0x07ff-0x07ff]
MSI-X 0x9ea1b950 has 129 vectors for 0000:44:00.1
MSI-X 0x9ea1b950 table could not find BAR3
INTELXL 0x9ea1b910 could not enable MSI-X: No such file or directory (https://ipxe.org/2dcc408e)
EFIPCI 0000:44:00.1 could not probe driver "x710-10gt-b": No such file or directory (https://ipxe.org/2dcc408e)
EFIPCI 0000:44:00.1 (8086:15ff class 020000) has driver "x710-10gt-b"
EFIPCI 0000:44:00.1 found range [c9000000,ca900000) -> [c9000000,ca900000)
EFIPCI 0000:44:00.1 found range [c4000000,c8100000) -> [c4000000,c8100000)
EFIPCI 0000:44:00.1 00000000+200000 is not within root bridge address space
EFIPCI 0000:44:00.1 could not probe driver "x710-10gt-b": No such device (https://ipxe.org/2ccb4087)
EFIPCI 0000:44:00.2 (8086:104e class 020000) has driver "x710-sfp-b"
EFIPCI 0000:44:00.2 (8086:104e class 020000) has driver "x710-sfp-b"
EFIPCI 0000:44:00.2 (8086:104e class 020000) has driver "x710-sfp-b"
EFIPCI 0000:44:00.2 found range [c9000000,ca900000) -> [c9000000,ca900000)
EFIPCI 0000:44:00.2 found range [c4000000,c8100000) -> [c4000000,c8100000)
EFIPCI 0000:44:00.2 c5000000+200000 -> c5000000
EFIPCI 0000:44:00.2 could not enable DAC: Error 0x7f10e083 (https://ipxe.org/7f10e083)
INTELXL 0x9ea1b910 PF 7 using port 3 queues [0x07ff-0x07ff]
MSI-X 0x9ea1b950 has 129 vectors for 0000:44:00.2
MSI-X 0x9ea1b950 table could not find BAR3
INTELXL 0x9ea1b910 could not enable MSI-X: No such file or directory (https://ipxe.org/2dcc408e)
EFIPCI 0000:44:00.2 could not probe driver "x710-sfp-b": No such file or directory (https://ipxe.org/2dcc408e)
EFIPCI 0000:44:00.2 (8086:104e class 020000) has driver "x710-sfp-b"
EFIPCI 0000:44:00.2 found range [c9000000,ca900000) -> [c9000000,ca900000)
EFIPCI 0000:44:00.2 found range [c4000000,c8100000) -> [c4000000,c8100000)
EFIPCI 0000:44:00.2 00000000+200000 is not within root bridge address space
EFIPCI 0000:44:00.2 could not probe driver "x710-sfp-b": No such device (https://ipxe.org/2ccb4087)
EFIPCI 0000:44:00.3 (8086:104e class 020000) has driver "x710-sfp-b"
EFIPCI 0000:44:00.3 (8086:104e class 020000) has driver "x710-sfp-b"
EFIPCI 0000:44:00.3 (8086:104e class 020000) has driver "x710-sfp-b"
EFIPCI 0000:44:00.3 found range [c9000000,ca900000) -> [c9000000,ca900000)
EFIPCI 0000:44:00.3 found range [c4000000,c8100000) -> [c4000000,c8100000)
EFIPCI 0000:44:00.3 c4000000+200000 -> c4000000
EFIPCI 0000:44:00.3 could not enable DAC: Error 0x7f10e083 (https://ipxe.org/7f10e083)
INTELXL 0x9ea1b910 PF 7 using port 3 queues [0x07ff-0x07ff]
MSI-X 0x9ea1b950 has 129 vectors for 0000:44:00.3
MSI-X 0x9ea1b950 table could not find BAR3
INTELXL 0x9ea1b910 could not enable MSI-X: No such file or directory (https://ipxe.org/2dcc408e)
EFIPCI 0000:44:00.3 could not probe driver "x710-sfp-b": No such file or directory (https://ipxe.org/2dcc408e)
EFIPCI 0000:44:00.3 (8086:104e class 020000) has driver "x710-sfp-b"
EFIPCI 0000:44:00.3 found range [c9000000,ca900000) -> [c9000000,ca900000)
EFIPCI 0000:44:00.3 found range [c4000000,c8100000) -> [c4000000,c8100000)
EFIPCI 0000:44:00.3 00000000+200000 is not within root bridge address space
EFIPCI 0000:44:00.3 could not probe driver "x710-sfp-b": No such device (https://ipxe.org/2ccb4087)
EFIPCI 0000:40:02.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:40:03.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:40:04.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:40:05.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:40:07.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:40:07.1 (1022:1484 class 060400) has no driver
EFIPCI 0000:45:00.0 (1022:148a class 130000) has no driver
EFIPCI 0000:45:00.2 (1022:1498 class 108000) has no driver
EFIPCI 0000:40:08.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:40:08.1 (1022:1484 class 060400) has no driver
EFIPCI 0000:46:00.0 (1022:1485 class 130000) has no driver
EFIPCI 0000:46:00.2 (1022:1498 class 108000) has no driver
EFIPCI 0000:40:08.2 (1022:1484 class 060400) has no driver
EFIPCI 0000:47:00.0 (1022:7901 class 010601) has no driver
EFIPCI 0000:40:08.3 (1022:1484 class 060400) has no driver
EFIPCI 0000:48:00.0 (1022:7901 class 010601) has no driver
EFIPCI 0000:60:00.0 (1022:1480 class 060000) has no driver
EFIPCI 0000:60:00.2 (1022:164f class 080600) has no driver
EFIPCI 0000:60:01.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:60:02.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:60:03.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:60:03.1 (1022:1483 class 060400) has no driver
EFIPCI 0000:61:00.0 (1e0f:0007 class 010802) has no driver
EFIPCI 0000:60:03.2 (1022:1483 class 060400) has no driver
EFIPCI 0000:62:00.0 (1e0f:0007 class 010802) has no driver
EFIPCI 0000:60:03.3 (1022:1483 class 060400) has no driver
EFIPCI 0000:63:00.0 (1e0f:0007 class 010802) has no driver
EFIPCI 0000:60:03.4 (1022:1483 class 060400) has no driver
EFIPCI 0000:64:00.0 (1e0f:0007 class 010802) has no driver
EFIPCI 0000:60:04.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:60:05.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:60:07.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:60:07.1 (1022:1484 class 060400) has no driver
EFIPCI 0000:65:00.0 (1022:148a class 130000) has no driver
EFIPCI 0000:65:00.2 (1022:1498 class 108000) has no driver
EFIPCI 0000:60:08.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:60:08.1 (1022:1484 class 060400) has no driver
EFIPCI 0000:66:00.0 (1022:1485 class 130000) has no driver
EFIPCI 0000:66:00.2 (1022:1498 class 108000) has no driver
EFIPCI 0000:80:00.0 (1022:1480 class 060000) has no driver
EFIPCI 0000:80:00.2 (1022:164f class 080600) has no driver
EFIPCI 0000:80:01.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:80:02.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:80:03.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:80:04.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:80:05.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:80:07.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:80:07.1 (1022:1484 class 060400) has no driver
EFIPCI 0000:81:00.0 (1022:148a class 130000) has no driver
EFIPCI 0000:81:00.2 (1022:1498 class 108000) has no driver
EFIPCI 0000:80:08.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:80:08.1 (1022:1484 class 060400) has no driver
EFIPCI 0000:82:00.0 (1022:1485 class 130000) has no driver
EFIPCI 0000:82:00.2 (1022:1498 class 108000) has no driver
EFIPCI 0000:82:00.3 (1022:148c class 0c0330) has no driver
EFIPCI 0000:a0:00.0 (1022:1480 class 060000) has no driver
EFIPCI 0000:a0:00.2 (1022:164f class 080600) has no driver
EFIPCI 0000:a0:01.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:a0:02.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:a0:03.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:a0:03.1 (1022:1483 class 060400) has no driver
EFIPCI 0000:a1:00.0 (1179:011a class 010802) has no driver
EFIPCI 0000:a0:03.2 (1022:1483 class 060400) has no driver
EFIPCI 0000:a2:00.0 (1179:011a class 010802) has no driver
EFIPCI 0000:a0:04.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:a0:05.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:a0:07.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:a0:07.1 (1022:1484 class 060400) has no driver
EFIPCI 0000:a3:00.0 (1022:148a class 130000) has no driver
EFIPCI 0000:a3:00.2 (1022:1498 class 108000) has no driver
EFIPCI 0000:a0:08.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:a0:08.1 (1022:1484 class 060400) has no driver
EFIPCI 0000:a4:00.0 (1022:1485 class 130000) has no driver
EFIPCI 0000:a4:00.1 (1022:1486 class 108000) has no driver
EFIPCI 0000:a4:00.2 (1022:1498 class 108000) has no driver
EFIPCI 0000:a4:00.3 (1022:148c class 0c0330) has no driver
EFIPCI 0000:c0:00.0 (1022:1480 class 060000) has no driver
EFIPCI 0000:c0:00.2 (1022:164f class 080600) has no driver
EFIPCI 0000:c0:01.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:c0:01.1 (1022:1483 class 060400) has no driver
EFIPCI 0000:c1:00.0 (15b3:101b class 020000) has driver "ConnectX-6"
EFIPCI 0000:c1:00.0 (15b3:101b class 020000) has driver "ConnectX-6"
EFIPCI 0000:c1:00.0 (15b3:101b class 020000) has driver "ConnectX-6"
EFIPCI 0000:c1:00.0 found range [bec00000,bf100000) -> [bec00000,bf100000)
EFIPCI 0000:c1:00.0 found range [ba000000,be000000) -> [ba000000,be000000)
EFIPCI 0000:c1:00.0 bc080000+1000 -> bc080000
EFIPCI 0000:c1:00.0 using driver "ConnectX-6"
EFIPCI 0000:c1:00.1 (15b3:101b class 020000) has driver "ConnectX-6"
EFIPCI 0000:c1:00.1 (15b3:101b class 020000) has driver "ConnectX-6"
EFIPCI 0000:c1:00.1 (15b3:101b class 020000) has driver "ConnectX-6"
EFIPCI 0000:c1:00.1 found range [bec00000,bf100000) -> [bec00000,bf100000)
EFIPCI 0000:c1:00.1 found range [ba000000,be000000) -> [ba000000,be000000)
EFIPCI 0000:c1:00.1 ba080000+1000 -> ba080000
EFIPCI 0000:c1:00.1 using driver "ConnectX-6"
EFIPCI 0000:c0:02.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:c0:03.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:c0:04.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:c0:05.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:c0:07.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:c0:07.1 (1022:1484 class 060400) has no driver
EFIPCI 0000:c2:00.0 (1022:148a class 130000) has no driver
EFIPCI 0000:c2:00.2 (1022:1498 class 108000) has no driver
EFIPCI 0000:c0:08.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:c0:08.1 (1022:1484 class 060400) has no driver
EFIPCI 0000:c3:00.0 (1022:1485 class 130000) has no driver
EFIPCI 0000:c3:00.2 (1022:1498 class 108000) has no driver
EFIPCI 0000:c0:08.2 (1022:1484 class 060400) has no driver
EFIPCI 0000:c4:00.0 (1022:7901 class 010601) has no driver
EFIPCI 0000:e0:00.0 (1022:1480 class 060000) has no driver
EFIPCI 0000:e0:00.2 (1022:164f class 080600) has no driver
EFIPCI 0000:e0:01.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:e0:02.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:e0:03.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:e0:03.1 (1022:1483 class 060400) has no driver
EFIPCI 0000:e0:03.2 (1022:1483 class 060400) has no driver
EFIPCI 0000:e0:03.3 (1022:1483 class 060400) has no driver
EFIPCI 0000:e0:03.4 (1022:1483 class 060400) has no driver
EFIPCI 0000:e0:04.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:e0:05.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:e0:07.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:e0:07.1 (1022:1484 class 060400) has no driver
EFIPCI 0000:e5:00.0 (1022:148a class 130000) has no driver
EFIPCI 0000:e5:00.2 (1022:1498 class 108000) has no driver
EFIPCI 0000:e0:08.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:e0:08.1 (1022:1484 class 060400) has no driver
EFIPCI 0000:e6:00.0 (1022:1485 class 130000) has no driver
EFIPCI 0000:e6:00.2 (1022:1498 class 108000) has no driver
ok
iPXE 1.21.1+ (ga8012) -- Open Source Network Boot Firmware -- https://ipxe.org
Features: DNS HTTP iSCSI TFTP SRP AoE EFI Menu
iPXE>

Haven't tried legacy boot but we're trying to convert to all uefi. Also like to add that I just tried the snp.efi (didn't know that was an option until a few days ago) and that works without issue.

@stappersg

This comment was marked as abuse.

@mcb30
Copy link
Member

mcb30 commented Sep 5, 2022

Commentary inline below:

EFIPCI 0000:44:00.0 (8086:15ff class 020000) has driver "x710-10gt-b"
EFIPCI 0000:44:00.0 found range [c9000000,ca900000) -> [c9000000,ca900000)
EFIPCI 0000:44:00.0 found range [c4000000,c8100000) -> [c4000000,c8100000)
EFIPCI 0000:44:00.0 c7000000+200000 -> c7000000
EFIPCI 0000:44:00.0 could not enable DAC: Error 0x7f10e083 (https://ipxe.org/7f10e083)
INTELXL 0x9ea1b910 PF 7 using port 3 queues [0x07ff-0x07ff]
MSI-X 0x9ea1b950 has 129 vectors for 0000:44:00.0
MSI-X 0x9ea1b950 table could not find BAR3
INTELXL 0x9ea1b910 could not enable MSI-X: No such file or directory (https://ipxe.org/2dcc408e)
EFIPCI 0000:44:00.0 could not probe driver "x710-10gt-b": No such file or directory (https://ipxe.org/2dcc408e)

PF 0 is detected with memory BAR at 0xc7000000. The address 0xc7000000 is within the root bridge range, and is apparently identity mapped. So far, so good.

The "could not enable DAC" message is potentially harmless: from the pointers observed within the other debug messages (e.g. 0x9ea1b910), it appears that iPXE is running within the low 4GB of RAM and so dual address cycles will not be needed anyway.

For some unknown reason, all subsequent MMIO reads from the memory BAR appear to be returning all ones (0xffffffff), as described in my earlier message.

EFIPCI 0000:44:00.0 (8086:15ff class 020000) has driver "x710-10gt-b"
EFIPCI 0000:44:00.0 found range [c9000000,ca900000) -> [c9000000,ca900000)
EFIPCI 0000:44:00.0 found range [c4000000,c8100000) -> [c4000000,c8100000)
EFIPCI 0000:44:00.0 00000000+200000 is not within root bridge address space
EFIPCI 0000:44:00.0 could not probe driver "x710-10gt-b": No such device (https://ipxe.org/2ccb4087)

This is the same device (PF 0) being discovered again. This is not entirely unsurprising, since other UEFI platforms have been observed to retry device probes several times in the event of a driver Start() method failing.

What is interesting is that the memory BAR now appears to have been zeroed (and hence disabled).

EFIPCI 0000:44:00.1 (8086:15ff class 020000) has driver "x710-10gt-b"
EFIPCI 0000:44:00.1 found range [c9000000,ca900000) -> [c9000000,ca900000)
EFIPCI 0000:44:00.1 found range [c4000000,c8100000) -> [c4000000,c8100000)
EFIPCI 0000:44:00.1 c6000000+200000 -> c6000000
EFIPCI 0000:44:00.1 could not enable DAC: Error 0x7f10e083 (https://ipxe.org/7f10e083)
INTELXL 0x9ea1b910 PF 7 using port 3 queues [0x07ff-0x07ff]
MSI-X 0x9ea1b950 has 129 vectors for 0000:44:00.1
MSI-X 0x9ea1b950 table could not find BAR3
INTELXL 0x9ea1b910 could not enable MSI-X: No such file or directory (https://ipxe.org/2dcc408e)
EFIPCI 0000:44:00.1 could not probe driver "x710-10gt-b": No such file or directory (https://ipxe.org/2dcc408e)
EFIPCI 0000:44:00.1 (8086:15ff class 020000) has driver "x710-10gt-b"
EFIPCI 0000:44:00.1 found range [c9000000,ca900000) -> [c9000000,ca900000)
EFIPCI 0000:44:00.1 found range [c4000000,c8100000) -> [c4000000,c8100000)
EFIPCI 0000:44:00.1 00000000+200000 is not within root bridge address space
EFIPCI 0000:44:00.1 could not probe driver "x710-10gt-b": No such device (https://ipxe.org/2ccb4087)

Same sequence of events happens for PF 1 ...

EFIPCI 0000:44:00.2 (8086:104e class 020000) has driver "x710-sfp-b"
EFIPCI 0000:44:00.2 (8086:104e class 020000) has driver "x710-sfp-b"
EFIPCI 0000:44:00.2 (8086:104e class 020000) has driver "x710-sfp-b"
EFIPCI 0000:44:00.2 found range [c9000000,ca900000) -> [c9000000,ca900000)
EFIPCI 0000:44:00.2 found range [c4000000,c8100000) -> [c4000000,c8100000)
EFIPCI 0000:44:00.2 c5000000+200000 -> c5000000
EFIPCI 0000:44:00.2 could not enable DAC: Error 0x7f10e083 (https://ipxe.org/7f10e083)
INTELXL 0x9ea1b910 PF 7 using port 3 queues [0x07ff-0x07ff]
MSI-X 0x9ea1b950 has 129 vectors for 0000:44:00.2
MSI-X 0x9ea1b950 table could not find BAR3
INTELXL 0x9ea1b910 could not enable MSI-X: No such file or directory (https://ipxe.org/2dcc408e)
EFIPCI 0000:44:00.2 could not probe driver "x710-sfp-b": No such file or directory (https://ipxe.org/2dcc408e)
EFIPCI 0000:44:00.2 (8086:104e class 020000) has driver "x710-sfp-b"
EFIPCI 0000:44:00.2 found range [c9000000,ca900000) -> [c9000000,ca900000)
EFIPCI 0000:44:00.2 found range [c4000000,c8100000) -> [c4000000,c8100000)
EFIPCI 0000:44:00.2 00000000+200000 is not within root bridge address space
EFIPCI 0000:44:00.2 could not probe driver "x710-sfp-b": No such device (https://ipxe.org/2ccb4087)

... and again for PF 2 ...

EFIPCI 0000:44:00.3 (8086:104e class 020000) has driver "x710-sfp-b"
EFIPCI 0000:44:00.3 found range [c9000000,ca900000) -> [c9000000,ca900000)
EFIPCI 0000:44:00.3 found range [c4000000,c8100000) -> [c4000000,c8100000)
EFIPCI 0000:44:00.3 c4000000+200000 -> c4000000
EFIPCI 0000:44:00.3 could not enable DAC: Error 0x7f10e083 (https://ipxe.org/7f10e083)
INTELXL 0x9ea1b910 PF 7 using port 3 queues [0x07ff-0x07ff]
MSI-X 0x9ea1b950 has 129 vectors for 0000:44:00.3
MSI-X 0x9ea1b950 table could not find BAR3
INTELXL 0x9ea1b910 could not enable MSI-X: No such file or directory (https://ipxe.org/2dcc408e)
EFIPCI 0000:44:00.3 could not probe driver "x710-sfp-b": No such file or directory (https://ipxe.org/2dcc408e)
EFIPCI 0000:44:00.3 (8086:104e class 020000) has driver "x710-sfp-b"
EFIPCI 0000:44:00.3 found range [c9000000,ca900000) -> [c9000000,ca900000)
EFIPCI 0000:44:00.3 found range [c4000000,c8100000) -> [c4000000,c8100000)
EFIPCI 0000:44:00.3 00000000+200000 is not within root bridge address space
EFIPCI 0000:44:00.3 could not probe driver "x710-sfp-b": No such device (https://ipxe.org/2ccb4087)

...and again for PF 3.

So, it's clear that something is zeroing the memory BAR, which would fully explain the fact that all reads seem to return 0xffffffff (since that is the defined behaviour when no PCI target responds to the read transaction).

It is highly suspicious that this seems to happen around the same time that the failed attempt to enable DAC is made, so the first experiment I'd want to try would be to comment out the call to dma_set_mask_64bit ( intelxl->dma ); in drivers/net/intelxl.c.

If that doesn't change anything, then I'd try adding debug statements such as:

DBGC ( intelxl, "*** BAR0 = %08x\n", pci_bar ( pci, PCI_BASE_ADDRESS_0 ) );

at various points within intelxl_probe() to find the point at which BAR 0 (the memory BAR) gets zeroed.

@loood
Copy link
Author

loood commented Sep 6, 2022

Tried commenting out the dma_set_mask_64bit ( intelxl->dma ); but still nothing. Will continue with adding DBGC lines.

iPXE initialising devices...EFIPCI 0000:00:00.0 (1022:1480 class 060000) has no driver
EFIPCI 0000:00:00.2 (1022:164f class 080600) has no driver
EFIPCI 0000:00:01.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:00:02.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:00:03.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:00:04.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:00:05.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:00:07.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:00:07.1 (1022:1484 class 060400) has no driver
EFIPCI 0000:01:00.0 (1022:148a class 130000) has no driver
EFIPCI 0000:01:00.2 (1022:1498 class 108000) has no driver
EFIPCI 0000:00:08.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:00:08.1 (1022:1484 class 060400) has no driver
EFIPCI 0000:02:00.0 (1022:1485 class 130000) has no driver
EFIPCI 0000:02:00.2 (1022:1498 class 108000) has no driver
EFIPCI 0000:02:00.3 (1022:148c class 0c0330) has no driver
EFIPCI 0000:00:14.0 (1022:790b class 0c0500) has no driver
EFIPCI 0000:00:14.3 (1022:790e class 060100) has no driver
EFIPCI 0000:00:18.0 (1022:1650 class 060000) has no driver
EFIPCI 0000:00:18.1 (1022:1651 class 060000) has no driver
EFIPCI 0000:00:18.2 (1022:1652 class 060000) has no driver
EFIPCI 0000:00:18.3 (1022:1653 class 060000) has no driver
EFIPCI 0000:00:18.4 (1022:1654 class 060000) has no driver
EFIPCI 0000:00:18.5 (1022:1655 class 060000) has no driver
EFIPCI 0000:00:18.6 (1022:1656 class 060000) has no driver
EFIPCI 0000:00:18.7 (1022:1657 class 060000) has no driver
EFIPCI 0000:00:19.0 (1022:1650 class 060000) has no driver
EFIPCI 0000:00:19.1 (1022:1651 class 060000) has no driver
EFIPCI 0000:00:19.2 (1022:1652 class 060000) has no driver
EFIPCI 0000:00:19.3 (1022:1653 class 060000) has no driver
EFIPCI 0000:00:19.4 (1022:1654 class 060000) has no driver
EFIPCI 0000:00:19.5 (1022:1655 class 060000) has no driver
EFIPCI 0000:00:19.6 (1022:1656 class 060000) has no driver
EFIPCI 0000:00:19.7 (1022:1657 class 060000) has no driver
EFIPCI 0000:20:00.0 (1022:1480 class 060000) has no driver
EFIPCI 0000:20:00.2 (1022:164f class 080600) has no driver
EFIPCI 0000:20:01.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:20:02.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:20:03.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:20:03.1 (1022:1483 class 060400) has no driver
EFIPCI 0000:21:00.0 (1e0f:0007 class 010802) has no driver
EFIPCI 0000:20:03.2 (1022:1483 class 060400) has no driver
EFIPCI 0000:22:00.0 (1e0f:0007 class 010802) has no driver
EFIPCI 0000:20:03.3 (1022:1483 class 060400) has no driver
EFIPCI 0000:23:00.0 (1e0f:0007 class 010802) has no driver
EFIPCI 0000:20:03.4 (1022:1483 class 060400) has no driver
EFIPCI 0000:24:00.0 (1e0f:0007 class 010802) has no driver
EFIPCI 0000:20:04.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:20:05.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:20:07.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:20:07.1 (1022:1484 class 060400) has no driver
EFIPCI 0000:25:00.0 (1022:148a class 130000) has no driver
EFIPCI 0000:25:00.2 (1022:1498 class 108000) has no driver
EFIPCI 0000:20:08.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:20:08.1 (1022:1484 class 060400) has no driver
EFIPCI 0000:26:00.0 (1022:1485 class 130000) has no driver
EFIPCI 0000:26:00.1 (1022:1486 class 108000) has no driver
EFIPCI 0000:26:00.2 (1022:1498 class 108000) has no driver
EFIPCI 0000:26:00.3 (1022:148c class 0c0330) has no driver
EFIPCI 0000:40:00.0 (1022:1480 class 060000) has no driver
EFIPCI 0000:40:00.2 (1022:164f class 080600) has no driver
EFIPCI 0000:40:01.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:40:01.1 (1022:1483 class 060400) has no driver
EFIPCI 0000:41:00.0 (1a03:1150 class 060400) has no driver
EFIPCI 0000:42:00.0 (1a03:2000 class 030000) has no driver
EFIPCI 0000:40:01.3 (1022:1483 class 060400) has no driver
EFIPCI 0000:43:00.0 (1b21:1142 class 0c0330) has no driver
EFIPCI 0000:40:01.4 (1022:1483 class 060400) has no driver
EFIPCI 0000:44:00.0 (8086:15ff class 020000) has driver "x710-10gt-b"
EFIPCI 0000:44:00.0 (8086:15ff class 020000) has driver "x710-10gt-b"
EFIPCI 0000:44:00.0 (8086:15ff class 020000) has driver "x710-10gt-b"
EFIPCI 0000:44:00.0 found range [c9000000,ca900000) -> [c9000000,ca900000)
EFIPCI 0000:44:00.0 found range [c4000000,c8100000) -> [c4000000,c8100000)
EFIPCI 0000:44:00.0 c7000000+200000 -> c7000000
INTELXL 0x9ea1b910 PF 7 using port 3 queues [0x07ff-0x07ff]
MSI-X 0x9ea1b950 has 129 vectors for 0000:44:00.0
MSI-X 0x9ea1b950 table could not find BAR3
INTELXL 0x9ea1b910 could not enable MSI-X: No such file or directory (https://ipxe.org/2dcc408e)
EFIPCI 0000:44:00.0 could not probe driver "x710-10gt-b": No such file or directory (https://ipxe.org/2dcc408e)
EFIPCI 0000:44:00.0 (8086:15ff class 020000) has driver "x710-10gt-b"
EFIPCI 0000:44:00.0 found range [c9000000,ca900000) -> [c9000000,ca900000)
EFIPCI 0000:44:00.0 found range [c4000000,c8100000) -> [c4000000,c8100000)
EFIPCI 0000:44:00.0 00000000+200000 is not within root bridge address space
EFIPCI 0000:44:00.0 could not probe driver "x710-10gt-b": No such device (https://ipxe.org/2ccb4087)
EFIPCI 0000:44:00.1 (8086:15ff class 020000) has driver "x710-10gt-b"
EFIPCI 0000:44:00.1 (8086:15ff class 020000) has driver "x710-10gt-b"
EFIPCI 0000:44:00.1 (8086:15ff class 020000) has driver "x710-10gt-b"
EFIPCI 0000:44:00.1 found range [c9000000,ca900000) -> [c9000000,ca900000)
EFIPCI 0000:44:00.1 found range [c4000000,c8100000) -> [c4000000,c8100000)
EFIPCI 0000:44:00.1 c6000000+200000 -> c6000000
INTELXL 0x9ea1b910 PF 7 using port 3 queues [0x07ff-0x07ff]
MSI-X 0x9ea1b950 has 129 vectors for 0000:44:00.1
MSI-X 0x9ea1b950 table could not find BAR3
INTELXL 0x9ea1b910 could not enable MSI-X: No such file or directory (https://ipxe.org/2dcc408e)
EFIPCI 0000:44:00.1 could not probe driver "x710-10gt-b": No such file or directory (https://ipxe.org/2dcc408e)
EFIPCI 0000:44:00.1 (8086:15ff class 020000) has driver "x710-10gt-b"
EFIPCI 0000:44:00.1 found range [c9000000,ca900000) -> [c9000000,ca900000)
EFIPCI 0000:44:00.1 found range [c4000000,c8100000) -> [c4000000,c8100000)
EFIPCI 0000:44:00.1 00000000+200000 is not within root bridge address space
EFIPCI 0000:44:00.1 could not probe driver "x710-10gt-b": No such device (https://ipxe.org/2ccb4087)
EFIPCI 0000:44:00.2 (8086:104e class 020000) has driver "x710-sfp-b"
EFIPCI 0000:44:00.2 (8086:104e class 020000) has driver "x710-sfp-b"
EFIPCI 0000:44:00.2 (8086:104e class 020000) has driver "x710-sfp-b"
EFIPCI 0000:44:00.2 found range [c9000000,ca900000) -> [c9000000,ca900000)
EFIPCI 0000:44:00.2 found range [c4000000,c8100000) -> [c4000000,c8100000)
EFIPCI 0000:44:00.2 c5000000+200000 -> c5000000
INTELXL 0x9ea1b910 PF 7 using port 3 queues [0x07ff-0x07ff]
MSI-X 0x9ea1b950 has 129 vectors for 0000:44:00.2
MSI-X 0x9ea1b950 table could not find BAR3
INTELXL 0x9ea1b910 could not enable MSI-X: No such file or directory (https://ipxe.org/2dcc408e)
EFIPCI 0000:44:00.2 could not probe driver "x710-sfp-b": No such file or directory (https://ipxe.org/2dcc408e)
EFIPCI 0000:44:00.2 (8086:104e class 020000) has driver "x710-sfp-b"
EFIPCI 0000:44:00.2 found range [c9000000,ca900000) -> [c9000000,ca900000)
EFIPCI 0000:44:00.2 found range [c4000000,c8100000) -> [c4000000,c8100000)
EFIPCI 0000:44:00.2 00000000+200000 is not within root bridge address space
EFIPCI 0000:44:00.2 could not probe driver "x710-sfp-b": No such device (https://ipxe.org/2ccb4087)
EFIPCI 0000:44:00.3 (8086:104e class 020000) has driver "x710-sfp-b"
EFIPCI 0000:44:00.3 (8086:104e class 020000) has driver "x710-sfp-b"
EFIPCI 0000:44:00.3 (8086:104e class 020000) has driver "x710-sfp-b"
EFIPCI 0000:44:00.3 found range [c9000000,ca900000) -> [c9000000,ca900000)
EFIPCI 0000:44:00.3 found range [c4000000,c8100000) -> [c4000000,c8100000)
EFIPCI 0000:44:00.3 c4000000+200000 -> c4000000
INTELXL 0x9ea1b910 PF 7 using port 3 queues [0x07ff-0x07ff]
MSI-X 0x9ea1b950 has 129 vectors for 0000:44:00.3
MSI-X 0x9ea1b950 table could not find BAR3
INTELXL 0x9ea1b910 could not enable MSI-X: No such file or directory (https://ipxe.org/2dcc408e)
EFIPCI 0000:44:00.3 could not probe driver "x710-sfp-b": No such file or directory (https://ipxe.org/2dcc408e)
EFIPCI 0000:44:00.3 (8086:104e class 020000) has driver "x710-sfp-b"
EFIPCI 0000:44:00.3 found range [c9000000,ca900000) -> [c9000000,ca900000)
EFIPCI 0000:44:00.3 found range [c4000000,c8100000) -> [c4000000,c8100000)
EFIPCI 0000:44:00.3 00000000+200000 is not within root bridge address space
EFIPCI 0000:44:00.3 could not probe driver "x710-sfp-b": No such device (https://ipxe.org/2ccb4087)
EFIPCI 0000:40:02.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:40:03.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:40:04.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:40:05.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:40:07.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:40:07.1 (1022:1484 class 060400) has no driver
EFIPCI 0000:45:00.0 (1022:148a class 130000) has no driver
EFIPCI 0000:45:00.2 (1022:1498 class 108000) has no driver
EFIPCI 0000:40:08.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:40:08.1 (1022:1484 class 060400) has no driver
EFIPCI 0000:46:00.0 (1022:1485 class 130000) has no driver
EFIPCI 0000:46:00.2 (1022:1498 class 108000) has no driver
EFIPCI 0000:40:08.2 (1022:1484 class 060400) has no driver
EFIPCI 0000:47:00.0 (1022:7901 class 010601) has no driver
EFIPCI 0000:40:08.3 (1022:1484 class 060400) has no driver
EFIPCI 0000:48:00.0 (1022:7901 class 010601) has no driver
EFIPCI 0000:60:00.0 (1022:1480 class 060000) has no driver
EFIPCI 0000:60:00.2 (1022:164f class 080600) has no driver
EFIPCI 0000:60:01.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:60:02.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:60:03.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:60:03.1 (1022:1483 class 060400) has no driver
EFIPCI 0000:61:00.0 (1e0f:0007 class 010802) has no driver
EFIPCI 0000:60:03.2 (1022:1483 class 060400) has no driver
EFIPCI 0000:62:00.0 (1e0f:0007 class 010802) has no driver
EFIPCI 0000:60:03.3 (1022:1483 class 060400) has no driver
EFIPCI 0000:63:00.0 (1e0f:0007 class 010802) has no driver
EFIPCI 0000:60:03.4 (1022:1483 class 060400) has no driver
EFIPCI 0000:64:00.0 (1e0f:0007 class 010802) has no driver
EFIPCI 0000:60:04.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:60:05.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:60:07.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:60:07.1 (1022:1484 class 060400) has no driver
EFIPCI 0000:65:00.0 (1022:148a class 130000) has no driver
EFIPCI 0000:65:00.2 (1022:1498 class 108000) has no driver
EFIPCI 0000:60:08.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:60:08.1 (1022:1484 class 060400) has no driver
EFIPCI 0000:66:00.0 (1022:1485 class 130000) has no driver
EFIPCI 0000:66:00.2 (1022:1498 class 108000) has no driver
EFIPCI 0000:80:00.0 (1022:1480 class 060000) has no driver
EFIPCI 0000:80:00.2 (1022:164f class 080600) has no driver
EFIPCI 0000:80:01.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:80:02.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:80:03.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:80:04.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:80:05.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:80:07.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:80:07.1 (1022:1484 class 060400) has no driver
EFIPCI 0000:81:00.0 (1022:148a class 130000) has no driver
EFIPCI 0000:81:00.2 (1022:1498 class 108000) has no driver
EFIPCI 0000:80:08.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:80:08.1 (1022:1484 class 060400) has no driver
EFIPCI 0000:82:00.0 (1022:1485 class 130000) has no driver
EFIPCI 0000:82:00.2 (1022:1498 class 108000) has no driver
EFIPCI 0000:82:00.3 (1022:148c class 0c0330) has no driver
EFIPCI 0000:a0:00.0 (1022:1480 class 060000) has no driver
EFIPCI 0000:a0:00.2 (1022:164f class 080600) has no driver
EFIPCI 0000:a0:01.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:a0:02.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:a0:03.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:a0:03.1 (1022:1483 class 060400) has no driver
EFIPCI 0000:a1:00.0 (1179:011a class 010802) has no driver
EFIPCI 0000:a0:03.2 (1022:1483 class 060400) has no driver
EFIPCI 0000:a2:00.0 (1179:011a class 010802) has no driver
EFIPCI 0000:a0:04.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:a0:05.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:a0:07.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:a0:07.1 (1022:1484 class 060400) has no driver
EFIPCI 0000:a3:00.0 (1022:148a class 130000) has no driver
EFIPCI 0000:a3:00.2 (1022:1498 class 108000) has no driver
EFIPCI 0000:a0:08.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:a0:08.1 (1022:1484 class 060400) has no driver
EFIPCI 0000:a4:00.0 (1022:1485 class 130000) has no driver
EFIPCI 0000:a4:00.1 (1022:1486 class 108000) has no driver
EFIPCI 0000:a4:00.2 (1022:1498 class 108000) has no driver
EFIPCI 0000:a4:00.3 (1022:148c class 0c0330) has no driver
EFIPCI 0000:c0:00.0 (1022:1480 class 060000) has no driver
EFIPCI 0000:c0:00.2 (1022:164f class 080600) has no driver
EFIPCI 0000:c0:01.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:c0:01.1 (1022:1483 class 060400) has no driver
EFIPCI 0000:c1:00.0 (15b3:101b class 020000) has driver "ConnectX-6"
EFIPCI 0000:c1:00.0 (15b3:101b class 020000) has driver "ConnectX-6"
EFIPCI 0000:c1:00.0 (15b3:101b class 020000) has driver "ConnectX-6"
EFIPCI 0000:c1:00.0 found range [bec00000,bf100000) -> [bec00000,bf100000)
EFIPCI 0000:c1:00.0 found range [ba000000,be000000) -> [ba000000,be000000)
EFIPCI 0000:c1:00.0 bc080000+1000 -> bc080000
EFIPCI 0000:c1:00.0 using driver "ConnectX-6"
EFIPCI 0000:c1:00.1 (15b3:101b class 020000) has driver "ConnectX-6"
EFIPCI 0000:c1:00.1 (15b3:101b class 020000) has driver "ConnectX-6"
EFIPCI 0000:c1:00.1 (15b3:101b class 020000) has driver "ConnectX-6"
EFIPCI 0000:c1:00.1 found range [bec00000,bf100000) -> [bec00000,bf100000)
EFIPCI 0000:c1:00.1 found range [ba000000,be000000) -> [ba000000,be000000)
EFIPCI 0000:c1:00.1 ba080000+1000 -> ba080000
EFIPCI 0000:c1:00.1 using driver "ConnectX-6"
EFIPCI 0000:c0:02.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:c0:03.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:c0:04.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:c0:05.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:c0:07.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:c0:07.1 (1022:1484 class 060400) has no driver
EFIPCI 0000:c2:00.0 (1022:148a class 130000) has no driver
EFIPCI 0000:c2:00.2 (1022:1498 class 108000) has no driver
EFIPCI 0000:c0:08.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:c0:08.1 (1022:1484 class 060400) has no driver
EFIPCI 0000:c3:00.0 (1022:1485 class 130000) has no driver
EFIPCI 0000:c3:00.2 (1022:1498 class 108000) has no driver
EFIPCI 0000:c0:08.2 (1022:1484 class 060400) has no driver
EFIPCI 0000:c4:00.0 (1022:7901 class 010601) has no driver
EFIPCI 0000:e0:00.0 (1022:1480 class 060000) has no driver
EFIPCI 0000:e0:00.2 (1022:164f class 080600) has no driver
EFIPCI 0000:e0:01.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:e0:02.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:e0:03.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:e0:03.1 (1022:1483 class 060400) has no driver
EFIPCI 0000:e0:03.2 (1022:1483 class 060400) has no driver
EFIPCI 0000:e0:03.3 (1022:1483 class 060400) has no driver
EFIPCI 0000:e0:03.4 (1022:1483 class 060400) has no driver
EFIPCI 0000:e0:04.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:e0:05.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:e0:07.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:e0:07.1 (1022:1484 class 060400) has no driver
EFIPCI 0000:e5:00.0 (1022:148a class 130000) has no driver
EFIPCI 0000:e5:00.2 (1022:1498 class 108000) has no driver
EFIPCI 0000:e0:08.0 (1022:1482 class 060000) has no driver
EFIPCI 0000:e0:08.1 (1022:1484 class 060400) has no driver
EFIPCI 0000:e6:00.0 (1022:1485 class 130000) has no driver
EFIPCI 0000:e6:00.2 (1022:1498 class 108000) has no driver
ok
iPXE 1.21.1+ (ga8012) -- Open Source Network Boot Firmware -- https://ipxe.org
Features: DNS HTTP iSCSI TFTP SRP AoE EFI Menu

@stappersg

This comment was marked as off-topic.

@alexdepalex
Copy link

alexdepalex commented Sep 20, 2022

Same here. We're using master (I know), and it worked till the 2nd of June. So some commits in between must have broken it.

@mcb30
Copy link
Member

mcb30 commented Sep 20, 2022

Same here. We're using master (I know), and it worked till a couple of weeks ago. So some commits in between must have broken it.

In that case, https://ipxe.org/howto/bisect may be useful.

@alexdepalex
Copy link

Commit a202de3 seems to break things for me.

stappersg referenced this issue Sep 20, 2022
Remove knowledge of the PFGEN_CTRL register (which changes location
between XL710 and E810 register maps), and instead use PCIe FLR to
reset the physical function.

Signed-off-by: Michael Brown <mcb30@ipxe.org>
@byvns
Copy link

byvns commented Oct 3, 2022

Hi We have the same problem with

PCI_ROM ( 0x8086, 0x37d1, "x722-1gt", "X722 1GBASE-T", 0 ),

while compiled with DEBUG=intelxl:3,pcimsix:3 we found this:

Media Present
Downloading NBP file...
NBP file dotmioaded successfully.
IPXE init iaiising devices...
INTELXL Ox5de6b890 PF 7 using port 3 queues [Ox07ff-Ox07ff]
MSI-X OxSde6b8dO has 129 vectors for 0000: 1b:00.O
MSI—X OxSde6b8dO table could not find BAR3
INTELXL OxSde6bB90 could not enable MSI—X: No such file or directory (https://ipxe.org/2dcc408e)
INTELXL OxSde6b830 PF 7 using port 3 queues [Ox07ff-Ox07ff]
MSI—X OxSde6b8dO has 123 vectors for 0000: 1b:OO.1
MSI—X OxSde6b8dO table could not find BAR3
INTELXL OxSde6b830 could not enable MSI—X: No such file or directory (https://ipxe.org/2dcc408e)
INTELXL OxSde6b830 PF 7 using port 3 queues [Ox07ff—Ox07ff]
MSI—X OxSde6b8dO has 129 vectors for 0000: 1b:OO.2
MSI-X OxSde6b8dO table could not find BAR3
INTELXL OxSde6b890 could not enable MSI—X: No such file or directory (https://ipxe.org/2dcc408e)
INTELXL OxSde6b830 PF 7 using port 3 queues [Ox07ff-Ox07ff]
MSI—X OxSde6b8dO has 123 vectors for 0000: 1b:OO.3
MSI—X OxSde6b8dO table could not find BAR3
INTELXL OxSde6b830 COU1d not enable MSI—X: No such file or directory (https://ipxe.org/2dcc408e)

@sasharozenson
Copy link

Commit a202de3 seems to break things for me.

Same here.

@mcb30
Copy link
Member

mcb30 commented Nov 13, 2022

Commit a202de3 seems to break things for me.

@alexdepalex Thanks for the bisection result. Should be fixed by #801

@alexdepalex
Copy link

alexdepalex commented Feb 6, 2023

Just a quick question to the people that are tracking this issue before I open a new one. Did some of you try the fixed code? We're using master, with which the adapters get discovered, but we can't get packets flowing over the network. We're booting into ipxe, configuring networking as we previously did on the commit that did work, but we can't ping the gateway or our dns servers.

Was somebody able to get this to work with X710 after the fix was introduced?

@sasharozenson
Copy link

sasharozenson commented Feb 6, 2023 via email

@alexdepalex
Copy link

Thanks. I'll give that a shot.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

7 participants