2023.3 OFS Release for Intel Agilex 7 PCIe Attach Reference Shells (ofs-2023.3)
·
1 commit
to release/ofs-2023.2
since this release
OFS 2023.3
Summary: OFS 2023.3 Release for Intel® Agilex 7 PCIe Attach FPGAs
- Boards Targeted:
- Intel Agilex® 7 FPGA I-Series Development Kit (2x R-Tile, F-Tile)
- Intel Agilex® 7 FPGA F-Series Development Kit (2x F-Tile)
- Intel® FPGA SmartNIC N6001-PL (P-Tile, E-Tile)
- Board Management Controller (BMC):
- Intel MAX® 10 Nios® Firmware Version: 3.15.0 (Intel® FPGA SmartNIC N6001-PL only)
- Intel MAX® 10 Build Version: 3.15.0 (Intel® FPGA SmartNIC N6001-PL only)
Intel Agilex® 7 FPGA F-Series and I-Series Development Kits do not utilize an OFS compatible BMC, thus certain features such as remote system update are not supported.
-
Quartus® Prime Pro Version: 23.3
-
Quartus Prime Pro License File: quartus-0.0-0.02iofs-linux.run
-
Quartus Prime Pro Patch: 0.13 patch (Generic Serial Flash Interface IP), 0.21 (PCIe Subsystem). Note that patches are found at the bottom of this page in the assets.
-
OS Tested: Red Hat® Enterprise Linux® 8.6
-
OPAE Version: 2.10.0-1
-
Kernel Version: 6.1.41-lts
-
OFS Intel Agilex 7 PCIe Attach FIM Github Branch: https://github.com/OFS/ofs-agx7-pcie-attach/ofs-2023.3
-
OFS N6001 FIM Github Tag: https://github.com/OFS/ofs-agx7-pcie-attach/releases/tag/ofs-2023.3-1
-
OFS FIM_COMMON Github Tag: https://github.com/OFS/ofs-fim-common/releases/tag/ofs-2023.3-1
OPAE SDK:
- OPAE SDK Branch: https://github.com/OFS/opae-sdk/tree/release/2.10.0
- OPAE SDK Tag: https://github.com/OFS/opae-sdk/releases/tag/2.10.0-1
OPAE SIM:
- OPAE SIM Branch: https://github.com/OFS/opae-sim/tree/release/2.10.0
- OPAE SIM Tag: https://github.com/OFS/opae-sim/releases/tag/2.10.0-1
Driver:
- Kernel Driver Branch: https://github.com/OFS/linux-dfl/tree/fpga-ofs-dev-6.1-lts
- Kernel Driver Tag: https://github.com/OFS/linux-dfl/releases/tag/ofs-2023.1-6.1-2
This page provides up-to-date information about the Open FPGA Stack (OFS) for Intel® Agilex® 7 PCIe Attach devices. This project targets the:
- Intel Agilex 7 FPGA I-Series Development Kit (2xR-Tile, F-Tile)
- Intel Agilex 7 FPGA F-Series Development Kit (2xF-Tile)
- Intel FPGA SmartNIC N6001-PL
The summary of OFS framework features are shown below. To find out more about these platforms refer to the documentation below:
- Intel FPGA SmartNIC N6001-PL Platform Product Brief
- Intel Agilex 7 FPGA F-Series Development Kit (2xF-Tile) User Guide
- Intel Agilex 7 FPGA I-Series Development Kit (2xR-Tile, F-Tile) User Guide
OFS FIM Targeting Intel® Agilex®7 PCIe Attach (2xR-Tile, F-Tile)
| Key Feature | Description |
|---|---|
| Target OPN | AGIB027R29A1E2VR3 |
| PCIe | R-tile PCIe* Gen5x8 |
| Virtualization | 5 physical functions/3 virtual functions with ability to expand |
| Memory | * Two Fabric DDR4 channels, x64 (no ECC), 2666 MHz, 8GB |
| Ethernet | 2x4x25GbE, 2x200GbE, 2x400GbE |
| Hard Processor System | Not enabled |
| Configuration and Board Manageability | * FPGA Management Engine that provides general control of common FPGA tasks (ex. error reporting, partial reconfiguration) * Platform Management Controller Interface (PMCI) Module for Board Management Controller |
| Partial Reconfiguration | Supported |
| OneAPI | OneAPI Acceleration Support Package (ASP) provided with compiled FIM to support OneAPI Runtime |
| Software Support | * Linux DFL drivers targeting OFS FIMs * OPAE Software Development Kit* OPAE Tools |
| Target Board | Intel Agilex 7 FPGA I-Series Development Kit (2xR-Tile, F-Tile) |
OFS FIM Targeting Intel® Agilex®7 PCIe Attach (2xF-tile)
| Key Feature | Description |
|---|---|
| Target OPN | AGFB027R24C2E2VR2 |
| PCIe | F-tile PCIe* Gen4x16 |
| Virtualization | 5 physical functions/3 virtual functions with ability to expand |
| Memory | 3 DDR Channels:* One HPS DDR4 bank, x40 (x32 Data and x8 ECC), 2400 MHz, 1GB each* Two Fabric DDR4 banks, x64 (no ECC), 2400 MHz, 8GB |
| Ethernet | 2x4x25GbE |
| Hard Processor System | 64-bit quad core Arm® Cortex®-A53 MPCore with integrated peripherals. |
| Configuration and Board Manageability | * FPGA Management Engine that provides general control of common FPGA tasks (ex. error reporting, partial reconfiguration) * Platform Controller Management Interface (PMCI) Module for Board Management Controller |
| Partial Reconfiguration | Supported |
| OneAPI | OneAPI Acceleration Support Package (ASP) provided with compiled FIM to support OneAPI Runtime |
| Software Support | * Linux DFL drivers targeting OFS FIMs * OPAE Software Development Kit* OPAE Tools |
| Target Board | Intel Agilex 7 FPGA F-Series Development Kit (2x F-Tile) |
OFS FIM Targeting Intel® Agilex®7 PCIe Attach (P-tile, E-tile)
| Key Feature | Description |
|---|---|
| Target OPN | AGFB014R24A2E2V |
| PCIe | P-tile PCIe* Gen4x16 |
| Virtualization | 5 physical functions/3 virtual functions with ability to expand |
| Memory | 5 DDR Channels:* One HPS DDR4 bank, x40 (x32 Data and x8 ECC), 1200 MHz, 1GB each* Four Fabric DDR4 banks, x32 (no ECC), 1200 MHz, 4GB |
| Ethernet | 2x4x25GbE, 2x4x10GbE or 2x100GbE |
| Hard Processor System | 64-bit quad core Arm® Cortex®-A53 MPCore with integrated peripherals. |
| Configuration and Board Manageability | * FPGA Management Engine that provides general control of common FPGA tasks (ex. error reporting, partial reconfiguration) * Platform Controller Management Interface (PMCI) Module for Board Management Controller |
| Partial Reconfiguration | Supported |
| OneAPI | OneAPI Acceleration Support Package (ASP) provided with compiled FIM to support OneAPI Runtime |
| Software Support | * Linux DFL drivers targeting OFS FIMs * OPAE Software Development Kit* OPAE Tools |
| Target Board | Intel FPGA SmartNIC N6001-PL |
The OFS hardware framework also provides:
- Support for unit test simulation (using Synopsys® VCS® or Siemens® Questa™ simulators)
- UVM support using Synopsys® VCS®
- Host exercisers that allow you to test interfaces on the FPGA
The OFS software framework provides:
- FPGA platform Linux drivers that are being upstreamed to linux.org
- A programmable software development kit and userspace tools for managing the FPGA
Important: If you would like to begin evaluating the default shell that can be built from this repository, please scroll down to the "assets" accordion button below which contains the FPGA binary/POF/SOF along with the applicable Linux driver and Open Programmable Acceleration Engine (OPAE) software development kit (SDK) packages.
New Updates for ofs-2023.3 Release
- Upgrade to Quartus Prime Pro version 23.3
- Intel Agilex 7 R-Tile Support
- Enhanced ofss script support
- hssi utility support for 200GbE and 400GbE, see hssi tool description
- Improved opae.io and pcie_device -h help details
- Repository has been updated to build PCIe Attach design for Intel Agilex 7 FPGA I-Series Development Kit (2xR-Tile, F-Tile) in addition to the Intel FPGA SmartNIC N6001-PL and Intel Agilex 7 FPGA F-Series Development Kits (2x F-Tile)
- Support for 200GbE and 400 GbE Ethernet configurations on I-Series Development Kit target.
- Reference clock for the Ethernet subsystem in the F-Series Development Kit (2xF-tile) shell design changed from Reference Clock 2 (QSFP Global REFCLK) to reference Clock 6 (QSFPDD REFCLK).
Known Issues
This table describes the known issues for the 2023.3 OFS Release targeting Intel Agilex 7 devices.
| ID | Known Issues | Workaround | Status | Platform Target Affected |
|---|---|---|---|---|
| 14020467906 | Compiling the F-tile PCIe attach design in a 100GbE configuration results in a build failure. | None. | Fixed in a future release of OFS | F-Series Development Kit |
| - | R-tile Agilex PCIe Attach Reference FIM does not support UVM simulation. Only unit test simulation is available. | None | Fixed in a future release of OFS | I-Series Development Kit |
| - | The R-Tile PCIe attach design requires a [16550 UART IP license file](https://github.com/OFS/ofs-agx7-pcie-attach/tree/release/ofs-2023.2/license) to be installed in Quartus Prime Pro even though it is not used in the design. | None | Fixed in a future release of OFS | I-Series Development Kit |
| 14020113416 | Simulations of Ethernet Subsystem in 10GbE configuration show rx_tvalid in an unknown state upon reset. 10GbE simulation is currently not supported | None | Fixed in a future release of OFS. | Intel FPGA SmartNIC N6001-PL |
| 14021023150 | The fpgainfo phy command reports QSFP as not connected even if Ethernet ports are up because QSFP status is not routed to the FPGA in the Intel Agilex 7 I-Series Development Kit. | Refer to the Port Status listed in the command to observe the link status. | No future fix. | I-Series Development Kit |
| 14020129685 | The hssi_loopback command is currently not supported when FIM Ethernet configuration is 2x100GbE. | None | Fixed in a future release of OFS. | Intel FPGA SmartNIC N6001-PL |
| 14018364039 | The OPAE command fpgainfo bmc and fpgainfo temp display a "CVL" field that is not utilized by the design. | None. Ignore "CVL" listings. | Fixed in a future release of OFS. | Intel FPGA SmartNIC N6001-PL |
Resolved Issues
| ID | Resolved Issues | Platform Target Affected |
|---|---|---|
| 14020225085 | The following unit tests are not working: he_mem_lb_test, mem_ss_csr_test, mem_ss_rst_test, and hssi_csr_test. | - F-Series Development Kit (2x F-Tile) - I-Series Development Kit (2xR-Tile, F-Tile) |
| 18019768262 | A Quartus issue is causing intermittent HPS build failures when generating the IP during compilation or simulation. | - F-Series Development Kit (2x F-Tile) - Intel FPGA SmartNIC N6001-PL |
| 14020221909 | When running the OPAE command **mem_tg** the maximum transfer rates reported are incorrect even though it indicates the test passes. | -F-Series Development Kit (2x F-Tile) - Intel FPGA SmartNIC N6001-PL |
| 14020116806 | Unit test hssi_kpi_test results are invalid and should not be used. | - F-Series Development Kit (2x F-Tile) - Intel FPGA SmartNIC N6001-PL |
| 22018273793 | Intel FPGA SmartNIC N6001-PL |
Important Notes
The following section provides important information about this release:
| ID | Important Notes |
|---|---|
| - | For the F-Series Development Kit (2xF-tile) shell design, the reference clock for the Ethernet subsystem uses reference Clock 6 (QSFPDD REFCLK), which is only accessible from FGT Quads 2 and 3. If you wish to use FGT Quads 0 or 1, you will need to change the reference clock to one that is accessible by all FGT Quads (e.g. Reference Clock 2 (QSFP Global REFCLK)). |
| - | When using the PF/VF configuration tool to reconfigure the PF/VF mux, you must keep at least one physical function and one virtual function on PF0. The tool does not support less than one PF and one VF on PF0. All other PFs and VFs can be removed if desired. |
| 15012246661 | When enabling cable hotplug IP and ANLT, the E-tile recipe resulting from the ANLT initialization flow is over-written by the hotplug initialization flow. If you require a custom ANLT recipe, then you cannot use hotplug at this time. You can disable hotplug by writing 1 to index-0 of HSSI Hotplug Debug Control Register (offset 0x600B4) followed by a port level reset or analog reset. |
| 15012406417 | If using the Intel FPGA SmartNIC N6001-PL Platform (SKU2) for evaluation of the OFS release, ensure DIP Switch SW1.4 on the board is set to convey the correct board type or the OPAE commands could display invalid temperature values for an Intel NIC E810 (SKU1) which is not populated on the SKU2 board. For Intel FPGA SmartNIC N6001-PL Platform (SKU2), SW1.4 must be off (pointing towards the PCIe goldfinger). Note that a BMC reset is required if you must flip the switch to the correct setting. |
| 14020225084 | The regress_run.py simulation script runs a superset of simulation tests for all configurations available in the ofs-agx7-pcie-attach repository. You can customize the regress_run.py script to run only the tests applicable to your design by using the -k list option in the script which directs the regression to only pick up tests you have listed in your list.txt file. Please refer to the FPGA Interface Manager Development Guide for more details. |