The vivado/vitis_hls detection, the hls target and the pcie_100g/pcie_8x10g (and _bd) targets are removed: the firmware is not built from this tree. docs/FPGA.md keeps the toolset version and the IP licence terms of the released bitstreams. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01HVeDQrPqZ52Tp6rzzZGxf3
2.9 KiB
FPGA smartNIC
See separate document for installation instructions.
Hardware
Currently supported FPGA is only Xilinx Alveo U55C.
See AMD/Xilinx webpage for card user guide (UG1469). According to the user guide:
Alveo data center accelerator cards are designed to be installed into a data center server, where controlled air flow provides direct cooling.
The card needs to be placed in a PCI Express (PCIe) Gen4 x8 slot, though mechanically slot has to accommodate x16 card. There is no need to connect additional power cable, as power of the card is not exceeding 75 W load available from PCIe edge connector. Current power estimation is about 30 W when idle and 45 W in operation. The card has built-in protection, which will cut power to the card if HBM temperature is above 120°C.
Two variants of the card are available:
100g- this variant operates one port in 100 Gbit/s mode and should be used when connecting detector via a switch.8x10g- this variant operates both QSFP ports at 4x10 Gbit/s. QSFP+ (40 Gbit/s) transceivers and MTO/MTP harness cables are necessary. It is designed for detector directly connected to the Jungfraujoch server, without switch.
See network documentation for details of network.
Firmware
The firmware is not built from this repository: the HLS (fpga/hls/) and RTL (fpga/hdl/) sources are
kept as a reference of what the card does, and the build has no firmware targets. The bitstreams were
made with AMD (Xilinx) Vivado and Vitis HLS 2022.2.
In addition to the Intellectual Property (IP) cores included in Vivado, two additional licenses are necessary:
- Non-cost license for Ultrascale+ 100G core has to be requested from AMD/Xilinx website, see Xilinx website, to build
100gdesign. - A paid license for the 10G/25G Ethernet Subsystem for Ultrascale+ is necessary to build the
8x10gdesign. PSI received non-cost licenses from Xilinx University Program for the latter cores. Therefore, usage of bitstreams generated by PSI continuous integration pipeline for8x10gis only allowed for non-commercial use.
Firmware releases
The firmware is stable and is carried from version to version: the MCS files attached to a release are normally the ones from the release before it (see Release contents).
Frame generator
The Jungfraujoch card is equipped with a frame generator. It allows simulating a JUNGFRAU detector without having access to such a system. It sits in parallel with the Ethernet MAC, so it is placed before the network stack and before any processing happening on the card. In the future a redirection will be possible to send the simulated stream through the 100G TX network link. Frame generator is written in HLS and controlled with AXI-Lite.