leonarski_fandClaude Opus 5
8fa1ab7b05
Build Packages / build:rugnux:aarch64 (cross) (push) Successful in 7m27s
Build Packages / build:windows:nocuda (push) Successful in 15m41s
Build Packages / build:rugnux:windows (push) Successful in 16m37s
Build Packages / build:windows:cuda (push) Successful in 19m33s
Build Packages / build:rugnux-tgz (x86_64) (push) Successful in 16m47s
Build Packages / build:viewer-tgz:cpu (push) Successful in 19m39s
Build Packages / build:viewer-tgz:cuda (push) Successful in 21m23s
Build Packages / build:rpm (rocky9_nocuda) (push) Successful in 22m3s
Build Packages / build:rpm (rocky8_nocuda) (push) Successful in 26m46s
Build Packages / build:rpm (ubuntu2204_nocuda) (push) Successful in 28m19s
Build Packages / build:rpm (ubuntu2404_nocuda) (push) Successful in 20m58s
Build Packages / build:rpm (rocky9_sls9) (push) Successful in 21m29s
Build Packages / build:rpm (rocky8_sls9) (push) Successful in 26m25s
Build Packages / build:rpm (rocky9) (push) Successful in 22m46s
Build Packages / build:rpm (rocky8) (push) Successful in 28m2s
Build Packages / Generate python client (push) Successful in 42s
Build Packages / Build documentation (push) Successful in 1m13s
Build Packages / Create release (push) Skipped
Build Packages / build:rpm (ubuntu2404) (push) Successful in 23m33s
Build Packages / XDS test (durin plugin) (push) Successful in 11m44s
Build Packages / DIALS test (push) Successful in 25m14s
Build Packages / build:rpm (ubuntu2204) (push) Successful in 27m29s
Build Packages / XDS test (JFJoch plugin) (push) Successful in 11m9s
Build Packages / XDS test (neggia plugin) (push) Successful in 9m44s
Build Packages / Unit tests (push) Successful in 1h25m11s
The rugnux tarball built and packaged correctly; the step that verifies it did not. Two shell mistakes, both mine, both of the same family. `! find /tmp/rgx -name 'libcufft*'` can never pass: find exits 0 whether or not it matched anything, so the negation always fails. That is what broke the x86_64 job after a successful build. The aarch64 checks were worse, in the way that matters. Piping a large producer into `grep -q` kills the producer with SIGPIPE as soon as grep exits on its first match, and `set -o pipefail` promotes that to the pipeline's status: on `cuobjdump --list-elf | grep -q sm_90` over a 225 MB binary it fails a check that should pass, and on `! ... | grep -q "x86-64"` the leading `!` inverts it into a PASS -- so an x86 file leaking into an aarch64 tarball, the exact thing that check exists to catch, would have been reported as clean. Both now capture each producer's output to a file and grep the file, with explicit if/exit rather than exit-status negation. Verified by running the checks verbatim against the real artifacts rather than only reading them: both tarballs pass, and the checks were confirmed to FAIL when they should -- an x86_64 file planted in the extracted tree is caught, and an architecture absent from the fatbin is reported missing. The toolchain file now comes from the checkout rather than /opt/cross in the image. It describes how to build this source, so it belongs with the source: baked into the image, the Eigen fix in the previous commit could not reach CI without rebuilding and re-pushing the image, and appeared to have no effect. Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01SQjneRUssfhi1k9rq8Ts3h
250 lines
11 KiB
Docker
250 lines
11 KiB
Docker
# Ubuntu 24.04 (Noble) base with CUDA 13 devel toolchain
|
|
FROM nvidia/cuda:13.3.0-devel-ubuntu24.04
|
|
LABEL authors="leonarski_f"
|
|
|
|
ENV DEBIAN_FRONTEND=noninteractive
|
|
|
|
ARG OPENSSL_VERSION=3.5.4
|
|
ARG QT_VERSION=6.9.1
|
|
ARG DBUS_VERSION=1.14.10
|
|
ARG NODE_MAJOR=22
|
|
ARG EIGEN_VERSION=3.4.0
|
|
# HDF5, libtiff and libjpeg-turbo are built by the jungfraujoch CMake itself (FetchContent /
|
|
# ExternalProject). Eigen is an external find_package(Eigen3 3.4) dependency, installed from source
|
|
# below (3.4.x is required; Eigen's same-major-version rule rejects 5.x). nasm is required by the
|
|
# project's libjpeg-turbo ExternalProject for SIMD-accelerated JPEG.
|
|
|
|
# Update base and install toolchain + static-Qt build dependencies
|
|
# (XCB/X11/OpenGL/EGL/DBus/fontconfig/freetype/zlib headers needed to build static Qt).
|
|
#
|
|
# arm64 is enabled as a second dpkg architecture here so this one image can also CROSS-COMPILE the
|
|
# rugnux CLI for aarch64 (DGX Spark GB10 / Grace Hopper GH200 -- both arm64 SBSA). Noble's deb822
|
|
# ubuntu.sources carries no Architectures: field, so a bare `dpkg --add-architecture arm64` sends apt
|
|
# to archive.ubuntu.com for arm64 indexes and 404s on every one; arm64 is published on
|
|
# ports.ubuntu.com instead. Pin the stock entries to amd64 and add a ports entry for arm64.
|
|
RUN set -eux; \
|
|
dpkg --add-architecture arm64; \
|
|
sed -i 's/^Components: main/Architectures: amd64\nComponents: main/' /etc/apt/sources.list.d/ubuntu.sources; \
|
|
printf '\nTypes: deb\nURIs: http://ports.ubuntu.com/ubuntu-ports\nSuites: noble noble-updates noble-security\nComponents: main restricted universe multiverse\nArchitectures: arm64\nSigned-By: /usr/share/keyrings/ubuntu-archive-keyring.gpg\n' \
|
|
>> /etc/apt/sources.list.d/ubuntu.sources
|
|
|
|
RUN set -eux; \
|
|
apt-get update; \
|
|
apt-get install -y --no-install-recommends \
|
|
ca-certificates \
|
|
curl \
|
|
wget \
|
|
git \
|
|
which \
|
|
tar \
|
|
xz-utils \
|
|
build-essential \
|
|
cmake \
|
|
ninja-build \
|
|
python3 \
|
|
python3-venv \
|
|
python3-requests \
|
|
python3.12 \
|
|
python3.12-venv \
|
|
perl \
|
|
pkg-config \
|
|
gdb \
|
|
file \
|
|
nasm \
|
|
dpkg-dev \
|
|
fakeroot \
|
|
libnuma-dev \
|
|
libkrb5-dev \
|
|
libxcb1-dev \
|
|
libx11-dev \
|
|
libxext-dev \
|
|
libxrender-dev \
|
|
libxi-dev \
|
|
libxrandr-dev \
|
|
libxcursor-dev \
|
|
libxfixes-dev \
|
|
libxinerama-dev \
|
|
libxkbcommon-dev \
|
|
libxkbcommon-x11-dev \
|
|
libx11-xcb-dev \
|
|
libxcb-shape0-dev \
|
|
libxcb-sync-dev \
|
|
libxcb-xfixes0-dev \
|
|
libxcb-image0-dev \
|
|
libxcb-icccm4-dev \
|
|
libxcb-keysyms1-dev \
|
|
libxcb-render-util0-dev \
|
|
libxcb-util-dev \
|
|
libxcb-randr0-dev \
|
|
libxcb-xkb-dev \
|
|
libxcb-shm0-dev \
|
|
libxcb-cursor0 \
|
|
libxcb-cursor-dev \
|
|
libxcb-glx0-dev \
|
|
libgl1-mesa-dev \
|
|
libglx-dev \
|
|
libegl1-mesa-dev \
|
|
libexpat1-dev \
|
|
zlib1g-dev \
|
|
libfontconfig1-dev \
|
|
libdrm-dev \
|
|
libglvnd-dev \
|
|
libassimp-dev \
|
|
libfreetype6-dev; \
|
|
apt-get clean; \
|
|
rm -rf /var/lib/apt/lists/*
|
|
|
|
# Use the default GCC/G++ (gcc-13 on Noble, supported by CUDA 13.3)
|
|
ENV CC=/usr/bin/gcc
|
|
ENV CXX=/usr/bin/g++
|
|
|
|
# Build a static OpenSSL
|
|
RUN set -eux; \
|
|
cd /tmp; \
|
|
curl -LO https://www.openssl.org/source/openssl-${OPENSSL_VERSION}.tar.gz; \
|
|
tar -xf openssl-${OPENSSL_VERSION}.tar.gz; \
|
|
cd openssl-${OPENSSL_VERSION}; \
|
|
./Configure linux-x86_64 no-shared no-module no-tests --prefix=/opt/openssl-${OPENSSL_VERSION} --libdir=lib; \
|
|
make -j"$(nproc)"; \
|
|
make install_sw; \
|
|
cd /; rm -rf /tmp/openssl-${OPENSSL_VERSION} /tmp/openssl-${OPENSSL_VERSION}.tar.gz
|
|
|
|
# Expose static OpenSSL to CMake/pkg-config
|
|
ENV OPENSSL_ROOT_DIR=/opt/openssl-${OPENSSL_VERSION}
|
|
ENV PKG_CONFIG_PATH=${OPENSSL_ROOT_DIR}/lib/pkgconfig:${OPENSSL_ROOT_DIR}/lib64/pkgconfig
|
|
|
|
# Install Node.js (NodeSource)
|
|
RUN set -eux; \
|
|
curl -fsSL https://deb.nodesource.com/setup_${NODE_MAJOR}.x | bash -; \
|
|
apt-get update; \
|
|
apt-get install -y --no-install-recommends nodejs; \
|
|
apt-get clean; \
|
|
rm -rf /var/lib/apt/lists/*; \
|
|
node --version; npm --version; (corepack enable || true)
|
|
|
|
# Static libdbus: link D-Bus into the viewer (Qt6::DBus) instead of pulling libdbus-1.so.3 at runtime.
|
|
# A distro libdbus-1.so drags in libsystemd (-> libzstd/liblz4/libcap/libgcrypt/libgpg-error) and
|
|
# libselinux (-> libpcre2). Disabling those integrations makes libdbus-1.a depend on ~libc alone, so
|
|
# that whole runtime .so tail disappears while the viewer keeps its single-instance / remote-control
|
|
# D-Bus feature -- it is a pure session-bus client (registers a name + exports an adaptor), so the
|
|
# daemon-side systemd/selinux features are irrelevant. Static-only install (no .so); the Qt build
|
|
# finds it through find_package(DBus1) via the -DDBus1_DIR hint (the CMake package config dbus
|
|
# installs, which imports libdbus-1.a). Built -fPIC (--with-pic) so the archive links into Qt's PIE
|
|
# tools (qdbusxml2cpp). expat is only a configure-time dep of the dbus daemon; the client libdbus-1
|
|
# links neither expat nor systemd.
|
|
RUN set -eux; \
|
|
cd /tmp; \
|
|
curl -LO https://dbus.freedesktop.org/releases/dbus/dbus-${DBUS_VERSION}.tar.xz; \
|
|
tar -xf dbus-${DBUS_VERSION}.tar.xz; \
|
|
cd dbus-${DBUS_VERSION}; \
|
|
./configure --prefix=/opt/dbus-${DBUS_VERSION}-static \
|
|
--enable-static --disable-shared --with-pic \
|
|
--disable-systemd --without-systemdsystemunitdir \
|
|
--disable-selinux --disable-apparmor --disable-libaudit \
|
|
--disable-tests --disable-asserts \
|
|
--disable-doxygen-docs --disable-xml-docs --disable-ducktype-docs \
|
|
CFLAGS="-fPIC"; \
|
|
make -j"$(nproc)"; \
|
|
make install; \
|
|
cd /; rm -rf /tmp/dbus-${DBUS_VERSION} /tmp/dbus-${DBUS_VERSION}.tar.xz
|
|
|
|
# Put the static libdbus pkgconfig ahead of the system one so Qt6::DBus resolves to the .a
|
|
ENV PKG_CONFIG_PATH=/opt/dbus-${DBUS_VERSION}-static/lib/pkgconfig:${PKG_CONFIG_PATH}
|
|
|
|
# Build and install static Qt with Core, Gui, Widgets, Charts, DBus
|
|
ARG QT_PREFIX=/opt/qt-${QT_VERSION}-static
|
|
RUN set -eux; \
|
|
cd /tmp; \
|
|
curl -LO https://download.qt.io/official_releases/qt/6.9/${QT_VERSION}/single/qt-everywhere-src-${QT_VERSION}.tar.xz; \
|
|
tar -xf qt-everywhere-src-${QT_VERSION}.tar.xz; \
|
|
mkdir -p qt-everywhere-src-${QT_VERSION}/build && cd qt-everywhere-src-${QT_VERSION}/build; \
|
|
cmake -G Ninja \
|
|
-DQT_BUILD_SUBMODULES="qtbase;qtshadertools;qtdeclarative;qtcharts;qt3d" \
|
|
-DBUILD_SHARED_LIBS=OFF \
|
|
-DQT_BUILD_TESTS=OFF \
|
|
-DQT_BUILD_EXAMPLES=OFF \
|
|
-DQT_FEATURE_dbus=ON \
|
|
-DQT_FEATURE_dbus_linked=ON \
|
|
-DDBus1_DIR=/opt/dbus-${DBUS_VERSION}-static/lib/cmake/DBus1 \
|
|
-DQT_FEATURE_xcb=ON \
|
|
-DQT_FEATURE_xcb_xlib=OFF \
|
|
-DQT_FEATURE_xkbcommon_x11=ON \
|
|
-DQT_FEATURE_opengl=ON \
|
|
-DQT_FEATURE_opengl_desktop=ON \
|
|
-DQT_FEATURE_opengl_dynamic=OFF \
|
|
-DQT_FEATURE_vulkan=OFF \
|
|
-DQT_FEATURE_glib=OFF \
|
|
-DCMAKE_BUILD_TYPE=Release \
|
|
-DCMAKE_INSTALL_PREFIX=${QT_PREFIX} \
|
|
-DCMAKE_C_COMPILER=${CC} \
|
|
-DCMAKE_CXX_COMPILER=${CXX} \
|
|
-DQT_FEATURE_openssl=ON \
|
|
-DQT_FEATURE_openssl_linked=ON \
|
|
-DOPENSSL_USE_STATIC_LIBS=TRUE \
|
|
..; \
|
|
cmake --build . -j"$(nproc)"; \
|
|
cmake --install .; \
|
|
cd /; rm -rf /tmp/qt-everywhere-src-${QT_VERSION} /tmp/qt-everywhere-src-${QT_VERSION}.tar.xz
|
|
|
|
# Eigen 3.4 (header-only) -- external find_package(Eigen3 3.4) dependency, installed to /opt/eigen-3.4.
|
|
RUN set -eux; \
|
|
cd /tmp; \
|
|
git clone --depth 1 --branch ${EIGEN_VERSION} https://gitlab.com/libeigen/eigen.git; \
|
|
cmake -G Ninja -S eigen -B eigen-build -DCMAKE_INSTALL_PREFIX=/opt/eigen-3.4 \
|
|
-DEIGEN_BUILD_BLAS=OFF -DEIGEN_BUILD_LAPACK=OFF -DEIGEN_BUILD_DOC=OFF -DBUILD_TESTING=OFF; \
|
|
cmake --install eigen-build; \
|
|
cd /; rm -rf /tmp/eigen /tmp/eigen-build
|
|
|
|
# Make Qt, the static libdbus, and Eigen discoverable by CMake. The static libdbus prefix is
|
|
# required here (not only at Qt build time): every Qt6::DBus consumer re-runs find_package(DBus1)
|
|
# through Qt's exported config, so DBus1Config.cmake must be on CMAKE_PREFIX_PATH for the viewer build.
|
|
ENV CMAKE_PREFIX_PATH=/opt/qt-${QT_VERSION}-static:/opt/dbus-${DBUS_VERSION}-static:/opt/eigen-3.4
|
|
|
|
# ---------------------------------------------------------------------------------------------
|
|
# aarch64 cross-compilation support (rugnux only -- the viewer is not cross-built).
|
|
#
|
|
# crossbuild-essential-arm64 the aarch64 gcc/g++.
|
|
# qemu-user-static HDF5 runs two try_run() probes (config/ConfigureChecks.cmake) that
|
|
# need CMAKE_CROSSCOMPILING_EMULATOR. libzmq guards its own run-checks
|
|
# with NOT CMAKE_CROSSCOMPILING; Ceres, libtiff, zstd, Catch2, spdlog,
|
|
# cpp-httplib, FFTW and ffbidx have no run-checks at all.
|
|
# binutils-aarch64-linux-gnu reading aarch64 ELF on the build host.
|
|
# :arm64 libraries ZLIB is one of the project's two external dependencies (Eigen, the
|
|
# other, is header-only and installed above); OpenSSL is needed by the
|
|
# libcurl the build fetches.
|
|
# ---------------------------------------------------------------------------------------------
|
|
RUN set -eux; \
|
|
apt-get update; \
|
|
apt-get install -y --no-install-recommends \
|
|
crossbuild-essential-arm64 binutils-aarch64-linux-gnu qemu-user-static \
|
|
zlib1g-dev:arm64 libssl-dev:arm64; \
|
|
apt-get clean; \
|
|
rm -rf /var/lib/apt/lists/*
|
|
|
|
# CUDA cross target tree -> /usr/local/cuda/targets/sbsa-linux, beside the image's x86_64 tree.
|
|
# These packages are NOT in the x86_64 CUDA repo (it publishes none) and NOT in the sbsa repo (that
|
|
# is the NATIVE arm64 one a Spark or GH200 installs locally). They have their own repo and keyring:
|
|
# repos/ubuntu2404/cross-linux-sbsa/
|
|
# repos/ubuntu2404/cross-linux-aarch64/ also exists -- that is the Tegra/Jetson tree, not this one.
|
|
RUN set -eux; \
|
|
cd /tmp; \
|
|
wget -q https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2404/cross-linux-sbsa/cuda-keyring_1.1-1_all.deb; \
|
|
dpkg -i cuda-keyring_1.1-1_all.deb; rm cuda-keyring_1.1-1_all.deb; \
|
|
apt-get update; \
|
|
V=$(nvcc --version | sed -nE 's/.*release ([0-9]+)\.([0-9]+).*/\1-\2/p'); \
|
|
apt-get install -y --no-install-recommends \
|
|
cuda-cudart-cross-sbsa-$V cuda-crt-cross-sbsa-$V \
|
|
cuda-culibos-cross-sbsa-$V libcufft-cross-sbsa-$V; \
|
|
test -f /usr/local/cuda/targets/sbsa-linux/lib/libcufft_static.a; \
|
|
apt-get clean; \
|
|
rm -rf /var/lib/apt/lists/*
|
|
|
|
# aarch64-sbsa.cmake is deliberately NOT copied in: the build passes it from the checkout, so the
|
|
# toolchain is versioned with the source it configures and needs no image rebuild to change.
|
|
|
|
# Set workdir for your project
|
|
WORKDIR /workspace
|
|
|
|
# Default entrypoint: interactive shell
|
|
CMD ["/bin/bash", "-l"]
|