leonarski_fandClaude Opus 5.5
a8c559bf6b
A Catch2 executable that builds in the portable configurations (JFJOCH_VIEWER_ONLY / JFJOCH_RUGNUX_ONLY) and links only what those build - JFJochRugnux, JFJochReader, JFJochImageAnalysis, JFJochWriter, JFJochCommon - so it can run on the macOS arm64 and Windows x64 jobs, where the receiver/broker/FPGA/HLS sources are not built and there is no GPU. EXCLUDE_FROM_ALL, so a product build does not pay for it; catch2 is now made available in the portable configure as well (it is EXCLUDE_FROM_ALL too). The cases tagged [portable] cover what depends on the architecture, the compiler or the standard library: bitshuffle/LZ4/zstd, HDF5 read-back (legacy/VDS/integrated, the direct-chunk path), miniCBF/marCCD/SMV header parsing, CBOR, CPU spot finding, azimuthal mapping, Bragg prediction/integration, gemmi MTZ/mmCIF. New in tests/PortableTest.cpp: - a golden FNV-1a hash of two frames of compression_benchmark.h5, decoded from the raw chunk by the hperf and the classic bitshuffle and through the HDF5 filter (x86 hashes affea29c511b6ec2 / e46913009c95a1f1); - a golden hash of a bitshuffle/LZ4 encode (the writer must produce the same bytes everywhere); - the shipped bitshuffle block selector against the classic reference over elem 1/2/4/8 and block tails; - the FFTW indexer, named explicitly, on a synthetic orthorhombic lattice (the existing FFT indexer lattice tests run only under CUDA); - a 4-frame end-to-end rugnux run on the git-LFS rotation dataset (HDF5 via external links, CPU spot finding, indexing, integration); SKIPs when LFS was not pulled. All 45 take ~4 s on Linux (~2 s without the LFS case), CPU-only build. M_PI replaced by PI (common/JFJochMath.h) in the two tagged files that used it, as MSVC does not define M_PI. The CBF gzip test shells out to gzip and is left untagged. CI: build and run jfjoch_portable_test "[portable]" in build-windows (both variants), build-rugnux-windows, build-macos-viewer and build-rugnux-macos, after the build and before packaging. Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01D1G8gJVAy6gp1K5Dz3NE5C
1.7 KiB
Large reference test datasets (git-LFS)
The [large] Catch tests in tests/ run the full analysis/processing pipeline over real
JUNGFRAU datasets that are too big to keep as ordinary git blobs. They are tracked with
git-LFS (see the tests/data/*.h5 rule in the top-level .gitattributes).
These files are not required to build or to run the normal test suite: every test that
needs them resolves the path through jfjoch_test::LargeDataFile() (tests/TestData.h) and
SKIP()s when the file is absent or is still an unfetched LFS pointer. jfjoch_test also
prints, at start-up, whether this directory is populated.
Fetching
git lfs install
git lfs pull # or: git lfs pull --include "tests/data/*.h5"
Datasets
| File | Dataset | Shipped |
|---|---|---|
rotation_master.h5 |
protein rotation series (~1800 images) | yes (LFS) |
rotation_master.h5 (plus its _data_NNNNNN.h5 files) is fetched by git lfs pull and
drives Rugnux_Rotation, and its first four frames Portable_Rugnux_RotationWedge (the
[portable] end-to-end check, which skips on the macOS/Windows jobs because they do not pull LFS). A separate serial dataset is intentionally not shipped
to keep the repository small — the rotation series can be run in serial mode (full analysis
without rotation indexing) to exercise that path. To add your own dataset, drop the master + its
data files here as real files (not symlinks, if you intend to commit them via LFS); the master
references its data files by relative name, so keep them side by side.