Files
Jungfraujoch/common/AzimuthalIntegrationMapping.h
leonarski_f b00c668e3a
Build Packages / Create release (push) Successful in 8s
Build Packages / build:portable:macos-arm64:nocuda (push) Successful in 5m11s
Build Packages / build:rugnux:linux-aarch64:cuda (push) Successful in 10m32s
Build Packages / build:portable:linux-x86_64:nocuda (push) Successful in 18m26s
Build Packages / build:portable:linux-x86_64:cuda (push) Successful in 22m11s
Build Packages / build:jfjoch:ubuntu2204:nocuda (push) Successful in 23m32s
Build Packages / build:portable:windows-x86_64:nocuda (push) Successful in 25m36s
Build Packages / build:jfjoch:rocky8:nocuda (push) Successful in 27m28s
Build Packages / HDF5 consumer tests (DIALS, XDS) (push) Successful in 28m10s
Build Packages / build:jfjoch:rocky9:nocuda (push) Successful in 28m10s
Build Packages / build:portable:windows-x86_64:cuda (push) Successful in 29m24s
Build Packages / build:jfjoch:ubuntu2404:nocuda (push) Successful in 21m45s
Build Packages / Generate python client (push) Successful in 31s
Build Packages / Build documentation (push) Successful in 1m21s
Build Packages / build:jfjoch:rocky8:cuda-sls9 (push) Successful in 24m2s
Build Packages / build:jfjoch:rocky9:cuda-sls9 (push) Successful in 29m25s
Build Packages / build:jfjoch:rocky8:cuda (push) Successful in 30m27s
Build Packages / build:jfjoch:ubuntu2204:cuda (push) Successful in 27m12s
Build Packages / build:jfjoch:ubuntu2404:cuda (push) Successful in 32m20s
Build Packages / build:jfjoch:rocky9:cuda (push) Successful in 33m36s
Build Packages / Unit tests (push) Successful in 2h7m18s
Build Packages / Validation Battery (push) Successful in 33m19s
v1.0.0-rc.179 (#90)
* Rugnux: Stills processing needs only the unit cell and space group beyond what the file records - detector distance, beam centre, tilt, panel placement, saturation level, gain and polarisation plane are found from the images - and is up to twice as fast.
* Rugnux: Stills can be indexed without a GPU, with a CPU implementation of the fast-feedback indexer (macOS, computers without a GPU).
* Rugnux: Rotation and stills data are integrated in the detector's own units with one gain model, improving data from CCD detectors.
* Web frontend: The Rugnux live page shows the placed model with its electron density and anomalous difference map in a Mol* viewer.

Reviewed-on: #90
Co-authored-by: Filip Leonarski <filip.leonarski@psi.ch>
2026-10-24 14:52:29 +02:00

124 lines
6.3 KiB
C++

// SPDX-FileCopyrightText: 2025 Filip Leonarski, Paul Scherrer Institute <filip.leonarski@psi.ch>
// SPDX-License-Identifier: GPL-3.0-only
#pragma once
#include <memory>
#include <mutex>
#include <optional>
#include "DiffractionExperiment.h"
#include "PixelMask.h"
// The per-pixel geometry of the last few mappings built through it, before the mask: every pixel's
// resolution, correction and bin. None of these depends on the mask - a masked pixel is only left
// out - so a mapping for the same geometry under another mask takes them from here and blanks its own
// masked pixels, instead of evaluating the geometry of every pixel again. Building a mapping is that
// evaluation, and on a 16 Mpx detector it is a tenth of a second on every core. A run alternates
// between a handful of centres - the file's, the measured one, the post-refined one, each built once
// to index and again to score - so several are kept, the
// least recently used going first (~170 MB each at 16 Mpx). A mapping being built holds the cache,
// so two built at once for the same geometry evaluate it once.
class AzimuthalIntegrationGeometryCache {
friend class AzimuthalIntegrationMapping;
static constexpr size_t MAX_ENTRIES = 6;
struct Entry {
std::vector<uint32_t> key; // bit patterns of everything SetupPixel reads, and the panel table
std::vector<uint16_t> pixel_to_bin;
std::vector<float> pixel_resolution;
std::vector<float> corrections;
};
std::mutex m;
std::vector<Entry> entries; // most recently used last
};
class AzimuthalIntegrationMapping {
protected:
const AzimuthalIntegrationSettings settings;
const float wavelength;
const size_t width, height;
// Where the image's pixels are on the plane the geometry describes; empty when they are where the
// image has them.
const DetectorModules modules;
std::vector<float> bin_to_q;
std::vector<float> bin_to_2theta;
std::vector<float> bin_to_d;
std::vector<float> bin_to_phi;
std::vector<uint16_t> pixel_to_bin;
std::vector<float> pixel_resolution;
std::vector<float> corrections;
std::optional<float> polarization_factor;
// Checksums of the two tables the GPU engines upload, taken once here. They are part of the key
// the shared device-table cache looks them up by (CudaSharedTables.h), so an engine that hands
// its own checksum in does not have to hash tens of megabytes on its way to a cache hit - and
// there is one engine per worker per pass. Both vectors are written in the constructor and never
// touched again, so a checksum taken there stays true for the mapping's whole life.
uint64_t pixel_to_bin_checksum = 0;
uint64_t corrections_checksum = 0;
// Bit-packed "this pixel is outside the resolution limits" mask, memoised for the limits it was
// last built for. Every worker's spot finder wants the identical mask and building it walks every
// pixel, so it is built once and shared. The mapping is const and read from all the worker threads
// at once, hence the mutex; and the mask is handed out as a shared_ptr, so a caller keeps the one
// it was given even if another thread later replaces the cached one.
mutable std::mutex res_mask_mutex;
mutable std::optional<float> res_mask_high, res_mask_low;
mutable std::shared_ptr<const std::vector<uint32_t>> res_mask_bits;
size_t nthreads;
void UpdateMaxBinNumber();
// A null mask sets up every pixel.
void SetupRawGeom(const DiffractionExperiment& experiment, const std::vector<uint32_t> &mask);
void SetupConvGeomRows(const DiffractionGeometry &geom, const std::vector<uint32_t> *mask, size_t row0, size_t row_end);
void SetupConvGeom(const DiffractionGeometry &geom, const std::vector<uint32_t> *mask);
void SetupConvGeomCached(const DiffractionGeometry &geom, const std::vector<uint32_t> &mask,
AzimuthalIntegrationGeometryCache &cache);
// Pixel pxl of the image, at (x, y) on the plane.
void SetupPixel(const DiffractionGeometry &geom, const std::vector<uint32_t> *mask,
uint32_t pxl, float x, float y);
AzimuthalIntegrationMapping(const DiffractionExperiment& experiment,
const PixelMask& mask,
AzimuthalIntegrationGeometryCache *cache,
size_t nthreads);
public:
AzimuthalIntegrationMapping(const DiffractionExperiment& experiment,
const PixelMask& mask,
size_t nthreads = 0);
// The same mapping, with the geometry of the pixels taken from `cache` when it holds this geometry
// (AzimuthalIntegrationGeometryCache), and left there for the next one when it does not.
AzimuthalIntegrationMapping(const DiffractionExperiment& experiment,
const PixelMask& mask,
AzimuthalIntegrationGeometryCache &cache,
size_t nthreads = 0);
[[nodiscard]] uint16_t GetBinNumber() const;
[[nodiscard]] const std::vector<uint16_t>& GetPixelToBin() const;
[[nodiscard]] const std::vector<float> &GetBinToQ() const;
[[nodiscard]] const std::vector<float> &GetBinToD() const;
[[nodiscard]] const std::vector<float> &GetBinToTwoTheta() const;
[[nodiscard]] const std::vector<float> &GetBinToPhi() const;
[[nodiscard]] uint16_t QToBin(float q) const;
[[nodiscard]] const std::vector<float> &Corrections() const;
[[nodiscard]] const std::vector<float> &Resolution() const;
[[nodiscard]] uint64_t GetPixelToBinChecksum() const;
[[nodiscard]] uint64_t GetCorrectionsChecksum() const;
// Pixels the spot finders must ignore because their resolution falls outside the limits, packed
// 32 pixels to a word (bit set = ignore), in the finders' own layout.
[[nodiscard]] std::shared_ptr<const std::vector<uint32_t>>
ResolutionMaskBits(std::optional<float> high_res, std::optional<float> low_res) const;
[[nodiscard]] size_t GetWidth() const;
[[nodiscard]] size_t GetHeight() const;
[[nodiscard]] const AzimuthalIntegrationSettings& Settings() const;
[[nodiscard]] int32_t GetAzimuthalBinCount() const;
[[nodiscard]] int32_t GetQBinCount() const;
[[nodiscard]] size_t GetNThreads() const;
};