Build Packages / Create release (push) Successful in 8s
Build Packages / build:portable:macos-arm64:nocuda (push) Successful in 5m11s
Build Packages / build:rugnux:linux-aarch64:cuda (push) Successful in 10m32s
Build Packages / build:portable:linux-x86_64:nocuda (push) Successful in 18m26s
Build Packages / build:portable:linux-x86_64:cuda (push) Successful in 22m11s
Build Packages / build:jfjoch:ubuntu2204:nocuda (push) Successful in 23m32s
Build Packages / build:portable:windows-x86_64:nocuda (push) Successful in 25m36s
Build Packages / build:jfjoch:rocky8:nocuda (push) Successful in 27m28s
Build Packages / HDF5 consumer tests (DIALS, XDS) (push) Successful in 28m10s
Build Packages / build:jfjoch:rocky9:nocuda (push) Successful in 28m10s
Build Packages / build:portable:windows-x86_64:cuda (push) Successful in 29m24s
Build Packages / build:jfjoch:ubuntu2404:nocuda (push) Successful in 21m45s
Build Packages / Generate python client (push) Successful in 31s
Build Packages / Build documentation (push) Successful in 1m21s
Build Packages / build:jfjoch:rocky8:cuda-sls9 (push) Successful in 24m2s
Build Packages / build:jfjoch:rocky9:cuda-sls9 (push) Successful in 29m25s
Build Packages / build:jfjoch:rocky8:cuda (push) Successful in 30m27s
Build Packages / build:jfjoch:ubuntu2204:cuda (push) Successful in 27m12s
Build Packages / build:jfjoch:ubuntu2404:cuda (push) Successful in 32m20s
Build Packages / build:jfjoch:rocky9:cuda (push) Successful in 33m36s
Build Packages / Unit tests (push) Successful in 2h7m18s
Build Packages / Validation Battery (push) Successful in 33m19s
* Rugnux: Stills processing needs only the unit cell and space group beyond what the file records - detector distance, beam centre, tilt, panel placement, saturation level, gain and polarisation plane are found from the images - and is up to twice as fast. * Rugnux: Stills can be indexed without a GPU, with a CPU implementation of the fast-feedback indexer (macOS, computers without a GPU). * Rugnux: Rotation and stills data are integrated in the detector's own units with one gain model, improving data from CCD detectors. * Web frontend: The Rugnux live page shows the placed model with its electron density and anomalous difference map in a Mol* viewer. Reviewed-on: #90 Co-authored-by: Filip Leonarski <filip.leonarski@psi.ch>
124 lines
6.3 KiB
C++
124 lines
6.3 KiB
C++
// SPDX-FileCopyrightText: 2025 Filip Leonarski, Paul Scherrer Institute <filip.leonarski@psi.ch>
|
|
// SPDX-License-Identifier: GPL-3.0-only
|
|
|
|
#pragma once
|
|
|
|
#include <memory>
|
|
#include <mutex>
|
|
#include <optional>
|
|
#include "DiffractionExperiment.h"
|
|
#include "PixelMask.h"
|
|
|
|
// The per-pixel geometry of the last few mappings built through it, before the mask: every pixel's
|
|
// resolution, correction and bin. None of these depends on the mask - a masked pixel is only left
|
|
// out - so a mapping for the same geometry under another mask takes them from here and blanks its own
|
|
// masked pixels, instead of evaluating the geometry of every pixel again. Building a mapping is that
|
|
// evaluation, and on a 16 Mpx detector it is a tenth of a second on every core. A run alternates
|
|
// between a handful of centres - the file's, the measured one, the post-refined one, each built once
|
|
// to index and again to score - so several are kept, the
|
|
// least recently used going first (~170 MB each at 16 Mpx). A mapping being built holds the cache,
|
|
// so two built at once for the same geometry evaluate it once.
|
|
class AzimuthalIntegrationGeometryCache {
|
|
friend class AzimuthalIntegrationMapping;
|
|
static constexpr size_t MAX_ENTRIES = 6;
|
|
struct Entry {
|
|
std::vector<uint32_t> key; // bit patterns of everything SetupPixel reads, and the panel table
|
|
std::vector<uint16_t> pixel_to_bin;
|
|
std::vector<float> pixel_resolution;
|
|
std::vector<float> corrections;
|
|
};
|
|
std::mutex m;
|
|
std::vector<Entry> entries; // most recently used last
|
|
};
|
|
|
|
class AzimuthalIntegrationMapping {
|
|
protected:
|
|
const AzimuthalIntegrationSettings settings;
|
|
const float wavelength;
|
|
const size_t width, height;
|
|
// Where the image's pixels are on the plane the geometry describes; empty when they are where the
|
|
// image has them.
|
|
const DetectorModules modules;
|
|
|
|
std::vector<float> bin_to_q;
|
|
std::vector<float> bin_to_2theta;
|
|
std::vector<float> bin_to_d;
|
|
std::vector<float> bin_to_phi;
|
|
std::vector<uint16_t> pixel_to_bin;
|
|
|
|
std::vector<float> pixel_resolution;
|
|
std::vector<float> corrections;
|
|
|
|
std::optional<float> polarization_factor;
|
|
|
|
// Checksums of the two tables the GPU engines upload, taken once here. They are part of the key
|
|
// the shared device-table cache looks them up by (CudaSharedTables.h), so an engine that hands
|
|
// its own checksum in does not have to hash tens of megabytes on its way to a cache hit - and
|
|
// there is one engine per worker per pass. Both vectors are written in the constructor and never
|
|
// touched again, so a checksum taken there stays true for the mapping's whole life.
|
|
uint64_t pixel_to_bin_checksum = 0;
|
|
uint64_t corrections_checksum = 0;
|
|
|
|
// Bit-packed "this pixel is outside the resolution limits" mask, memoised for the limits it was
|
|
// last built for. Every worker's spot finder wants the identical mask and building it walks every
|
|
// pixel, so it is built once and shared. The mapping is const and read from all the worker threads
|
|
// at once, hence the mutex; and the mask is handed out as a shared_ptr, so a caller keeps the one
|
|
// it was given even if another thread later replaces the cached one.
|
|
mutable std::mutex res_mask_mutex;
|
|
mutable std::optional<float> res_mask_high, res_mask_low;
|
|
mutable std::shared_ptr<const std::vector<uint32_t>> res_mask_bits;
|
|
|
|
size_t nthreads;
|
|
|
|
void UpdateMaxBinNumber();
|
|
|
|
// A null mask sets up every pixel.
|
|
void SetupRawGeom(const DiffractionExperiment& experiment, const std::vector<uint32_t> &mask);
|
|
void SetupConvGeomRows(const DiffractionGeometry &geom, const std::vector<uint32_t> *mask, size_t row0, size_t row_end);
|
|
void SetupConvGeom(const DiffractionGeometry &geom, const std::vector<uint32_t> *mask);
|
|
void SetupConvGeomCached(const DiffractionGeometry &geom, const std::vector<uint32_t> &mask,
|
|
AzimuthalIntegrationGeometryCache &cache);
|
|
|
|
// Pixel pxl of the image, at (x, y) on the plane.
|
|
void SetupPixel(const DiffractionGeometry &geom, const std::vector<uint32_t> *mask,
|
|
uint32_t pxl, float x, float y);
|
|
|
|
AzimuthalIntegrationMapping(const DiffractionExperiment& experiment,
|
|
const PixelMask& mask,
|
|
AzimuthalIntegrationGeometryCache *cache,
|
|
size_t nthreads);
|
|
public:
|
|
|
|
AzimuthalIntegrationMapping(const DiffractionExperiment& experiment,
|
|
const PixelMask& mask,
|
|
size_t nthreads = 0);
|
|
// The same mapping, with the geometry of the pixels taken from `cache` when it holds this geometry
|
|
// (AzimuthalIntegrationGeometryCache), and left there for the next one when it does not.
|
|
AzimuthalIntegrationMapping(const DiffractionExperiment& experiment,
|
|
const PixelMask& mask,
|
|
AzimuthalIntegrationGeometryCache &cache,
|
|
size_t nthreads = 0);
|
|
|
|
[[nodiscard]] uint16_t GetBinNumber() const;
|
|
[[nodiscard]] const std::vector<uint16_t>& GetPixelToBin() const;
|
|
[[nodiscard]] const std::vector<float> &GetBinToQ() const;
|
|
[[nodiscard]] const std::vector<float> &GetBinToD() const;
|
|
[[nodiscard]] const std::vector<float> &GetBinToTwoTheta() const;
|
|
[[nodiscard]] const std::vector<float> &GetBinToPhi() const;
|
|
[[nodiscard]] uint16_t QToBin(float q) const;
|
|
[[nodiscard]] const std::vector<float> &Corrections() const;
|
|
[[nodiscard]] const std::vector<float> &Resolution() const;
|
|
[[nodiscard]] uint64_t GetPixelToBinChecksum() const;
|
|
[[nodiscard]] uint64_t GetCorrectionsChecksum() const;
|
|
// Pixels the spot finders must ignore because their resolution falls outside the limits, packed
|
|
// 32 pixels to a word (bit set = ignore), in the finders' own layout.
|
|
[[nodiscard]] std::shared_ptr<const std::vector<uint32_t>>
|
|
ResolutionMaskBits(std::optional<float> high_res, std::optional<float> low_res) const;
|
|
[[nodiscard]] size_t GetWidth() const;
|
|
[[nodiscard]] size_t GetHeight() const;
|
|
[[nodiscard]] const AzimuthalIntegrationSettings& Settings() const;
|
|
[[nodiscard]] int32_t GetAzimuthalBinCount() const;
|
|
[[nodiscard]] int32_t GetQBinCount() const;
|
|
[[nodiscard]] size_t GetNThreads() const;
|
|
};
|