75e401f0e5
Build Packages / Unit tests (push) Successful in 1h31m59s
Build Packages / build:rpm (rocky8_nocuda) (push) Successful in 8m43s
Build Packages / build:rpm (rocky9_nocuda) (push) Successful in 10m5s
Build Packages / build:rpm (ubuntu2204_nocuda) (push) Successful in 9m27s
Build Packages / build:rpm (ubuntu2404_nocuda) (push) Successful in 8m56s
Build Packages / build:rpm (rocky8_sls9) (push) Successful in 9m24s
Build Packages / build:rpm (rocky9_sls9) (push) Successful in 10m27s
Build Packages / build:rpm (rocky8) (push) Successful in 9m20s
Build Packages / build:rpm (rocky9) (push) Successful in 10m50s
Build Packages / build:rpm (ubuntu2204) (push) Successful in 9m54s
Build Packages / build:rpm (ubuntu2404) (push) Successful in 8m38s
Build Packages / DIALS test (push) Successful in 12m13s
Build Packages / XDS test (durin plugin) (push) Successful in 7m8s
Build Packages / XDS test (JFJoch plugin) (push) Successful in 7m8s
Build Packages / XDS test (neggia plugin) (push) Successful in 7m50s
Build Packages / Generate python client (push) Successful in 16s
Build Packages / Build documentation (push) Successful in 50s
Build Packages / Create release (push) Skipped
This is an UNSTABLE release. It includes many experimental features, as well as many AI generated fixes. We recommend using rc.152 for production use. * jfjoch_broker: Add EXPERIMENTAL pixelrefine mode for image processing * jfjoch_broker: Allow to load user mask from 8-bit and 16-bit TIFF files * jfjoch_broker: Add ROI calculation in non-FPGA workflow * jfjoch_broker: Fixes to TCP image pusher * jfjoch_broker: Remove NUMA bindings * jfjoch_broker: Improvements to indexing * jfjoch_broker: For PSI EIGER, trimming energies are taken from the detector configuration (now compulsory) instead of hardcoded values * jfjoch_writer: Save ROI definitions and the per-pixel ROI bitmap in the master file; azimuthal ROIs support phi (angular) sectors * jfjoch_viewer: Major redesign with dockable panels and saved layouts, plus on-canvas creation/move/resize of box, circle and azimuthal ROIs * jfjoch_viewer: Run jfjoch_process reprocessing jobs from inside the GUI and overlay per-run results Reviewed-on: #63
101 lines
3.9 KiB
C++
101 lines
3.9 KiB
C++
// SPDX-FileCopyrightText: 2026 Filip Leonarski, Paul Scherrer Institute <filip.leonarski@psi.ch>
|
|
// SPDX-License-Identifier: GPL-3.0-only
|
|
|
|
#pragma once
|
|
|
|
#include <atomic>
|
|
#include <optional>
|
|
#include <string>
|
|
#include <vector>
|
|
|
|
#include "../common/DiffractionExperiment.h"
|
|
#include "../common/PixelMask.h"
|
|
#include "../common/CrystalLattice.h"
|
|
#include "../common/Reflection.h" // MergedReflection
|
|
#include "../common/JFJochMessages.h" // DataMessage
|
|
#include "../common/JFJochReceiverPlots.h" // MeanProcessingTime
|
|
#include "../image_analysis/spot_finding/SpotFindingSettings.h"
|
|
|
|
class JFJochHDF5Reader;
|
|
|
|
// Offline reprocessing of a stored Jungfraujoch HDF5 dataset, shared by jfjoch_process,
|
|
// jfjoch_azint and (later) the viewer. The full processing workflow lives here, not in the CLIs:
|
|
// setup, an optional two-pass rotation-indexing pre-pass, a parallel per-image loop (std::thread),
|
|
// an optional scaling/merging post-pass, and the _process.h5 output. The detector geometry and all
|
|
// algorithm settings are configured on the DiffractionExperiment by the caller; ProcessConfig only
|
|
// carries run control. Cancellable from any thread (e.g. SIGINT or a GUI button) via Cancel().
|
|
enum class ProcessMode {
|
|
AzimuthalIntegration, // preprocess + azimuthal integration only (jfjoch_azint)
|
|
FullAnalysis // spot finding + indexing + refinement + integration (jfjoch_process)
|
|
};
|
|
|
|
struct ProcessConfig {
|
|
ProcessMode mode = ProcessMode::FullAnalysis;
|
|
|
|
int start_image = 0;
|
|
int end_image = -1; // -1 => to the end of the dataset
|
|
int stride = 1;
|
|
int nthreads = 1;
|
|
|
|
// Output prefix for the _process.h5 (and scaled reflections). Empty => process without writing.
|
|
std::string output_prefix;
|
|
|
|
SpotFindingSettings spot_finding; // FullAnalysis spot finding
|
|
|
|
// Rotation indexing (FullAnalysis)
|
|
bool rotation_indexing = false;
|
|
bool two_pass_rotation = true;
|
|
bool reuse_rotation_spots = true;
|
|
int rotation_indexing_image_count = 30;
|
|
std::optional<CrystalLattice> forced_rotation_lattice;
|
|
|
|
// Scaling / merging (FullAnalysis). reference_data (from a reference MTZ) also drives the
|
|
// per-image live scaling path when present.
|
|
bool run_scaling = false;
|
|
int64_t scaling_iter = 3;
|
|
std::vector<MergedReflection> reference_data;
|
|
};
|
|
|
|
struct ProcessResult {
|
|
bool cancelled = false;
|
|
uint64_t images_processed = 0;
|
|
double processing_time_s = 0.0;
|
|
double frame_rate_hz = 0.0;
|
|
double throughput_MBs = 0.0;
|
|
std::optional<float> indexing_rate;
|
|
std::optional<UnitCell> consensus_cell;
|
|
bool rotation_lattice_found = false;
|
|
MeanProcessingTime mean_processing_time{};
|
|
std::optional<std::string> written_master_path;
|
|
std::string merge_statistics_text; // populated when scaling/merging ran
|
|
};
|
|
|
|
// Callbacks for progress and live results. Methods may be called from worker threads, so an
|
|
// implementation must be thread-safe. The default no-ops suit the CLIs.
|
|
class JFJochProcessObserver {
|
|
public:
|
|
virtual ~JFJochProcessObserver() = default;
|
|
virtual void OnPhase(const std::string &phase) {}
|
|
virtual void OnProgress(uint64_t done, uint64_t total) {}
|
|
virtual void OnImageProcessed(const DataMessage &msg) {}
|
|
};
|
|
|
|
class JFJochProcess {
|
|
JFJochHDF5Reader &reader_;
|
|
DiffractionExperiment experiment_;
|
|
PixelMask pixel_mask_;
|
|
ProcessConfig config_;
|
|
std::atomic<bool> cancelled_{false};
|
|
|
|
public:
|
|
JFJochProcess(JFJochHDF5Reader &reader, DiffractionExperiment experiment,
|
|
PixelMask pixel_mask, ProcessConfig config);
|
|
|
|
// Runs the configured workflow to completion or until Cancel(). Throws on setup failure.
|
|
ProcessResult Run(JFJochProcessObserver *observer = nullptr);
|
|
|
|
// Request cancellation; safe to call from any thread (the worker loop checks between images).
|
|
void Cancel() { cancelled_ = true; }
|
|
bool IsCancelled() const { return cancelled_; }
|
|
};
|