Build Packages / Create release (push) Successful in 26s
Build Packages / Build documentation (push) Successful in 1m43s
Build Packages / build:portable:macos-arm64:nocuda (push) Successful in 5m7s
Build Packages / build:portable:linux-x86_64:nocuda (push) Successful in 11m48s
Build Packages / build:rugnux:linux-aarch64:cuda (push) Successful in 7m22s
Build Packages / build:portable:linux-x86_64:cuda (push) Successful in 12m24s
Build Packages / HDF5 consumer tests (DIALS, XDS) (push) Successful in 25m30s
Build Packages / build:portable:windows-x86_64:nocuda (push) Successful in 25m29s
Build Packages / build:portable:windows-x86_64:cuda (push) Successful in 29m41s
Build Packages / build:jfjoch:ubuntu2204:nocuda (push) Successful in 21m44s
Build Packages / build:jfjoch:rocky8:nocuda (push) Successful in 24m41s
Build Packages / build:jfjoch:rocky9:nocuda (push) Successful in 26m9s
Build Packages / build:jfjoch:ubuntu2404:nocuda (push) Successful in 26m3s
Build Packages / build:jfjoch:rocky8:cuda-sls9 (push) Successful in 28m28s
Build Packages / Generate python client (push) Successful in 27s
Build Packages / build:jfjoch:rocky9:cuda-sls9 (push) Successful in 31m16s
Build Packages / build:jfjoch:ubuntu2204:cuda (push) Successful in 20m44s
Build Packages / build:jfjoch:rocky8:cuda (push) Successful in 26m27s
Build Packages / build:jfjoch:ubuntu2404:cuda (push) Successful in 22m52s
Build Packages / build:jfjoch:rocky9:cuda (push) Successful in 27m44s
Build Packages / Unit tests (push) Successful in 1h46m55s
Build Packages / Validation Battery (push) Successful in 52m50s
* Rugnux: Several rotation sweeps of one crystal are merged as one dataset (`rugnux a_master.h5 b_master.h5`), on a common indexing and cell, with a non-isomorphous sweep left out and reported; `--sweeps separate` processes each sweep on its own. Bruker `.sfrm` frames and imgCIF files with a full goniometer axis chain are read. * Rugnux: More robust rotation processing - a retry with a more sensitive spot finder when no lattice is found, a self-consistent detector distance, long axes and doubled cells tested as hypotheses, a `-C` supercell multiple stepped down, and each ice ring merged, down-weighted or rejected on its own. * Rugnux: Serial stills are merged with a partiality-aware error model, reported as `ERROR_MODEL_A/B/C` with no ISa or R_merge/R_meas/R_pim; runs without `-S` have an overall intensity scale about 0.86-0.88 times that of earlier versions, with unchanged statistics. A second crystal form is left out of the merge and reported, the indexing ambiguity is resolved more reliably, and `--model` no longer influences processing. * Rugnux: The reported CC1/2 is the standard unweighted one, which can be lower than before on sweeps with weak frames; ISa comes with a 95% interval (`ISA_LOW`/`ISA_HIGH`). * Rugnux: Model refinement adds anisotropic/TLS, local NCS and twin refinement where R-free supports them; building waters and relabelling ions is now off by default (`--refine-solvent` turns it on). * NXmx: A detector of several modules is written as `module_0` ... `module_N` only, so DIALS reads each module as its own panel. * Other: JPEG previews use a bundled encoder (libjpeg-turbo no longer needed), Rugnux prints how to cite it, and the release archives contain the HTML documentation. Reviewed-on: #92 Co-authored-by: Filip Leonarski <filip.leonarski@psi.ch>
128 lines
6.6 KiB
C++
128 lines
6.6 KiB
C++
// SPDX-FileCopyrightText: 2026 Filip Leonarski, Paul Scherrer Institute <filip.leonarski@psi.ch>
|
|
// SPDX-License-Identifier: GPL-3.0-only
|
|
|
|
#pragma once
|
|
|
|
#include <QElapsedTimer>
|
|
#include <QString>
|
|
#include <QWidget>
|
|
#include <cstdint>
|
|
#include <optional>
|
|
#include <vector>
|
|
|
|
#include "../JFJochProcessController.h"
|
|
#include "../../rugnux/RugnuxDefaults.h"
|
|
#include "../JFJochImageReadingWorker.h" // ReprocessingInputs
|
|
#include "../widgets/PowderCalibrationWidget.h" // CalibrationSelection
|
|
|
|
class QTableWidget;
|
|
class QProgressBar;
|
|
class QStackedWidget;
|
|
class QToolBar;
|
|
class QToolButton;
|
|
|
|
// Makes processing a first-class GUI activity: a dockable panel with a table of processing jobs run
|
|
// on the current dataset. A job can be run locally (off the GUI thread, via JFJochProcessController)
|
|
// or its rugnux command line copied for a cluster. A finished local run is registered as a
|
|
// reader snapshot so its results become a selectable view of the dataset. Re-processing reads a
|
|
// stored HDF5 file, so the panel shows an explanatory message while connected to a live HTTP stream.
|
|
class JFJochProcessingJobsWindow : public QWidget {
|
|
Q_OBJECT
|
|
public:
|
|
explicit JFJochProcessingJobsWindow(JFJochImageReadingWorker *worker, QWidget *parent = nullptr);
|
|
|
|
signals:
|
|
void registerSnapshot(QString id, QString label, QString master_path);
|
|
void activateSnapshot(QString id);
|
|
void renameRun(QString id, QString label);
|
|
void removeRun(QString id);
|
|
void writeStatusBar(QString message, int timeout_ms = 0);
|
|
// Live per-image results while a job runs, for the dataset-info plots (nullptr clears it).
|
|
void liveDataset(std::shared_ptr<const JFJochReaderDataset> dataset);
|
|
void jobStarted(); // a reprocessing job was launched — reveal the (hidden-by-default) panel
|
|
|
|
public slots:
|
|
void onHttpConnectionChanged(bool connected, QString addr);
|
|
void clearJobs(); // reset the table on a new file (re-adds the Original row)
|
|
void setActiveRun(QString active_id); // bold the row of the run currently shown in the plots
|
|
// The panel's "Analyze dataset" action; the mode is the panel's selected page. The calibrant
|
|
// selection is only used by ProcessMode::Calibration.
|
|
void newJob(ProcessMode mode = ProcessMode::FullAnalysis, CalibrationSelection calibration = {});
|
|
void setImageRange(int64_t first, int64_t last);
|
|
|
|
private slots:
|
|
void cancelJob();
|
|
void removeResult();
|
|
void viewResults();
|
|
void onPhase(QString phase);
|
|
void onProgress(quint64 done, quint64 total);
|
|
void onFinished(ProcessResult result, QString report, std::vector<ReportCheck> checks);
|
|
void onFailed(QString error);
|
|
|
|
private:
|
|
struct JobInfo {
|
|
QString id; // stable reader-snapshot key
|
|
QString label; // editable display name (legend / table)
|
|
QString snapshot_path; // empty unless saved
|
|
bool has_result = false;
|
|
// Merge statistics captured when a scaling/merging job finished (drive the analysis window).
|
|
bool has_merge_stats = false;
|
|
MergeStatistics merge_stats;
|
|
double isa = 0.0;
|
|
bool merge_has_reference = false;
|
|
TwinningAnalysisResult twinning; // twinning test of the merged intensities
|
|
std::optional<gemmi::SpaceGroup> space_group; // final space group (searched or fixed)
|
|
std::optional<SearchSpaceGroupResult> space_group_search; // ranked candidates, when a search ran
|
|
std::vector<std::pair<float, float>> merged_i_sigma; // ISa diagnostic scatter
|
|
QString report; // the rugnux result report text (a section of the window)
|
|
std::vector<ReportCheck> checks; // the report's pathology checklist
|
|
// Detector calibration result (Calibration mode): the fit, the header geometry it is compared
|
|
// against, and where the .poni was written.
|
|
std::optional<CalibrationResult> calibration;
|
|
std::optional<DiffractionGeometry> calibration_header;
|
|
QString poni_path;
|
|
QToolButton *graph_btn = nullptr; // per-row "show statistics" button (enabled once stats exist)
|
|
};
|
|
struct JobSpec {
|
|
ProcessMode mode = ProcessMode::FullAnalysis;
|
|
int start_image = 0;
|
|
int end_image = 0; // 0 == to the end
|
|
int threads = 4;
|
|
bool save_h5 = true; // write the per-image _process.h5 (also drives the viewer snapshot)
|
|
bool save_merged = true; // write the merged .mtz/.cif
|
|
QString prefix;
|
|
bool scaling = false;
|
|
bool refine_geometry = false; // stills-only global geometry bundle-adjust (needs a known cell)
|
|
int refine_geometry_frames = RUGNUX_REFINE_GEOMETRY_FRAMES; // strong indexed frames fed to that bundle adjustment
|
|
bool rotation_postrefine = true; // rotation-only two-pass geometry post-refine (default on)
|
|
bool detect_beam_stop = true; // project frames and mask the beam-stop shadow (default on)
|
|
int detect_beam_stop_frames = RUGNUX_DETECT_BEAM_STOP_FRAMES; // frames projected to find it
|
|
CalibrationSelection calibration; // Calibration mode: calibrant rings + rings/spots method
|
|
};
|
|
|
|
// Returns 0 = cancel, 1 = run locally, 2 = copy command line; fills spec from the dialog.
|
|
int askJob(const ReprocessingInputs &inputs, JobSpec &spec);
|
|
ProcessConfig buildConfig(const JobSpec &spec, const ReprocessingInputs &inputs) const;
|
|
void setStatus(int row, const QString &text);
|
|
void addOriginalRow(); // the file's own data as the first, always-present run
|
|
void addRowActions(int row, const QString &id); // per-row graph (stats) + trash (remove) buttons
|
|
void showStats(const QString &id); // open the merge-statistics window for a run
|
|
void removeRunById(const QString &id); // remove a run from the table + reader
|
|
|
|
JFJochImageReadingWorker *worker_;
|
|
JFJochProcessController *controller_;
|
|
// The experiment a running calibration job was launched with: WritePoniFile needs the detector
|
|
// size and wavelength from it once the fit comes back.
|
|
DiffractionExperiment calibration_experiment_;
|
|
QToolBar *toolbar_;
|
|
QStackedWidget *stack_; // page 0: jobs table, page 1: HTTP-mode message
|
|
QTableWidget *table_;
|
|
QProgressBar *running_bar_ = nullptr; // lives in the running row's Status cell
|
|
QElapsedTimer job_timer_; // running job wall-clock, for rate + ETA
|
|
int running_row_ = -1;
|
|
int job_counter_ = 0;
|
|
// The image range picked on a plot, offered as the next job's start/end image; -1 = none.
|
|
int64_t range_first_ = -1, range_last_ = -1;
|
|
std::vector<JobInfo> jobs_;
|
|
};
|