mx/Jungfraujoch
2
1
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases 67 Wiki Activity

rugnux: fix --scale on a self-contained _process.h5 (reflections + error model)

Browse Source 
Offline --scale re-scales the reflections stored in a _process.h5 without
re-integration, but was broken for a self-contained integrated snapshot:

1. HDF5MetadataSource::ReadReflections fell back per-image to the linked
   source pixel files for every non-indexed frame (a snapshot's master holds
   /entry/reflections only for the sparse indexed images). With the raw
   _data_NNNNNN.h5 absent or not co-located this threw an HDF5 error; when
   present it needlessly reopened multi-GB files thousands of times. Decide
   once whether the master is the authoritative reflection store and, if so,
   never fall back - a missing per-image group just means the frame has none.
   Legacy/VDS acquisitions (no /entry/reflections in the master) still resolve
   reflections lazily to the source data files.

2. The scale-only stills branch never fit the (a,b) error model, so it merged
   with the identity model - far worse intensities than the full pipeline
   (lyso8 CC1/2 76%->21%). Fit RefineErrorModel and honour --reject-outliers,
   mirroring Rugnux.cpp.

Round-trip validated: full merge == integrate(--no-merge) + --scale (identical
error model a=0.793 b=2.287, matching unique reflection counts), and --scale
now reads reflections in ~2.5s with no raw-file access.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
This commit is contained in:
leonarski_f
2026-07-14 10:06:07 +02:00
co-authored by Claude Opus 4.8
parent 097b9a29d1
commit db8ae0452e
2 changed files with 20 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files
reader/HDF5MetadataSource.cpp
+8 -1
View File
@@ -1099,6 +1099,13 @@ std::vector<IntegrationOutcome> HDF5MetadataSource::ReadReflections(size_t start
std::vector<IntegrationOutcome> ret;
ret.reserve(end_image_val - start_image + 1);
// A self-contained integrated _process.h5 keeps all reflections in this master (one group per
// indexed image), so a missing per-image group means that image simply has none - never fall
// back to the linked source pixel files (which may be absent, and never hold a snapshot's
// reflections). A legacy/VDS acquisition has no /entry/reflections in the master and resolves
// reflections lazily from the source data files instead.
const bool master_reflections_authoritative = master_file->Exists("/entry/reflections");
for (size_t img = start_image; img <= end_image_val; img++) {
IntegrationOutcome outcome;
@@ -1112,7 +1119,7 @@ std::vector<IntegrationOutcome> HDF5MetadataSource::ReadReflections(size_t start
HDF5ReadOnlyFile *meta_file = master_file.get();
size_t meta_image_id = img;
std::string refl_group = fmt::format("/entry/reflections/image_{:06d}", img);
if (!master_file->Exists(refl_group)) {
if (!master_reflections_authoritative && !master_file->Exists(refl_group)) {
const auto loc = ResolveMeta(static_cast<int64_t>(img));
meta_file = loc.file.get();
meta_image_id = loc.local_index;