Files
Jungfraujoch/image_pusher/LiveCollection.h
T
leonarski_f afbe844b20
Build Packages / Create release (push) Successful in 17s
Build Packages / build:portable:macos-arm64:nocuda (push) Successful in 4m41s
Build Packages / HDF5 consumer tests (DIALS, XDS) (push) Successful in 20m49s
Build Packages / build:portable:windows-x86_64:nocuda (push) Successful in 13m6s
Build Packages / build:portable:windows-x86_64:cuda (push) Successful in 23m44s
Build Packages / build:rugnux:linux-aarch64:cuda (push) Successful in 7m28s
Build Packages / build:portable:linux-x86_64:nocuda (push) Successful in 11m50s
Build Packages / build:portable:linux-x86_64:cuda (push) Successful in 14m9s
Build Packages / build:jfjoch:rocky8:nocuda (push) Successful in 16m25s
Build Packages / build:jfjoch:ubuntu2204:nocuda (push) Successful in 15m42s
Build Packages / build:jfjoch:rocky9:nocuda (push) Successful in 20m50s
Build Packages / build:jfjoch:ubuntu2404:nocuda (push) Successful in 20m36s
Build Packages / build:jfjoch:rocky8:cuda-sls9 (push) Successful in 22m18s
Build Packages / build:jfjoch:rocky9:cuda-sls9 (push) Successful in 23m29s
Build Packages / Generate python client (push) Successful in 30s
Build Packages / Build documentation (push) Successful in 1m10s
Build Packages / build:jfjoch:rocky8:cuda (push) Successful in 21m38s
Build Packages / build:jfjoch:ubuntu2204:cuda (push) Successful in 17m8s
Build Packages / build:jfjoch:rocky9:cuda (push) Successful in 23m10s
Build Packages / build:jfjoch:ubuntu2404:cuda (push) Successful in 19m16s
Build Packages / Unit tests (push) Successful in 2h8m4s
Build Packages / Validation Battery (push) Successful in 40m53s
v1.0.0-rc.178 (#88)
* Rugnux: Processes serial crystallography data from XFELs - SACLA (MPCCD), PAL-XFEL and European XFEL (CXI), LCLS (XTC) and SwissFEL Alvra (JUNGFRAU with a CrystFEL module geometry) - with several files or Jungfraujoch master files merged in one run (`rugnux *_master.h5`).
* Rugnux: Stills processing takes a known unit cell and space group as a starting point, finds the beam centre (and, with a cell, the detector distance) from the images, detects the saturation level in other facilities' files and refines the placement of individual detector panels.
* Rugnux: The stills report gives R_split and CC1/2 from frame half-sets, comparable with CrystFEL.
* jfjoch_viewer: Opens the same XFEL file formats.
* Validation: A stills battery checks Rugnux against deposited structures from SACLA, PAL-XFEL, LCLS, European XFEL and SwissFEL.
* Rugnux: More reliable convergence of rotation scaling, and live molecular replacement starts as soon as the model is uploaded.
* jfjoch_broker: Initialize clears the previous dataset's bearer tokens, image buffer and live Rugnux status, and a slow CUDA JIT cache is reported at start.

Reviewed-on: #88
Co-authored-by: Filip Leonarski <filip.leonarski@psi.ch>
2026-10-21 11:20:01 +02:00

77 lines
3.1 KiB
C++

// SPDX-FileCopyrightText: 2026 Filip Leonarski, Paul Scherrer Institute <filip.leonarski@psi.ch>
// SPDX-License-Identifier: GPL-3.0-only
#pragma once
#include <chrono>
#include <condition_variable>
#include <cstdint>
#include <mutex>
#include <optional>
#include <string>
#include <vector>
#include "../common/JFJochMessages.h"
// What a reader following the current collection needs from the broker (GET /live/start.cbor and
// GET /live/events): the start message the writer of the master file received, then each data file
// as a writer reports it closed and renamed into place, then the end of the collection. Fed by the
// image pusher; read by the HTTP routes. One follower at a time.
class LiveCollection {
public:
struct DataFile {
uint64_t file_number = 0;
std::string file; // relative to the collection's root, as the writer named it
uint64_t first_image = 0;
uint64_t image_count = 0;
};
struct Snapshot {
uint64_t generation = 0; // 0: no collection since the broker started
bool started = false; // the start message is known
uint64_t run_number = 0;
std::string run_name;
std::string file_prefix;
uint64_t number_of_images = 0;
int64_t images_per_file = 0;
std::vector<DataFile> files; // in the order they were closed
bool ended = false;
uint64_t end_images = 0;
std::string end_error;
};
// A collection was accepted (/start); its start message comes with Begin, once the image pusher
// starts the writers - for a DECTRIS detector only when the detector's own start message arrives.
// A reader following it in between waits for it.
void Expect();
// start_cbor: the start message as the writer of the master file received it.
void Begin(const StartMessage &start, std::vector<uint8_t> start_cbor);
void FileClosed(uint64_t file_number, uint64_t image_count);
// After every writer has acknowledged END: the data files and the master are in place.
void End(uint64_t images, const std::string &error = "");
// The measurement is over: ends a collection the image pusher did not end, with this error.
void EndIfOpen(const std::string &error);
// Back to "no collection since the broker started" (/initialize): nothing of the last one is kept.
void Forget();
// The start message of the current collection; nothing before it is known.
std::optional<std::vector<uint8_t>> StartCBOR() const;
// Blocks until the start message arrives (when not `started_seen`), the collection has more than
// `files_seen` files, has ended, a new collection has begun, or `wait` passes; returns the state then.
Snapshot Wait(uint64_t generation, bool started_seen, size_t files_seen, std::chrono::milliseconds wait);
Snapshot Get() const;
// The single follower slot; false when another follower holds it.
bool AcquireFollower();
void ReleaseFollower();
private:
mutable std::mutex m;
std::condition_variable cv;
Snapshot state;
StartMessage start_message;
std::vector<uint8_t> start_cbor;
bool follower = false;
};