Build Packages / Create release (push) Successful in 17s
Build Packages / build:portable:macos-arm64:nocuda (push) Successful in 4m41s
Build Packages / HDF5 consumer tests (DIALS, XDS) (push) Successful in 20m49s
Build Packages / build:portable:windows-x86_64:nocuda (push) Successful in 13m6s
Build Packages / build:portable:windows-x86_64:cuda (push) Successful in 23m44s
Build Packages / build:rugnux:linux-aarch64:cuda (push) Successful in 7m28s
Build Packages / build:portable:linux-x86_64:nocuda (push) Successful in 11m50s
Build Packages / build:portable:linux-x86_64:cuda (push) Successful in 14m9s
Build Packages / build:jfjoch:rocky8:nocuda (push) Successful in 16m25s
Build Packages / build:jfjoch:ubuntu2204:nocuda (push) Successful in 15m42s
Build Packages / build:jfjoch:rocky9:nocuda (push) Successful in 20m50s
Build Packages / build:jfjoch:ubuntu2404:nocuda (push) Successful in 20m36s
Build Packages / build:jfjoch:rocky8:cuda-sls9 (push) Successful in 22m18s
Build Packages / build:jfjoch:rocky9:cuda-sls9 (push) Successful in 23m29s
Build Packages / Generate python client (push) Successful in 30s
Build Packages / Build documentation (push) Successful in 1m10s
Build Packages / build:jfjoch:rocky8:cuda (push) Successful in 21m38s
Build Packages / build:jfjoch:ubuntu2204:cuda (push) Successful in 17m8s
Build Packages / build:jfjoch:rocky9:cuda (push) Successful in 23m10s
Build Packages / build:jfjoch:ubuntu2404:cuda (push) Successful in 19m16s
Build Packages / Unit tests (push) Successful in 2h8m4s
Build Packages / Validation Battery (push) Successful in 40m53s
* Rugnux: Processes serial crystallography data from XFELs - SACLA (MPCCD), PAL-XFEL and European XFEL (CXI), LCLS (XTC) and SwissFEL Alvra (JUNGFRAU with a CrystFEL module geometry) - with several files or Jungfraujoch master files merged in one run (`rugnux *_master.h5`). * Rugnux: Stills processing takes a known unit cell and space group as a starting point, finds the beam centre (and, with a cell, the detector distance) from the images, detects the saturation level in other facilities' files and refines the placement of individual detector panels. * Rugnux: The stills report gives R_split and CC1/2 from frame half-sets, comparable with CrystFEL. * jfjoch_viewer: Opens the same XFEL file formats. * Validation: A stills battery checks Rugnux against deposited structures from SACLA, PAL-XFEL, LCLS, European XFEL and SwissFEL. * Rugnux: More reliable convergence of rotation scaling, and live molecular replacement starts as soon as the model is uploaded. * jfjoch_broker: Initialize clears the previous dataset's bearer tokens, image buffer and live Rugnux status, and a slow CUDA JIT cache is reported at start. Reviewed-on: #88 Co-authored-by: Filip Leonarski <filip.leonarski@psi.ch>
77 lines
3.1 KiB
C++
77 lines
3.1 KiB
C++
// SPDX-FileCopyrightText: 2026 Filip Leonarski, Paul Scherrer Institute <filip.leonarski@psi.ch>
|
|
// SPDX-License-Identifier: GPL-3.0-only
|
|
|
|
#pragma once
|
|
|
|
#include <chrono>
|
|
#include <condition_variable>
|
|
#include <cstdint>
|
|
#include <mutex>
|
|
#include <optional>
|
|
#include <string>
|
|
#include <vector>
|
|
|
|
#include "../common/JFJochMessages.h"
|
|
|
|
// What a reader following the current collection needs from the broker (GET /live/start.cbor and
|
|
// GET /live/events): the start message the writer of the master file received, then each data file
|
|
// as a writer reports it closed and renamed into place, then the end of the collection. Fed by the
|
|
// image pusher; read by the HTTP routes. One follower at a time.
|
|
class LiveCollection {
|
|
public:
|
|
struct DataFile {
|
|
uint64_t file_number = 0;
|
|
std::string file; // relative to the collection's root, as the writer named it
|
|
uint64_t first_image = 0;
|
|
uint64_t image_count = 0;
|
|
};
|
|
|
|
struct Snapshot {
|
|
uint64_t generation = 0; // 0: no collection since the broker started
|
|
bool started = false; // the start message is known
|
|
uint64_t run_number = 0;
|
|
std::string run_name;
|
|
std::string file_prefix;
|
|
uint64_t number_of_images = 0;
|
|
int64_t images_per_file = 0;
|
|
std::vector<DataFile> files; // in the order they were closed
|
|
bool ended = false;
|
|
uint64_t end_images = 0;
|
|
std::string end_error;
|
|
};
|
|
|
|
// A collection was accepted (/start); its start message comes with Begin, once the image pusher
|
|
// starts the writers - for a DECTRIS detector only when the detector's own start message arrives.
|
|
// A reader following it in between waits for it.
|
|
void Expect();
|
|
// start_cbor: the start message as the writer of the master file received it.
|
|
void Begin(const StartMessage &start, std::vector<uint8_t> start_cbor);
|
|
void FileClosed(uint64_t file_number, uint64_t image_count);
|
|
// After every writer has acknowledged END: the data files and the master are in place.
|
|
void End(uint64_t images, const std::string &error = "");
|
|
// The measurement is over: ends a collection the image pusher did not end, with this error.
|
|
void EndIfOpen(const std::string &error);
|
|
// Back to "no collection since the broker started" (/initialize): nothing of the last one is kept.
|
|
void Forget();
|
|
|
|
// The start message of the current collection; nothing before it is known.
|
|
std::optional<std::vector<uint8_t>> StartCBOR() const;
|
|
|
|
// Blocks until the start message arrives (when not `started_seen`), the collection has more than
|
|
// `files_seen` files, has ended, a new collection has begun, or `wait` passes; returns the state then.
|
|
Snapshot Wait(uint64_t generation, bool started_seen, size_t files_seen, std::chrono::milliseconds wait);
|
|
Snapshot Get() const;
|
|
|
|
// The single follower slot; false when another follower holds it.
|
|
bool AcquireFollower();
|
|
void ReleaseFollower();
|
|
|
|
private:
|
|
mutable std::mutex m;
|
|
std::condition_variable cv;
|
|
Snapshot state;
|
|
StartMessage start_message;
|
|
std::vector<uint8_t> start_cbor;
|
|
bool follower = false;
|
|
};
|