Build Packages / Create release (push) Successful in 7s
Build Packages / build:portable:macos-arm64:nocuda (push) Successful in 4m56s
Build Packages / build:rugnux:linux-aarch64:cuda (push) Successful in 9m10s
Build Packages / build:portable:linux-x86_64:nocuda (push) Successful in 13m51s
Build Packages / build:portable:linux-x86_64:cuda (push) Successful in 16m56s
Build Packages / build:jfjoch:rocky8:nocuda (push) Successful in 20m59s
Build Packages / build:portable:windows-x86_64:nocuda (push) Successful in 21m25s
Build Packages / build:jfjoch:rocky9:nocuda (push) Successful in 21m17s
Build Packages / build:jfjoch:ubuntu2204:nocuda (push) Successful in 14m14s
Build Packages / HDF5 consumer tests (DIALS, XDS) (push) Successful in 25m59s
Build Packages / build:portable:windows-x86_64:cuda (push) Successful in 25m48s
Build Packages / build:jfjoch:ubuntu2404:nocuda (push) Successful in 15m52s
Build Packages / build:jfjoch:rocky8:cuda-sls9 (push) Successful in 19m33s
Build Packages / Generate python client (push) Successful in 29s
Build Packages / Build documentation (push) Successful in 1m19s
Build Packages / build:jfjoch:ubuntu2204:cuda (push) Successful in 20m49s
Build Packages / build:jfjoch:rocky9:cuda-sls9 (push) Successful in 25m31s
Build Packages / build:jfjoch:rocky8:cuda (push) Successful in 25m24s
Build Packages / build:jfjoch:rocky9:cuda (push) Successful in 26m5s
Build Packages / build:jfjoch:ubuntu2404:cuda (push) Successful in 22m19s
Build Packages / Unit tests (push) Failing after 2h28m24s
Build Packages / Validation Battery (push) Successful in 40m33s
* Rugnux: Processes a collection live while jfjoch_broker writes it (`rugnux <master.h5> <broker URL>`). * Rugnux: Processing starts on the first images and confirms its choices once all are in, so analysis can begin during collection. * Rugnux: Faster processing, especially on servers with several GPUs and CPU sockets and on computers without a GPU (`--no-gpu`, macOS). * Rugnux: Uses much less GPU memory, so large data sets stay on the GPU of smaller cards, and a data set too large for the card is processed on the CPU instead. * Rugnux: On macOS, Bragg integration runs on the Apple GPU. * Rugnux: Better handling of twinning and pseudo-symmetry, with the twin hypothesis written as `<prefix>_twin_<SG>.mtz`, and a wrong `--model` no longer confirms the data or decides the hand. * Rugnux: `--model` accepts predicted (AlphaFold) models and falls back to molecular replacement when the model is not placed as a rigid body (experimental `--mr` forces it), settling space group, hand and twinning and writing a different answer as `<prefix>_mr.mtz`. * Rugnux: Molecular replacement is faster and settles the space group in more cases with several copies in the asymmetric unit. * Rugnux: Deposition-ready mmCIF, a richer report, and numbered steps on the terminal with the full log in `<prefix>_log.txt`; `_P1.mtz`, `--estimate-beam-center` and `--beam-center-search` are removed. * Rugnux: The beam-stop shadow is found correctly on tilted detectors. * Rugnux: Stills files that record a stationary goniometer axis get the default stills geometry refinement. * jfjoch_viewer: "Analyze dataset" uses the same defaults as a bare `rugnux <file>`, and shows the results of processed CBF, marCCD and SMV sweeps. * jfjoch_viewer: The Files panel refreshes on F5 and every few seconds, and the plot type and other selections stay put during live collection. * jfjoch_writer: Memory stays bounded and old data files are closed efficiently on long runs, any failure ends the run in an error state the broker is told about, and the master file appears only after its data files; the ZeroMQ pusher logs when a stalled writer makes it drop images. * Fixes: The TCP image pusher no longer blocks the broker's receiver, GPU out-of-memory failures stop with a clear message, and the XDS plugin masks module and chip edges. --------- Co-authored-by: Filip Leonarski <jungfrau@filips-mac-mini.home> Reviewed-on: #85 Co-authored-by: Filip Leonarski <filip.leonarski@psi.ch>
196 lines
7.3 KiB
C++
196 lines
7.3 KiB
C++
// SPDX-FileCopyrightText: 2024 Filip Leonarski, Paul Scherrer Institute <filip.leonarski@psi.ch>
|
|
// SPDX-License-Identifier: GPL-3.0-only
|
|
|
|
#pragma once
|
|
|
|
#include <cstring>
|
|
#include <string>
|
|
#include <exception>
|
|
|
|
enum class JFJochExceptionCategory {
|
|
JSON,
|
|
InputParameterAboveMax,
|
|
InputParameterBelowMin,
|
|
InputParameterInvalid,
|
|
WrongNumber,
|
|
WrongUnit,
|
|
ArrayOutOfBounds,
|
|
HDF5,
|
|
IBVerbs,
|
|
RESTCommandUnknown,
|
|
WrongDAQState,
|
|
WrongReceiverState,
|
|
Detector,
|
|
MemAllocFailed,
|
|
AcquisitionDeviceError,
|
|
GPUCUDAError,
|
|
GainFileOpenError,
|
|
MockFileOpenError,
|
|
Compression,
|
|
SharedMemory,
|
|
ZeroMQ,
|
|
ServiceUndefined,
|
|
TriggerError,
|
|
FileWriteError,
|
|
ZSTDCompressionError,
|
|
LogstashConnectionFailure,
|
|
TIFFGeneratorError,
|
|
gRPCError,
|
|
PreviewError,
|
|
HardwareParityError,
|
|
SpotFinderError,
|
|
PCIeError,
|
|
CBORError,
|
|
UDPError,
|
|
CommunicationError,
|
|
SimplonError,
|
|
CalibrationError,
|
|
IndexerError,
|
|
GPUMetalError
|
|
};
|
|
|
|
class JFJochException : public std::exception {
|
|
protected:
|
|
std::string msg;
|
|
JFJochExceptionCategory category;
|
|
static std::string DecodeCategory(JFJochExceptionCategory category) {
|
|
switch (category) {
|
|
case JFJochExceptionCategory::JSON:
|
|
return "JSON parsing or analysis error";
|
|
case JFJochExceptionCategory::InputParameterAboveMax:
|
|
return "Input parameter above max";
|
|
case JFJochExceptionCategory::InputParameterBelowMin:
|
|
return "Input parameter below min";
|
|
case JFJochExceptionCategory::InputParameterInvalid:
|
|
return "Input parameter invalid";
|
|
case JFJochExceptionCategory::WrongNumber:
|
|
return "Wrong number";
|
|
case JFJochExceptionCategory::WrongUnit:
|
|
return "Wrong unit";
|
|
case JFJochExceptionCategory::ArrayOutOfBounds:
|
|
return "Array out of bounds";
|
|
case JFJochExceptionCategory::HDF5:
|
|
return "HDF5 error";
|
|
case JFJochExceptionCategory::IBVerbs:
|
|
return "Infiniband error";
|
|
case JFJochExceptionCategory::RESTCommandUnknown:
|
|
return "REST command unknown";
|
|
case JFJochExceptionCategory::WrongDAQState:
|
|
return "DAQ state error";
|
|
case JFJochExceptionCategory::Detector:
|
|
return "Detector error";
|
|
case JFJochExceptionCategory::MemAllocFailed:
|
|
return "Memory error";
|
|
case JFJochExceptionCategory::AcquisitionDeviceError:
|
|
return "Acquisition device error";
|
|
case JFJochExceptionCategory::GPUCUDAError:
|
|
return "CUDA (GPU) error";
|
|
case JFJochExceptionCategory::GainFileOpenError:
|
|
return "Gain file open error";
|
|
case JFJochExceptionCategory::MockFileOpenError:
|
|
return "Mock file open error";
|
|
case JFJochExceptionCategory::Compression:
|
|
return "Compression error";
|
|
case JFJochExceptionCategory::SharedMemory:
|
|
return "Shared memory error";
|
|
case JFJochExceptionCategory::ZeroMQ:
|
|
return "ZeroMQ error";
|
|
case JFJochExceptionCategory::ServiceUndefined:
|
|
return "Service undefined error";
|
|
case JFJochExceptionCategory::TriggerError:
|
|
return "Trigger error";
|
|
case JFJochExceptionCategory::FileWriteError:
|
|
return "File writer error";
|
|
case JFJochExceptionCategory::ZSTDCompressionError:
|
|
return "Zstd compressor error";
|
|
case JFJochExceptionCategory::LogstashConnectionFailure:
|
|
return "Logstash connection error";
|
|
case JFJochExceptionCategory::TIFFGeneratorError:
|
|
return "TIFF writer error";
|
|
case JFJochExceptionCategory::gRPCError:
|
|
return "Remote node (gRPC) error";
|
|
case JFJochExceptionCategory::PreviewError:
|
|
return "Preview error";
|
|
case JFJochExceptionCategory::HardwareParityError:
|
|
return "Parity error (HW)";
|
|
case JFJochExceptionCategory::SpotFinderError:
|
|
return "Spot finder";
|
|
case JFJochExceptionCategory::PCIeError:
|
|
return "PCIe driver error";
|
|
case JFJochExceptionCategory::CBORError:
|
|
return "CBOR serialization error";
|
|
case JFJochExceptionCategory::UDPError:
|
|
return "UDP simulator error";
|
|
case JFJochExceptionCategory::CommunicationError:
|
|
return "Communication error";
|
|
case JFJochExceptionCategory::SimplonError:
|
|
return "Simplon API error";
|
|
case JFJochExceptionCategory::CalibrationError:
|
|
return "Detector calibration error";
|
|
case JFJochExceptionCategory::IndexerError:
|
|
return "Indexer error";
|
|
case JFJochExceptionCategory::GPUMetalError:
|
|
return "Metal (GPU) error";
|
|
default:
|
|
return "";
|
|
}
|
|
}
|
|
public:
|
|
JFJochException(JFJochExceptionCategory in_val, const std::string &description) noexcept :
|
|
category(in_val) {
|
|
try {
|
|
msg = DecodeCategory(category) + " (" + description + ")";
|
|
} catch (...) {}
|
|
}
|
|
|
|
JFJochException(const JFJochException &e) noexcept {
|
|
try {
|
|
category = e.category;
|
|
msg = e.msg;
|
|
} catch (...) {}
|
|
}
|
|
|
|
[[nodiscard]] const char *what() const noexcept override {
|
|
return msg.c_str();
|
|
}
|
|
|
|
[[nodiscard]] JFJochExceptionCategory Category() const noexcept {
|
|
return category;
|
|
}
|
|
};
|
|
|
|
class WrongDAQStateException : public JFJochException {
|
|
public:
|
|
explicit WrongDAQStateException(const std::string &description)
|
|
: JFJochException(JFJochExceptionCategory::WrongDAQState, description) {}
|
|
};
|
|
|
|
// Thrown when an operation leaves a subsystem (typically the detector) in an undefined state that a
|
|
// simple retry cannot recover from - the broker must re-initialise. The state machine catches this
|
|
// separately and goes to the Error state, whereas ordinary acquisition failures return to Idle.
|
|
class JFJochCriticalException : public JFJochException {
|
|
public:
|
|
explicit JFJochCriticalException(const std::string &description,
|
|
JFJochExceptionCategory in_category = JFJochExceptionCategory::Detector)
|
|
: JFJochException(in_category, description) {}
|
|
};
|
|
|
|
// A PCIe/FPGA hardware fault leaves the acquisition device in an undefined state that a retry cannot
|
|
// recover from, so it is critical: the state machine forces re-initialisation (Error state) rather
|
|
// than returning to Idle as it does for ordinary acquisition failures.
|
|
class PCIeDeviceException : public JFJochCriticalException {
|
|
public:
|
|
explicit PCIeDeviceException(const std::string &description)
|
|
: JFJochCriticalException(description, JFJochExceptionCategory::PCIeError) {
|
|
msg += " (" + std::string(strerror(errno)) + ")";
|
|
}
|
|
};
|
|
|
|
// Thrown by JFJochBitShuffleCompressor::Compress when the compressed output does not fit in the
|
|
// caller-provided destination buffer. Lets callers (e.g. the receiver) drop just that frame.
|
|
class CompressionBufferTooSmallException : public JFJochException {
|
|
public:
|
|
explicit CompressionBufferTooSmallException(const std::string &description)
|
|
: JFJochException(JFJochExceptionCategory::Compression, description) {}
|
|
};
|