v1.0.0-rc.139 #49

Open

leonarski_f wants to merge 33 commits from 2604-start-speed into main

pull from: 2604-start-speed

merge into: mx:main

mx:main

mx:gitea-pages

mx:2604-async-start

mx:2605-sigma-correction

mx:2604-hdf5-errors

mx:2604-rc.136

mx:2604-rc.135

mx:2604-processing-options

mx:2603-single-file

mx:2604-detector-parallel-logic

mx:2603-pipeline-upgrades

mx:2603-multilattice

mx:2603-rc.131-2

mx:2603-rc.131

mx:2603-rc.130

mx:2603-rc.129

mx:2603-ep

mx:2602-scaling-d-limit

mx:2602-residual

mx:2601-completness

mx:2601-1.0.0-rc.124

mx:2601-1.0.0-rc.123

mx:2512-scaling-merging

mx:2512-1.0.0-rc.122

mx:2512-1.0.0-rc.121

mx:2511-1.0.0-rc.120

mx:2511-1.0.0-rc.119b

mx:2511-1.0.0-rc.119

mx:2511-1.0.0-rc.118

mx:2511-1.0.0-rc.117

mx:2511-1.0.0-rc.116

mx:2511-1.0.0-rc.115c

mx:2511-1.0.0-rc.115

mx:2511-1.0.0-rc.114b

mx:2511-1.0.0-rc.114

mx:2511-1.0.0-rc.113

mx:2511-1.0.0-rc.112

mx:2511-1.0.0-rc.111

mx:2511-1.0.0-rc.110

mx:2511-1.0.0-rc.109

mx:2511-1.0.0-rc.108

mx:2511-1.0.0-rc.107

mx:2511-1.0.0-rc.106

mx:2511-1.0.0-rc.105

mx:2511-1.0.0-rc.104

mx:2511-rc.103

mx:2511-1.0.0-rc.102

mx:2511-viewer-enh-2

mx:2511-viewer-enh

mx:2511-eiger-mask-3

mx:2511-eiger-mask

mx:2510-viewer-improvements

mx:2510-viewer-3D

mx:2510-fpga-clamp

mx:2510-rc.88

mx:2510-release

mx:2509-rc.82

mx:2509-gitea

Conversation 0 Commits 33 Files Changed 189

+876 -635

leonarski_f commented 2026-04-28 15:06:06 +02:00

Owner

Copy Link

Copy Source

This is an UNSTABLE release. The release has significant modifications and bug fixes, if things go wrong, it is better to revert to 1.0.0-rc.132.

• jfjoch_broker: Further reduce startup time for DECTRIS detectors by selectively modifying SIMPLON parameters on /start
• jfjoch_broker: Further reduce startup time for DECTRIS detectors by not setting beam center and detector distance via SIMPLON API on '/start'
• jfjoch_broker: Add an extra message to ZeroMQ puller ready to monitor Lite worklow preparation time
• jfjoch_broker: Image buffer configuration is postponed for Lite receiver flow till start message is received
• jfjoch_broker: Use nanoseconds internally for frame/image/readout time
• jfjoch_broker: Extra messages added for receiver operation (to be removed after debugging finished)
• jfojch_broker: Improve profiling of different data analysis steps
• jfjoch_broker: Record integration reflection count
• jfjoch_broker: Fix bug where ZeroMQ preview frequency was confusing time units (micro vs. milliseconds)
• jfjoch_broker: Fix bug where '/wait_till_done' got deadlocked
• jfjoch_writer: Fix confusion between NaN and zero in floating-point datasets

Breaking changes: detector definition is now using nanoseconds to define minimum frame time, minimum count time and readout time.

This is an UNSTABLE release. The release has significant modifications and bug fixes, if things go wrong, it is better to revert to 1.0.0-rc.132. * jfjoch_broker: Further reduce startup time for DECTRIS detectors by selectively modifying SIMPLON parameters on `/start` * jfjoch_broker: Further reduce startup time for DECTRIS detectors by not setting beam center and detector distance via SIMPLON API on '/start' * jfjoch_broker: Add an extra message to ZeroMQ puller ready to monitor Lite worklow preparation time * jfjoch_broker: Image buffer configuration is postponed for Lite receiver flow till start message is received * jfjoch_broker: Use nanoseconds internally for frame/image/readout time * jfjoch_broker: Extra messages added for receiver operation (to be removed after debugging finished) * jfojch_broker: Improve profiling of different data analysis steps * jfjoch_broker: Record integration reflection count * jfjoch_broker: Fix bug where ZeroMQ preview frequency was confusing time units (micro vs. milliseconds) * jfjoch_broker: Fix bug where '/wait_till_done' got deadlocked * jfjoch_writer: Fix confusion between NaN and zero in floating-point datasets **Breaking changes**: detector definition is now using nanoseconds to define minimum frame time, minimum count time and readout time.

leonarski_f added 14 commits 2026-04-28 15:06:06 +02:00

DectrisSimplonClient: Reduce number of calls to Simplon API at start e5ee55e963

JFJochReceiver: Move preparing image buffer to later for Lite-workflow 36b45f2ab4

ZMQImagePuller: Add logging of connect 3ba3cc6e99

VERSION: 1.0.0-rc.139 cd4a4fb6b5

DectrisSimplonClient: Don't configure beam center and detector distance via SIMPLON API, as these just take too much time, while Jungfraujoch anyway doesn't use these values 2b84394d2a

CHANGELOG b89298a466

DiffractionExperiment: Use std::chrono::duration to convert to float f9433eee38

Detector read-out time can be in nanoseconds (this is work in progress, need to adapt count time and frame time to serious units) 9fe5fc7e4c

DetectorSettings: Remove unnecessary overload for FrameTime e3447b13e6

Use constexpr based definitions instead of macros beb4f316e5

Define time using std::chrono::nanosecond whenever possible, than if needed for I/O convert to micro/milli-seconds c2d15e22ab

JFJochReceiver: Make it a bit more verbose f493d77a2a

CHANGELOG 3a6abe3f2a

Frontend: Fix units 38358e51b0

leonarski_f added 2 commits 2026-04-28 16:04:43 +02:00

JFJochStateMachine: Notify everyone on CalibrateDetector finished a7e98e91ab

JFJochStateMachine: Notify everyone on CalibrateDetector finished + small modifications to handling state 162eab63b7

leonarski_f added 1 commit 2026-04-28 16:32:15 +02:00

JFJochReceiverFPGA: compression and total processing time are lost due to order of operations 994c0f96fa

leonarski_f added 1 commit 2026-04-28 16:45:26 +02:00

JFJochStateMachine: Fix missing pedestal thread a6326b0377

leonarski_f added 11 commits 2026-04-28 20:06:09 +02:00

IndexAndRefine: Don't allow zero size/very small volume d84cb9079a

MXAnalysisAfterFPGA: Include spot finding analysis time in the total number 5f38e35aca

IndexAndRefine: Indexing time is now recorded in the main loop ae4c5a7758

jfjoch_writer: Put NaN into indexed lattice as placeholder 0e9cb1bb7a

MXAnalysisAfterFPGA: Also calculate time for CPU workflow 2373902eb4

JFJochStateMachine: Fix state transition in Pedestal() e1b22c792a

jfjoch_writer: Enable fill value in AutoIncrVector to support NaN placeholder 81c9695c6b

jfjoch_writer: Add index analysis time + refactor saving profiling information 97a5899b73

jfjoch_writer: Save integrated reflection count 83fff25724

CHANGELOG 99c3070bcf

CHANGELOG c14c187901

leonarski_f added 1 commit 2026-04-28 20:08:12 +02:00

CHANGELOG 8d34477c00

leonarski_f added 1 commit 2026-04-28 20:40:21 +02:00

CMake: Fix f32ceefc55

leonarski_f added 2 commits 2026-04-28 22:25:01 +02:00

AnalyzeIndexing: Make it safer for weird data 2665abe047

JFJochReceiverProcessingTest: Add test of receiver running without valid spots 60bcaee351

Some checks are pending

Hide all checks

Build Packages / build:rpm (ubuntu2404_nocuda) (push) Successful in 12m58s

Details

Build Packages / build:rpm (ubuntu2204_nocuda) (push) Successful in 13m22s

Details

Build Packages / build:rpm (rocky8_nocuda) (push) Successful in 13m36s

Details

Build Packages / build:rpm (rocky9_nocuda) (push) Successful in 15m2s

Details

Build Packages / build:rpm (rocky8_sls9) (push) Successful in 15m18s

Details

Build Packages / build:rpm (rocky9_sls9) (push) Successful in 16m0s

Details

Build Packages / build:rpm (rocky8) (push) Successful in 10m39s

Details

Build Packages / build:rpm (rocky9) (push) Successful in 12m24s

Details

Build Packages / Generate python client (push) Successful in 34s

Details

Build Packages / build:rpm (ubuntu2404) (push) Successful in 12m51s

Details

Build Packages / Unit tests (push) Has started running

Details

Build Packages / Build documentation (push) Successful in 48s

Details

Build Packages / Create release (push) Has been skipped

Details

Build Packages / XDS test (neggia plugin) (push) Successful in 10m55s

Details

Build Packages / XDS test (JFJoch plugin) (push) Successful in 11m20s

Details

Build Packages / XDS test (durin plugin) (push) Successful in 12m5s

Details

Build Packages / build:rpm (ubuntu2204) (push) Successful in 14m54s

Details

Build Packages / DIALS test (push) Successful in 15m0s

Details

Build Packages / build:rpm (rocky8_nocuda) (pull_request) Successful in 11m13s

Details

Build Packages / build:rpm (rocky9_nocuda) (pull_request) Successful in 12m33s

Details

Build Packages / build:rpm (ubuntu2404_nocuda) (pull_request) Successful in 13m28s

Details

Build Packages / build:rpm (ubuntu2204_nocuda) (pull_request) Successful in 13m38s

Details

Build Packages / build:rpm (rocky8) (pull_request) Successful in 13m0s

Details

Build Packages / build:rpm (rocky8_sls9) (pull_request) Successful in 15m44s

Details

Build Packages / build:rpm (rocky9_sls9) (pull_request) Successful in 15m59s

Details

Build Packages / build:rpm (rocky9) (pull_request) Successful in 11m1s

Details

Build Packages / build:rpm (ubuntu2204) (pull_request) Successful in 9m31s

Details

Build Packages / Generate python client (pull_request) Successful in 36s

Details

Build Packages / Unit tests (pull_request) Has started running

Details

Build Packages / Build documentation (pull_request) Successful in 59s

Details

Build Packages / Create release (pull_request) Has been skipped

Details

Build Packages / XDS test (neggia plugin) (pull_request) Successful in 8m6s

Details

Build Packages / XDS test (durin plugin) (pull_request) Successful in 9m52s

Details

Build Packages / XDS test (JFJoch plugin) (pull_request) Successful in 9m40s

Details

Build Packages / build:rpm (ubuntu2404) (pull_request) Successful in 12m9s

Details

Build Packages / DIALS test (pull_request) Successful in 13m56s

Details

This pull request can be merged automatically.

You are not authorized to merge this pull request.

View command line instructions

Checkout

From your project repository, check out a new branch and test the changes.

git fetch -u origin 2604-start-speed:2604-start-speed

git checkout 2604-start-speed

Sign in to join this conversation.

Reviewers

No Reviewers

Labels

No items

No Label

Milestone

No items

No Milestone

Projects

Clear projects

No project

Assignees

Clear assignees

appleb_m (appleb_m) buntschu_d (buntschu_d) duan_j (duan_j) glettig_w (glettig_w) gotthard_g (gotthard_g) leonarski_f (leonarski_f) takaba_k (takaba_k)

No Assignees

1 Participants

Notifications

Subscribe

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: mx/Jungfraujoch#49