v1.0.0-rc.129 #36

Merged
leonarski_f merged 42 commits from 2603-rc.129 into main 2026-03-05 22:13:12 +01:00

42 Commits

Author SHA1 Message Date
690042d9f0 Frontend: Handle undefined written image count
All checks were successful
Build Packages / build:rpm (rocky8_nocuda) (push) Successful in 13m20s
Build Packages / build:rpm (ubuntu2204_nocuda) (push) Successful in 15m17s
Build Packages / build:rpm (rocky9_nocuda) (push) Successful in 15m52s
Build Packages / build:rpm (ubuntu2404_nocuda) (push) Successful in 16m27s
Build Packages / Generate python client (push) Successful in 59s
Build Packages / Build documentation (push) Successful in 1m5s
Build Packages / Create release (push) Has been skipped
Build Packages / build:rpm (rocky8_sls9) (push) Successful in 17m35s
Build Packages / build:rpm (rocky8) (push) Successful in 19m5s
Build Packages / build:rpm (rocky9) (push) Successful in 19m46s
Build Packages / build:rpm (rocky9_sls9) (push) Successful in 20m6s
Build Packages / build:rpm (ubuntu2204) (push) Successful in 10m52s
Build Packages / build:rpm (ubuntu2404) (push) Successful in 11m34s
Build Packages / build:rpm (rocky8_nocuda) (pull_request) Successful in 12m52s
Build Packages / build:rpm (rocky9_nocuda) (pull_request) Successful in 13m45s
Build Packages / build:rpm (ubuntu2404_nocuda) (pull_request) Successful in 12m28s
Build Packages / build:rpm (ubuntu2204_nocuda) (pull_request) Successful in 13m13s
Build Packages / Generate python client (pull_request) Successful in 51s
Build Packages / build:rpm (rocky8_sls9) (pull_request) Successful in 13m32s
Build Packages / Build documentation (pull_request) Successful in 1m38s
Build Packages / Create release (pull_request) Has been skipped
Build Packages / build:rpm (rocky9_sls9) (pull_request) Successful in 12m36s
Build Packages / build:rpm (rocky8) (pull_request) Successful in 10m8s
Build Packages / build:rpm (rocky9) (pull_request) Successful in 11m39s
Build Packages / build:rpm (ubuntu2404) (pull_request) Successful in 10m19s
Build Packages / build:rpm (ubuntu2204) (pull_request) Successful in 11m27s
Build Packages / Unit tests (push) Successful in 1h6m52s
Build Packages / Unit tests (pull_request) Successful in 58m24s
2026-03-05 20:47:19 +01:00
61bbe652b9 broker_local.json: use HDF5 2026-03-05 20:45:29 +01:00
c1cef1e907 ZMQStream2Pusher: Clear handling of images written if no notification socket 2026-03-05 20:45:03 +01:00
574e83315f Improve handling of TCP socket 2026-03-05 20:41:09 +01:00
a53635b1ac TCP: Send FIFO max size (though not exposed at the moment) 2026-03-05 20:26:46 +01:00
1758417702 jfjoch_broker: Export writer FIFO utilization for TCP socket 2026-03-05 19:59:23 +01:00
512023f5f6 TCPImagePuller: add fifo occupancy in ACK message 2026-03-05 19:48:44 +01:00
6410dcd604 CHANGELOG 2026-03-05 19:29:54 +01:00
d8839183f4 Docs: update 2026-03-05 19:06:18 +01:00
427d9c91cf BraggPrediction: Add angle from Ewald sphere according to nXDS definition 2026-03-05 19:00:22 +01:00
ad1e724bcf jfjoch_writer: Repub ZeroMQ from TCP image stream
All checks were successful
Build Packages / build:rpm (rocky8_nocuda) (push) Successful in 12m36s
Build Packages / build:rpm (ubuntu2404_nocuda) (push) Successful in 18m8s
Build Packages / build:rpm (ubuntu2204_nocuda) (push) Successful in 18m22s
Build Packages / Generate python client (push) Successful in 34s
Build Packages / build:rpm (rocky9) (push) Successful in 19m16s
Build Packages / build:rpm (rocky9_nocuda) (push) Successful in 19m28s
Build Packages / Create release (push) Has been skipped
Build Packages / build:rpm (rocky8_sls9) (push) Successful in 19m37s
Build Packages / build:rpm (rocky8) (push) Successful in 19m56s
Build Packages / Build documentation (push) Successful in 1m10s
Build Packages / build:rpm (rocky9_sls9) (push) Successful in 20m36s
Build Packages / build:rpm (ubuntu2204) (push) Successful in 11m11s
Build Packages / build:rpm (ubuntu2404) (push) Successful in 8m36s
Build Packages / Unit tests (push) Successful in 53m29s
2026-03-05 17:22:47 +01:00
8bfe145afa https://libzmq.readthedocs.io/en/latest/zmq_msg_send.html 2026-03-05 17:11:14 +01:00
5f608af40e TCPStreamPusher: Enforce run number in ACK match input 2026-03-05 17:00:18 +01:00
846fd389a1 jfjoch_tests: add test for data collection without processing data
Some checks failed
Build Packages / build:rpm (rocky8_nocuda) (push) Successful in 11m45s
Build Packages / build:rpm (ubuntu2204_nocuda) (push) Successful in 14m30s
Build Packages / build:rpm (rocky9_nocuda) (push) Successful in 14m43s
Build Packages / build:rpm (ubuntu2404_nocuda) (push) Successful in 14m47s
Build Packages / Generate python client (push) Successful in 39s
Build Packages / Build documentation (push) Successful in 1m8s
Build Packages / Create release (push) Has been skipped
Build Packages / build:rpm (rocky8) (push) Successful in 19m3s
Build Packages / build:rpm (rocky8_sls9) (push) Successful in 19m44s
Build Packages / build:rpm (rocky9) (push) Successful in 20m9s
Build Packages / build:rpm (rocky9_sls9) (push) Successful in 20m21s
Build Packages / build:rpm (ubuntu2204) (push) Successful in 11m26s
Build Packages / build:rpm (ubuntu2404) (push) Successful in 9m44s
Build Packages / Unit tests (push) Has been cancelled
2026-03-05 16:13:19 +01:00
92dbc35098 OpenAPI: Export images written and images with write error 2026-03-05 16:12:31 +01:00
7147a31167 jfjoch_test: Fix TCPImageCommTest to handle situation when pullers have "reverse" assignment of socket numbers 2026-03-05 16:03:48 +01:00
47433f95af Documentation: Add image analysis
Some checks failed
Build Packages / build:rpm (rocky8_nocuda) (push) Successful in 11m37s
Build Packages / build:rpm (ubuntu2404_nocuda) (push) Successful in 14m39s
Build Packages / build:rpm (rocky9_nocuda) (push) Successful in 14m57s
Build Packages / Generate python client (push) Successful in 55s
Build Packages / build:rpm (ubuntu2204_nocuda) (push) Successful in 15m55s
Build Packages / Build documentation (push) Successful in 1m5s
Build Packages / Create release (push) Has been skipped
Build Packages / build:rpm (rocky8) (push) Successful in 19m31s
Build Packages / build:rpm (rocky8_sls9) (push) Successful in 19m36s
Build Packages / build:rpm (rocky9) (push) Successful in 20m18s
Build Packages / build:rpm (rocky9_sls9) (push) Successful in 20m35s
Build Packages / build:rpm (ubuntu2204) (push) Successful in 11m48s
Build Packages / build:rpm (ubuntu2404) (push) Successful in 9m38s
Build Packages / Unit tests (push) Failing after 55m28s
2026-03-05 13:55:37 +01:00
e8b25b15b2 jfjoch_writer: Add auto-fork option 2026-03-05 13:46:39 +01:00
a5f3cf62d2 Fixes from last commit
Some checks failed
Build Packages / build:rpm (rocky9) (push) Failing after 23m43s
Build Packages / build:rpm (rocky8) (push) Failing after 23m45s
Build Packages / build:rpm (rocky9_sls9) (push) Failing after 23m47s
Build Packages / build:rpm (rocky8_sls9) (push) Failing after 23m49s
Build Packages / build:rpm (ubuntu2404_nocuda) (push) Failing after 23m51s
Build Packages / build:rpm (ubuntu2204_nocuda) (push) Failing after 23m53s
Build Packages / build:rpm (rocky9_nocuda) (push) Failing after 23m55s
Build Packages / build:rpm (rocky8_nocuda) (push) Failing after 23m57s
Build Packages / Create release (push) Has been skipped
Build Packages / Generate python client (push) Successful in 32s
Build Packages / Build documentation (push) Successful in 51s
Build Packages / build:rpm (ubuntu2404) (push) Successful in 9m23s
Build Packages / build:rpm (ubuntu2204) (push) Successful in 10m1s
Build Packages / Unit tests (push) Has been cancelled
2026-03-05 12:38:16 +01:00
343e9a1172 jfjoch_broker: Allow to query image pusher status
Some checks failed
Build Packages / build:rpm (ubuntu2204) (push) Has been cancelled
Build Packages / build:rpm (ubuntu2404) (push) Has been cancelled
Build Packages / Generate python client (push) Has been cancelled
Build Packages / Build documentation (push) Has been cancelled
Build Packages / Unit tests (push) Has been cancelled
Build Packages / Create release (push) Has been cancelled
Build Packages / build:rpm (rocky9_nocuda) (push) Has started running
Build Packages / build:rpm (rocky8_nocuda) (push) Has been cancelled
Build Packages / build:rpm (ubuntu2404_nocuda) (push) Has been cancelled
Build Packages / build:rpm (rocky9_sls9) (push) Has been cancelled
Build Packages / build:rpm (rocky8_sls9) (push) Has been cancelled
Build Packages / build:rpm (rocky8) (push) Has been cancelled
Build Packages / build:rpm (rocky9) (push) Has been cancelled
Build Packages / build:rpm (ubuntu2204_nocuda) (push) Has been cancelled
2026-03-05 12:28:37 +01:00
4ede10aa6a jfjoch_broker: Allow to query connected writers 2026-03-05 12:05:46 +01:00
ca0409bd5f TCPImagePusher: Further improvement
All checks were successful
Build Packages / build:rpm (rocky8_nocuda) (push) Successful in 11m9s
Build Packages / build:rpm (ubuntu2204_nocuda) (push) Successful in 14m35s
Build Packages / build:rpm (ubuntu2404_nocuda) (push) Successful in 15m33s
Build Packages / Generate python client (push) Successful in 40s
Build Packages / Build documentation (push) Successful in 57s
Build Packages / build:rpm (rocky9_nocuda) (push) Successful in 17m53s
Build Packages / Create release (push) Has been skipped
Build Packages / build:rpm (rocky9) (push) Successful in 18m28s
Build Packages / build:rpm (rocky8) (push) Successful in 19m26s
Build Packages / build:rpm (rocky8_sls9) (push) Successful in 19m43s
Build Packages / build:rpm (rocky9_sls9) (push) Successful in 20m31s
Build Packages / build:rpm (ubuntu2204) (push) Successful in 11m24s
Build Packages / build:rpm (ubuntu2404) (push) Successful in 9m28s
Build Packages / Unit tests (push) Successful in 57m13s
2026-03-05 10:52:10 +01:00
0ef220c0b2 TCPStreamPusher: Persistent operation
Some checks failed
Build Packages / build:rpm (ubuntu2404_nocuda) (push) Successful in 12m10s
Build Packages / build:rpm (rocky8_nocuda) (push) Successful in 12m23s
Build Packages / build:rpm (ubuntu2204_nocuda) (push) Successful in 12m55s
Build Packages / Generate python client (push) Successful in 20s
Build Packages / build:rpm (rocky8) (push) Successful in 13m12s
Build Packages / build:rpm (rocky9_nocuda) (push) Successful in 13m26s
Build Packages / Create release (push) Has been skipped
Build Packages / build:rpm (rocky8_sls9) (push) Successful in 13m29s
Build Packages / Build documentation (push) Successful in 45s
Build Packages / build:rpm (rocky9) (push) Successful in 15m24s
Build Packages / build:rpm (rocky9_sls9) (push) Successful in 15m39s
Build Packages / build:rpm (ubuntu2404) (push) Successful in 7m18s
Build Packages / build:rpm (ubuntu2204) (push) Successful in 8m10s
Build Packages / Unit tests (push) Failing after 56m16s
2026-03-05 08:38:26 +01:00
91591a3cc3 TCPStreamPusher: Implement KEEPALIVE + writers stay connected 2026-03-05 08:30:16 +01:00
cc33d5ff9c FileWriter: Handle hdf5_mutex better 2026-03-05 08:26:08 +01:00
2be7780bc4 jfjoch_writer: Reserve all metadata vectors when opening file
Some checks failed
Build Packages / build:rpm (ubuntu2404_nocuda) (push) Successful in 12m30s
Build Packages / build:rpm (ubuntu2204_nocuda) (push) Successful in 13m30s
Build Packages / build:rpm (rocky8_nocuda) (push) Successful in 14m10s
Build Packages / Generate python client (push) Successful in 12s
Build Packages / build:rpm (rocky8) (push) Successful in 14m14s
Build Packages / build:rpm (rocky8_sls9) (push) Successful in 14m23s
Build Packages / Create release (push) Has been skipped
Build Packages / build:rpm (rocky9_nocuda) (push) Successful in 14m56s
Build Packages / Build documentation (push) Successful in 39s
Build Packages / build:rpm (rocky9) (push) Successful in 14m58s
Build Packages / build:rpm (rocky9_sls9) (push) Successful in 15m12s
Build Packages / build:rpm (ubuntu2404) (push) Successful in 7m29s
Build Packages / build:rpm (ubuntu2204) (push) Successful in 8m44s
Build Packages / Unit tests (push) Failing after 3h12m6s
2026-03-04 20:15:54 +01:00
99e252bc72 jfjoch_writer: Some (likely small) performance gains 2026-03-04 20:03:24 +01:00
089316265f VERSION: 1.0.0-rc.129
All checks were successful
Build Packages / build:rpm (ubuntu2404_nocuda) (push) Successful in 12m10s
Build Packages / build:rpm (rocky8_nocuda) (push) Successful in 13m31s
Build Packages / build:rpm (ubuntu2204_nocuda) (push) Successful in 13m49s
Build Packages / Generate python client (push) Successful in 14s
Build Packages / build:rpm (rocky8) (push) Successful in 14m0s
Build Packages / build:rpm (rocky8_sls9) (push) Successful in 14m17s
Build Packages / Create release (push) Has been skipped
Build Packages / Build documentation (push) Successful in 39s
Build Packages / build:rpm (rocky9_nocuda) (push) Successful in 14m49s
Build Packages / build:rpm (rocky9_sls9) (push) Successful in 14m54s
Build Packages / build:rpm (rocky9) (push) Successful in 15m21s
Build Packages / build:rpm (ubuntu2204) (push) Successful in 8m40s
Build Packages / build:rpm (ubuntu2404) (push) Successful in 7m30s
Build Packages / Unit tests (push) Successful in 57m20s
2026-03-04 17:28:05 +01:00
446e8aa86c Documentation: Update 2026-03-04 17:27:09 +01:00
aa5b966207 OpenAPI: Add TCP socket pusher settings + add monitoring of images written with OpenAPI 2026-03-04 17:25:37 +01:00
204ae82825 TCPStreamPusher: Single class handling multiple connections 2026-03-04 17:14:01 +01:00
d2c66edd45 TCP: Allow to get written image count 2026-03-04 16:13:14 +01:00
536fc0761d TCP: Fixes - allow for live monitoring of ACK progress 2026-03-04 15:54:40 +01:00
3f8736dd34 Documentation: Fix 2026-03-04 15:33:44 +01:00
2914d77dbd TCP: Improve behavior and documentation 2026-03-04 15:30:07 +01:00
5345b41e16 JFJochHttpReader: Parse /status 2026-03-04 14:07:21 +01:00
b6db6040e8 jfjoch_broker: Output version with /status 2026-03-04 14:07:08 +01:00
e6e8ffd838 TCPStreamPusherSocket: Very minor refactor 2026-03-04 13:46:22 +01:00
94072d3626 jfjoch_test: Add TCP/IP integration test 2026-03-04 13:37:52 +01:00
a3a986830b TCP: Implemented ACK return stream, as a feedback channel (to be read properly!) 2026-03-04 12:24:05 +01:00
939bb02ce2 XtalOptimizer: Add lattice rotation-only optimizer 2026-03-04 11:26:10 +01:00
cd561dd3d9 ScaleAndMerge: rotation wedge can be refined 2026-03-04 09:00:43 +01:00