leonarski_f and Claude Opus 5.5
f5a990dc8d
XFELReader: a deflated frame is inflated and converted a piece at a time, while it is in the cache
...
The reader inflated a whole deflated chunk (4 MB for a 1 Mpx int32 frame, 2 MB for its uint16 per-frame
mask) into a buffer and then converted it in a second pass; with 16 reading threads those buffers never
stay in the cache, so the conversion ran at memory speed. A deflated, unshuffled chunk is now inflated in
128 kB pieces (InflateInPieces, the zlib stream API - the stream's checksum is checked as before), and
each piece is converted into the image, or marked in the mask, before the next is inflated. Shuffled,
bitshuffle/LZ4, HDF5-read and single-panel (placed) frames are converted as a whole, as before.
Bit-identical: the FNV pixel hashes of 2000 frames on the five reader configurations of the previous
commit are unchanged, and a new test reads 300 x 300 frames (several pieces, a final partial one) with a
per-frame mask and a gain pixel by pixel. Reader alone, 16 threads, 3000 frames: 2.43 -> 1.73 s (the
previous commit's state -> this). rugnux on the 14,445-frame CXI run, against rc178 (A/B, two runs each):
geometry refinement sample 11.6 -> 5.1 s, image pass 27.7 -> 12.9 s, whole run 67.7 -> 46.2 s; the
geometry refinement, module placement and tilt log lines are identical.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com >
Claude-Session: https://claude.ai/code/session_015CeEGgpKdfkCTJb3YNMJcu
2026-10-23 11:20:16 +02:00
..
2026-08-13 17:03:10 +02:00
2026-09-29 15:57:32 +02:00
2026-07-19 09:39:28 +02:00
2026-10-16 15:34:43 +02:00
2026-10-16 15:34:43 +02:00
2026-10-16 15:34:43 +02:00
2025-05-05 19:32:22 +02:00
2026-09-29 15:57:32 +02:00
2026-10-16 15:34:43 +02:00
2026-09-02 21:17:31 +02:00
2026-10-19 18:49:24 +02:00
2026-10-19 16:07:31 +02:00
2026-04-29 09:50:50 +02:00
2026-09-29 15:57:32 +02:00
2026-10-22 10:53:31 +02:00
2026-10-23 04:01:11 +02:00
2026-10-21 10:40:20 +02:00
2026-10-16 15:34:43 +02:00
2026-10-16 15:34:43 +02:00
2026-10-21 10:26:30 +02:00
2026-09-29 15:57:32 +02:00
2026-10-06 14:03:18 +02:00
2026-10-23 01:26:44 +02:00
2026-10-23 01:26:44 +02:00
2026-10-22 13:00:17 +02:00
2026-10-06 14:03:18 +02:00
2026-10-22 20:18:51 +02:00
2026-08-13 17:03:10 +02:00
2026-08-13 17:03:10 +02:00
2026-10-19 07:03:28 +02:00
2026-09-02 21:17:31 +02:00
2026-10-21 10:28:23 +02:00
2026-05-28 18:48:35 +02:00
2026-10-20 18:39:41 +02:00
2025-05-05 19:32:22 +02:00
2026-10-22 20:18:50 +02:00
2025-06-10 18:14:04 +02:00
2026-10-06 14:03:18 +02:00
2026-09-02 21:17:31 +02:00
2026-09-29 15:57:32 +02:00
2026-10-21 12:42:08 +02:00
2026-10-16 15:34:43 +02:00
2026-10-20 01:51:28 +02:00
2026-10-16 15:34:43 +02:00
2025-11-19 09:40:50 +01:00
2026-10-20 23:30:48 +02:00
2026-04-29 09:50:50 +02:00
2026-08-25 08:21:39 +02:00
2026-09-02 21:17:31 +02:00
2026-10-19 07:03:28 +02:00
2026-09-02 21:17:31 +02:00
2026-09-02 21:17:31 +02:00
2026-08-13 17:03:10 +02:00
2026-10-16 15:34:43 +02:00
2026-05-08 11:39:51 +02:00
2024-11-22 21:25:20 +01:00
2025-10-20 20:43:44 +02:00
2025-04-14 11:52:06 +02:00
2025-11-09 12:42:27 +01:00
2025-09-08 20:28:59 +02:00
2025-09-08 20:28:59 +02:00
2025-03-24 12:16:33 +01:00
2026-09-22 06:48:37 +02:00
2026-10-06 14:03:18 +02:00
2025-06-18 15:19:18 +02:00
2026-09-02 21:17:31 +02:00
2026-10-19 07:03:28 +02:00
2025-12-12 21:24:20 +01:00
2026-02-01 13:29:33 +01:00
2026-10-19 07:03:28 +02:00
2026-10-22 17:27:43 +02:00
2026-03-03 22:24:44 +01:00
2025-11-19 09:40:50 +01:00
2026-08-25 08:21:39 +02:00
2026-09-29 15:57:32 +02:00
2026-10-19 07:03:28 +02:00
2026-10-16 15:34:43 +02:00
2025-05-05 19:32:22 +02:00
2024-11-22 21:25:20 +01:00
2026-08-25 08:21:39 +02:00
2026-10-19 07:03:28 +02:00
2026-10-21 12:44:40 +02:00
2026-06-15 20:24:15 +02:00
2026-09-29 15:57:32 +02:00
2026-06-23 20:29:49 +02:00
2026-07-19 09:39:28 +02:00
2026-10-19 22:11:51 +02:00
2024-11-22 21:25:20 +01:00
2026-09-29 15:57:32 +02:00
2026-06-23 20:29:49 +02:00
2026-09-29 15:57:32 +02:00
2026-09-09 07:25:13 +02:00
2026-10-16 15:34:43 +02:00
2026-09-29 15:57:32 +02:00
2026-09-29 15:57:32 +02:00
2024-11-22 21:25:20 +01:00
2026-10-21 19:55:08 +02:00
2026-10-19 07:03:28 +02:00
2026-10-19 07:03:28 +02:00
2026-10-16 15:34:43 +02:00
2026-10-19 07:03:28 +02:00
2026-10-19 07:03:28 +02:00
2026-10-22 20:18:51 +02:00
2026-10-22 19:26:33 +02:00
2024-12-04 20:58:51 +01:00
2026-10-19 07:03:28 +02:00
2026-10-20 07:51:07 +02:00
2025-03-02 13:15:28 +01:00
2026-06-08 08:30:35 +02:00
2026-10-20 23:30:17 +02:00
2026-08-25 08:21:39 +02:00
2026-10-16 15:34:43 +02:00
2026-10-21 11:27:31 +02:00
2026-10-16 15:34:43 +02:00
2025-11-09 12:42:27 +01:00
2026-08-13 17:03:10 +02:00
2026-09-29 15:57:32 +02:00
2026-10-16 15:34:43 +02:00
2026-08-27 22:16:54 +02:00
2024-11-22 21:25:20 +01:00
2025-11-09 12:42:27 +01:00
2026-10-16 15:34:43 +02:00
2025-10-01 22:54:40 +02:00
2026-10-20 20:56:07 +02:00
2026-09-02 21:17:31 +02:00
2026-10-20 02:18:19 +02:00
2026-09-22 06:48:37 +02:00
2026-09-02 21:17:31 +02:00
2026-06-23 20:29:49 +02:00
2026-10-21 10:26:30 +02:00
2026-10-21 10:26:30 +02:00
2026-10-16 15:34:43 +02:00
2026-10-16 15:34:43 +02:00
2026-10-20 02:18:19 +02:00
2026-10-19 07:03:28 +02:00
2026-10-20 01:00:54 +02:00
2026-10-22 20:18:51 +02:00
2026-10-22 20:18:51 +02:00
2026-10-21 10:40:20 +02:00
2026-10-20 16:37:25 +02:00
2026-10-16 15:34:43 +02:00
2026-10-19 07:03:28 +02:00
2026-10-23 06:41:10 +02:00
2026-09-29 15:57:32 +02:00
2026-09-09 07:25:13 +02:00
2026-10-16 15:34:43 +02:00
2026-08-13 17:03:10 +02:00
2026-10-06 14:03:18 +02:00
2026-10-21 10:40:20 +02:00
2026-09-29 15:57:32 +02:00
2026-03-02 15:57:12 +01:00
2026-10-16 15:34:43 +02:00
2026-10-16 15:34:43 +02:00
2026-09-02 21:17:31 +02:00
2026-09-29 15:57:32 +02:00
2026-08-13 17:03:10 +02:00
2026-10-19 19:35:54 +02:00
2026-06-23 20:29:49 +02:00
2026-04-16 11:59:59 +02:00
2026-10-21 12:44:40 +02:00
2025-11-02 13:45:57 +01:00
2025-12-12 21:24:20 +01:00
2026-09-22 06:48:37 +02:00
2026-10-16 15:34:43 +02:00
2026-05-28 18:48:35 +02:00
2026-10-16 15:34:43 +02:00
2026-10-19 07:03:28 +02:00
2026-10-16 15:34:43 +02:00
2026-10-23 11:20:16 +02:00
2026-09-02 21:17:31 +02:00
2026-10-06 14:03:18 +02:00
2026-10-06 14:03:18 +02:00
2026-10-19 19:35:54 +02:00
2026-03-26 20:50:33 +01:00
2024-11-22 21:25:20 +01:00
2026-09-29 15:57:32 +02:00