Files
Jungfraujoch/image_analysis/image_preprocessing/ImagePreprocessorCPU.h
T
leonarski_fandClaude Opus 5.5 9c5141c7c0 CPU pixel pipeline: decode, preprocess and ring pass per bitshuffle block; flag rings in the local sweep
The CPU-only image loop is DRAM-bound on 16M frames: decode, preprocess, the adaptive finder's plain
ring pass and FlagRings each streamed the whole frame through memory.

- JFJochDecompressHperfBlocks hands each decoded bitshuffle block to a callback; with no output
  buffer the block is unshuffled into a reused block-sized scratch (JFJochDecompressBlocks).
- MXAnalysisWithoutFPGA::PreprocessCPU preprocesses each block into the int32 buffer
  (ImagePreprocessorCPU::AnalyzeBlock) and, when the fused CPU finder runs, puts it through the plain
  ring pass + fused azint (AdaptiveSpotFinderCPU::AccumulateRingsBlock) while it is in cache. Detect()
  then starts from those sums. The per-worker decompression buffer is no longer allocated for
  bitshuffled data.
- FlagRings becomes FlagRow, called by DetectAt's first pass for row y+NBX just before that row enters
  the vertical sums; first_pass_needed is marked from each row's candidates at the same point.

Exact: blocks arrive in pixel order, so the float azint sums see the same pixels in the same order;
the per-pixel expressions are unchanged; everything else is integer. p.hkl, p.mtz, p_P1.mtz and
p_unmerged.mtz byte-identical to rc173 on myob, cytc, lyso, sparse (CPU-only build), GPU myob
identical (the GPU path does not take this route).

CPU-only, 32 workers, under the gpulock on a shared (loaded) machine, base -> fused, two rounds
(second in reversed order):
  myob  155.9 -> 97.7 s, 139.9 -> 88.1 s   (loop 46.1 -> 26.8 s/pass; user 3690 -> 2221 s)
  cytc  220.8 -> 156.6 s, 216.6 -> 155.1 s (user 5160 -> 4128 s)
  lyso  134.5 -> 123.3 s, 69.5 -> 64.8 s
  peak RSS myob 15.2 -> 10.8 GB, cytc 12.6 -> 10.4 GB, lyso 7.0 -> 6.7 GB

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01D1G8gJVAy6gp1K5Dz3NE5C
2026-09-28 02:00:50 +02:00

22 lines
1.1 KiB
C++

// SPDX-FileCopyrightText: 2026 Filip Leonarski, Paul Scherrer Institute <filip.leonarski@psi.ch>
// SPDX-License-Identifier: GPL-3.0-only
#pragma once
#include "ImagePreprocessor.h"
class ImagePreprocessorCPU : public ImagePreprocessor {
std::vector<bool> mask_1bit;
template <class T> void AnalyzeBlock(ImagePreprocessorBuffer &processed_image, size_t first, const uint8_t *input,
size_t n, T err_value, T sat_value, ImageStatistics &stats);
public:
ImagePreprocessorCPU(const DiffractionExperiment &experiment, const PixelMask &mask);
ImageStatistics Analyze(ImagePreprocessorBuffer &processed_image, const uint8_t *decompressed_image, CompressedImageMode image_mode) override;
// Analyze for the n pixels from pixel `first` on, whose values `input` holds, adding to stats. The
// blocks of an image can come in any order and together give Analyze()'s result.
void AnalyzeBlock(ImagePreprocessorBuffer &processed_image, size_t first, const uint8_t *input, size_t n,
CompressedImageMode image_mode, ImageStatistics &stats);
};