edb9b94fa5
Merge with Master+RamBuffer
2021-03-03 17:55:18 +01:00
babic_a
cc85b6e71d
Merge branch 'ram_buffer'
...
# Conflicts:
# CMakeLists.txt
# jf-assembler/test/main.cpp
# jf-live-writer/CMakeLists.txt
# jf-live-writer/include/live_writer_config.hpp
# jf-live-writer/src/main.cpp
# jf-live-writer/test/CMakeLists.txt
# jf-live-writer/test/main.cpp
# scripts/JF01-buffer-worker.sh
# scripts/JF02-buffer-worker.sh
# scripts/JF06-buffer-worker.sh
# scripts/JF06_4M-buffer-worker.sh
# sf-stream/include/stream_config.hpp
# sf-stream/src/ZmqLiveSender.cpp
2021-02-26 12:32:36 +01:00
hax_l
7db438671c
more debug msgs. adjusts on streamer and assembler to work with frame_index instead of pulse_id.
2021-02-19 18:16:34 +01:00
babic_a
402a2b978d
Rework sf-stream to attach to assembler
2021-01-19 16:58:07 +01:00
babic_a
d3d51d2957
Adjust stats to new stream workings
2021-01-19 16:57:41 +01:00
babic_a
ccca4225d4
Change bind and connect socket helper functions to take string
2021-01-19 13:02:03 +01:00
babic_a
0a3db103c5
Change stats names to use _ instead of -
...
Using - is causing problems in Influx -> we move to use
the executable name instead of the project name as the main
identifier.
2021-01-15 11:18:07 +01:00
babic_a
3ed5bcb330
Statistics for sf-stream
2021-01-15 11:07:31 +01:00
babic_a
f58ec4270c
Implementation fo StreamStats for outputting Grafana metrics
2021-01-15 11:06:47 +01:00
babic_a
2937326dbf
Return n_lost_pulses in sync from receiver
...
In order to have proper statistics we need to return the
number of lost pulses from the receiver. We cannot just count
the gap in pulse_id as the beam might be operated at
different frequencies.
2021-01-15 10:59:43 +01:00
babic_a
dd52eea55b
Reverse sync difference criteria in streamer
2021-01-13 16:20:51 +01:00
babic_a
e9bb30eac8
Fix streamer sync attempts for loop
2021-01-13 16:18:47 +01:00
babic_a
cb9ddb3693
Fix the count of input parameters in streamer
2021-01-13 16:14:56 +01:00
babic_a
6ee8f7d89d
Remove pulse_id stream from streamer
...
This is not needed anymore since we have a different architecture.
2021-01-13 15:54:28 +01:00
babic_a
326c108bda
usefull messages in case of frame number disagreement
2020-10-27 19:51:03 +01:00
babic_a
b8b152e5ed
Rename Detector Name to lower case
2020-09-30 13:49:57 +02:00
babic_a
79f6eaebc9
Shorten help string in console
2020-09-30 13:38:35 +02:00
babic_a
f42298e264
Improve attribute reading from sf_stream
2020-09-30 11:38:39 +02:00
babic_a
a7efe6492e
Use core-buffer load config
2020-09-30 10:48:13 +02:00
babic_a
70c6e754f3
Cleanup of version files
2020-09-29 09:56:01 +02:00
babic_a
1790544a35
Remove live stream of pulse_ids
2020-09-29 09:27:26 +02:00
babic_a
fbbbb47f96
Rename zmq pulse receiver
2020-09-24 13:18:34 +02:00
babic_a
7e1d1dae2b
Make use of common connect function in Pulse Receiver
2020-09-24 13:04:28 +02:00
babic_a
53a2690567
Improve statistics and logging for sf_stream
2020-09-21 10:16:27 +02:00
babic_a
5dbaf3319f
Add sync attempt output counter
2020-09-21 10:16:05 +02:00
babic_a
3e097a5cd8
Adjust stream sender to use reference
2020-09-21 09:56:06 +02:00
babic_a
5a22344e84
Externalize the socket creation
2020-09-21 09:45:13 +02:00
babic_a
f84f4fbcdb
Make function const
2020-09-18 15:29:34 +02:00
babic_a
639fe3790a
Refactor pulse_id receiver
2020-09-18 15:25:31 +02:00
babic_a
1ddee279db
Throw away useless metrics
2020-09-04 17:15:13 +02:00
babic_a
ac58965758
Adapt Live sender to RamBuffer
2020-09-04 17:00:01 +02:00
babic_a
c7185f249b
Cleanup sf_streamer
2020-07-17 11:20:50 +02:00
babic_a
465369a322
Add pulse_id stream to streamer
...
The pulse_id stream can be used to synchronize components.
For example, the writer can listen for the current pulse_id
and write with 1 second delay to a file. This will help us
eliminate the need to wait for the run to complete to start
the data write request.
2020-07-16 11:27:09 +02:00
babic_a
773320799a
Switch analysis socket to NOBLOCK
...
Since we cannot control the rate of the producer (its
whatever the detector is currently doing) we cannot afford
to block if no clients are present.
2020-07-15 10:34:54 +02:00
babic_a
6129b711ba
Change processing socket from PUB to PUSH
...
Since processing of live data can be done at 100Hz it would
be more difficult to stream the full rate with a PUB/SUB mode.
To support distributed live analysis we move to PUSH/PULL
model, since we can support only one live processing at a time
anyway (network constraints when working with large detectors).
2020-07-15 10:29:21 +02:00
babic_a
ed23b58332
Iteration over the specified modules instead of all
...
Left over from the development process where we used always
the 16M.
2020-06-18 13:48:49 +02:00
babic_a
e0c3d673cc
Reduce number of IO threads
2020-06-09 14:29:18 +02:00
babic_a
9ff5c08b9b
Convert sf_stream to single thread
2020-06-09 14:24:36 +02:00
babic_a
5638071b95
Fix whitespace
2020-06-09 14:20:12 +02:00
babic_a
4c6f75eb75
Move hpp to correct folder
2020-06-09 14:18:43 +02:00
babic_a
337c3d5462
Modulo on atomic is not really supported
2020-06-09 14:14:12 +02:00
babic_a
c541da141b
Fix changes once the class was extracted
2020-06-09 14:10:19 +02:00
babic_a
cdef401862
Extract sender from main
2020-06-09 14:03:42 +02:00
babic_a
3a50aca2f1
Fix typo
2020-06-09 14:03:31 +02:00
babic_a
69d13fc3aa
Extract stream sending logic to class
2020-06-09 14:03:12 +02:00
babic_a
b189d5ab34
Add lost pulses statistics
2020-06-09 13:16:26 +02:00
babic_a
71de5c5db0
Return number of lost images in resync event
2020-06-09 11:20:44 +02:00
babic_a
5e1377e00a
Adapt main to the new recv class
2020-06-09 11:02:18 +02:00
babic_a
c6960b5e59
Extract Receiver from module for Zmq recv and assembly
2020-06-09 10:58:47 +02:00
babic_a
cca0572d3e
Adapt live RecvModule
2020-06-09 10:58:11 +02:00
lhdamiani
babic_a
hax_l