ec6050f331
remove run_name and number_frames_expected from the metadata(they are calculated on stremvis side)
2021-08-20 12:14:14 +02:00
babic_a
cc85b6e71d
Merge branch 'ram_buffer'
...
# Conflicts:
# CMakeLists.txt
# jf-assembler/test/main.cpp
# jf-live-writer/CMakeLists.txt
# jf-live-writer/include/live_writer_config.hpp
# jf-live-writer/src/main.cpp
# jf-live-writer/test/CMakeLists.txt
# jf-live-writer/test/main.cpp
# scripts/JF01-buffer-worker.sh
# scripts/JF02-buffer-worker.sh
# scripts/JF06-buffer-worker.sh
# scripts/JF06_4M-buffer-worker.sh
# sf-stream/include/stream_config.hpp
# sf-stream/src/ZmqLiveSender.cpp
2021-02-26 12:32:36 +01:00
babic_a
402a2b978d
Rework sf-stream to attach to assembler
2021-01-19 16:58:07 +01:00
babic_a
d3d51d2957
Adjust stats to new stream workings
2021-01-19 16:57:41 +01:00
babic_a
ccca4225d4
Change bind and connect socket helper functions to take string
2021-01-19 13:02:03 +01:00
babic_a
0a3db103c5
Change stats names to use _ instead of -
...
Using - is causing problems in Influx -> we move to use
the executable name instead of the project name as the main
identifier.
2021-01-15 11:18:07 +01:00
babic_a
fec900ff63
Increase the sf_stream output frequency to 10 seconds
2021-01-15 11:15:28 +01:00
babic_a
3ed5bcb330
Statistics for sf-stream
2021-01-15 11:07:31 +01:00
babic_a
f58ec4270c
Implementation fo StreamStats for outputting Grafana metrics
2021-01-15 11:06:47 +01:00
babic_a
2937326dbf
Return n_lost_pulses in sync from receiver
...
In order to have proper statistics we need to return the
number of lost pulses from the receiver. We cannot just count
the gap in pulse_id as the beam might be operated at
different frequencies.
2021-01-15 10:59:43 +01:00
babic_a
0cf973802d
Add stream stats modulo to config file
2021-01-14 15:45:41 +01:00
babic_a
dd52eea55b
Reverse sync difference criteria in streamer
2021-01-13 16:20:51 +01:00
babic_a
e9bb30eac8
Fix streamer sync attempts for loop
2021-01-13 16:18:47 +01:00
babic_a
cb9ddb3693
Fix the count of input parameters in streamer
2021-01-13 16:14:56 +01:00
babic_a
6ee8f7d89d
Remove pulse_id stream from streamer
...
This is not needed anymore since we have a different architecture.
2021-01-13 15:54:28 +01:00
babic_a
326c108bda
usefull messages in case of frame number disagreement
2020-10-27 19:51:03 +01:00
babic_a
b8b152e5ed
Rename Detector Name to lower case
2020-09-30 13:49:57 +02:00
babic_a
79f6eaebc9
Shorten help string in console
2020-09-30 13:38:35 +02:00
babic_a
f42298e264
Improve attribute reading from sf_stream
2020-09-30 11:38:39 +02:00
babic_a
5b36132952
Fix build for sf_stream
2020-09-30 11:35:16 +02:00
babic_a
a7efe6492e
Use core-buffer load config
2020-09-30 10:48:13 +02:00
babic_a
70c6e754f3
Cleanup of version files
2020-09-29 09:56:01 +02:00
babic_a
c494e7a9ab
Local changes
2020-09-29 09:39:43 +02:00
babic_a
1790544a35
Remove live stream of pulse_ids
2020-09-29 09:27:26 +02:00
babic_a
fbbbb47f96
Rename zmq pulse receiver
2020-09-24 13:18:34 +02:00
babic_a
7e1d1dae2b
Make use of common connect function in Pulse Receiver
2020-09-24 13:04:28 +02:00
babic_a
677f9c44c4
Since we are sending only pulse_ids adjust n threads
2020-09-24 13:03:39 +02:00
babic_a
55882bd0d1
Shorten metadata name in buffer format
2020-09-24 09:51:02 +02:00
babic_a
d230eeec00
Add link library
2020-09-21 10:36:49 +02:00
babic_a
53a2690567
Improve statistics and logging for sf_stream
2020-09-21 10:16:27 +02:00
babic_a
5dbaf3319f
Add sync attempt output counter
2020-09-21 10:16:05 +02:00
babic_a
3e097a5cd8
Adjust stream sender to use reference
2020-09-21 09:56:06 +02:00
babic_a
5a22344e84
Externalize the socket creation
2020-09-21 09:45:13 +02:00
babic_a
f84f4fbcdb
Make function const
2020-09-18 15:29:34 +02:00
babic_a
639fe3790a
Refactor pulse_id receiver
2020-09-18 15:25:31 +02:00
babic_a
1ddee279db
Throw away useless metrics
2020-09-04 17:15:13 +02:00
babic_a
ac58965758
Adapt Live sender to RamBuffer
2020-09-04 17:00:01 +02:00
babic_a
552caa82de
Fix table format and values
2020-07-27 17:06:13 +02:00
babic_a
e99514d2df
Fix table in README
2020-07-27 17:04:27 +02:00
babic_a
601d7df786
Update diagrams and add them to README
2020-07-27 16:58:30 +02:00
babic_a
2df8fa8fe3
Add test for sf-stream
2020-07-27 16:21:50 +02:00
babic_a
8270cca180
Add documentation about ZMQ receiving and image assembly
2020-07-23 18:01:08 +02:00
babic_a
5202a80560
Add first version of sf-stream README
2020-07-23 16:46:36 +02:00
babic_a
b55fb89ae5
Add stub README files for components
2020-07-23 13:06:13 +02:00
babic_a
c7185f249b
Cleanup sf_streamer
2020-07-17 11:20:50 +02:00
babic_a
465369a322
Add pulse_id stream to streamer
...
The pulse_id stream can be used to synchronize components.
For example, the writer can listen for the current pulse_id
and write with 1 second delay to a file. This will help us
eliminate the need to wait for the run to complete to start
the data write request.
2020-07-16 11:27:09 +02:00
babic_a
773320799a
Switch analysis socket to NOBLOCK
...
Since we cannot control the rate of the producer (its
whatever the detector is currently doing) we cannot afford
to block if no clients are present.
2020-07-15 10:34:54 +02:00
babic_a
6129b711ba
Change processing socket from PUB to PUSH
...
Since processing of live data can be done at 100Hz it would
be more difficult to stream the full rate with a PUB/SUB mode.
To support distributed live analysis we move to PUSH/PULL
model, since we can support only one live processing at a time
anyway (network constraints when working with large detectors).
2020-07-15 10:29:21 +02:00
babic_a
ed23b58332
Iteration over the specified modules instead of all
...
Left over from the development process where we used always
the 16M.
2020-06-18 13:48:49 +02:00
babic_a
e0c3d673cc
Reduce number of IO threads
2020-06-09 14:29:18 +02:00
Dmitry Ozerov
babic_a