babic_a
d3d51d2957
Adjust stats to new stream workings
2021-01-19 16:57:41 +01:00
babic_a
fec900ff63
Increase the sf_stream output frequency to 10 seconds
2021-01-15 11:15:28 +01:00
babic_a
f58ec4270c
Implementation fo StreamStats for outputting Grafana metrics
2021-01-15 11:06:47 +01:00
babic_a
2937326dbf
Return n_lost_pulses in sync from receiver
...
In order to have proper statistics we need to return the
number of lost pulses from the receiver. We cannot just count
the gap in pulse_id as the beam might be operated at
different frequencies.
2021-01-15 10:59:43 +01:00
babic_a
0cf973802d
Add stream stats modulo to config file
2021-01-14 15:45:41 +01:00
babic_a
6ee8f7d89d
Remove pulse_id stream from streamer
...
This is not needed anymore since we have a different architecture.
2021-01-13 15:54:28 +01:00
babic_a
a7efe6492e
Use core-buffer load config
2020-09-30 10:48:13 +02:00
babic_a
fbbbb47f96
Rename zmq pulse receiver
2020-09-24 13:18:34 +02:00
babic_a
7e1d1dae2b
Make use of common connect function in Pulse Receiver
2020-09-24 13:04:28 +02:00
babic_a
677f9c44c4
Since we are sending only pulse_ids adjust n threads
2020-09-24 13:03:39 +02:00
babic_a
3e097a5cd8
Adjust stream sender to use reference
2020-09-21 09:56:06 +02:00
babic_a
f84f4fbcdb
Make function const
2020-09-18 15:29:34 +02:00
babic_a
639fe3790a
Refactor pulse_id receiver
2020-09-18 15:25:31 +02:00
babic_a
ac58965758
Adapt Live sender to RamBuffer
2020-09-04 17:00:01 +02:00
babic_a
c7185f249b
Cleanup sf_streamer
2020-07-17 11:20:50 +02:00
babic_a
465369a322
Add pulse_id stream to streamer
...
The pulse_id stream can be used to synchronize components.
For example, the writer can listen for the current pulse_id
and write with 1 second delay to a file. This will help us
eliminate the need to wait for the run to complete to start
the data write request.
2020-07-16 11:27:09 +02:00
babic_a
6129b711ba
Change processing socket from PUB to PUSH
...
Since processing of live data can be done at 100Hz it would
be more difficult to stream the full rate with a PUB/SUB mode.
To support distributed live analysis we move to PUSH/PULL
model, since we can support only one live processing at a time
anyway (network constraints when working with large detectors).
2020-07-15 10:29:21 +02:00
babic_a
e0c3d673cc
Reduce number of IO threads
2020-06-09 14:29:18 +02:00
babic_a
4c6f75eb75
Move hpp to correct folder
2020-06-09 14:18:43 +02:00
babic_a
71de5c5db0
Return number of lost images in resync event
2020-06-09 11:20:44 +02:00
babic_a
c6960b5e59
Extract Receiver from module for Zmq recv and assembly
2020-06-09 10:58:47 +02:00
babic_a
cca0572d3e
Adapt live RecvModule
2020-06-09 10:58:11 +02:00
babic_a
51918a3707
Change atomic type to int
2020-06-09 10:19:05 +02:00
babic_a
5d2871185a
Move FastQueue to sf_stream
2020-06-09 10:10:19 +02:00
babic_a
08a4b891a6
Add sync limit
2020-06-08 17:28:03 +02:00
babic_a
a6e1c6c84e
Move stream configs to separate file
2020-06-04 11:57:42 +02:00
babic_a
871030f2d7
Make module alignment for lower rep rates
2020-06-04 11:49:26 +02:00
babic_a
67398de47f
Remove pulse_id from module alignment
2020-06-04 11:28:40 +02:00
babic_a
e2cbdb5904
Tidy up
2020-06-04 09:58:46 +02:00
babic_a
8a5f594b3d
Finished refactoring
2020-05-20 12:49:55 +02:00
babic_a