Commit Graph

60 Commits

Author SHA1 Message Date
babic_a 0a3db103c5 Change stats names to use _ instead of -
Using - is causing problems in Influx -> we move to use
the executable name instead of the project name as the main
identifier.
2021-01-15 11:18:07 +01:00
babic_a 3ed5bcb330 Statistics for sf-stream 2021-01-15 11:07:31 +01:00
babic_a f58ec4270c Implementation fo StreamStats for outputting Grafana metrics 2021-01-15 11:06:47 +01:00
babic_a 2937326dbf Return n_lost_pulses in sync from receiver
In order to have proper statistics we need to return the
number of lost pulses from the receiver. We cannot just count
the gap in pulse_id as the beam might be operated at
different frequencies.
2021-01-15 10:59:43 +01:00
babic_a dd52eea55b Reverse sync difference criteria in streamer 2021-01-13 16:20:51 +01:00
babic_a e9bb30eac8 Fix streamer sync attempts for loop 2021-01-13 16:18:47 +01:00
babic_a cb9ddb3693 Fix the count of input parameters in streamer 2021-01-13 16:14:56 +01:00
babic_a 6ee8f7d89d Remove pulse_id stream from streamer
This is not needed anymore since we have a different architecture.
2021-01-13 15:54:28 +01:00
babic_a b8b152e5ed Rename Detector Name to lower case 2020-09-30 13:49:57 +02:00
babic_a 79f6eaebc9 Shorten help string in console 2020-09-30 13:38:35 +02:00
babic_a f42298e264 Improve attribute reading from sf_stream 2020-09-30 11:38:39 +02:00
babic_a a7efe6492e Use core-buffer load config 2020-09-30 10:48:13 +02:00
babic_a fbbbb47f96 Rename zmq pulse receiver 2020-09-24 13:18:34 +02:00
babic_a 7e1d1dae2b Make use of common connect function in Pulse Receiver 2020-09-24 13:04:28 +02:00
babic_a 53a2690567 Improve statistics and logging for sf_stream 2020-09-21 10:16:27 +02:00
babic_a 5dbaf3319f Add sync attempt output counter 2020-09-21 10:16:05 +02:00
babic_a 3e097a5cd8 Adjust stream sender to use reference 2020-09-21 09:56:06 +02:00
babic_a 5a22344e84 Externalize the socket creation 2020-09-21 09:45:13 +02:00
babic_a f84f4fbcdb Make function const 2020-09-18 15:29:34 +02:00
babic_a 639fe3790a Refactor pulse_id receiver 2020-09-18 15:25:31 +02:00
babic_a 1ddee279db Throw away useless metrics 2020-09-04 17:15:13 +02:00
babic_a ac58965758 Adapt Live sender to RamBuffer 2020-09-04 17:00:01 +02:00
babic_a c7185f249b Cleanup sf_streamer 2020-07-17 11:20:50 +02:00
babic_a 465369a322 Add pulse_id stream to streamer
The pulse_id stream can be used to synchronize components.
For example, the writer can listen for the current pulse_id
and write with 1 second delay to a file. This will help us
eliminate the need to wait for the run to complete to start
the data write request.
2020-07-16 11:27:09 +02:00
babic_a 773320799a Switch analysis socket to NOBLOCK
Since we cannot control the rate of the producer (its
whatever the detector is currently doing) we cannot afford
to block if no clients are present.
2020-07-15 10:34:54 +02:00
babic_a 6129b711ba Change processing socket from PUB to PUSH
Since processing of live data can be done at 100Hz it would
be more difficult to stream the full rate with a PUB/SUB mode.

To support distributed live analysis we move to PUSH/PULL
model, since we can support only one live processing at a time
anyway (network constraints when working with large detectors).
2020-07-15 10:29:21 +02:00
babic_a ed23b58332 Iteration over the specified modules instead of all
Left over from the development process where we used always
the 16M.
2020-06-18 13:48:49 +02:00
babic_a e0c3d673cc Reduce number of IO threads 2020-06-09 14:29:18 +02:00
babic_a 9ff5c08b9b Convert sf_stream to single thread 2020-06-09 14:24:36 +02:00
babic_a 5638071b95 Fix whitespace 2020-06-09 14:20:12 +02:00
babic_a 4c6f75eb75 Move hpp to correct folder 2020-06-09 14:18:43 +02:00
babic_a 337c3d5462 Modulo on atomic is not really supported 2020-06-09 14:14:12 +02:00
babic_a c541da141b Fix changes once the class was extracted 2020-06-09 14:10:19 +02:00
babic_a cdef401862 Extract sender from main 2020-06-09 14:03:42 +02:00
babic_a 3a50aca2f1 Fix typo 2020-06-09 14:03:31 +02:00
babic_a 69d13fc3aa Extract stream sending logic to class 2020-06-09 14:03:12 +02:00
babic_a b189d5ab34 Add lost pulses statistics 2020-06-09 13:16:26 +02:00
babic_a 71de5c5db0 Return number of lost images in resync event 2020-06-09 11:20:44 +02:00
babic_a 5e1377e00a Adapt main to the new recv class 2020-06-09 11:02:18 +02:00
babic_a c6960b5e59 Extract Receiver from module for Zmq recv and assembly 2020-06-09 10:58:47 +02:00
babic_a cca0572d3e Adapt live RecvModule 2020-06-09 10:58:11 +02:00
babic_a 51918a3707 Change atomic type to int 2020-06-09 10:19:05 +02:00
babic_a 5d2871185a Move FastQueue to sf_stream 2020-06-09 10:10:19 +02:00
babic_a c49ace75a8 Rewrite sync code 2020-06-08 17:31:12 +02:00
babic_a 08a4b891a6 Add sync limit 2020-06-08 17:28:03 +02:00
babic_a 422b599b38 Rename core_config to buffer_config namespace 2020-06-04 11:59:05 +02:00
babic_a a6e1c6c84e Move stream configs to separate file 2020-06-04 11:57:42 +02:00
babic_a 871030f2d7 Make module alignment for lower rep rates 2020-06-04 11:49:26 +02:00
babic_a 45753de39f Trimming the fat from live recv module 2020-06-04 11:41:19 +02:00
babic_a 67398de47f Remove pulse_id from module alignment 2020-06-04 11:28:40 +02:00