Commit Graph

1768 Commits

Author SHA1 Message Date
babic_a f79c8d34e5 Renamed cadump to epics_writer 2020-08-11 15:58:46 +02:00
babic_a 6638f5075e Fixing queue logic 2020-08-11 15:58:30 +02:00
babic_a 0025540a1e Renamed cadump to epics_writer 2020-08-11 13:54:37 +02:00
babic_a f4bd6a15f1 First working broker example 2020-08-11 13:53:35 +02:00
babic_a cfb99ff17f Change description of running program 2020-08-11 13:36:41 +02:00
babic_a a9167922a6 Adding RabbitMQ broker 2020-08-11 13:35:31 +02:00
babic_a 3d923c0c76 Add requirement package to cadump 2020-08-11 11:17:07 +02:00
babic_a ffe5635015 Removing code that does not belong here 2020-08-11 11:16:14 +02:00
babic_a 0501533b80 Add 'cadump/' from commit '89228a57f2936f8cf2e6fb9c3a37c337c5b4d011'
git-subtree-dir: cadump
git-subtree-mainline: c99ec49917
git-subtree-split: 89228a57f2
2020-08-11 10:59:17 +02:00
babic_a c99ec49917 Start of README for writer 2020-08-11 10:59:05 +02:00
babic_a d8b7b43c1a Add manual bitshuffle test 2020-08-11 10:58:51 +02:00
babic_a 3afe3c598c Add stubs 2020-08-11 10:58:37 +02:00
babic_a 9bfbc98a77 Add link to hybrid programming 2020-07-28 16:12:58 +02:00
babic_a c09eef444e Add another link 2020-07-28 16:11:09 +02:00
babic_a 48becec15b Add low latency performance tuning paper 2020-07-28 16:10:06 +02:00
babic_a 552caa82de Fix table format and values 2020-07-27 17:06:13 +02:00
babic_a e99514d2df Fix table in README 2020-07-27 17:04:27 +02:00
babic_a 979cdd3b4a Merge remote-tracking branch 'origin/master' 2020-07-27 16:58:37 +02:00
babic_a 601d7df786 Update diagrams and add them to README 2020-07-27 16:58:30 +02:00
babic_a 2df8fa8fe3 Add test for sf-stream 2020-07-27 16:21:50 +02:00
Dmitry Ozerov df51bb6ca5 version used in July Alvra experiment (conversion and compression of files using Ivan's export_file.py code based on jungfrau_utils); make list of frames in crystfel notation to separate laser light/dark 2020-07-27 14:47:41 +02:00
babic_a 27b936daea Add 2 articles to README 2020-07-27 14:14:59 +02:00
babic_a d963621d87 Add stub for MPI daq POC 2020-07-24 13:25:25 +02:00
babic_a 44a60a8d27 Improve text about scope 2020-07-23 18:05:36 +02:00
babic_a 8270cca180 Add documentation about ZMQ receiving and image assembly 2020-07-23 18:01:08 +02:00
babic_a 5202a80560 Add first version of sf-stream README 2020-07-23 16:46:36 +02:00
babic_a 36960ec73e Add sf-stream overview drawing 2020-07-23 16:46:21 +02:00
babic_a 22a954c8c3 Add details to README regarding udp receiving 2020-07-23 16:02:24 +02:00
babic_a 1e3b8c393b Add clarification comment in sf-buffer 2020-07-23 15:53:24 +02:00
babic_a 70724d747a Update text regarding sf-buffer zmq sending 2020-07-23 14:23:29 +02:00
babic_a b0ee5b916f Improve text for sf-buffer 2020-07-23 14:11:13 +02:00
babic_a 066eb80529 Update drawings 2020-07-23 13:57:31 +02:00
babic_a 60b8757a65 Improve README and fill in more info 2020-07-23 13:46:46 +02:00
babic_a 98be7b9e5c Add more details in the main README regarding scope 2020-07-23 13:36:43 +02:00
babic_a bb681800a2 Update main README with up to date information 2020-07-23 13:13:44 +02:00
babic_a b55fb89ae5 Add stub README files for components 2020-07-23 13:06:13 +02:00
babic_a 8bd1733905 Update README of sf-buffer with improved naming
Changed module_name to module_folder (for consistency).
2020-07-23 12:36:27 +02:00
babic_a 234081f931 Fix example of offset calculation in sf-buffer 2020-07-23 12:30:45 +02:00
babic_a 73389746ca Fix previous commit link 2020-07-23 12:12:58 +02:00
babic_a 85eaf57237 Change link to sf-buffer page and not directly the README 2020-07-23 12:11:44 +02:00
babic_a a94010aaf8 Update README.md with overview diagram 2020-07-22 16:26:34 +02:00
babic_a f0970b1c8a Add more details to sf-buffer file structure 2020-07-22 14:28:53 +02:00
babic_a 79d3e86d9e Added first version of sf-buffer documentation 2020-07-22 14:22:50 +02:00
babic_a bf0bc1180f Add drawings for File and Folder layout on disk 2020-07-22 14:21:15 +02:00
babic_a 04deffbffc Move sf-buffer specific text to sf-buffer README.md 2020-07-22 11:45:23 +02:00
babic_a 3c0f0ab49f Update README.md about the sf-buffer 2020-07-22 11:06:28 +02:00
babic_a 3055c5bc60 Add socket to listen for current pulse_id
The live writer will listen to the stream of pulse_ids coming
from the sf-stream in order to determine the writing delay
it needs to apply. (we will wait 1 second after the data was
written to try to read it back)
2020-07-21 13:25:44 +02:00
babic_a 9d9549b868 Remove start_pulse_id and pulse_id_step from live writer
We do not rely on start_pulse_id and pulse_id_step to
calculate the next image as we don't care which image this
will be - we write whatever we receive. This will allow us
to use an external driver for the pulses we desire to write.
2020-07-20 14:59:00 +02:00
babic_a 0441758d96 Change main writer to operate n_pulses instead of stop_pulse_id
The live writer has been changed to operate on the number of
desired pulses instead of the start and stop pulse_id. This
makes more sense in the context of live retrieval since the
stop pulse id has not been yet observed and the user would
need to calculate it anyway.
2020-07-20 14:55:37 +02:00
babic_a c12601f756 Add JFH5LiveWriter
In comparison with the normal writer, the block operations
have been dropped and the buffering of metadata is not sparse
anymore. Direct chunk writing used for data and buffering +
dump at end for metadata.
2020-07-20 14:49:43 +02:00