Commit Graph

537 Commits

Author SHA1 Message Date
babic_a 7ff6e59bf7 Add basic interaction test for WriterModule 2020-04-07 13:13:46 +02:00
babic_a 2c9987d33f Remove useless close file command 2020-04-07 13:13:24 +02:00
babic_a 0792d3ad8d Improve tests on Module state 2020-04-07 12:27:00 +02:00
babic_a 0448c7a264 Implement new rest api for process manager 2020-04-07 12:20:23 +02:00
babic_a 093271afeb Define ProcessManager interface 2020-04-07 12:20:10 +02:00
babic_a eab61a693c Rename REST start function 2020-04-07 11:58:50 +02:00
babic_a cdc6eb4266 Refactor ProcessManager 2020-04-07 11:13:59 +02:00
babic_a 77408a4c54 Setup WriterUtils as their own namespace 2020-04-06 17:15:22 +02:00
babic_a d550fb4586 Add mock file format 2020-04-06 17:05:32 +02:00
babic_a 27ee81bd22 Add H5WriterModule test 2020-04-06 17:05:23 +02:00
babic_a d375a65043 Remove tests that are not relevant anymore due to refactoring 2020-04-06 16:24:02 +02:00
babic_a de01a75cab Remove try catch around errors we cannot recover from 2020-04-06 16:21:30 +02:00
babic_a af816bd541 Simplify the write thread flow 2020-04-06 15:48:56 +02:00
babic_a 7ceaa2cb4b Remove unused DummyWriter 2020-04-06 15:40:14 +02:00
babic_a 04b16680d6 Adjust BufferedWriter to new Writer 2020-04-06 15:31:09 +02:00
babic_a ab0c6f4b00 Refactor MetadataBuffer 2020-04-06 15:30:51 +02:00
babic_a 32dba2320a Partial implementation of write thread 2020-04-06 14:44:41 +02:00
babic_a b826ed30b4 Small refactoring of BufferedWriter 2020-04-06 14:25:36 +02:00
babic_a 70062e3f14 Pass file properties to writing thread 2020-04-06 13:36:54 +02:00
babic_a f4e7d9505e Remove default value for user_id of writing process
Does not really make sense since the value is hard-coded anyway and will not change
in different deployments.
2020-04-06 13:33:45 +02:00
babic_a b9908b60d5 Add a default writing user_id to the config 2020-04-06 13:32:28 +02:00
babic_a 98d44b6dfd Add start_writing method to H5WriteModule 2020-04-06 13:27:55 +02:00
babic_a 90e70049bd Add stop_writing method to H5WriteModule 2020-04-06 13:24:15 +02:00
babic_a 4fff563dad Rename "writing" to "saving" from ZmqRecvModule
The module should not have a notion of writing - but
2020-04-06 13:19:39 +02:00
babic_a d6fabb7846 Rename "writing" to "saving" from ZmqRecvModule
The module should not have a notion of writing - but saving/discarding flag is
very useful.
2020-04-06 13:18:15 +02:00
babic_a 2cb6dac8ba Cleanup empty lines 2020-04-06 13:11:13 +02:00
babic_a 48232925bc Add module sub-folder 2020-04-06 11:53:32 +02:00
babic_a e3194a3252 Move receiver to proper folder 2020-04-06 11:33:44 +02:00
babic_a e35894326d Make RB initialization flag local 2020-04-06 11:29:19 +02:00
babic_a 4685bbbc76 Fix debug output text 2020-04-06 11:28:14 +02:00
babic_a c45a5846d4 Add verification on RB initialization request 2020-04-06 11:25:44 +02:00
babic_a bdb99f1d13 Improve RingBuffer initialization
Remove automatic initialization on slot reservation - the client will need to take care
of the initialization at the most appropriate time - also allows the calling code to define
the slot size.
2020-04-06 11:12:30 +02:00
babic_a 8c144a07d7 Fix style in compression 2020-04-03 16:54:01 +02:00
babic_a 06f15b8cb9 Add compression buffer size validation 2020-04-03 16:53:50 +02:00
babic_a 233c483fc7 Make RingBuffer initialization thread safe 2020-04-03 15:38:15 +02:00
babic_a d571cdfed7 Remove unused functions 2020-04-03 15:32:24 +02:00
babic_a a0bf79cb35 Remove usage of this-> 2020-04-03 15:31:51 +02:00
babic_a 68bfcb0f74 Increase default ZMQ receive buffer to 15MB 2020-04-03 15:31:39 +02:00
babic_a 9d1158a68b Properly release ring buffer when reading the slots 2020-04-03 14:13:16 +02:00
babic_a e65d90bc34 Remove deprecated methods from tests 2020-04-03 14:00:02 +02:00
babic_a 1949eab3ef Substitute deprecated method with valid one for Zmq recv 2020-04-03 13:51:35 +02:00
babic_a a3d8b1e92b Fix tests 2020-04-03 13:48:16 +02:00
babic_a 1107a08d0f Adjust usage of new ZmqReceiver 2020-04-03 13:48:10 +02:00
babic_a 3853e08238 Cleanup ZmqReceiver 2020-04-03 13:47:48 +02:00
babic_a 90a4206fe0 Remove useless shared_ptr 2020-04-03 13:31:09 +02:00
babic_a dbf33bd8e2 Add simple transfer test 2020-04-02 18:02:45 +02:00
babic_a 378cf77754 Fix reference assignment in RingBuffer constructor
(How does this even compile?!?!)
2020-04-02 17:56:33 +02:00
babic_a 8af70fb6d9 Change number assign for bool 2020-04-02 17:43:47 +02:00
babic_a 8593ed51b6 Move compression to the receiver since it is done there. 2020-04-02 15:48:51 +02:00
babic_a 81feebd4f6 Implement a simple transfer test 2020-04-02 15:46:52 +02:00