Commit Graph

118 Commits

Author SHA1 Message Date
babic_a 01eb2f8ed7 Rename folder of core library 2020-03-23 11:54:27 +01:00
babic_a c30e6be0b0 Add compression headers to CONDA package 2020-03-19 10:11:32 +01:00
babic_a d8489377d0 Add empty line 2019-12-02 10:33:17 +01:00
babic_a d7c85029c4 New test case 2019-08-02 10:26:47 +02:00
babic_a 1a3f803ba0 WIP 2019-05-14 09:05:39 +02:00
babic_a 1f3ade67c2 Add receiver threads to WriterManager 2019-05-13 10:35:40 +02:00
babic_a 478665816d Add method to get the current ringbuffer slot size 2019-04-30 15:49:55 +02:00
babic_a c46f3d2227 Split ringbuffer write to reserve and commit
Since the introduction of compression, it is no longer practival to do a manual memcopy int he
ringbuffer write method. In order to save a memory copy, the ringbuffer does not copy the buffer
itself, but the compression is done directly to the ringbuffer slot.
2019-04-30 15:46:48 +02:00
babic_a c3e62c34cf Add compression methods
Adding compression methods for bitshuffle and lz4. Compression behaves in the same way as the H5 filters do,
so the compressed data can be directly chunk written to H5 files.
2019-04-30 15:45:36 +02:00
babic_a 6225d0cf1d Fix DEBUG build 2019-04-26 15:55:35 +02:00
babic_a 32a025f0fc Fix syntactic problems with RingBuffer 2019-04-26 15:33:01 +02:00
babic_a b8803b1e04 Cosmetic improvements to WriterManager 2019-04-26 15:32:41 +02:00
babic_a fd732aefa2 Add clear method to RingBuffer
Since the writer will be running all the time, if a user calls stop, the
state of the RingBuffer needs to be cleared without re-creating the object.
2019-04-26 15:27:33 +02:00
babic_a e9e7fdf2a4 Finished refactoring WriterManager 2019-04-26 12:55:46 +02:00
babic_a 191ea4eaf5 Merge PSIWriter with WriterManager
It does not make sense to have 2 separate entities for this. The writer
manager only responsibility was to control the PSIWriter.
2019-04-26 10:50:29 +02:00
babic_a ce8753ab00 Add header types to PSIWriter 2019-04-25 14:21:40 +02:00
babic_a 2d4088475c Adding back receive_zmq method 2019-04-25 13:16:23 +02:00
babic_a 60bfb3a664 WIP PSIWriter 2019-04-25 13:16:04 +02:00
babic_a 3a8e926e69 New PSI writer class 2019-04-25 12:00:53 +02:00
babic_a 8b96e28bb3 Move writing functions to PSIWriter 2019-04-25 11:49:35 +02:00
babic_a fa44290733 Fix line length 2019-04-25 10:23:32 +02:00
babic_a 1b24f1a99d Set effective uid and gid 2019-04-25 10:15:44 +02:00
babic_a 179223639e Remove unused methods from the WriterManager 2019-04-25 09:41:09 +02:00
babic_a e2e49e5e11 Add new start method to WriterManager 2019-04-23 18:15:38 +02:00
babic_a 297a017c09 Move methods to protected 2019-04-23 18:15:03 +02:00
babic_a 7c8cbe708f RestApi changed again 2019-04-23 18:14:36 +02:00
babic_a 4fddd37974 New REST interface 2019-04-23 16:40:16 +02:00
babic_a 7cd11be183 Rename run_writers to run_receivers
In the new implementation the default state is to have the receivers running,
but not the writers.
2019-04-23 12:02:49 +02:00
babic_a 81f4f194e3 Start writer thread implementation 2019-04-04 18:53:16 +02:00
babic_a 3e596c09a2 Add TODO to WriterManager 2019-04-04 18:39:42 +02:00
babic_a e6956d9e6d Added error signaling to Writer 2019-04-03 16:42:39 +02:00
babic_a 7852017aba Remove unused WriterManager parameters 2019-04-03 16:06:26 +02:00
babic_a 5bf3688ae0 Remove old references 2019-04-03 14:55:08 +02:00
babic_a bbd6cda86f Fix interface for RestApi 2019-04-03 13:43:44 +02:00
babic_a 19235b4c62 Add signaling from writer to manager 2019-04-02 15:52:22 +02:00
babic_a 1c3304861e Do not stop the process when the writer finishes. 2019-04-02 15:44:21 +02:00
babic_a 3bc14a79ab Changes to ProcessManager for new writer 2019-04-02 15:41:44 +02:00
babic_a 38e6969900 Refactor writing of h5 2019-04-02 15:41:23 +02:00
babic_a 2ed6ccd9e1 Running the writer logic 2019-04-02 14:51:37 +02:00
babic_a be6b774d68 Implement the receive frame correctly 2019-04-02 14:38:47 +02:00
babic_a 5e73aaff5f Call constructor from CPconst 2019-04-02 12:15:06 +02:00
babic_a e33d78f683 Added copy constructor to ZmqReceiver 2019-04-02 12:12:17 +02:00
babic_a 724ac2101e Receiver process adaptation 2019-04-02 12:01:36 +02:00
babic_a 2a7ef227fb Refactoring the WritingManager 2019-04-02 11:14:42 +02:00
babic_a e6d4f0fa04 Started refactoring of WriterManager 2019-03-29 16:47:00 +01:00
babic_a 3869f27972 Improved RestApi 2019-03-29 16:46:41 +01:00
babic_a bea27191c5 Pass crow app to RestAPI
In order to properly stop the REST api you need to have
a handle to the app object.
2019-03-29 16:18:01 +01:00
babic_a 74007b007b Create start endpoint 2019-03-29 16:13:26 +01:00
babic_a 851db25572 Remove ProxyManager 2019-03-29 15:48:27 +01:00
babic_a 25a710f4ac Use lock_guard instead of locking Mutex 2019-03-29 15:29:17 +01:00