Commit Graph

465 Commits

Author SHA1 Message Date
babic_a dce62b6fa7 Set the default number of receiving threads to 1 2020-03-31 13:48:41 +02:00
babic_a 69e8530879 Remove unused config parameter 2020-03-31 13:47:14 +02:00
babic_a be3a605c8c Restructure folder to writer and receiver 2020-03-31 13:46:15 +02:00
babic_a a4bfa273ab Reformat output code 2020-03-31 13:38:47 +02:00
babic_a 793fbfe24e Unify brackets 2020-03-30 10:44:12 +02:00
babic_a 080b8d1d0e Remove unused include 2020-03-30 10:43:00 +02:00
babic_a c25d26e4a8 Improve WriterManager style 2020-03-30 10:42:27 +02:00
babic_a ce20f4232f Remove useless comment 2020-03-27 08:39:47 +01:00
babic_a 7234764d71 Improve RingBuffer 2020-03-26 16:55:47 +01:00
babic_a f9b25367fa Move public interfaces to include folder 2020-03-26 15:47:38 +01:00
babic_a e94bf27f0f Move public headers to include folder 2020-03-26 15:42:31 +01:00
babic_a 96d50eeadc Rename header to match others 2020-03-26 15:35:50 +01:00
babic_a 4d3ac76bbb Cosmetic fixes in header 2020-03-26 14:48:24 +01:00
babic_a b1ee237416 Split file to external and core 2020-03-26 12:41:00 +01:00
babic_a fcfb856fa9 Change extension to use C++ instead of C 2020-03-26 12:40:08 +01:00
babic_a ccc6714178 Move compression out of dedicated folder 2020-03-25 10:12:22 +01:00
babic_a d91ccfbafd Improve style 2020-03-25 10:10:36 +01:00
babic_a 0d967218ee Improve style of ZMQ receiver 2020-03-24 12:09:00 +01:00
babic_a 23553fb65e Fix typos in debug mode 2020-03-24 11:44:23 +01:00
babic_a abba1ddabd Add cmake build to ignore 2020-03-24 11:37:44 +01:00
babic_a 7ca073ad45 Improve gtest naming 2020-03-24 11:36:29 +01:00
babic_a 2aa19bafbd Prepare unit tests targets 2020-03-24 11:34:58 +01:00
babic_a 587156cf8f Add gtest build template 2020-03-24 11:34:42 +01:00
babic_a 084ee46601 Add static cast to size_t 2020-03-24 11:34:13 +01:00
babic_a 57287b7e0a Remove function inlining 2020-03-24 11:33:54 +01:00
babic_a f6a0d8de3f Rework build system 2020-03-24 09:10:18 +01:00
babic_a e389e1a9be Change CMakeList directory 2020-03-23 12:07:39 +01:00
babic_a 43e766eb54 Adjust include after dependency move 2020-03-23 12:07:28 +01:00
babic_a 931dde4444 Move include folders to extern (header only libs) 2020-03-23 12:05:50 +01:00
babic_a 199e9a0fba Move bitshuffle project in external directory 2020-03-23 12:04:19 +01:00
babic_a 5998e34838 Add CmakeList for core writer 2020-03-23 11:54:49 +01:00
babic_a 01eb2f8ed7 Rename folder of core library 2020-03-23 11:54:27 +01:00
babic_a c30e6be0b0 Add compression headers to CONDA package 2020-03-19 10:11:32 +01:00
babic_a d8489377d0 Add empty line 2019-12-02 10:33:17 +01:00
babic_a d7c85029c4 New test case 2019-08-02 10:26:47 +02:00
babic_a 1a3f803ba0 WIP 2019-05-14 09:05:39 +02:00
babic_a 1f3ade67c2 Add receiver threads to WriterManager 2019-05-13 10:35:40 +02:00
babic_a 478665816d Add method to get the current ringbuffer slot size 2019-04-30 15:49:55 +02:00
babic_a c46f3d2227 Split ringbuffer write to reserve and commit
Since the introduction of compression, it is no longer practival to do a manual memcopy int he
ringbuffer write method. In order to save a memory copy, the ringbuffer does not copy the buffer
itself, but the compression is done directly to the ringbuffer slot.
2019-04-30 15:46:48 +02:00
babic_a c3e62c34cf Add compression methods
Adding compression methods for bitshuffle and lz4. Compression behaves in the same way as the H5 filters do,
so the compressed data can be directly chunk written to H5 files.
2019-04-30 15:45:36 +02:00
babic_a 6225d0cf1d Fix DEBUG build 2019-04-26 15:55:35 +02:00
babic_a 32a025f0fc Fix syntactic problems with RingBuffer 2019-04-26 15:33:01 +02:00
babic_a b8803b1e04 Cosmetic improvements to WriterManager 2019-04-26 15:32:41 +02:00
babic_a fd732aefa2 Add clear method to RingBuffer
Since the writer will be running all the time, if a user calls stop, the
state of the RingBuffer needs to be cleared without re-creating the object.
2019-04-26 15:27:33 +02:00
babic_a e9e7fdf2a4 Finished refactoring WriterManager 2019-04-26 12:55:46 +02:00
babic_a 191ea4eaf5 Merge PSIWriter with WriterManager
It does not make sense to have 2 separate entities for this. The writer
manager only responsibility was to control the PSIWriter.
2019-04-26 10:50:29 +02:00
babic_a ce8753ab00 Add header types to PSIWriter 2019-04-25 14:21:40 +02:00
babic_a 2d4088475c Adding back receive_zmq method 2019-04-25 13:16:23 +02:00
babic_a 60bfb3a664 WIP PSIWriter 2019-04-25 13:16:04 +02:00
babic_a 3a8e926e69 New PSI writer class 2019-04-25 12:00:53 +02:00