Commit Graph

36 Commits

Author SHA1 Message Date
9637d0602f receive multimodule (#65)
* add config files for multimodule receiving

* read subfiles with unordered and missing frames

* save work debugging

* Revert "save work debugging"

This reverts commit e791992a05.

* Revert "read subfiles with unordered and missing frames"

This reverts commit 1177fd129d.

* throw when two frames have different frame numbers

* write single part RawFile (working beta)

* correct total number of frames in master file

* add new mythen file with syncd frames

* save work

* save work for receive multimodule
multimodule config results in too much packet loss. needs more debugging.

* setup Task Distributiosn/ parallelization programming model

* read frames with same frame number

* clang-tidy fixes, formatting, add tests

* added second receiver

* Synchronize between zmq streams and merge frames

* improve readability in loop

* fix failing tests

* add simple test for merge frames

---------

Co-authored-by: Bechir <bechir.brahem420@gmail.com>
Co-authored-by: Erik Frojdh <erik.frojdh@gmail.com>
2024-05-07 11:06:37 +02:00
70acfbf4ac write rawfiles (single file) and read rawfiles in order (#66)
* read subfiles with unordered and missing frames

* save work debugging

* Revert "save work debugging"

This reverts commit e791992a05.

* Revert "read subfiles with unordered and missing frames"

This reverts commit 1177fd129d.

* throw when two frames have different frame numbers

* write single part RawFile (working beta)

* correct total number of frames in master file

* add new mythen file with syncd frames

* read frames with same frame number

* clang-tidy fixes, formatting, add tests

* improve readability in loop

* fix failing tests

---------

Co-authored-by: Bechir <bechir.brahem420@gmail.com>
2024-05-07 10:46:24 +02:00
28d7e8c07a read write cluster file (#60)
* Read and write cluster files (save work)

* add reading test

* use define for examples env variable and fix ci

* read and write cluster files (working)

* fix cluster CI
2024-04-16 13:14:41 +02:00
9dfd388927 use clang-tidy (#59)
* use clang-tidy for Frame.cpp

* fixes for defs.cpp

* clang-tidy 6/45

* clang-tidy for core

* clang-tidy fixes: for hpp File,FileInterface,SubFile.cpp

* ci fixes

* fix build errors

* fix clang-tidy command ci

* fix clang-tidy ci

* clang-tidy for rawfile.cpp

* clang-tidy numpy helpers

* fix ci

* clang-tidy file_io

* clang-tidy file_io and core working

* zmqheader

* clagn-tidy: network_io,file_io,core

* clang-tidy working

* format

---------

Co-authored-by: Bechir <bechir.brahem420@gmail.com>
2024-04-12 17:35:36 +02:00
abf364765c Merge branch 'developer' into feature/remove-factories 2024-04-11 17:33:29 +02:00
260cb96f64 add documentation to code 2024-04-10 17:18:23 +02:00
bfb59d650b remove factories and change to size_t 2024-04-10 13:48:10 +02:00
ea17a640cf fix for ci and fetchcontent build
replace cmake --build with actual command in github format workflow for faster checking
2024-04-10 11:03:58 +02:00
0755de309e working simple streamer 2024-04-09 17:30:42 +02:00
59b04ad6e8 add boost library 2024-04-09 15:45:01 +02:00
a48820059d headers are now included with their library prefix 2024-04-09 11:36:15 +02:00
a2499c96d6 restructure zmq socker interface
zmq socket can now return vector of frames. it knows end of transmission with header.data == 0
it can also send vector of frames
2024-04-09 11:14:21 +02:00
598e9f6708 format files 2024-04-05 17:05:42 +02:00
2f23e4610d fix warnings 2024-04-05 16:04:01 +02:00
3c58039502 add tests for zmqheader and remove simdjson warnings 2024-04-05 15:22:31 +02:00
35d2b274f4 add simdjson as public for network_io
in ZmqHeader.hpp we are using templates that depend on simdjson. other libraries should also link simdjson
2024-04-04 16:35:46 +02:00
47cf462f3d zmq sender and receiver examples 2024-04-04 15:51:18 +02:00
f772434072 add network_io folder 2024-04-03 16:40:00 +02:00
31a20d4f6c fix ci and add formatting (#48)
* add dependency

* dont run blocking zmq example and add formatting

* format files
2024-04-03 13:47:52 +02:00
70b0ae2ae8 ZmqSocket prototype 2024-04-03 10:50:35 +02:00
0a6030aa3e moving code into aare:: namespace 2024-04-02 12:26:51 +02:00
449c5119a4 save numpy files frame by frame (#37)
Co-authored-by: Bechir <bechir.brahem420@gmail.com>
2024-04-02 11:35:58 +02:00
d07f867630 conform to file interface (PR#4) (#33)
* use FileInterface with numpy

---------

Co-authored-by: Bechir <bechir.brahem420@gmail.com>
2024-03-27 16:33:51 +01:00
bf216f55c6 reading raw moench files (PR#3) (#32)
* reading moench and raw files

* read mythen3 files

* read multiport mythen3

* delete .vscode and .env.dev

---------

Co-authored-by: Bechir <bechir.brahem420@gmail.com>
2024-03-27 08:58:43 +01:00
937acd1138 reading multi port files (PR#2) (#31)
* works, not tested well on multi columns


---------

Co-authored-by: Erik Fröjdh <erik.frojdh@gmail.com>
2024-03-26 17:53:11 +01:00
e280742a6c add logger class (#29)
* add logger class

* add LOCATION macro for logger

* added printing in files
2024-03-26 17:40:19 +01:00
d0151153fb add contextManager to hanldle files 2024-03-22 15:02:15 +01:00
cd905e96f3 remove templates 2024-03-20 14:25:31 +01:00
25d282717c move static numpy functions to another header
- use env variables
- change warnings back to ON
2024-03-11 14:58:44 +01:00
765bbdc295 read numpy file: works 2024-03-08 18:26:02 +01:00
146d2aed19 merge with organizing targets 2024-03-08 13:28:34 +01:00
ef61e62238 new folder structure 2024-03-07 15:48:06 +01:00
5690a61284 add python bindings 2024-03-07 03:09:43 +01:00
22fb8763be better file structure for better separation 2024-03-06 21:08:52 +01:00
1b7ea707ae saving work: failed attempt at sublibraries 2024-03-05 15:40:04 +01:00
d720a8e338 add the empty directories 2024-02-12 19:00:41 +01:00