Commit Graph

53 Commits

Author SHA1 Message Date
9637d0602f receive multimodule (#65)
* add config files for multimodule receiving

* read subfiles with unordered and missing frames

* save work debugging

* Revert "save work debugging"

This reverts commit e791992a05.

* Revert "read subfiles with unordered and missing frames"

This reverts commit 1177fd129d.

* throw when two frames have different frame numbers

* write single part RawFile (working beta)

* correct total number of frames in master file

* add new mythen file with syncd frames

* save work

* save work for receive multimodule
multimodule config results in too much packet loss. needs more debugging.

* setup Task Distributiosn/ parallelization programming model

* read frames with same frame number

* clang-tidy fixes, formatting, add tests

* added second receiver

* Synchronize between zmq streams and merge frames

* improve readability in loop

* fix failing tests

* add simple test for merge frames

---------

Co-authored-by: Bechir <bechir.brahem420@gmail.com>
Co-authored-by: Erik Frojdh <erik.frojdh@gmail.com>
2024-05-07 11:06:37 +02:00
70acfbf4ac write rawfiles (single file) and read rawfiles in order (#66)
* read subfiles with unordered and missing frames

* save work debugging

* Revert "save work debugging"

This reverts commit e791992a05.

* Revert "read subfiles with unordered and missing frames"

This reverts commit 1177fd129d.

* throw when two frames have different frame numbers

* write single part RawFile (working beta)

* correct total number of frames in master file

* add new mythen file with syncd frames

* read frames with same frame number

* clang-tidy fixes, formatting, add tests

* improve readability in loop

* fix failing tests

---------

Co-authored-by: Bechir <bechir.brahem420@gmail.com>
2024-05-07 10:46:24 +02:00
28d7e8c07a read write cluster file (#60)
* Read and write cluster files (save work)

* add reading test

* use define for examples env variable and fix ci

* read and write cluster files (working)

* fix cluster CI
2024-04-16 13:14:41 +02:00
9dfd388927 use clang-tidy (#59)
* use clang-tidy for Frame.cpp

* fixes for defs.cpp

* clang-tidy 6/45

* clang-tidy for core

* clang-tidy fixes: for hpp File,FileInterface,SubFile.cpp

* ci fixes

* fix build errors

* fix clang-tidy command ci

* fix clang-tidy ci

* clang-tidy for rawfile.cpp

* clang-tidy numpy helpers

* fix ci

* clang-tidy file_io

* clang-tidy file_io and core working

* zmqheader

* clagn-tidy: network_io,file_io,core

* clang-tidy working

* format

---------

Co-authored-by: Bechir <bechir.brahem420@gmail.com>
2024-04-12 17:35:36 +02:00
04a2272937 make file interface and rawfile variables private 2024-04-11 17:42:45 +02:00
2ebbd0d7cd setup doxygen and clang-uml files 2024-04-11 17:20:34 +02:00
111b421476 add documentation for file_io files 2024-04-10 18:09:09 +02:00
530feca830 restore ssize_t changes 2024-04-10 13:57:16 +02:00
bfb59d650b remove factories and change to size_t 2024-04-10 13:48:10 +02:00
0755de309e working simple streamer 2024-04-09 17:30:42 +02:00
a48820059d headers are now included with their library prefix 2024-04-09 11:36:15 +02:00
a2499c96d6 restructure zmq socker interface
zmq socket can now return vector of frames. it knows end of transmission with header.data == 0
it can also send vector of frames
2024-04-09 11:14:21 +02:00
598e9f6708 format files 2024-04-05 17:05:42 +02:00
2f23e4610d fix warnings 2024-04-05 16:04:01 +02:00
9e96f8b150 format headers 2024-04-03 14:53:06 +02:00
8627f5e97b format 2024-04-03 14:14:27 +02:00
b02feceb2c compiler generated constructors and reduced warnings 2024-04-03 14:12:25 +02:00
31a20d4f6c fix ci and add formatting (#48)
* add dependency

* dont run blocking zmq example and add formatting

* format files
2024-04-03 13:47:52 +02:00
d80ea2269f renamed _get_data() to data() 2024-04-03 12:14:59 +02:00
faf2714a60 new files 2024-04-02 17:19:57 +02:00
670d9415e6 added tests and features to load full file 2024-04-02 17:19:10 +02:00
d196eb5a2e made member variables private in NumpyFile 2024-04-02 15:09:16 +02:00
e59940aa01 formatting 2024-04-02 15:05:09 +02:00
a6c0879de7 moved reading of metadata into NumpyFile 2024-04-02 15:01:56 +02:00
390ceb02d8 renamed NumpyFile member variable header to m_header 2024-04-02 14:36:55 +02:00
9854500a6f moving m_fname into respective class 2024-04-02 14:32:04 +02:00
0a6030aa3e moving code into aare:: namespace 2024-04-02 12:26:51 +02:00
449c5119a4 save numpy files frame by frame (#37)
Co-authored-by: Bechir <bechir.brahem420@gmail.com>
2024-04-02 11:35:58 +02:00
04cbe9924e fix file test issues 2024-03-28 12:40:20 +01:00
6e8cf179c7 added first tests for reading files 2024-03-27 18:03:18 +01:00
130f6746e3 removed inheritence from File 2024-03-27 16:55:17 +01:00
d07f867630 conform to file interface (PR#4) (#33)
* use FileInterface with numpy

---------

Co-authored-by: Bechir <bechir.brahem420@gmail.com>
2024-03-27 16:33:51 +01:00
0973580670 options for using the system libraries instead of fetch content 2024-03-27 10:50:38 +01:00
bf216f55c6 reading raw moench files (PR#3) (#32)
* reading moench and raw files

* read mythen3 files

* read multiport mythen3

* delete .vscode and .env.dev

---------

Co-authored-by: Bechir <bechir.brahem420@gmail.com>
2024-03-27 08:58:43 +01:00
937acd1138 reading multi port files (PR#2) (#31)
* works, not tested well on multi columns


---------

Co-authored-by: Erik Fröjdh <erik.frojdh@gmail.com>
2024-03-26 17:53:11 +01:00
aa60a434e9 Merge pull request #27 from slsdetectorgroup/feature/restructure-FileHandler
add contextManager to hanldle files
2024-03-22 17:27:17 +01:00
d0151153fb add contextManager to hanldle files 2024-03-22 15:02:15 +01:00
23658764a0 added write options 2024-03-22 14:59:12 +01:00
0932869b4c added data type 2024-03-22 10:34:57 +01:00
eb2b093130 added size and row, col 2024-03-22 10:33:57 +01:00
cffe020a6f added a draft for file interface 2024-03-22 10:26:15 +01:00
72e3b58c09 fix cmake 2024-03-20 17:39:52 +01:00
cd905e96f3 remove templates 2024-03-20 14:25:31 +01:00
9380fd1be8 fix warnings 2024-03-12 17:21:05 +01:00
609c754b23 moved functions to NumpyHelper.cpp and added a few tests 2024-03-12 16:52:36 +01:00
25d282717c move static numpy functions to another header
- use env variables
- change warnings back to ON
2024-03-11 14:58:44 +01:00
5173f26bf8 fix merge errors 2024-03-08 18:42:24 +01:00
565cad0fca merge with branch developer (commit: ea8efa) 2024-03-08 18:34:45 +01:00
765bbdc295 read numpy file: works 2024-03-08 18:26:02 +01:00
b8cd465a12 silence warnings 2024-03-08 16:13:17 +01:00