Commit Graph

14 Commits

Author SHA1 Message Date
d59967fcc4 Fix import statement in pipelines.data_integration.py 2025-03-14 10:12:57 +01:00
4f438f86fe Update import statements in pipelines/data_integration.py. from instruments.readers import ... -> from instruments import ... 2025-02-25 09:21:52 +01:00
81be6b54c8 Change import statements with try except to enable explicit import of submodules from import to avoid conflicts with parent project. 2025-02-22 17:10:53 +01:00
e358d4ab64 Synch with remote repo 2025-02-03 10:31:48 +01:00
7ffcd90e7b Add validation step to yaml file validation to ensure list type and a minimun length for the 'instrument_datafolder' keyword. 2025-01-22 15:55:21 +01:00
85d44d71d6 Attempt to dynamically resolve path to dima package, when excecuted from command line. 2024-11-24 17:37:38 +01:00
59e910a0f9 Modified logger setup to create monthly logs 2024-11-21 11:46:11 +01:00
c866ce8ee9 Fixed command line interface bug 2024-11-10 18:19:59 +01:00
83b4a12e8b Major code refactoring and simplifications to enhance modularity. Included a command line interface. 2024-11-01 09:52:41 +01:00
a8ceffba8b Corrected import statements due to dependency name changes 2024-10-17 16:52:42 +02:00
9a76b3a01a Added 'filename_format' attribute to YAML schema. It takes as value a string of comma separated keys from available attributes in YAML file. 2024-10-14 16:01:24 +02:00
5cc409f882 Fixed bug introduce in logger due to invalid date naming replace : with - 2024-10-10 14:29:36 +02:00
3e143fb9c7 Abstracted reusable steps in integration_sources as dima_pipeline.py and added functionality to make a collection of hdf5 files, where each represents an single experiment of campaign. 2024-09-25 15:23:23 +02:00
de859102ab Moved src/data_integration_lib.py -> pipelines/data_integration.py 2024-09-17 15:32:23 +02:00