|
|
c28286a626
|
Make file reader selection case insensitive by using ext.lower() and update config_text_reader.py to point to renamed dictionary.
|
2025-02-08 19:45:16 +01:00 |
|
|
|
0b29e2ec68
|
remove instruments/dictionaries/ICAD_NO2.yaml. Its dict terms are now in ICAD.yaml.
|
2025-02-08 19:23:37 +01:00 |
|
|
|
609bb0b859
|
Add dict terms from ICAD_NO2.yaml
|
2025-02-08 19:22:27 +01:00 |
|
|
|
ef7fe70bf0
|
Combine dictionaries of ICAD_HONO.yaml and ICAD_NO2.yaml into ICAD.yaml
|
2025-02-08 19:21:17 +01:00 |
|
|
|
b58e205f9f
|
Remove skip directory condition when directory keywords are empty. Here, all paths to files should be considered.
|
2025-02-07 16:37:01 +01:00 |
|
|
|
f986edd4a5
|
Fix reader txt/csv default behavior.
|
2025-02-07 16:25:45 +01:00 |
|
|
|
0d26777732
|
Enable instrumentFolder of form <instFolder>/<category>/ to be trasfered without flatenning
|
2025-02-07 16:24:21 +01:00 |
|
|
|
b374de60f3
|
Add try except block to trigger errors for invalid group names.
|
2025-02-06 16:07:45 +01:00 |
|
|
|
2f72177410
|
Add constraint to match only path/to/keyword1/keyword2/files containing a composite keyword keyword1/keyword2.
|
2025-02-06 15:34:38 +01:00 |
|
|
|
5d0ab4603f
|
Add property to extracted dataset as dataframe. Now time column is of datetime type to facilitate downstream procesing.
|
2025-02-04 17:23:32 +01:00 |
|
|
|
6fae139360
|
Implement method in hdf5 manager to infer datetime column in dataset
|
2025-02-04 17:13:01 +01:00 |
|
|
|
32bba4239a
|
Synch with remote repo
|
2025-02-03 10:31:48 +01:00 |
|
|
|
a3ccff4079
|
Fix typo in html text.
|
2025-01-27 13:53:59 +01:00 |
|
|
|
6653add80c
|
Update readme.md and set_up_env.sh
|
2025-01-27 13:29:29 +01:00 |
|
|
|
ef66d8f1c2
|
Update unload operation to remove reference and fix logic error to dataset metadata extraction.
|
2025-01-24 10:28:43 +01:00 |
|
|
|
1ae607f73b
|
Add validation step to yaml file validation to ensure list type and a minimun length for the 'instrument_datafolder' keyword.
|
2025-01-22 15:55:21 +01:00 |
|
|
|
5b06548d88
|
Fix typo on extension items, extensions need to include a dot .json and .yaml.
|
2025-01-21 09:30:49 +01:00 |
|
|
|
45132b42ce
|
Add json and yaml extensions to admissible file extension lists.
|
2025-01-21 08:57:38 +01:00 |
|
|
|
dd3ebcfe6d
|
Updated to cleared jupyter notebooks
|
2025-01-14 14:46:43 +01:00 |
|
|
|
4f85ca1ad6
|
Added comments to explain configuration parameters/or variables.
|
2025-01-14 14:25:53 +01:00 |
|
|
|
2bd2e89134
|
Add directory tree structure description.
|
2024-12-04 17:20:35 +01:00 |
|
|
|
600899dca2
|
Update .gitignore with output_files/
|
2024-12-04 16:53:57 +01:00 |
|
|
|
4a91785efb
|
Add .gitkeep and keep this folder empty. it is only to be used for local processing
|
2024-12-04 16:52:50 +01:00 |
|
|
|
49dff5b87b
|
Update readme with getting started section
|
2024-12-04 16:24:14 +01:00 |
|
|
|
3e37854445
|
Solved binary incompatibility issue of generated environment by conda installing h5py and numpy from conda-forge or default channels.
|
2024-12-04 16:15:42 +01:00 |
|
|
|
112b88e31f
|
Updated bash script and yml env file to set up python interpreter.
|
2024-12-04 13:52:35 +01:00 |
|
|
|
d422067223
|
Update to readme.md
|
2024-12-03 13:55:45 +01:00 |
|
|
|
47c9bd8e3d
|
Update readme with key features of the repo.
|
2024-12-03 13:50:53 +01:00 |
|
|
|
31d8af6aef
|
Updated README.md with software arquitecture figure
|
2024-12-02 17:28:22 +01:00 |
|
|
|
b2455b2456
|
Updated README.md with software arquitecture figure
|
2024-12-02 17:24:48 +01:00 |
|
|
|
6bc89ebff0
|
Updated README
|
2024-12-02 17:22:52 +01:00 |
|
|
|
1a941bbb6e
|
Updated figure name.
|
2024-12-02 17:08:36 +01:00 |
|
|
|
c57bb62ebd
|
Updated ci runner pipeline fot gitlab page
|
2024-12-02 16:31:49 +01:00 |
|
|
|
f3bb82a937
|
Updated documentation and built doc website
|
2024-12-02 16:31:03 +01:00 |
|
|
|
23e0ced190
|
Relocated to visualization module
|
2024-12-02 15:39:41 +01:00 |
|
|
|
fc561a6068
|
Add __init__.py
|
2024-12-02 15:36:03 +01:00 |
|
|
|
c373c18062
|
Moved hdf5_lib.py to visualization folder
|
2024-12-02 15:34:44 +01:00 |
|
|
|
f2df2ced66
|
Removed no longer useful notebook
|
2024-12-02 15:32:57 +01:00 |
|
|
|
4797c8e894
|
Added env file specification and bash script for env setup
|
2024-12-02 15:10:21 +01:00 |
|
|
|
2e52109bee
|
removed review folder. This is now supposed to be create for review of experimental campaign data objects metadata.
|
2024-12-02 14:32:34 +01:00 |
|
|
|
dccf64ef30
|
Configure GitLab Pages
|
2024-11-26 13:43:09 +01:00 |
|
|
|
f4f27b7084
|
Add draft of dima documentation
|
2024-11-26 13:40:43 +01:00 |
|
|
|
11ca454b94
|
Removed bacause some of the functionalities have been outsourced to other modules src/hdf5_ops.py and src/hdf5_writer.py
|
2024-11-26 11:55:06 +01:00 |
|
|
|
22298f643a
|
Merge branch 'main' of https://gitlab.psi.ch/5505/dima
|
2024-11-25 15:50:25 +01:00 |
|
|
|
31a129694c
|
Updated instrument dictionaries with variable descriptor names aligned with CF metadata conventions.
|
2024-11-25 15:49:49 +01:00 |
|
|
|
5c61e2391a
|
Update to DIMA package path resolution from file.
|
2024-11-24 19:45:18 +01:00 |
|
|
|
1b2b319295
|
Attempt to dynamically resolve path to dima package, when excecuted from command line.
|
2024-11-24 17:37:38 +01:00 |
|
|
|
1174ffc8b8
|
Commented out metadata info about group members for a given group. This is to simplify yaml or json representation of the metadata.
|
2024-11-24 15:57:54 +01:00 |
|
|
|
d7f6e52068
|
Reimplemented code snippet using hdf5_Writer module
|
2024-11-24 11:32:26 +01:00 |
|
|
|
967be876d1
|
Moved func create_hdf5_file_from_dataframe() from hdf5_lib_part2 into hdf5_write.py
|
2024-11-24 11:30:08 +01:00 |
|
