230 Commits

Author SHA1 Message Date
54e30ef9ec Implemented git add and commit for second metadata review step, and create it function to checkout branches. 2024-03-27 14:23:16 +01:00
2aac145379 Removed buggy statement, which was expected to detect recently created review files 2024-03-26 16:34:38 +01:00
302b7dbfa5 Implemented metadata review library 2024-03-26 16:21:02 +01:00
a727e38db4 Implemented hdf5_vis.py, which is a hdf5 visualization library to obtain treemap and yaml representations of hdf5 files. 2024-03-26 16:14:40 +01:00
a58bf4f019 Refactored import dependencies. 2024-03-26 13:57:19 +01:00
1b9963d44d Moved to input_files/ 2024-03-25 08:51:34 +01:00
1bf1f60beb Added lines to treat string attributes as fixed-length strings, which are represented as bytes that need to be decoded with utf-8. There are a few advantages, and hdf5 reader provide more precise behavior than variable length strings 2024-03-22 17:28:47 +01:00
13cb6395aa Restructured the way table_preamble attribute is represented. Now it is a list of strings as opposed to a multilinear string with special characters like \n. This is to avoid parsing problems in the yalm files. 2024-03-22 17:26:30 +01:00
fff935f551 Included optional argument in make_copy function and commented out a few lines that increase dataset storage complexity. 2024-03-21 17:16:14 +01:00
4244e39232 Implemented hdf5_vis.py to gather functions that display or represent properties of an hdf5 file in a human readable file format like yalm or html files that enble interative visualizations on the browser. 2024-03-21 16:30:27 +01:00
e389ffbefe Relocated def display_group_hierarchy_on_a_treemap(filename: str) to hdf5_vis.py 2024-03-21 16:27:54 +01:00
8004a891aa Included lines to work on copies of files, and removed .strip() to create the table preamble because it destroyed txt structure. 2024-03-19 14:55:49 +01:00
63e7fb28d0 Removed the 'backup_' name from the copied file so that the orignal name is preserved in the hdf5 file. The file copy storage location is enough to distinguise it from the original file. 2024-03-19 14:07:37 +01:00
2d8503ef7a Included make_file_copy function 2024-03-19 11:59:39 +01:00
2271be6ecc Moved make_file_copy internal function to g5505_utils.py module because it can be reused accross file readers. 2024-03-19 11:58:08 +01:00
7fe254755f Replaced attributes, previously extracted from the table_preamble in .txt and .dat files with a single dataset attribute called table_preamble that contains the whole table preamble. 2024-03-19 11:40:35 +01:00
b886066133 Simplified code and corrected buggy if statement. Included input verification steps and OS path normalization. 2024-03-19 11:11:05 +01:00
afa89df143 Relocated scripts 2024-03-18 13:44:11 +01:00
98682420fe Moved openbis_lib.py to src folder. 2024-02-21 15:58:21 +01:00
79b7428b9f Cleaned up code by removing commented lines and so on. 2024-02-21 10:47:12 +01:00
219435511b Changed variable names, rearranged pieces of code, and set up data checks. 2024-02-21 10:41:57 +01:00
1a4294e0c2 Modified to received unified dictionary structure and transform it into equivalent group datasets and attribute structure. 2024-02-16 16:52:21 +01:00
a2818975b5 Modified to include all relevant inputs to hdf5 file creation for different groups 2024-02-16 16:50:13 +01:00
a6400b9ac4 Inclided function to copy an entired h5 file in a group. Useful when integrating h5 files into new ones. 2024-02-15 16:01:15 +01:00
e7bdee21da Refactored to interact with config_file.py, which sets available file readers 2024-02-15 15:59:42 +01:00
13416ddeec Added a configuration file to select available group dependent file reader functions. This is to enable modularity and scalability. 2024-02-15 15:57:45 +01:00
337a1947fe Reverted a few minor refactoring changes. 2024-02-15 10:10:10 +01:00
8ba9547895 Refactored hdf5_lib.py due to previous file move. 2024-02-15 09:59:36 +01:00
73dce0a562 Moved smog_chamber_file_reader.py to src folder. 2024-02-15 09:58:50 +01:00
dfdfea2b71 Created src folder and transfered into it previously deleted python scripts. 2024-02-15 09:52:15 +01:00