Commit Graph

25 Commits

Author SHA1 Message Date
florez_j 1b9963d44d Moved to input_files/ 2024-03-25 08:51:34 +01:00
florez_j 1bf1f60beb Added lines to treat string attributes as fixed-length strings, which are represented as bytes that need to be decoded with utf-8. There are a few advantages, and hdf5 reader provide more precise behavior than variable length strings 2024-03-22 17:28:47 +01:00
florez_j 13cb6395aa Restructured the way table_preamble attribute is represented. Now it is a list of strings as opposed to a multilinear string with special characters like \n. This is to avoid parsing problems in the yalm files. 2024-03-22 17:26:30 +01:00
florez_j fff935f551 Included optional argument in make_copy function and commented out a few lines that increase dataset storage complexity. 2024-03-21 17:16:14 +01:00
florez_j 4244e39232 Implemented hdf5_vis.py to gather functions that display or represent properties of an hdf5 file in a human readable file format like yalm or html files that enble interative visualizations on the browser. 2024-03-21 16:30:27 +01:00
florez_j e389ffbefe Relocated def display_group_hierarchy_on_a_treemap(filename: str) to hdf5_vis.py 2024-03-21 16:27:54 +01:00
florez_j 8004a891aa Included lines to work on copies of files, and removed .strip() to create the table preamble because it destroyed txt structure. 2024-03-19 14:55:49 +01:00
florez_j 63e7fb28d0 Removed the 'backup_' name from the copied file so that the orignal name is preserved in the hdf5 file. The file copy storage location is enough to distinguise it from the original file. 2024-03-19 14:07:37 +01:00
florez_j 2d8503ef7a Included make_file_copy function 2024-03-19 11:59:39 +01:00
florez_j 2271be6ecc Moved make_file_copy internal function to g5505_utils.py module because it can be reused accross file readers. 2024-03-19 11:58:08 +01:00
florez_j 7fe254755f Replaced attributes, previously extracted from the table_preamble in .txt and .dat files with a single dataset attribute called table_preamble that contains the whole table preamble. 2024-03-19 11:40:35 +01:00
florez_j b886066133 Simplified code and corrected buggy if statement. Included input verification steps and OS path normalization. 2024-03-19 11:11:05 +01:00
florez_j afa89df143 Relocated scripts 2024-03-18 13:44:11 +01:00
florez_j 98682420fe Moved openbis_lib.py to src folder. 2024-02-21 15:58:21 +01:00
florez_j 79b7428b9f Cleaned up code by removing commented lines and so on. 2024-02-21 10:47:12 +01:00
florez_j 219435511b Changed variable names, rearranged pieces of code, and set up data checks. 2024-02-21 10:41:57 +01:00
florez_j 1a4294e0c2 Modified to received unified dictionary structure and transform it into equivalent group datasets and attribute structure. 2024-02-16 16:52:21 +01:00
florez_j a2818975b5 Modified to include all relevant inputs to hdf5 file creation for different groups 2024-02-16 16:50:13 +01:00
florez_j a6400b9ac4 Inclided function to copy an entired h5 file in a group. Useful when integrating h5 files into new ones. 2024-02-15 16:01:15 +01:00
florez_j e7bdee21da Refactored to interact with config_file.py, which sets available file readers 2024-02-15 15:59:42 +01:00
florez_j 13416ddeec Added a configuration file to select available group dependent file reader functions. This is to enable modularity and scalability. 2024-02-15 15:57:45 +01:00
florez_j 337a1947fe Reverted a few minor refactoring changes. 2024-02-15 10:10:10 +01:00
florez_j 8ba9547895 Refactored hdf5_lib.py due to previous file move. 2024-02-15 09:59:36 +01:00
florez_j 73dce0a562 Moved smog_chamber_file_reader.py to src folder. 2024-02-15 09:58:50 +01:00
florez_j dfdfea2b71 Created src folder and transfered into it previously deleted python scripts. 2024-02-15 09:52:15 +01:00