Commit Graph

263 Commits

Author SHA1 Message Date
4244e39232 Implemented hdf5_vis.py to gather functions that display or represent properties of an hdf5 file in a human readable file format like yalm or html files that enble interative visualizations on the browser. 2024-03-21 16:30:27 +01:00
e389ffbefe Relocated def display_group_hierarchy_on_a_treemap(filename: str) to hdf5_vis.py 2024-03-21 16:27:54 +01:00
8004a891aa Included lines to work on copies of files, and removed .strip() to create the table preamble because it destroyed txt structure. 2024-03-19 14:55:49 +01:00
63e7fb28d0 Removed the 'backup_' name from the copied file so that the orignal name is preserved in the hdf5 file. The file copy storage location is enough to distinguise it from the original file. 2024-03-19 14:07:37 +01:00
2d8503ef7a Included make_file_copy function 2024-03-19 11:59:39 +01:00
2271be6ecc Moved make_file_copy internal function to g5505_utils.py module because it can be reused accross file readers. 2024-03-19 11:58:08 +01:00
7fe254755f Replaced attributes, previously extracted from the table_preamble in .txt and .dat files with a single dataset attribute called table_preamble that contains the whole table preamble. 2024-03-19 11:40:35 +01:00
b886066133 Simplified code and corrected buggy if statement. Included input verification steps and OS path normalization. 2024-03-19 11:11:05 +01:00
afa89df143 Relocated scripts 2024-03-18 13:44:11 +01:00
23d0923c93 Moved to src/ folder. 2024-03-18 13:42:30 +01:00
07a532b20b Implemented demos to illustrate functionalities of the openbis_lib.py module. 2024-02-21 16:02:09 +01:00
bf2c28f843 This filed was moved to src folder. 2024-02-21 15:58:59 +01:00
98682420fe Moved openbis_lib.py to src folder. 2024-02-21 15:58:21 +01:00
a031a33f4f Included output_files folder for the sake of organization. 2024-02-21 15:47:33 +01:00
19f7c4a026 Updated gitignore with h5 file extension. 2024-02-21 15:46:17 +01:00
79b7428b9f Cleaned up code by removing commented lines and so on. 2024-02-21 10:47:12 +01:00
219435511b Changed variable names, rearranged pieces of code, and set up data checks. 2024-02-21 10:41:57 +01:00
1a4294e0c2 Modified to received unified dictionary structure and transform it into equivalent group datasets and attribute structure. 2024-02-16 16:52:21 +01:00
a2818975b5 Modified to include all relevant inputs to hdf5 file creation for different groups 2024-02-16 16:50:13 +01:00
7ddf9e6c24 Solved no module found error by including including the absolute path of src 2024-02-16 13:20:36 +01:00
1604e8c7ad Removed file, which is now in src folder 2024-02-15 16:02:27 +01:00
a6400b9ac4 Inclided function to copy an entired h5 file in a group. Useful when integrating h5 files into new ones. 2024-02-15 16:01:15 +01:00
e7bdee21da Refactored to interact with config_file.py, which sets available file readers 2024-02-15 15:59:42 +01:00
13416ddeec Added a configuration file to select available group dependent file reader functions. This is to enable modularity and scalability. 2024-02-15 15:57:45 +01:00
337a1947fe Reverted a few minor refactoring changes. 2024-02-15 10:10:10 +01:00
8ba9547895 Refactored hdf5_lib.py due to previous file move. 2024-02-15 09:59:36 +01:00
73dce0a562 Moved smog_chamber_file_reader.py to src folder. 2024-02-15 09:58:50 +01:00
1ecf57318e Deleted due to changed name to smog_chamber_file_reader.py 2024-02-15 09:54:00 +01:00
dfdfea2b71 Created src folder and transfered into it previously deleted python scripts. 2024-02-15 09:52:15 +01:00
4433f47505 Removed files will be shortly relocated into newly created src folder 2024-02-15 09:49:30 +01:00
e449021a6d Integrated data and time columns in smps txt files as a single column called Timestamp 2024-02-14 09:31:59 +01:00
e082e066b1 Implemented a file reader module for smog chamber file formats, smog_chamber_group_reader.py. its use is equivalent to that of g5505_file_reader.py, to read file formats of the multiphase chemistry group. 2024-02-13 16:44:32 +01:00
03dcc62f9a Renamed the main functions for the sake of clarity and transfered a few functions to the g5505_utils.py module. 2024-02-13 16:40:52 +01:00
d62327ba25 Created g5505_utils.py module with very specific helper functions of the 5505 group. This is to remove clutter from the main module hdf5_lib.py 2024-02-13 16:39:05 +01:00
8f757ca68c Implemented filtering mechanishm in function create_hdf5_file_from_filesystem_path, which allows only directory paths containing a key word in include list to be stored in the hdf5 file group structure. 2024-02-02 16:30:29 +01:00
be43367bc0 Updated function create_hdf5_file_from_filesystem_path(ofilename,input_file_system_path), which now can integrate xps ibw files as datasets in the resulting file. 2024-02-01 15:29:03 +01:00
118191d93a Implemented minor change to output dictionary. keys meant to be dataset's attributes are now access to the key attributes_key, that take the value of a dictionary. 2024-02-01 15:26:05 +01:00
9a88fbf3ae Implementated module to read file of common types arising in multiphase chemistry group experiments. Status: in progres. 2024-01-31 16:47:28 +01:00
755d0cbf2e Implemented partially the func create_hdf5_file_from_filesystem_path, which reads a file system path and copies if directory structure in a hdf5 file. Next steps require aligning the structure in the context of our FAIR data file hierarchy and adding data to it. Last commit of the year :). Happy holidays! 2023-12-22 15:05:28 +01:00
ce0e7e08b1 Refined the construct_mask code so that it works with datetime defined intervals. 2023-11-09 16:26:54 +01:00
bf4fc055a5 Implemented module for background estimation 2023-11-09 10:17:47 +01:00
99a0305472 Removed FileList.h5 2023-11-03 09:58:01 +01:00
ccefbc2501 Pushed new FileList_v2.h5 2023-11-03 09:57:01 +01:00
8730a4d2c8 Improved comments 2023-11-02 16:11:21 +01:00
be1bfc8015 Improved comments 2023-11-02 16:07:24 +01:00
5a156d17a6 Refactored according to minor changes performed to the hdf5_lib.py dependency. 2023-11-02 15:53:33 +01:00
bf4d03f369 Added output_files' folder, environment.yml file, and jupyter notebook demo on how to create and visualize hdf5 files. 2023-11-02 15:49:35 +01:00
25c0f07cc3 Implemented 1) function to add metadata to root folder in existing hdf5 file, 2) piece of code to display root folder's metadata on treemap's hoover. 2023-11-02 15:46:14 +01:00
86be738216 Rerun jupyter notebook and updated FileList.h5 and napp_plotlib.py due to changes on code dependencies. 2023-10-31 14:33:25 +01:00
cc52fafc44 Implemented a few new features such as create_group_hierarchy of any depth, get_parent_child_relationships, and display_group_hierarchy_on_a_treemap. Additionally, unified read_hdf5_as_dataframe's and documented it better. 2023-10-31 14:30:34 +01:00