|
|
8004a891aa
|
Included lines to work on copies of files, and removed .strip() to create the table preamble because it destroyed txt structure.
|
2024-03-19 14:55:49 +01:00 |
|
|
|
63e7fb28d0
|
Removed the 'backup_' name from the copied file so that the orignal name is preserved in the hdf5 file. The file copy storage location is enough to distinguise it from the original file.
|
2024-03-19 14:07:37 +01:00 |
|
|
|
2d8503ef7a
|
Included make_file_copy function
|
2024-03-19 11:59:39 +01:00 |
|
|
|
2271be6ecc
|
Moved make_file_copy internal function to g5505_utils.py module because it can be reused accross file readers.
|
2024-03-19 11:58:08 +01:00 |
|
|
|
7fe254755f
|
Replaced attributes, previously extracted from the table_preamble in .txt and .dat files with a single dataset attribute called table_preamble that contains the whole table preamble.
|
2024-03-19 11:40:35 +01:00 |
|
|
|
b886066133
|
Simplified code and corrected buggy if statement. Included input verification steps and OS path normalization.
|
2024-03-19 11:11:05 +01:00 |
|
|
|
afa89df143
|
Relocated scripts
|
2024-03-18 13:44:11 +01:00 |
|
|
|
23d0923c93
|
Moved to src/ folder.
|
2024-03-18 13:42:30 +01:00 |
|
|
|
07a532b20b
|
Implemented demos to illustrate functionalities of the openbis_lib.py module.
|
2024-02-21 16:02:09 +01:00 |
|
|
|
bf2c28f843
|
This filed was moved to src folder.
|
2024-02-21 15:58:59 +01:00 |
|
|
|
98682420fe
|
Moved openbis_lib.py to src folder.
|
2024-02-21 15:58:21 +01:00 |
|
|
|
a031a33f4f
|
Included output_files folder for the sake of organization.
|
2024-02-21 15:47:33 +01:00 |
|
|
|
19f7c4a026
|
Updated gitignore with h5 file extension.
|
2024-02-21 15:46:17 +01:00 |
|
|
|
79b7428b9f
|
Cleaned up code by removing commented lines and so on.
|
2024-02-21 10:47:12 +01:00 |
|
|
|
219435511b
|
Changed variable names, rearranged pieces of code, and set up data checks.
|
2024-02-21 10:41:57 +01:00 |
|
|
|
1a4294e0c2
|
Modified to received unified dictionary structure and transform it into equivalent group datasets and attribute structure.
|
2024-02-16 16:52:21 +01:00 |
|
|
|
a2818975b5
|
Modified to include all relevant inputs to hdf5 file creation for different groups
|
2024-02-16 16:50:13 +01:00 |
|
|
|
7ddf9e6c24
|
Solved no module found error by including including the absolute path of src
|
2024-02-16 13:20:36 +01:00 |
|
|
|
1604e8c7ad
|
Removed file, which is now in src folder
|
2024-02-15 16:02:27 +01:00 |
|
|
|
a6400b9ac4
|
Inclided function to copy an entired h5 file in a group. Useful when integrating h5 files into new ones.
|
2024-02-15 16:01:15 +01:00 |
|
|
|
e7bdee21da
|
Refactored to interact with config_file.py, which sets available file readers
|
2024-02-15 15:59:42 +01:00 |
|
|
|
13416ddeec
|
Added a configuration file to select available group dependent file reader functions. This is to enable modularity and scalability.
|
2024-02-15 15:57:45 +01:00 |
|
|
|
337a1947fe
|
Reverted a few minor refactoring changes.
|
2024-02-15 10:10:10 +01:00 |
|
|
|
8ba9547895
|
Refactored hdf5_lib.py due to previous file move.
|
2024-02-15 09:59:36 +01:00 |
|
|
|
73dce0a562
|
Moved smog_chamber_file_reader.py to src folder.
|
2024-02-15 09:58:50 +01:00 |
|
|
|
1ecf57318e
|
Deleted due to changed name to smog_chamber_file_reader.py
|
2024-02-15 09:54:00 +01:00 |
|
|
|
dfdfea2b71
|
Created src folder and transfered into it previously deleted python scripts.
|
2024-02-15 09:52:15 +01:00 |
|
|
|
4433f47505
|
Removed files will be shortly relocated into newly created src folder
|
2024-02-15 09:49:30 +01:00 |
|
|
|
e449021a6d
|
Integrated data and time columns in smps txt files as a single column called Timestamp
|
2024-02-14 09:31:59 +01:00 |
|
|
|
e082e066b1
|
Implemented a file reader module for smog chamber file formats, smog_chamber_group_reader.py. its use is equivalent to that of g5505_file_reader.py, to read file formats of the multiphase chemistry group.
|
2024-02-13 16:44:32 +01:00 |
|
|
|
03dcc62f9a
|
Renamed the main functions for the sake of clarity and transfered a few functions to the g5505_utils.py module.
|
2024-02-13 16:40:52 +01:00 |
|
|
|
d62327ba25
|
Created g5505_utils.py module with very specific helper functions of the 5505 group. This is to remove clutter from the main module hdf5_lib.py
|
2024-02-13 16:39:05 +01:00 |
|
|
|
8f757ca68c
|
Implemented filtering mechanishm in function create_hdf5_file_from_filesystem_path, which allows only directory paths containing a key word in include list to be stored in the hdf5 file group structure.
|
2024-02-02 16:30:29 +01:00 |
|
|
|
be43367bc0
|
Updated function create_hdf5_file_from_filesystem_path(ofilename,input_file_system_path), which now can integrate xps ibw files as datasets in the resulting file.
|
2024-02-01 15:29:03 +01:00 |
|
|
|
118191d93a
|
Implemented minor change to output dictionary. keys meant to be dataset's attributes are now access to the key attributes_key, that take the value of a dictionary.
|
2024-02-01 15:26:05 +01:00 |
|
|
|
9a88fbf3ae
|
Implementated module to read file of common types arising in multiphase chemistry group experiments. Status: in progres.
|
2024-01-31 16:47:28 +01:00 |
|
|
|
755d0cbf2e
|
Implemented partially the func create_hdf5_file_from_filesystem_path, which reads a file system path and copies if directory structure in a hdf5 file. Next steps require aligning the structure in the context of our FAIR data file hierarchy and adding data to it. Last commit of the year :). Happy holidays!
|
2023-12-22 15:05:28 +01:00 |
|
|
|
ce0e7e08b1
|
Refined the construct_mask code so that it works with datetime defined intervals.
|
2023-11-09 16:26:54 +01:00 |
|
|
|
bf4fc055a5
|
Implemented module for background estimation
|
2023-11-09 10:17:47 +01:00 |
|
|
|
99a0305472
|
Removed FileList.h5
|
2023-11-03 09:58:01 +01:00 |
|
|
|
ccefbc2501
|
Pushed new FileList_v2.h5
|
2023-11-03 09:57:01 +01:00 |
|
|
|
8730a4d2c8
|
Improved comments
|
2023-11-02 16:11:21 +01:00 |
|
|
|
be1bfc8015
|
Improved comments
|
2023-11-02 16:07:24 +01:00 |
|
|
|
5a156d17a6
|
Refactored according to minor changes performed to the hdf5_lib.py dependency.
|
2023-11-02 15:53:33 +01:00 |
|
|
|
bf4d03f369
|
Added output_files' folder, environment.yml file, and jupyter notebook demo on how to create and visualize hdf5 files.
|
2023-11-02 15:49:35 +01:00 |
|
|
|
25c0f07cc3
|
Implemented 1) function to add metadata to root folder in existing hdf5 file, 2) piece of code to display root folder's metadata on treemap's hoover.
|
2023-11-02 15:46:14 +01:00 |
|
|
|
86be738216
|
Rerun jupyter notebook and updated FileList.h5 and napp_plotlib.py due to changes on code dependencies.
|
2023-10-31 14:33:25 +01:00 |
|
|
|
cc52fafc44
|
Implemented a few new features such as create_group_hierarchy of any depth, get_parent_child_relationships, and display_group_hierarchy_on_a_treemap. Additionally, unified read_hdf5_as_dataframe's and documented it better.
|
2023-10-31 14:30:34 +01:00 |
|
|
|
87b256d93e
|
Updated create_hdf5_file.py with input, enabling either botton-up and top-down construction of group hierarchies. So, far, implementation works for top-down construction where group hierarchies can be of any depth and defined by categorical columns.
|
2023-10-26 14:44:53 +02:00 |
|
|
|
d95a08caaa
|
Implemented partially validation of group hierarchy input param. It needs to be extended to deeper group hierarchies and perhaps output nonconforming lowerlevel groups.
|
2023-10-20 16:56:27 +02:00 |
|
