|
|
f37ba4705a
|
Included .h5 files for now, but they should be enable later on through git LFS.
|
2024-03-26 16:18:48 +01:00 |
|
|
|
a727e38db4
|
Implemented hdf5_vis.py, which is a hdf5 visualization library to obtain treemap and yaml representations of hdf5 files.
|
2024-03-26 16:14:40 +01:00 |
|
|
|
a58bf4f019
|
Refactored import dependencies.
|
2024-03-26 13:57:19 +01:00 |
|
|
|
e934ae65d6
|
Relocated from src/
|
2024-03-25 08:52:13 +01:00 |
|
|
|
1b9963d44d
|
Moved to input_files/
|
2024-03-25 08:51:34 +01:00 |
|
|
|
1bf1f60beb
|
Added lines to treat string attributes as fixed-length strings, which are represented as bytes that need to be decoded with utf-8. There are a few advantages, and hdf5 reader provide more precise behavior than variable length strings
|
2024-03-22 17:28:47 +01:00 |
|
|
|
13cb6395aa
|
Restructured the way table_preamble attribute is represented. Now it is a list of strings as opposed to a multilinear string with special characters like \n. This is to avoid parsing problems in the yalm files.
|
2024-03-22 17:26:30 +01:00 |
|
|
|
fff935f551
|
Included optional argument in make_copy function and commented out a few lines that increase dataset storage complexity.
|
2024-03-21 17:16:14 +01:00 |
|
|
|
4244e39232
|
Implemented hdf5_vis.py to gather functions that display or represent properties of an hdf5 file in a human readable file format like yalm or html files that enble interative visualizations on the browser.
|
2024-03-21 16:30:27 +01:00 |
|
|
|
e389ffbefe
|
Relocated def display_group_hierarchy_on_a_treemap(filename: str) to hdf5_vis.py
|
2024-03-21 16:27:54 +01:00 |
|
|
|
8004a891aa
|
Included lines to work on copies of files, and removed .strip() to create the table preamble because it destroyed txt structure.
|
2024-03-19 14:55:49 +01:00 |
|
|
|
63e7fb28d0
|
Removed the 'backup_' name from the copied file so that the orignal name is preserved in the hdf5 file. The file copy storage location is enough to distinguise it from the original file.
|
2024-03-19 14:07:37 +01:00 |
|
|
|
2d8503ef7a
|
Included make_file_copy function
|
2024-03-19 11:59:39 +01:00 |
|
|
|
2271be6ecc
|
Moved make_file_copy internal function to g5505_utils.py module because it can be reused accross file readers.
|
2024-03-19 11:58:08 +01:00 |
|
|
|
7fe254755f
|
Replaced attributes, previously extracted from the table_preamble in .txt and .dat files with a single dataset attribute called table_preamble that contains the whole table preamble.
|
2024-03-19 11:40:35 +01:00 |
|
|
|
b886066133
|
Simplified code and corrected buggy if statement. Included input verification steps and OS path normalization.
|
2024-03-19 11:11:05 +01:00 |
|
|
|
afa89df143
|
Relocated scripts
|
2024-03-18 13:44:11 +01:00 |
|
|
|
23d0923c93
|
Moved to src/ folder.
|
2024-03-18 13:42:30 +01:00 |
|
|
|
07a532b20b
|
Implemented demos to illustrate functionalities of the openbis_lib.py module.
|
2024-02-21 16:02:09 +01:00 |
|
|
|
bf2c28f843
|
This filed was moved to src folder.
|
2024-02-21 15:58:59 +01:00 |
|
|
|
98682420fe
|
Moved openbis_lib.py to src folder.
|
2024-02-21 15:58:21 +01:00 |
|
|
|
a031a33f4f
|
Included output_files folder for the sake of organization.
|
2024-02-21 15:47:33 +01:00 |
|
|
|
19f7c4a026
|
Updated gitignore with h5 file extension.
|
2024-02-21 15:46:17 +01:00 |
|
|
|
79b7428b9f
|
Cleaned up code by removing commented lines and so on.
|
2024-02-21 10:47:12 +01:00 |
|
|
|
219435511b
|
Changed variable names, rearranged pieces of code, and set up data checks.
|
2024-02-21 10:41:57 +01:00 |
|
|
|
1a4294e0c2
|
Modified to received unified dictionary structure and transform it into equivalent group datasets and attribute structure.
|
2024-02-16 16:52:21 +01:00 |
|
|
|
a2818975b5
|
Modified to include all relevant inputs to hdf5 file creation for different groups
|
2024-02-16 16:50:13 +01:00 |
|
|
|
7ddf9e6c24
|
Solved no module found error by including including the absolute path of src
|
2024-02-16 13:20:36 +01:00 |
|
|
|
1604e8c7ad
|
Removed file, which is now in src folder
|
2024-02-15 16:02:27 +01:00 |
|
|
|
a6400b9ac4
|
Inclided function to copy an entired h5 file in a group. Useful when integrating h5 files into new ones.
|
2024-02-15 16:01:15 +01:00 |
|
|
|
e7bdee21da
|
Refactored to interact with config_file.py, which sets available file readers
|
2024-02-15 15:59:42 +01:00 |
|
|
|
13416ddeec
|
Added a configuration file to select available group dependent file reader functions. This is to enable modularity and scalability.
|
2024-02-15 15:57:45 +01:00 |
|
|
|
337a1947fe
|
Reverted a few minor refactoring changes.
|
2024-02-15 10:10:10 +01:00 |
|
|
|
8ba9547895
|
Refactored hdf5_lib.py due to previous file move.
|
2024-02-15 09:59:36 +01:00 |
|
|
|
73dce0a562
|
Moved smog_chamber_file_reader.py to src folder.
|
2024-02-15 09:58:50 +01:00 |
|
|
|
1ecf57318e
|
Deleted due to changed name to smog_chamber_file_reader.py
|
2024-02-15 09:54:00 +01:00 |
|
|
|
dfdfea2b71
|
Created src folder and transfered into it previously deleted python scripts.
|
2024-02-15 09:52:15 +01:00 |
|
|
|
4433f47505
|
Removed files will be shortly relocated into newly created src folder
|
2024-02-15 09:49:30 +01:00 |
|
|
|
e449021a6d
|
Integrated data and time columns in smps txt files as a single column called Timestamp
|
2024-02-14 09:31:59 +01:00 |
|
|
|
e082e066b1
|
Implemented a file reader module for smog chamber file formats, smog_chamber_group_reader.py. its use is equivalent to that of g5505_file_reader.py, to read file formats of the multiphase chemistry group.
|
2024-02-13 16:44:32 +01:00 |
|
|
|
03dcc62f9a
|
Renamed the main functions for the sake of clarity and transfered a few functions to the g5505_utils.py module.
|
2024-02-13 16:40:52 +01:00 |
|
|
|
d62327ba25
|
Created g5505_utils.py module with very specific helper functions of the 5505 group. This is to remove clutter from the main module hdf5_lib.py
|
2024-02-13 16:39:05 +01:00 |
|
|
|
8f757ca68c
|
Implemented filtering mechanishm in function create_hdf5_file_from_filesystem_path, which allows only directory paths containing a key word in include list to be stored in the hdf5 file group structure.
|
2024-02-02 16:30:29 +01:00 |
|
|
|
be43367bc0
|
Updated function create_hdf5_file_from_filesystem_path(ofilename,input_file_system_path), which now can integrate xps ibw files as datasets in the resulting file.
|
2024-02-01 15:29:03 +01:00 |
|
|
|
118191d93a
|
Implemented minor change to output dictionary. keys meant to be dataset's attributes are now access to the key attributes_key, that take the value of a dictionary.
|
2024-02-01 15:26:05 +01:00 |
|
|
|
9a88fbf3ae
|
Implementated module to read file of common types arising in multiphase chemistry group experiments. Status: in progres.
|
2024-01-31 16:47:28 +01:00 |
|
|
|
755d0cbf2e
|
Implemented partially the func create_hdf5_file_from_filesystem_path, which reads a file system path and copies if directory structure in a hdf5 file. Next steps require aligning the structure in the context of our FAIR data file hierarchy and adding data to it. Last commit of the year :). Happy holidays!
|
2023-12-22 15:05:28 +01:00 |
|
|
|
ce0e7e08b1
|
Refined the construct_mask code so that it works with datetime defined intervals.
|
2023-11-09 16:26:54 +01:00 |
|
|
|
bf4fc055a5
|
Implemented module for background estimation
|
2023-11-09 10:17:47 +01:00 |
|
|
|
99a0305472
|
Removed FileList.h5
|
2023-11-03 09:58:01 +01:00 |
|
