|
|
afa89df143
|
Relocated scripts
|
2024-03-18 13:44:11 +01:00 |
|
|
|
23d0923c93
|
Moved to src/ folder.
|
2024-03-18 13:42:30 +01:00 |
|
|
|
07a532b20b
|
Implemented demos to illustrate functionalities of the openbis_lib.py module.
|
2024-02-21 16:02:09 +01:00 |
|
|
|
bf2c28f843
|
This filed was moved to src folder.
|
2024-02-21 15:58:59 +01:00 |
|
|
|
98682420fe
|
Moved openbis_lib.py to src folder.
|
2024-02-21 15:58:21 +01:00 |
|
|
|
a031a33f4f
|
Included output_files folder for the sake of organization.
|
2024-02-21 15:47:33 +01:00 |
|
|
|
19f7c4a026
|
Updated gitignore with h5 file extension.
|
2024-02-21 15:46:17 +01:00 |
|
|
|
79b7428b9f
|
Cleaned up code by removing commented lines and so on.
|
2024-02-21 10:47:12 +01:00 |
|
|
|
219435511b
|
Changed variable names, rearranged pieces of code, and set up data checks.
|
2024-02-21 10:41:57 +01:00 |
|
|
|
1a4294e0c2
|
Modified to received unified dictionary structure and transform it into equivalent group datasets and attribute structure.
|
2024-02-16 16:52:21 +01:00 |
|
|
|
a2818975b5
|
Modified to include all relevant inputs to hdf5 file creation for different groups
|
2024-02-16 16:50:13 +01:00 |
|
|
|
7ddf9e6c24
|
Solved no module found error by including including the absolute path of src
|
2024-02-16 13:20:36 +01:00 |
|
|
|
1604e8c7ad
|
Removed file, which is now in src folder
|
2024-02-15 16:02:27 +01:00 |
|
|
|
a6400b9ac4
|
Inclided function to copy an entired h5 file in a group. Useful when integrating h5 files into new ones.
|
2024-02-15 16:01:15 +01:00 |
|
|
|
e7bdee21da
|
Refactored to interact with config_file.py, which sets available file readers
|
2024-02-15 15:59:42 +01:00 |
|
|
|
13416ddeec
|
Added a configuration file to select available group dependent file reader functions. This is to enable modularity and scalability.
|
2024-02-15 15:57:45 +01:00 |
|
|
|
337a1947fe
|
Reverted a few minor refactoring changes.
|
2024-02-15 10:10:10 +01:00 |
|
|
|
8ba9547895
|
Refactored hdf5_lib.py due to previous file move.
|
2024-02-15 09:59:36 +01:00 |
|
|
|
73dce0a562
|
Moved smog_chamber_file_reader.py to src folder.
|
2024-02-15 09:58:50 +01:00 |
|
|
|
1ecf57318e
|
Deleted due to changed name to smog_chamber_file_reader.py
|
2024-02-15 09:54:00 +01:00 |
|
|
|
dfdfea2b71
|
Created src folder and transfered into it previously deleted python scripts.
|
2024-02-15 09:52:15 +01:00 |
|
|
|
4433f47505
|
Removed files will be shortly relocated into newly created src folder
|
2024-02-15 09:49:30 +01:00 |
|
|
|
e449021a6d
|
Integrated data and time columns in smps txt files as a single column called Timestamp
|
2024-02-14 09:31:59 +01:00 |
|
|
|
e082e066b1
|
Implemented a file reader module for smog chamber file formats, smog_chamber_group_reader.py. its use is equivalent to that of g5505_file_reader.py, to read file formats of the multiphase chemistry group.
|
2024-02-13 16:44:32 +01:00 |
|
|
|
03dcc62f9a
|
Renamed the main functions for the sake of clarity and transfered a few functions to the g5505_utils.py module.
|
2024-02-13 16:40:52 +01:00 |
|
|
|
d62327ba25
|
Created g5505_utils.py module with very specific helper functions of the 5505 group. This is to remove clutter from the main module hdf5_lib.py
|
2024-02-13 16:39:05 +01:00 |
|
|
|
8f757ca68c
|
Implemented filtering mechanishm in function create_hdf5_file_from_filesystem_path, which allows only directory paths containing a key word in include list to be stored in the hdf5 file group structure.
|
2024-02-02 16:30:29 +01:00 |
|
|
|
be43367bc0
|
Updated function create_hdf5_file_from_filesystem_path(ofilename,input_file_system_path), which now can integrate xps ibw files as datasets in the resulting file.
|
2024-02-01 15:29:03 +01:00 |
|
|
|
118191d93a
|
Implemented minor change to output dictionary. keys meant to be dataset's attributes are now access to the key attributes_key, that take the value of a dictionary.
|
2024-02-01 15:26:05 +01:00 |
|
|
|
9a88fbf3ae
|
Implementated module to read file of common types arising in multiphase chemistry group experiments. Status: in progres.
|
2024-01-31 16:47:28 +01:00 |
|
|
|
755d0cbf2e
|
Implemented partially the func create_hdf5_file_from_filesystem_path, which reads a file system path and copies if directory structure in a hdf5 file. Next steps require aligning the structure in the context of our FAIR data file hierarchy and adding data to it. Last commit of the year :). Happy holidays!
|
2023-12-22 15:05:28 +01:00 |
|
|
|
ce0e7e08b1
|
Refined the construct_mask code so that it works with datetime defined intervals.
|
2023-11-09 16:26:54 +01:00 |
|
|
|
bf4fc055a5
|
Implemented module for background estimation
|
2023-11-09 10:17:47 +01:00 |
|
|
|
99a0305472
|
Removed FileList.h5
|
2023-11-03 09:58:01 +01:00 |
|
|
|
ccefbc2501
|
Pushed new FileList_v2.h5
|
2023-11-03 09:57:01 +01:00 |
|
|
|
8730a4d2c8
|
Improved comments
|
2023-11-02 16:11:21 +01:00 |
|
|
|
be1bfc8015
|
Improved comments
|
2023-11-02 16:07:24 +01:00 |
|
|
|
5a156d17a6
|
Refactored according to minor changes performed to the hdf5_lib.py dependency.
|
2023-11-02 15:53:33 +01:00 |
|
|
|
bf4d03f369
|
Added output_files' folder, environment.yml file, and jupyter notebook demo on how to create and visualize hdf5 files.
|
2023-11-02 15:49:35 +01:00 |
|
|
|
25c0f07cc3
|
Implemented 1) function to add metadata to root folder in existing hdf5 file, 2) piece of code to display root folder's metadata on treemap's hoover.
|
2023-11-02 15:46:14 +01:00 |
|
|
|
86be738216
|
Rerun jupyter notebook and updated FileList.h5 and napp_plotlib.py due to changes on code dependencies.
|
2023-10-31 14:33:25 +01:00 |
|
|
|
cc52fafc44
|
Implemented a few new features such as create_group_hierarchy of any depth, get_parent_child_relationships, and display_group_hierarchy_on_a_treemap. Additionally, unified read_hdf5_as_dataframe's and documented it better.
|
2023-10-31 14:30:34 +01:00 |
|
|
|
87b256d93e
|
Updated create_hdf5_file.py with input, enabling either botton-up and top-down construction of group hierarchies. So, far, implementation works for top-down construction where group hierarchies can be of any depth and defined by categorical columns.
|
2023-10-26 14:44:53 +02:00 |
|
|
|
d95a08caaa
|
Implemented partially validation of group hierarchy input param. It needs to be extended to deeper group hierarchies and perhaps output nonconforming lowerlevel groups.
|
2023-10-20 16:56:27 +02:00 |
|
|
|
7eb1686d1f
|
Modified creat_hdf5_file to admit group_by_list of functions that will be used to create group hierarchy.
|
2023-10-19 16:57:33 +02:00 |
|
|
|
7ff1d8d09b
|
Implemented package to interface openbis with python and upload hdf5 file data from Thorsten data into openbis.
|
2023-10-18 17:00:01 +02:00 |
|
|
|
54ac1d5463
|
Modified to find input data inside newly added input_files folder.
|
2023-10-10 09:02:45 +02:00 |
|
|
|
0248ca3c6e
|
Added a new function read_hdf5_as_dataframe_v2 which supports hdf5 files without datasets and replaced the dataframe construction procedure to a column wise basis.
|
2023-10-10 09:00:41 +02:00 |
|
|
|
d42ddd6ff0
|
Removed Filelist.h5, which is now relocated in input_files folder
|
2023-10-10 08:52:32 +02:00 |
|
|
|
736f0ba915
|
Added folders input_files and logs to store input data (hdf5 files) and resulting logs.
|
2023-10-10 08:51:10 +02:00 |
|
