|
|
56010f58ad
|
Submitted metadata review.
|
2024-03-27 13:55:39 +01:00 |
|
|
|
819474f678
|
Initialized metadata review process.
|
2024-03-27 13:55:39 +01:00 |
|
|
|
383c5377c1
|
Initialized metadata review process.
|
2024-03-27 13:51:17 +01:00 |
|
|
|
270825e9dc
|
Initialized metadata review process.
|
2024-03-27 11:35:53 +01:00 |
|
|
|
06283e286f
|
Initialized metadata review process.
|
2024-03-26 17:22:42 +01:00 |
|
|
|
2aac145379
|
Removed buggy statement, which was expected to detect recently created review files
|
2024-03-26 16:34:38 +01:00 |
|
|
|
1a89e1af66
|
Implemented script to run metadata review workflow
|
2024-03-26 16:25:44 +01:00 |
|
|
|
302b7dbfa5
|
Implemented metadata review library
|
2024-03-26 16:21:02 +01:00 |
|
|
|
1f2bb419fe
|
Save commit
|
2024-03-26 16:20:04 +01:00 |
|
|
|
f37ba4705a
|
Included .h5 files for now, but they should be enable later on through git LFS.
|
2024-03-26 16:18:48 +01:00 |
|
|
|
a727e38db4
|
Implemented hdf5_vis.py, which is a hdf5 visualization library to obtain treemap and yaml representations of hdf5 files.
|
2024-03-26 16:14:40 +01:00 |
|
|
|
a58bf4f019
|
Refactored import dependencies.
|
2024-03-26 13:57:19 +01:00 |
|
|
|
e934ae65d6
|
Relocated from src/
|
2024-03-25 08:52:13 +01:00 |
|
|
|
1b9963d44d
|
Moved to input_files/
|
2024-03-25 08:51:34 +01:00 |
|
|
|
1bf1f60beb
|
Added lines to treat string attributes as fixed-length strings, which are represented as bytes that need to be decoded with utf-8. There are a few advantages, and hdf5 reader provide more precise behavior than variable length strings
|
2024-03-22 17:28:47 +01:00 |
|
|
|
13cb6395aa
|
Restructured the way table_preamble attribute is represented. Now it is a list of strings as opposed to a multilinear string with special characters like \n. This is to avoid parsing problems in the yalm files.
|
2024-03-22 17:26:30 +01:00 |
|
|
|
fff935f551
|
Included optional argument in make_copy function and commented out a few lines that increase dataset storage complexity.
|
2024-03-21 17:16:14 +01:00 |
|
|
|
4244e39232
|
Implemented hdf5_vis.py to gather functions that display or represent properties of an hdf5 file in a human readable file format like yalm or html files that enble interative visualizations on the browser.
|
2024-03-21 16:30:27 +01:00 |
|
|
|
e389ffbefe
|
Relocated def display_group_hierarchy_on_a_treemap(filename: str) to hdf5_vis.py
|
2024-03-21 16:27:54 +01:00 |
|
|
|
8004a891aa
|
Included lines to work on copies of files, and removed .strip() to create the table preamble because it destroyed txt structure.
|
2024-03-19 14:55:49 +01:00 |
|
|
|
63e7fb28d0
|
Removed the 'backup_' name from the copied file so that the orignal name is preserved in the hdf5 file. The file copy storage location is enough to distinguise it from the original file.
|
2024-03-19 14:07:37 +01:00 |
|
|
|
2d8503ef7a
|
Included make_file_copy function
|
2024-03-19 11:59:39 +01:00 |
|
|
|
2271be6ecc
|
Moved make_file_copy internal function to g5505_utils.py module because it can be reused accross file readers.
|
2024-03-19 11:58:08 +01:00 |
|
|
|
7fe254755f
|
Replaced attributes, previously extracted from the table_preamble in .txt and .dat files with a single dataset attribute called table_preamble that contains the whole table preamble.
|
2024-03-19 11:40:35 +01:00 |
|
|
|
b886066133
|
Simplified code and corrected buggy if statement. Included input verification steps and OS path normalization.
|
2024-03-19 11:11:05 +01:00 |
|
|
|
afa89df143
|
Relocated scripts
|
2024-03-18 13:44:11 +01:00 |
|
|
|
23d0923c93
|
Moved to src/ folder.
|
2024-03-18 13:42:30 +01:00 |
|
|
|
07a532b20b
|
Implemented demos to illustrate functionalities of the openbis_lib.py module.
|
2024-02-21 16:02:09 +01:00 |
|
|
|
bf2c28f843
|
This filed was moved to src folder.
|
2024-02-21 15:58:59 +01:00 |
|
|
|
98682420fe
|
Moved openbis_lib.py to src folder.
|
2024-02-21 15:58:21 +01:00 |
|
|
|
a031a33f4f
|
Included output_files folder for the sake of organization.
|
2024-02-21 15:47:33 +01:00 |
|
|
|
19f7c4a026
|
Updated gitignore with h5 file extension.
|
2024-02-21 15:46:17 +01:00 |
|
|
|
79b7428b9f
|
Cleaned up code by removing commented lines and so on.
|
2024-02-21 10:47:12 +01:00 |
|
|
|
219435511b
|
Changed variable names, rearranged pieces of code, and set up data checks.
|
2024-02-21 10:41:57 +01:00 |
|
|
|
1a4294e0c2
|
Modified to received unified dictionary structure and transform it into equivalent group datasets and attribute structure.
|
2024-02-16 16:52:21 +01:00 |
|
|
|
a2818975b5
|
Modified to include all relevant inputs to hdf5 file creation for different groups
|
2024-02-16 16:50:13 +01:00 |
|
|
|
7ddf9e6c24
|
Solved no module found error by including including the absolute path of src
|
2024-02-16 13:20:36 +01:00 |
|
|
|
1604e8c7ad
|
Removed file, which is now in src folder
|
2024-02-15 16:02:27 +01:00 |
|
|
|
a6400b9ac4
|
Inclided function to copy an entired h5 file in a group. Useful when integrating h5 files into new ones.
|
2024-02-15 16:01:15 +01:00 |
|
|
|
e7bdee21da
|
Refactored to interact with config_file.py, which sets available file readers
|
2024-02-15 15:59:42 +01:00 |
|
|
|
13416ddeec
|
Added a configuration file to select available group dependent file reader functions. This is to enable modularity and scalability.
|
2024-02-15 15:57:45 +01:00 |
|
|
|
337a1947fe
|
Reverted a few minor refactoring changes.
|
2024-02-15 10:10:10 +01:00 |
|
|
|
8ba9547895
|
Refactored hdf5_lib.py due to previous file move.
|
2024-02-15 09:59:36 +01:00 |
|
|
|
73dce0a562
|
Moved smog_chamber_file_reader.py to src folder.
|
2024-02-15 09:58:50 +01:00 |
|
|
|
1ecf57318e
|
Deleted due to changed name to smog_chamber_file_reader.py
|
2024-02-15 09:54:00 +01:00 |
|
|
|
dfdfea2b71
|
Created src folder and transfered into it previously deleted python scripts.
|
2024-02-15 09:52:15 +01:00 |
|
|
|
4433f47505
|
Removed files will be shortly relocated into newly created src folder
|
2024-02-15 09:49:30 +01:00 |
|
|
|
e449021a6d
|
Integrated data and time columns in smps txt files as a single column called Timestamp
|
2024-02-14 09:31:59 +01:00 |
|
|
|
e082e066b1
|
Implemented a file reader module for smog chamber file formats, smog_chamber_group_reader.py. its use is equivalent to that of g5505_file_reader.py, to read file formats of the multiphase chemistry group.
|
2024-02-13 16:44:32 +01:00 |
|
|
|
03dcc62f9a
|
Renamed the main functions for the sake of clarity and transfered a few functions to the g5505_utils.py module.
|
2024-02-13 16:40:52 +01:00 |
|
