Commit Graph

347 Commits

Author SHA1 Message Date
18165eca1a Modified import statements to account for reader module's relocation. 2024-08-23 13:27:26 +02:00
15b76f7704 Fixed a few import dependencies after relocating this file. 2024-08-23 10:57:13 +02:00
a0f44a1f4b Moved src/g5505_file_reader.py -> instruments/readers/g5505_file_reader.py to increase modularity with respect to new intrument additions. 2024-08-23 10:11:29 +02:00
1112a214e9 Moved src/g5505_utils.py to utils/g5505_utils.py 2024-08-23 07:27:39 +02:00
d7fc38abd9 Moved get_parent_relationships func into hdf5_vis.py and cleaned up unused import statements 2024-08-22 09:50:26 +02:00
05d1133e32 Moved get_parent_child_relationships() funct from hdf5_lib.py tinto hdf5_vis.py to avoid circular dependency between the lower level and higher level module. Thus removed also src.hdf5_lib.py import statement. 2024-08-22 09:47:57 +02:00
d7c7808400 Implemented method for appending new attributes to an specific object. 2024-08-16 09:32:58 +02:00
bb250e9940 Implemented method to reformat a given column in a datatable holding datetime info into a desired datetime format. During data integration this will serve to normalize datatime formats across data tables 2024-08-16 08:08:28 +02:00
062a688f47 Added method to reformat columns containing datetime byte strings into a desired datetime formated object 2024-08-14 16:22:28 +02:00
5124df14d8 Changed link to descriptions according to new instrument folder location. 2024-08-12 13:40:43 +02:00
c876e925a7 Modified code to point to new instrument folders location. Also, upgrated code to accept either a user specified location or the default location 2024-08-12 13:40:01 +02:00
7f0e5384ea Moved instruments folder outside src/. 2024-08-12 10:09:21 +02:00
18aba8d0d3 Implemented dataset append method in HDF5DatOpsAPI 2024-08-09 15:25:09 +02:00
5fe7fc4b70 Developed a class to manage data operations on a given hdf5 file 2024-08-09 13:23:54 +02:00
8f7f14ab68 Removed time stamp configuration attributes from ACSM_TOFWARE, because it can be messy for a configuration file. 2024-08-08 11:24:41 +02:00
74db800e01 Updated file with new instrument configuration ACSM. 2024-08-07 16:38:52 +02:00
ae1e3bfc23 Moved ext_to_reader_dict to g5505_file_reader.py and replaced redear selection based on g5505_reader.select_file_reader(hdf5_file_path). 2024-08-07 16:30:36 +02:00
4e669b3eee Moved hdf5_file_path to file reader mapping and extension definitions to g5505_file_reader_module.py. Created functions to compute file_reader key from path to file in the hdf5 file and select the reader based on the key. This should enable more modular file reader selection. 2024-08-07 16:21:22 +02:00
3430627494 Modified reader to output table_preamble as a dataset as opposed to attributes of the file. I believe this is better for readability of the metadata given that those preambles can sometimes contain large ammounts of text. 2024-08-02 14:37:06 +02:00
4e584b9d90 Modified .yaml config files to satisty metadata naming expectations. 2024-07-17 08:50:24 +02:00
938e8e50a1 Changed names of expected root level metadata attributes. 2024-07-17 08:48:47 +02:00
a06e28291c Added attribution insertion order tracking at the root level and reorganized a few import statements. 2024-07-17 08:41:40 +02:00
2ebe5f3220 Made edits to documentation 2024-07-11 13:42:38 +02:00
f04f5eaaf9 Robustified column name to description assigment, however it may be a bit slower than before. 2024-07-10 13:31:47 +02:00
5c6fcabf91 Updated the yaml instrument descriptions. 2024-07-10 13:29:14 +02:00
73beb83278 Moved parse_attribute() from ..review_lib.py into ...utils.py and backpropagate (refactored) changes to respective modules. 2024-07-10 11:32:00 +02:00
2ce925735d Modified return datetime output to a format without colons, which could be problematic for filenaming. 2024-07-10 09:47:56 +02:00
0a0b4ac41d Moved a few functions from ...reader.py and hdf5_lib.py into ..utils.py, and refactored accordingly. 2024-07-10 09:19:30 +02:00
0c74c52e09 Removed smogchamber reader because its funtionality is now integrated into g5505_file_reader.py. 2024-07-09 16:13:01 +02:00
afc6c93823 Removed non utilized code. 2024-07-08 15:29:13 +02:00
cb7d914908 Cleaned code and modified def create_hdf5_file_from_dataframe to create group hierichy implicitly from path rather than recursively. 2024-07-08 15:24:48 +02:00
92eca4d79e Moved remaining git operations in metadata_review_lib.py to git_ops.py and refactored accoringly 2024-07-05 15:46:20 +02:00
77386432f8 Merge branch 'main' of https://gitlab.psi.ch/5505/dima 2024-07-02 16:50:08 +02:00
177a5aa2a1 Updated documentation. 2024-07-02 16:49:48 +02:00
ca8570b3b0 Merge branch 'main' of https://gitlab.psi.ch/5505/dima 2024-07-01 16:20:06 +02:00
ba6d89d8e1 Modified created at function to output date time and time zone 2024-07-01 16:19:28 +02:00
c074e45892 Renamed script_name to processing_file. 2024-07-01 16:17:25 +02:00
b816e62f3b Made a few edits. 2024-06-21 15:55:44 +02:00
db199f81e0 Merge branch 'main' of https://gitlab.psi.ch/5505/dima 2024-06-21 15:42:46 +02:00
6d6caf96db Cleared out outputs. 2024-06-21 15:42:23 +02:00
5ab775ecac Added a few root level metadata names and definitions 2024-06-21 15:40:38 +02:00
cedfe614e7 Implemented input argument to enable append information to exisintg attributes, which must take the values of either strings or lists. 2024-06-20 15:32:33 +02:00
106795ae59 Added a few lines to detect the existence of the file and change the file mode from 'w' to 'a' based on that information. 2024-06-20 09:03:47 +02:00
498a51cbc6 Updated function to add project level metadata at the root group of the hdf5 file. 2024-06-19 18:31:11 +02:00
06c5c6d84b Incorporated method to MetadataHarvester class to collect project level metadata. 2024-06-19 18:30:02 +02:00
04558e7785 Added code to parse dict attributes. 2024-06-18 14:42:51 +02:00
a6868d985d Fixed bug regarding datetime to str column conversion in dataframe by using .map(srt) (element wise operation) as opposed to .apply(str) 2024-06-18 09:21:46 +02:00
b66dc11a62 Replaced applymap to .apply because the former is being depricated 2024-06-17 13:47:54 +02:00
ed1641af55 Created function to save dataframes with annotations in hdf5 format 2024-06-17 13:36:05 +02:00
0eba80db41 Added metadata printer method and rewrote slightly a few class terms. 2024-06-17 08:44:44 +02:00