Commit Graph

15 Commits

Author SHA1 Message Date
993db5d783 Optimzed and included df to np structured array conversion. \n-Replaced loop plus append with list comprehension. \n-Replaced pd df column concatenation based on row-wise concatenation with df.aggr() method that uses column wise concatenation. 2024-05-23 22:18:37 +02:00
83de18989f Added feature to interpret links to description in the yaml intrument configuration file and added them at the dataset level as attributes. 2024-05-09 19:17:08 +02:00
67765d53f0 Incorparated feature to merge data and time data which may originally be in separate columns in text source files. This is specified in the text source specification yaml file 2024-04-30 14:50:33 +02:00
9d9e9dcfe5 Added lines to parse instrument reader properties from yaml file. 2024-04-23 11:02:10 +02:00
9071120e50 Refactored code to read .dat and .txt files in binary mode first rb, then the prespecified encoding is used to decode the lines. This is to have more control over the decoding process and be able to better spot possible encoding errors. 2024-04-02 18:35:04 +02:00
6fb5253d21 Corrected a few bugs; deletion of useless buggy line and configuration of text reader with latin-1 encoding for a few cases. 2024-03-28 18:20:57 +01:00
a58bf4f019 Refactored import dependencies. 2024-03-26 13:57:19 +01:00
13cb6395aa Restructured the way table_preamble attribute is represented. Now it is a list of strings as opposed to a multilinear string with special characters like \n. This is to avoid parsing problems in the yalm files. 2024-03-22 17:26:30 +01:00
fff935f551 Included optional argument in make_copy function and commented out a few lines that increase dataset storage complexity. 2024-03-21 17:16:14 +01:00
8004a891aa Included lines to work on copies of files, and removed .strip() to create the table preamble because it destroyed txt structure. 2024-03-19 14:55:49 +01:00
2271be6ecc Moved make_file_copy internal function to g5505_utils.py module because it can be reused accross file readers. 2024-03-19 11:58:08 +01:00
7fe254755f Replaced attributes, previously extracted from the table_preamble in .txt and .dat files with a single dataset attribute called table_preamble that contains the whole table preamble. 2024-03-19 11:40:35 +01:00
219435511b Changed variable names, rearranged pieces of code, and set up data checks. 2024-02-21 10:41:57 +01:00
a6400b9ac4 Inclided function to copy an entired h5 file in a group. Useful when integrating h5 files into new ones. 2024-02-15 16:01:15 +01:00
dfdfea2b71 Created src folder and transfered into it previously deleted python scripts. 2024-02-15 09:52:15 +01:00