|
|
34fb1be71f
|
updated readme and reader to handle ignore ascii character errors
|
2024-05-24 15:55:15 +02:00 |
|
|
|
7633816c23
|
Deleted output no longer returned in data integration pipeline
|
2024-05-24 14:55:08 +02:00 |
|
|
|
55d3a2c92b
|
Updated readme file
|
2024-05-24 11:56:30 +02:00 |
|
|
|
8315f8991b
|
Updated configuration file organization and workflow description.
|
2024-05-24 11:15:05 +02:00 |
|
|
|
8cff0d6f74
|
Commented out openia python module.
|
2024-05-24 10:54:15 +02:00 |
|
|
|
e278cde961
|
Added bottom level instrument metadata descriptions such as units and description.
|
2024-05-24 09:50:25 +02:00 |
|
|
|
1c39986503
|
Removed yaml file output from data integration file. The creation of this file is being outsource to data store repo
|
2024-05-24 09:32:30 +02:00 |
|
|
|
292708e745
|
Removed creation of yaml file subsequent to data integration. This can cause misalignment with data store. I think the yaml snapshot of a hdf5 file should therefore be outsourced there.
|
2024-05-24 09:30:24 +02:00 |
|
|
|
c4f12eaa84
|
Made a few optimizations to code and documentation. Expressions relying on list comprehensions were simplified with generator expressions. ex,: any([keyword in filename for keyword in select_file_keywords]) was simplified to any(keyword in filename for keyword in select_file_keywords).
|
2024-05-24 09:06:07 +02:00 |
|
|
|
9c311342d8
|
Replaced attribute table_header in Lopap configuration file with a shorter version which is consistent accross more files. Some of the headers might change.
|
2024-05-24 08:55:36 +02:00 |
|
|
|
67a52ab00a
|
Optimzed and included df to np structured array conversion. \n-Replaced loop plus append with list comprehension. \n-Replaced pd df column concatenation based on row-wise concatenation with df.aggr() method that uses column wise concatenation.
|
2024-05-23 22:20:19 +02:00 |
|
|
|
993db5d783
|
Optimzed and included df to np structured array conversion. \n-Replaced loop plus append with list comprehension. \n-Replaced pd df column concatenation based on row-wise concatenation with df.aggr() method that uses column wise concatenation.
|
2024-05-23 22:18:37 +02:00 |
|
|
|
e4b9487575
|
Replaced commented lines by accurate comments
|
2024-05-22 20:15:17 +02:00 |
|
|
|
7c1c0bf33c
|
Simplified code by updating HDF5 attributes using .update() dict method (inherited from dict type).
|
2024-05-22 20:11:54 +02:00 |
|
|
|
83de18989f
|
Added feature to interpret links to description in the yaml intrument configuration file and added them at the dataset level as attributes.
|
2024-05-09 19:17:08 +02:00 |
|
|
|
e8a13dba20
|
Added link to descriptions and units of table variables/or columns. These can be used as attributes of datasets from tabular data
|
2024-05-09 19:15:20 +02:00 |
|
|
|
6d1b7545e5
|
Included timestamp specification, which indicates column names in a list that contain datetime information.
|
2024-04-30 14:51:58 +02:00 |
|
|
|
67765d53f0
|
Incorparated feature to merge data and time data which may originally be in separate columns in text source files. This is specified in the text source specification yaml file
|
2024-04-30 14:50:33 +02:00 |
|
|
|
fee72bbda6
|
Performed edits to README.md
|
2024-04-26 14:33:41 +02:00 |
|
|
|
faef7db666
|
Updated readme file with instructions on how to set compound attributes and delete them.
|
2024-04-26 14:27:01 +02:00 |
|
|
|
7441d63cd3
|
Removed unecessary pygit depenedency and associated function that relied on it.
|
2024-04-26 13:15:33 +02:00 |
|
|
|
b344a4045f
|
Cleared out jupyter notebook.
|
2024-04-26 13:09:41 +02:00 |
|
|
|
9552bfead2
|
Included new delete attribute and restart review features.
|
2024-04-26 13:08:27 +02:00 |
|
|
|
94d717f9db
|
Corrected parsing problem from hdf5 to yaml attribute. Single element arrays are now represented as a scalar as opposed to a list with a single element.
|
2024-04-26 12:54:41 +02:00 |
|
|
|
5c4be34ac2
|
Updated hdf5 file with yaml review file.
|
2024-04-26 11:30:09 +02:00 |
|
|
|
9e951c051c
|
Submitted metadata review.
|
2024-04-26 11:30:05 +02:00 |
|
|
|
1975cde356
|
Updated hdf5 file with yaml review file.
|
2024-04-26 11:28:58 +02:00 |
|
|
|
08a64eb354
|
Updated hdf5 file with yaml review file.
|
2024-04-26 11:07:58 +02:00 |
|
|
|
1bfa19c63f
|
Submitted metadata review.
|
2024-04-26 11:07:42 +02:00 |
|
|
|
70ccc9e56d
|
Initialized metadata review.
|
2024-04-26 10:56:32 +02:00 |
|
|
|
657269a2ef
|
Updated hdf5 file with yaml review file.
|
2024-04-25 16:56:12 +02:00 |
|
|
|
63b102bae9
|
Submitted metadata review.
|
2024-04-25 16:56:06 +02:00 |
|
|
|
e8409389da
|
Updated hdf5 file with yaml review file.
|
2024-04-25 16:49:51 +02:00 |
|
|
|
d0c0014a7d
|
Submitted metadata review.
|
2024-04-25 16:47:44 +02:00 |
|
|
|
08bf5bc27f
|
Initialized metadata review.
|
2024-04-25 16:45:20 +02:00 |
|
|
|
836fe45fa0
|
Submitted metadata review.
|
2024-04-25 16:31:15 +02:00 |
|
|
|
8303f2948f
|
Submitted metadata review.
|
2024-04-25 14:39:38 +02:00 |
|
|
|
56ccd681ba
|
Submitted metadata review.
|
2024-04-25 13:25:14 +02:00 |
|
|
|
f7c410a0ac
|
Submitted metadata review.
|
2024-04-25 13:20:22 +02:00 |
|
|
|
162d0be274
|
Merge branch 'review_ThorstenBR'
|
2024-04-25 09:06:03 +02:00 |
|
|
|
c2343afe38
|
Submitted metadata review.
|
2024-04-25 09:00:26 +02:00 |
|
|
|
3c6440977f
|
Implemented delete attribute feature and corrected yaml display of compound attributes
|
2024-04-25 08:58:29 +02:00 |
|
|
|
4f15c3b684
|
Submitted metadata review.
|
2024-04-24 18:18:54 +02:00 |
|
|
|
f55431064e
|
Initialized metadata review.
|
2024-04-24 18:12:21 +02:00 |
|
|
|
6869d799cd
|
Simplified branch naming
|
2024-04-24 17:26:08 +02:00 |
|
|
|
4663ed10e2
|
Fixed branch naming problem
|
2024-04-24 17:21:44 +02:00 |
|
|
|
cf2431d4c3
|
Included created_at() function
|
2024-04-24 17:16:59 +02:00 |
|
|
|
508266132e
|
Deleted config_file.py
|
2024-04-24 17:16:30 +02:00 |
|
|
|
be02ad01ed
|
Removed problematic lines, which depended on soon to be removed dependency config_file.py
|
2024-04-24 17:14:13 +02:00 |
|
|
|
6260e7da3c
|
Redefined name of review branch as review:<review's name>
|
2024-04-24 17:09:38 +02:00 |
|
