Commit Graph

157 Commits

Author SHA1 Message Date
c2343afe38 Submitted metadata review. 2024-04-25 09:00:26 +02:00
3c6440977f Implemented delete attribute feature and corrected yaml display of compound attributes 2024-04-25 08:58:29 +02:00
4f15c3b684 Submitted metadata review. 2024-04-24 18:18:54 +02:00
f55431064e Initialized metadata review. 2024-04-24 18:12:21 +02:00
4663ed10e2 Fixed branch naming problem 2024-04-24 17:21:44 +02:00
cf2431d4c3 Included created_at() function 2024-04-24 17:16:59 +02:00
508266132e Deleted config_file.py 2024-04-24 17:16:30 +02:00
be02ad01ed Removed problematic lines, which depended on soon to be removed dependency config_file.py 2024-04-24 17:14:13 +02:00
6260e7da3c Redefined name of review branch as review:<review's name> 2024-04-24 17:09:38 +02:00
c64cad6779 Removed this workflow because it is redundant. Replaced this with active creation of review branch in gitlab 2024-04-24 17:05:25 +02:00
d26c6d3b5a Cleared out jupyter notebooks 2024-04-24 17:03:37 +02:00
a9146e5afc Implemented delete attribute feature for review and simplified code. 2024-04-24 17:02:18 +02:00
ec5703bcaa Editted documentation 2024-04-23 14:19:42 +02:00
e959538d99 Performed minor edits 2024-04-23 14:07:16 +02:00
2845b4c8ab Performed minor edits 2024-04-23 13:53:17 +02:00
ceb8a34ee0 Commented out no needed python import statements 2024-04-23 13:23:13 +02:00
129443d6d9 Updated python libraries and intallation instructions. 2024-04-23 13:20:42 +02:00
8876d5af4f Example data integretion configuration files 2024-04-23 12:03:24 +02:00
f65abda6d1 jupyter notebook to run data integration workflow 2024-04-23 11:11:13 +02:00
a12cd80355 Implemented function that takes yaml config files specifying data integration output 2024-04-23 11:10:13 +02:00
b233dc094d yaml intrument configuration file for text data 2024-04-23 11:07:49 +02:00
d3ec0bd473 Included additional directory path validation based on dir keywords 2024-04-23 11:05:20 +02:00
9d9e9dcfe5 Added lines to parse instrument reader properties from yaml file. 2024-04-23 11:02:10 +02:00
074d2e3954 Removed config_file output file naming and instead user now inputs desired output filename. Also added input argument to introduce root level metadata. 2024-04-18 19:14:06 +02:00
1ed37920c2 Replaced git commands in terms of subprocess.run 2024-04-17 15:26:45 +02:00
a1c88fdb5a Added lines to flatten (shorten) original directory paths in the resulting hdf5 file. 2024-04-17 15:20:26 +02:00
8005b60579 Included a boolean input argument hdf5_upload to deactivate hdf5 upload for testing. 2024-04-07 17:09:01 +02:00
edd1bbf5be Added an import and treemap to png statemets, but for some reason didnot work, and took forever to run. So, I left the lines but for now commented them out. 2024-04-07 16:55:37 +02:00
89e94a1b2b Renamed forth_submit_.. function to last_submit .. 2024-04-05 17:21:18 +02:00
5e70d9158b Deleted function third_complete_metadata_review() because forth_complete_metadata_review() is the same. Also, modified a substring of their name from complete to submit and submit to save for clarity. Usually submission is the last step of a review process. 2024-04-05 17:10:34 +02:00
d68dc98070 Implemented some safeguards that enable only commits of untracked metadata review files 2024-04-04 14:20:13 +02:00
d6ee987859 Submitted metadata review. 2024-04-04 14:07:54 +02:00
12b3accad9 Initialized metadata review. 2024-04-04 14:06:21 +02:00
e9578a775a Submitted metadata review. 2024-04-04 13:23:52 +02:00
7a39c49931 Initialized metadata review. 2024-04-04 13:16:33 +02:00
5839c0f466 Resolved incoming changes from main branch 2024-04-04 13:07:43 +02:00
44d4a7b29b .ipybn 2024-04-04 13:00:56 +02:00
dd1f1245e3 Refactored comment lines. 2024-04-04 12:58:17 +02:00
2d5fecfb34 Removed git checkout statements, to avoid conflicting changes of .ipybn files. 2024-04-04 12:56:37 +02:00
96c68f7614 Added .ipynb files to gitignore 2024-04-04 11:18:07 +02:00
fa4fe691d0 Refactored a few git statemets in terms of subprocess.run 2024-04-04 11:02:24 +02:00
48d3b8f492 Submitted previous deletes to clean working directory tree 2024-04-04 10:58:16 +02:00
811a4a0615 Initialized metadata review process. 2024-04-04 09:51:39 +02:00
a2e6d823ce Submitted previous deletes to clean working directory tree 2024-04-04 09:40:24 +02:00
0417ac6deb Modified hdf5 file path whose metadata is to be reviewed. 2024-04-04 09:31:19 +02:00
dee204010d Initialized metadata review process. 2024-04-04 09:23:55 +02:00
72e37ed277 Implemented jupyter notebooks for metadata review workflow excecution. 2024-04-04 09:18:36 +02:00
719e9d6672 Repurposed the role of the config_file.py. Now it only provides functions to select the file_readers based on group id and produce a created_at timestamp. 2024-04-03 13:55:54 +02:00
5cd19979b6 Implemented first approach to data integration workflow 2024-04-03 13:51:21 +02:00
f9b31c06fd Reimplemented file filtering, first file extension contraints are imposed and then file keyword contraints. 2024-04-03 13:49:16 +02:00