290 Commits

Author SHA1 Message Date
e24d451542 Updated thirdparty submodule to latest version 2025-02-22 15:02:17 +01:00
456f4c297f Adjust code due to changes in flag definition location. 2025-02-20 17:28:43 +01:00
60e1c35745 Move flag definitions from ...utils.py to flags/ebas_flags.yaml 2025-02-20 17:26:50 +01:00
dc34e07f62 Add actris_acsm_converter as a third_party submodule 2025-02-20 16:07:47 +01:00
ae15333207 Update layout figure 2025-02-17 15:46:40 +01:00
de33977e71 Start restructuring of app to make it more modular, and improve layout a bit 2025-02-17 15:44:51 +01:00
0454b54b8c Fix bug: When flag folder empty, it now returns [] (as opposed to None) 2025-02-17 15:42:57 +01:00
0911260f26 Save changes. 2025-02-15 18:20:58 +01:00
25f3ee12a4 Fix bug. Saved flags from apps were not associated with right parent variable. 2025-02-15 18:10:29 +01:00
46767996b8 Modify experimental campaign descriptor to point to yearly acsm_tofware data. 2025-02-15 18:08:14 +01:00
a516479036 Change data lineage format. Now, data lineage information is accessed using name of the file as key. 2025-02-15 17:57:50 +01:00
3123fec9da Add new version of dash board graphical user interphase 2025-02-13 19:59:20 +01:00
10fdd1b8c7 Fix bug when saving flags to flagsFolder and subsequent visualization of existing flags. 2025-02-13 19:58:30 +01:00
e53d8dec8c Simplify load_flags() function by removing redundant h5 verification step 2025-02-13 19:56:44 +01:00
11ecdebf1b Move flagging app to app folder with initialized callbacks/ and components/ modules 2025-02-13 18:13:45 +01:00
479c11d0d4 Move app scripts to app folder. This is to improve modularity of the app 2025-02-13 18:03:41 +01:00
1a86dc2065 Implement instrument, file, and variable selection dropdown menus. 2025-02-13 17:56:08 +01:00
79f9badb1c Update dima submodule to latest version. 2025-02-11 13:16:14 +01:00
f2d46101b1 Add demo jupyter notebook to visualize variables and their associated flags 2025-02-11 13:15:19 +01:00
ca08044569 Update keys of data_lineage_metadata.yaml. keys are now the filenames in the folder. 2025-02-11 13:14:14 +01:00
80fbe3af91 Update params/validity_thresholds.yaml with values from 2024 JFJ ACSM data 2025-02-11 13:12:00 +01:00
0623c2462b Adjust command line interface of steps/apply_... and steps/compute_aut... 2025-02-11 13:07:29 +01:00
f2854d4ca0 Implement pipelines/steps/visualize_datatable_vars.py 2025-02-11 13:03:46 +01:00
e7ad4d2a36 Add new demo for acsm pipeline and clearout the other notebooks 2025-02-10 16:15:56 +01:00
3c482c1d21 Rename and move jupyter notebook demos to notebooks folder 2025-02-10 16:14:49 +01:00
b966151d9c Update with template for compute_cpc_flags(). This still needs to be completed. 2025-02-10 10:54:18 +01:00
ca2b8b6787 Rename apply_diagnostic_flags.py to compute_automated_flags.py because the function also computes both cpc and diagnostic based flags 2025-02-10 10:45:55 +01:00
e2958b608f Update dima to latest version 2025-02-08 14:52:27 +01:00
d93003f5c4 Add import statement and adjust dependencies. 2025-02-06 16:57:46 +01:00
ad95d11a0d Implement utils module for reusable functions across steps in the pipelines 2025-02-06 16:54:36 +01:00
6ed9fe1eb1 Rename pipeline step to apply_diagnositc_flags, it perform a check based on specified thresholds and then assigns I, V, or M labels producing a labeling of a variable. 2025-02-06 16:25:40 +01:00
f8b900422b Rename function 2025-02-06 16:15:19 +01:00
5e979b4e5e Update dima submodule to latest version 2025-02-06 16:08:35 +01:00
2c2b154528 Update to account for yaml file attribute renamings. 2025-02-05 18:15:43 +01:00
e2b5aa9d69 Update file structure to depend on calibration_parameters.yaml and update thresholds for JFJ/ACSM_TOFWARE/2024 data. 2025-02-05 17:05:07 +01:00
afd6ef4d1b Fix typo in denominators. 2025-02-05 16:49:36 +01:00
bc779bd583 Update calibration parameters for JFJ/ACSM_TOFWARE/2024 data. 2025-02-05 16:48:14 +01:00
48e2127fef Reimplement apply_calibration_factors() in terms of load_calibration_file() and compute_calibration_factors() to reduce complexity and improve modularity. 2025-02-04 18:12:42 +01:00
d4681b32ca Update dima to latest version 2025-02-04 16:50:37 +01:00
a5a9fa9c3f Add anchor to default params from tofware and use alias to complete interval specific params coming from time period specific calibrations 2025-02-04 14:31:42 +01:00
484eb1ae2c Change path to file to be relative with respect to project directory path. 2025-02-03 16:13:19 +01:00
caa40304c5 Fix typo 2025-02-03 16:11:32 +01:00
baf755cebd Move params defined in calibration_factors.yaml to a file calibration_params.yaml to decouple user-input from low-level pipeline parameters. 2025-02-03 11:53:20 +01:00
fba121cf5c Remove anchors and replace aliases with the name of the keyword they refer to. Example, keyword : keyword_anchor value, *keyword_anchor replaced as keyword. 2025-02-03 11:28:57 +01:00
713a4c4fe7 Add calibration intevals keyword, which enables adding calibration parameters for specific time intervals. The calibration function is actually a piecewise function, where each piece uses a different set of calibration params. 2025-02-03 10:54:16 +01:00
49237198f3 Reconfigure dima's url to https://gitlab.psi.ch/5505-public/dima.git. 2025-02-03 10:44:13 +01:00
714f693512 Update dima to latest version. 2025-02-03 10:37:19 +01:00
da7f3fa2db Update to latest version. 2025-02-03 10:33:15 +01:00
c4706e2f3a rename file and add flow_ref parameter to it 2025-01-31 10:03:34 +01:00
bad191637b Move flow_ref paramter to operational_var_range.yaml (soon to be called validity_threshold.s) 2025-01-31 10:00:51 +01:00