Commit Graph

248 Commits

Author SHA1 Message Date
44a696e52f Change submodule url from gitlab to gitea 2025-05-26 13:18:51 +02:00
989e99078a Merge branch 'main' of https://gitlab.psi.ch/apog/acsmnode
This updates todo.md
2025-05-26 13:12:52 +02:00
52fdb7a8ad Fix number of variables by subtracting one. Start_time is now excluded from count. 2025-05-26 13:12:40 +02:00
e8327f7bd7 Merge branch 'changes/leila' into 'main'
Changes/leila

See merge request apog/acsmnode!7
2025-05-26 13:09:55 +02:00
f8ee5b1ce4 Added a todo 2025-05-26 11:59:56 +02:00
e22321f823 Updated to do list 2025-05-21 18:59:19 +02:00
7a0ce95848 Changed the originator address 2025-05-21 17:22:09 +02:00
f7e1c31550 added len(interpolated_cpc) 2025-05-21 16:35:50 +02:00
a7faf69c96 Changed missing value code generator, any number greater than the largest possible one that can be represented in terms of 9s is capped 2025-05-21 15:17:25 +02:00
ce776610f6 Add new step to remove inletP or in general a column from nas file 2025-05-21 09:49:05 +02:00
e39c23bbad Update generate_flags.py to skip checking for cpc flags when not available 2025-05-21 09:48:19 +02:00
01769f10e0 Implement new step to remove column from already created nas file. 2025-05-21 09:43:36 +02:00
f880b0f1ba Updated dima to latest version 2025-05-21 09:27:50 +02:00
e87ff83c66 Merge branch 'leila_more_modifications' into 'main'
Changed name of originator and submitter in file campaignDescriptor.yaml

See merge request apog/acsmnode!6
2025-05-21 09:22:43 +02:00
c181e7abad Update file campaignDescriptor.yaml 2025-05-20 17:32:43 +02:00
727256cb46 Merge branch 'leila_modifications' into 'main'
Added limits on y axis for flags visualization

See merge request apog/acsmnode!5
2025-05-20 17:28:45 +02:00
a9461cb1aa Added limits on y axis for flags visualization 2025-05-20 16:27:11 +02:00
e4d87080bc Enable all flaggs for use in flagging app and display them in order according to their ranking (see app/flags/ebas_dict.yaml) 2025-05-19 17:10:16 +02:00
ccd4740dba Merge branch 'todos_update' into 'main'
Todos update

See merge request apog/acsmnode!4
2025-05-16 14:31:48 +02:00
cc1b445d38 Implement binary flags for visualization purposes, and fix bug with cpc flags. 2025-05-16 14:22:17 +02:00
78d5c22dc3 Flag from diagnostics (456) should override other flags like CPC (652, 460) 2025-05-15 16:03:08 +02:00
58d7b425aa Add generate cpc flags pipelines/steps/generate_flags.py 2025-05-15 15:01:11 +02:00
23ee4c412b Update dima to latest version 2025-05-15 14:58:24 +02:00
9915538442 Update dima submodule to point to dima remote on Gitea.psi.ch 2025-05-14 10:15:37 +02:00
fb3e3904bd Remove defaults channel from conda source channels 2025-05-13 12:50:33 +02:00
37671a3685 update pipelines/steps/visualize_datatable_vars.py with interactive plots and refactor dependent jupyter nb accordingly 2025-05-13 11:32:46 +02:00
e152c9eefd Update file TODO.md 2025-05-12 14:38:39 +02:00
0e642d4b9b Update file TODO.md 2025-05-08 11:19:59 +02:00
1c0a4631aa Update file TODO.md 2025-05-08 09:20:06 +02:00
ae107acea8 Update file TODO.md 2025-04-11 14:54:35 +02:00
5a54a22ebd Update after run with PAY dataset. 2025-04-11 11:31:35 +02:00
0353c8492b Added data chain step. This step updates the current parameters with new input folder params 2025-04-11 11:23:04 +02:00
4408514439 Rename attribute station --> station_abbr 2025-04-11 11:20:48 +02:00
e7863078aa Add data chain step /update_datachain_params.py. This uses params specified in input data folder to update current data chain params 2025-04-11 11:07:52 +02:00
cea83396d2 Add function to estimate project directory path 2025-04-11 11:05:41 +02:00
68a7d5dc2b Fix out of bound error in pipelines/steps/visualize_datatable_vars.py 2025-04-11 11:04:00 +02:00
c9e25c2483 Add new placeholder for submitter name and remove metadata element 'station' conflicting with third party converter 2025-04-11 11:02:38 +02:00
13bcd88a93 Replace station attribute with station_abbr, so it does not conflict with ebas database naming 2025-04-11 10:41:05 +02:00
6c8cb61df2 I added some todos 2025-04-10 16:51:46 +02:00
b0b3ccef66 Update campaignDescriptor.yaml with originator and submitter info 2025-04-08 21:27:51 +02:00
4725d85e61 Update data chain notebook 2025-04-08 21:26:36 +02:00
881209bf82 Update steps to allow filenames for PAYERN station 2025-04-08 21:26:01 +02:00
3dfed2c5f3 Update pipelines/steps/prepare_ebas_submission.py. Rmoved hard coded paths and build output name using metadata from campaign descriptor. Also, we can now specify month ranges 2025-04-08 18:44:46 +02:00
5dd280e88c Update pipelines/steps/utils.py. Now we can load the campaign descriptor using load_project_yaml_files() 2025-04-08 18:43:01 +02:00
bfaaeb4416 Add header templates for JFJ and PAY 2025-04-08 18:35:44 +02:00
ca0366338a Add pipeline step to update actris_header with submitter and originator 2025-04-08 18:34:51 +02:00
0e625b558a Update third party submodule 2025-04-08 15:46:18 +02:00
00a85505c8 Fix bug when infering name of flags file from dataset name 2025-04-04 16:53:41 +02:00
dcf6b8ec41 Clean up and document steps in notebooks/demo_visualize_diagnostic_flags_from_hdf5_file.ipynb 2025-04-04 16:07:07 +02:00
d290daaa39 Update pipelines/steps/visualize_datatable_vars.py. Specify alternative path to flags in case they are not in the HDF5 file. We assume there is an append directory where they may be. Otherwise it throws and error. 2025-04-04 16:06:11 +02:00