Commit Graph

248 Commits

Author SHA1 Message Date
florez_j 44a696e52f Change submodule url from gitlab to gitea 2025-05-26 13:18:51 +02:00
florez_j 989e99078a Merge branch 'main' of https://gitlab.psi.ch/apog/acsmnode
This updates todo.md
2025-05-26 13:12:52 +02:00
florez_j 52fdb7a8ad Fix number of variables by subtracting one. Start_time is now excluded from count. 2025-05-26 13:12:40 +02:00
florez_j e8327f7bd7 Merge branch 'changes/leila' into 'main'
Changes/leila

See merge request apog/acsmnode!7
2025-05-26 13:09:55 +02:00
simon_l f8ee5b1ce4 Added a todo 2025-05-26 11:59:56 +02:00
simon_l e22321f823 Updated to do list 2025-05-21 18:59:19 +02:00
simon_l 7a0ce95848 Changed the originator address 2025-05-21 17:22:09 +02:00
simon_l f7e1c31550 added len(interpolated_cpc) 2025-05-21 16:35:50 +02:00
florez_j a7faf69c96 Changed missing value code generator, any number greater than the largest possible one that can be represented in terms of 9s is capped 2025-05-21 15:17:25 +02:00
florez_j ce776610f6 Add new step to remove inletP or in general a column from nas file 2025-05-21 09:49:05 +02:00
florez_j e39c23bbad Update generate_flags.py to skip checking for cpc flags when not available 2025-05-21 09:48:19 +02:00
florez_j 01769f10e0 Implement new step to remove column from already created nas file. 2025-05-21 09:43:36 +02:00
florez_j f880b0f1ba Updated dima to latest version 2025-05-21 09:27:50 +02:00
florez_j e87ff83c66 Merge branch 'leila_more_modifications' into 'main'
Changed name of originator and submitter in file campaignDescriptor.yaml

See merge request apog/acsmnode!6
2025-05-21 09:22:43 +02:00
simon_l c181e7abad Update file campaignDescriptor.yaml 2025-05-20 17:32:43 +02:00
florez_j 727256cb46 Merge branch 'leila_modifications' into 'main'
Added limits on y axis for flags visualization

See merge request apog/acsmnode!5
2025-05-20 17:28:45 +02:00
simon_l a9461cb1aa Added limits on y axis for flags visualization 2025-05-20 16:27:11 +02:00
florez_j e4d87080bc Enable all flaggs for use in flagging app and display them in order according to their ranking (see app/flags/ebas_dict.yaml) 2025-05-19 17:10:16 +02:00
florez_j ccd4740dba Merge branch 'todos_update' into 'main'
Todos update

See merge request apog/acsmnode!4
2025-05-16 14:31:48 +02:00
florez_j cc1b445d38 Implement binary flags for visualization purposes, and fix bug with cpc flags. 2025-05-16 14:22:17 +02:00
simon_l 78d5c22dc3 Flag from diagnostics (456) should override other flags like CPC (652, 460) 2025-05-15 16:03:08 +02:00
florez_j 58d7b425aa Add generate cpc flags pipelines/steps/generate_flags.py 2025-05-15 15:01:11 +02:00
florez_j 23ee4c412b Update dima to latest version 2025-05-15 14:58:24 +02:00
florez_j 9915538442 Update dima submodule to point to dima remote on Gitea.psi.ch 2025-05-14 10:15:37 +02:00
florez_j fb3e3904bd Remove defaults channel from conda source channels 2025-05-13 12:50:33 +02:00
florez_j 37671a3685 update pipelines/steps/visualize_datatable_vars.py with interactive plots and refactor dependent jupyter nb accordingly 2025-05-13 11:32:46 +02:00
simon_l e152c9eefd Update file TODO.md 2025-05-12 14:38:39 +02:00
simon_l 0e642d4b9b Update file TODO.md 2025-05-08 11:19:59 +02:00
simon_l 1c0a4631aa Update file TODO.md 2025-05-08 09:20:06 +02:00
simon_l ae107acea8 Update file TODO.md 2025-04-11 14:54:35 +02:00
florez_j 5a54a22ebd Update after run with PAY dataset. 2025-04-11 11:31:35 +02:00
florez_j 0353c8492b Added data chain step. This step updates the current parameters with new input folder params 2025-04-11 11:23:04 +02:00
florez_j 4408514439 Rename attribute station --> station_abbr 2025-04-11 11:20:48 +02:00
florez_j e7863078aa Add data chain step /update_datachain_params.py. This uses params specified in input data folder to update current data chain params 2025-04-11 11:07:52 +02:00
florez_j cea83396d2 Add function to estimate project directory path 2025-04-11 11:05:41 +02:00
florez_j 68a7d5dc2b Fix out of bound error in pipelines/steps/visualize_datatable_vars.py 2025-04-11 11:04:00 +02:00
florez_j c9e25c2483 Add new placeholder for submitter name and remove metadata element 'station' conflicting with third party converter 2025-04-11 11:02:38 +02:00
florez_j 13bcd88a93 Replace station attribute with station_abbr, so it does not conflict with ebas database naming 2025-04-11 10:41:05 +02:00
simon_l 6c8cb61df2 I added some todos 2025-04-10 16:51:46 +02:00
florez_j b0b3ccef66 Update campaignDescriptor.yaml with originator and submitter info 2025-04-08 21:27:51 +02:00
florez_j 4725d85e61 Update data chain notebook 2025-04-08 21:26:36 +02:00
florez_j 881209bf82 Update steps to allow filenames for PAYERN station 2025-04-08 21:26:01 +02:00
florez_j 3dfed2c5f3 Update pipelines/steps/prepare_ebas_submission.py. Rmoved hard coded paths and build output name using metadata from campaign descriptor. Also, we can now specify month ranges 2025-04-08 18:44:46 +02:00
florez_j 5dd280e88c Update pipelines/steps/utils.py. Now we can load the campaign descriptor using load_project_yaml_files() 2025-04-08 18:43:01 +02:00
florez_j bfaaeb4416 Add header templates for JFJ and PAY 2025-04-08 18:35:44 +02:00
florez_j ca0366338a Add pipeline step to update actris_header with submitter and originator 2025-04-08 18:34:51 +02:00
florez_j 0e625b558a Update third party submodule 2025-04-08 15:46:18 +02:00
florez_j 00a85505c8 Fix bug when infering name of flags file from dataset name 2025-04-04 16:53:41 +02:00
florez_j dcf6b8ec41 Clean up and document steps in notebooks/demo_visualize_diagnostic_flags_from_hdf5_file.ipynb 2025-04-04 16:07:07 +02:00
florez_j d290daaa39 Update pipelines/steps/visualize_datatable_vars.py. Specify alternative path to flags in case they are not in the HDF5 file. We assume there is an append directory where they may be. Otherwise it throws and error. 2025-04-04 16:06:11 +02:00