|
|
a7faf69c96
|
Changed missing value code generator, any number greater than the largest possible one that can be represented in terms of 9s is capped
|
2025-05-21 15:17:25 +02:00 |
|
|
|
ce776610f6
|
Add new step to remove inletP or in general a column from nas file
|
2025-05-21 09:49:05 +02:00 |
|
|
|
e39c23bbad
|
Update generate_flags.py to skip checking for cpc flags when not available
|
2025-05-21 09:48:19 +02:00 |
|
|
|
01769f10e0
|
Implement new step to remove column from already created nas file.
|
2025-05-21 09:43:36 +02:00 |
|
|
|
f880b0f1ba
|
Updated dima to latest version
|
2025-05-21 09:27:50 +02:00 |
|
|
|
e87ff83c66
|
Merge branch 'leila_more_modifications' into 'main'
Changed name of originator and submitter in file campaignDescriptor.yaml
See merge request apog/acsmnode!6
|
2025-05-21 09:22:43 +02:00 |
|
|
|
c181e7abad
|
Update file campaignDescriptor.yaml
|
2025-05-20 17:32:43 +02:00 |
|
|
|
727256cb46
|
Merge branch 'leila_modifications' into 'main'
Added limits on y axis for flags visualization
See merge request apog/acsmnode!5
|
2025-05-20 17:28:45 +02:00 |
|
|
|
a9461cb1aa
|
Added limits on y axis for flags visualization
|
2025-05-20 16:27:11 +02:00 |
|
|
|
e4d87080bc
|
Enable all flaggs for use in flagging app and display them in order according to their ranking (see app/flags/ebas_dict.yaml)
|
2025-05-19 17:10:16 +02:00 |
|
|
|
ccd4740dba
|
Merge branch 'todos_update' into 'main'
Todos update
See merge request apog/acsmnode!4
|
2025-05-16 14:31:48 +02:00 |
|
|
|
cc1b445d38
|
Implement binary flags for visualization purposes, and fix bug with cpc flags.
|
2025-05-16 14:22:17 +02:00 |
|
|
|
78d5c22dc3
|
Flag from diagnostics (456) should override other flags like CPC (652, 460)
|
2025-05-15 16:03:08 +02:00 |
|
|
|
58d7b425aa
|
Add generate cpc flags pipelines/steps/generate_flags.py
|
2025-05-15 15:01:11 +02:00 |
|
|
|
23ee4c412b
|
Update dima to latest version
|
2025-05-15 14:58:24 +02:00 |
|
|
|
9915538442
|
Update dima submodule to point to dima remote on Gitea.psi.ch
|
2025-05-14 10:15:37 +02:00 |
|
|
|
fb3e3904bd
|
Remove defaults channel from conda source channels
|
2025-05-13 12:50:33 +02:00 |
|
|
|
37671a3685
|
update pipelines/steps/visualize_datatable_vars.py with interactive plots and refactor dependent jupyter nb accordingly
|
2025-05-13 11:32:46 +02:00 |
|
|
|
e152c9eefd
|
Update file TODO.md
|
2025-05-12 14:38:39 +02:00 |
|
|
|
0e642d4b9b
|
Update file TODO.md
|
2025-05-08 11:19:59 +02:00 |
|
|
|
1c0a4631aa
|
Update file TODO.md
|
2025-05-08 09:20:06 +02:00 |
|
|
|
ae107acea8
|
Update file TODO.md
|
2025-04-11 14:54:35 +02:00 |
|
|
|
5a54a22ebd
|
Update after run with PAY dataset.
|
2025-04-11 11:31:35 +02:00 |
|
|
|
0353c8492b
|
Added data chain step. This step updates the current parameters with new input folder params
|
2025-04-11 11:23:04 +02:00 |
|
|
|
4408514439
|
Rename attribute station --> station_abbr
|
2025-04-11 11:20:48 +02:00 |
|
|
|
e7863078aa
|
Add data chain step /update_datachain_params.py. This uses params specified in input data folder to update current data chain params
|
2025-04-11 11:07:52 +02:00 |
|
|
|
cea83396d2
|
Add function to estimate project directory path
|
2025-04-11 11:05:41 +02:00 |
|
|
|
68a7d5dc2b
|
Fix out of bound error in pipelines/steps/visualize_datatable_vars.py
|
2025-04-11 11:04:00 +02:00 |
|
|
|
c9e25c2483
|
Add new placeholder for submitter name and remove metadata element 'station' conflicting with third party converter
|
2025-04-11 11:02:38 +02:00 |
|
|
|
13bcd88a93
|
Replace station attribute with station_abbr, so it does not conflict with ebas database naming
|
2025-04-11 10:41:05 +02:00 |
|
|
|
6c8cb61df2
|
I added some todos
|
2025-04-10 16:51:46 +02:00 |
|
|
|
b0b3ccef66
|
Update campaignDescriptor.yaml with originator and submitter info
|
2025-04-08 21:27:51 +02:00 |
|
|
|
4725d85e61
|
Update data chain notebook
|
2025-04-08 21:26:36 +02:00 |
|
|
|
881209bf82
|
Update steps to allow filenames for PAYERN station
|
2025-04-08 21:26:01 +02:00 |
|
|
|
3dfed2c5f3
|
Update pipelines/steps/prepare_ebas_submission.py. Rmoved hard coded paths and build output name using metadata from campaign descriptor. Also, we can now specify month ranges
|
2025-04-08 18:44:46 +02:00 |
|
|
|
5dd280e88c
|
Update pipelines/steps/utils.py. Now we can load the campaign descriptor using load_project_yaml_files()
|
2025-04-08 18:43:01 +02:00 |
|
|
|
bfaaeb4416
|
Add header templates for JFJ and PAY
|
2025-04-08 18:35:44 +02:00 |
|
|
|
ca0366338a
|
Add pipeline step to update actris_header with submitter and originator
|
2025-04-08 18:34:51 +02:00 |
|
|
|
0e625b558a
|
Update third party submodule
|
2025-04-08 15:46:18 +02:00 |
|
|
|
00a85505c8
|
Fix bug when infering name of flags file from dataset name
|
2025-04-04 16:53:41 +02:00 |
|
|
|
dcf6b8ec41
|
Clean up and document steps in notebooks/demo_visualize_diagnostic_flags_from_hdf5_file.ipynb
|
2025-04-04 16:07:07 +02:00 |
|
|
|
d290daaa39
|
Update pipelines/steps/visualize_datatable_vars.py. Specify alternative path to flags in case they are not in the HDF5 file. We assume there is an append directory where they may be. Otherwise it throws and error.
|
2025-04-04 16:06:11 +02:00 |
|
|
|
b3b5516aed
|
Fix typo in README.md
|
2025-04-04 09:46:36 +02:00 |
|
|
|
17f497f1c5
|
Update README.md with instructions to set up network drive access credentials and update TODO.md
|
2025-04-02 14:40:55 +02:00 |
|
|
|
9a23bf283a
|
Fix output directory in campaignDescripor.yaml
|
2025-04-02 14:17:45 +02:00 |
|
|
|
73c0409207
|
Update README.md with instruction to build, run, and stop docker container on which the data chain will run
|
2025-04-02 14:10:52 +02:00 |
|
|
|
73648ebe31
|
Update Dockerfile and docker-compose.yaml. By default, container can use cifs to map network drives so no need to install, and added bash command to docker compose file to run both jupyterlab and dash board simultanously
|
2025-04-02 14:09:44 +02:00 |
|
|
|
c6b010702c
|
Remove run_container.sh. This is now done by running the docker-compose.yaml file using docker
|
2025-04-02 11:27:42 +02:00 |
|
|
|
643a305782
|
Update ACSM data chain workflow with markdown descriptions
|
2025-04-02 11:26:03 +02:00 |
|
|
|
f0da41e914
|
Add docker-compose.yaml to replace run_container.sh
|
2025-04-02 11:17:20 +02:00 |
|
