Commit Graph

272 Commits

Author SHA1 Message Date
bb9625cd34 update notebooks after running them with 2024 pay data 2025-06-06 17:21:01 +02:00
5d84d726b6 Aligning remote renku/main with local
Merge branch 'renku/main' of https://gitea.psi.ch/apog/acsmnode into renku/main
2025-06-06 17:07:06 +02:00
0671f0ad7f Refactor notebooks for workflow generation 2025-06-06 17:05:10 +02:00
7b3404ecd9 Added workflows folder and utils.py to support workflow generation 2025-06-06 17:03:25 +02:00
160791b738 Refactor steps to collect information for renku workflow file generation 2025-06-06 17:02:13 +02:00
1b9e61688f Remove notebooks from .gitignore. this is needed to run the data chain app 2025-06-04 15:37:46 +02:00
358944ee7f Append previous .dockerignore and requiremnts.txt to the version after renku init, basically trying to restore them back after being overwritten by renku init. 2025-06-04 14:57:24 +02:00
19f4e6a0f0 renku init
renku-transaction: b204f31a23ed480b9323904a193047db
2025-06-04 14:52:49 +02:00
14c41ce76d Prepare gitrepo for renku init. Remove data/ from .gitignore and Rename Dockerfile by Dockerfile.ascmchain to avoid conflicts with renku. 2025-06-04 14:49:22 +02:00
a4847f0071 Renamed Dockerfile to avoid conflicts with project rekurization/init 2025-06-04 14:10:24 +02:00
effd5b865e Replace nonoperation reviewPannel in app/data_flagging_app.py with date range picker. Cached time column to speed up figure update but it doesnot look there was much improvement. 2025-06-04 14:03:45 +02:00
da6884ef21 Fix bug in app/data_flagging_app.py. This is a TODO/BUG [from Leïla] Correct error when flags are loaded in the app. 2025-06-04 10:47:48 +02:00
c15aa4e828 Merge pull request 'WIP.new_changes_leila' (#1) from new_changes_leila into main
Reviewed-on: APOG/acsmnode#1
2025-06-04 09:35:31 +02:00
fc6f6708b8 Merge branch 'main' into new_changes_leila 2025-06-04 09:34:12 +02:00
8afa2f98d1 Update notebooks/acsm_pipeline.ipynb. Step 5.2: added all species for the new uncertainty 2025-05-28 11:51:36 +02:00
3a23db1a12 Update TODO.md. Added some todos and deleted one that is done now. 2025-05-28 11:48:26 +02:00
196e237838 Update pipelines/steps/utils.py. Changes uncertainty_estimate 2025-05-28 08:48:38 +02:00
ddfa1273af update dima to latest version. 2025-05-27 10:14:02 +02:00
a730368678 Add step to adjust uncertainties 2025-05-27 10:03:03 +02:00
f3f830487e Extend pipelines/steps/adjust_uncertainty_column_in_nas_file.py to handle list of variables. 2025-05-27 09:53:12 +02:00
38fe2b8774 Update data chain notebook with step to adjust uncertainties 2025-05-26 20:00:31 +02:00
08ba10dc48 Implement new step pipelines/steps/adjust_uncertainty_column_in_nas_file.py. 2025-05-26 19:50:18 +02:00
b1b8b426fc Update dima to latest version 2025-05-26 19:42:57 +02:00
59489c611f Add cell and comment to manually choose data dirs to analize 2025-05-26 13:33:50 +02:00
44a696e52f Change submodule url from gitlab to gitea 2025-05-26 13:18:51 +02:00
989e99078a Merge branch 'main' of https://gitlab.psi.ch/apog/acsmnode
This updates todo.md
2025-05-26 13:12:52 +02:00
52fdb7a8ad Fix number of variables by subtracting one. Start_time is now excluded from count. 2025-05-26 13:12:40 +02:00
e8327f7bd7 Merge branch 'changes/leila' into 'main'
Changes/leila

See merge request apog/acsmnode!7
2025-05-26 13:09:55 +02:00
f8ee5b1ce4 Added a todo 2025-05-26 11:59:56 +02:00
e22321f823 Updated to do list 2025-05-21 18:59:19 +02:00
7a0ce95848 Changed the originator address 2025-05-21 17:22:09 +02:00
f7e1c31550 added len(interpolated_cpc) 2025-05-21 16:35:50 +02:00
a7faf69c96 Changed missing value code generator, any number greater than the largest possible one that can be represented in terms of 9s is capped 2025-05-21 15:17:25 +02:00
ce776610f6 Add new step to remove inletP or in general a column from nas file 2025-05-21 09:49:05 +02:00
e39c23bbad Update generate_flags.py to skip checking for cpc flags when not available 2025-05-21 09:48:19 +02:00
01769f10e0 Implement new step to remove column from already created nas file. 2025-05-21 09:43:36 +02:00
f880b0f1ba Updated dima to latest version 2025-05-21 09:27:50 +02:00
e87ff83c66 Merge branch 'leila_more_modifications' into 'main'
Changed name of originator and submitter in file campaignDescriptor.yaml

See merge request apog/acsmnode!6
2025-05-21 09:22:43 +02:00
c181e7abad Update file campaignDescriptor.yaml 2025-05-20 17:32:43 +02:00
727256cb46 Merge branch 'leila_modifications' into 'main'
Added limits on y axis for flags visualization

See merge request apog/acsmnode!5
2025-05-20 17:28:45 +02:00
a9461cb1aa Added limits on y axis for flags visualization 2025-05-20 16:27:11 +02:00
e4d87080bc Enable all flaggs for use in flagging app and display them in order according to their ranking (see app/flags/ebas_dict.yaml) 2025-05-19 17:10:16 +02:00
ccd4740dba Merge branch 'todos_update' into 'main'
Todos update

See merge request apog/acsmnode!4
2025-05-16 14:31:48 +02:00
cc1b445d38 Implement binary flags for visualization purposes, and fix bug with cpc flags. 2025-05-16 14:22:17 +02:00
78d5c22dc3 Flag from diagnostics (456) should override other flags like CPC (652, 460) 2025-05-15 16:03:08 +02:00
58d7b425aa Add generate cpc flags pipelines/steps/generate_flags.py 2025-05-15 15:01:11 +02:00
23ee4c412b Update dima to latest version 2025-05-15 14:58:24 +02:00
9915538442 Update dima submodule to point to dima remote on Gitea.psi.ch 2025-05-14 10:15:37 +02:00
fb3e3904bd Remove defaults channel from conda source channels 2025-05-13 12:50:33 +02:00
37671a3685 update pipelines/steps/visualize_datatable_vars.py with interactive plots and refactor dependent jupyter nb accordingly 2025-05-13 11:32:46 +02:00