APOG_public/acsm-fairifier
0
0
Fork 0
mirror of https://gitea.psi.ch/APOG/acsm-fairifier.git synced 2026-05-02 16:14:11 +02:00
Code Issues Packages Projects Releases Wiki Activity

Commit Graph

  • 0a4cb88341 fix: temp fix for large file uploads with dash-uploader (archived repo) main florez_j 2025-09-25 16:43:13 +02:00
  • 3175db94da Refactor minorly notebooks/demo_acsm_pipeline.ipynb to include Renku Metadata Logging using RenkuWorkflowBuilder class. florez_j 2025-09-23 16:18:58 +02:00
  • c023fd7937 Update README.md with requirement for renku graph visualization. florez_j 2025-09-23 16:15:52 +02:00
  • 3140e1b05e Add run_and_add_step() method in RenkuWorkflowBuilder and improve docstrings. The new method runs step and record renku metadata in a centralized workflow file in yaml format. florez_j 2025-09-23 16:14:23 +02:00
  • 3663fce07c Remove renku workflow recording input parameters in main and delegated that to RenkuWorkflowBuilder. This way we can more easily extent provenance recording to other steps. Steps however still need to return a dictionary with valid structure and renku provenance information. florez_j 2025-09-23 16:11:52 +02:00
  • 58ce34d56d Comment out line that was conflicting with dockercompose file. When activating local acsm processor with whole repo as a volumn, data figures and params folders were not visible in container. florez_j 2025-09-23 16:07:21 +02:00
  • e2d9936de8 Update dima to latest commit florez_j 2025-09-20 16:21:47 +02:00
  • 151719729c Prepare v1.0.0 release as acsm-fairifier v1.0.0 florez_j 2025-07-04 15:19:14 +02:00
  • fd68fa4ca3 Update campaignDescriptor.yaml with new instructions florez_j 2025-07-04 14:53:41 +02:00
  • e80abbdf9a Update README.md with conda forge install instructions and input data format. Add environment.yml to construct comp env based on conda forge. florez_j 2025-07-04 14:52:29 +02:00
  • 41af4cabe2 Update dima to latest version florez_j 2025-06-29 17:49:31 +02:00
  • c694e4c71d Update submodule to tag v1.0.0 florez_j 2025-06-26 11:30:42 +02:00
  • 367f8d5ca5 Update dima to latest version florez_j 2025-06-25 16:55:03 +02:00
  • 267988514d Update docker-compose.yaml to make changes in the whole project persistent florez_j 2025-06-25 16:47:20 +02:00
  • 2475e21101 Fix typos in CampaignDescriptor.yaml florez_j 2025-06-25 16:46:35 +02:00
  • 28b7b539e8 Update dockerfile to comply with psi rules about anaconda florez_j 2025-06-25 14:21:16 +02:00
  • 1bba5cd755 Comment out dot.view() for compatibility issues running on docker florez_j 2025-06-22 15:25:52 +02:00
  • f90ef82a32 Comment out dot.view() for compatibility issues running on docker florez_j 2025-06-22 15:22:24 +02:00
  • 967a40f93a Update Dockerfile to contain renderer for graphviz workflow files florez_j 2025-06-22 15:06:13 +02:00
  • 6547cd9e17 Update campaignDescriptor.yaml with instruction details florez_j 2025-06-22 15:00:57 +02:00
  • 7fc2ee211d Update readme.md with clarifying statement. NETWORK_MOUNT env variable defautls to data/ in repo florez_j 2025-06-22 14:59:50 +02:00
  • 3f2c3b47f2 Update docker-compose.yaml with env variable NETWORK_MOUNT. Local run: it defaults to data/ and otherwise it takes the value based on .env externally defined. florez_j 2025-06-22 14:48:30 +02:00
  • a80f03463c Update reademe.md florez_j 2025-06-22 12:44:50 +02:00
  • dec7dc47e2 Update docker-compose.yaml to depend on externally defined network drive (e.g., NETWORK_DRIVE) florez_j 2025-06-22 12:44:07 +02:00
  • e6b05b4914 Update campaignDescriptor.yaml to depend on externally defined network drive (e.g., NETWORK_DRIVE) florez_j 2025-06-22 12:43:37 +02:00
  • 071d1f49a7 Update dima to latest version florez_j 2025-06-22 12:27:48 +02:00
  • 1e4cd3fc8a Update dima to latest version florez_j 2025-06-20 13:44:00 +02:00
  • bb3907d384 Fixed url type in README.md florez_j 2025-06-18 08:58:40 +02:00
  • 6d421bdad8 Update docker-compose.yaml. Includes services for running with a network drive or locally florez_j 2025-06-17 22:09:00 +02:00
  • 4cda1ffb72 Add poster with figures florez_j 2025-06-17 22:07:55 +02:00
  • 5319430d5d Update to README.md, includes main features authors and funding florez_j 2025-06-17 22:07:27 +02:00
  • 482db5704d Add AGPL3 licence florez_j 2025-06-11 10:36:47 +02:00
  • 23253644f8 Update dima to latest version. Params can now be partially ingested to hdf5 files florez_j 2025-06-10 16:04:56 +02:00
  • 56ead34ef9 Correct typo in README.md florez_j 2025-06-10 14:45:38 +02:00
  • 0414f5608c update dima to latest version florez_j 2025-06-10 14:43:23 +02:00
  • 57c5d9784c Add notebook for worfklow visualization florez_j 2025-06-07 20:03:53 +02:00
  • fda5099221 Change computational env to include graphviz for workflow visualization florez_j 2025-06-07 20:02:41 +02:00
  • 457a2ae016 Update workflow step names florez_j 2025-06-07 20:01:02 +02:00
  • 8f9790456c Implement plot_workflow_file() --> workflows/utils.py. florez_j 2025-06-07 19:54:45 +02:00
  • fdad73dd77 Update dima to latest version florez_j 2025-06-07 19:16:50 +02:00
  • bb9625cd34 update notebooks after running them with 2024 pay data renku/main florez_j 2025-06-06 17:21:01 +02:00
  • 5d84d726b6 Aligning remote renku/main with local Merge branch 'renku/main' of https://gitea.psi.ch/apog/acsmnode into renku/main florez_j 2025-06-06 17:07:06 +02:00
  • 0671f0ad7f Refactor notebooks for workflow generation florez_j 2025-06-06 17:05:10 +02:00
  • 7b3404ecd9 Added workflows folder and utils.py to support workflow generation florez_j 2025-06-06 17:03:25 +02:00
  • 160791b738 Refactor steps to collect information for renku workflow file generation florez_j 2025-06-06 17:02:13 +02:00
  • 1b9e61688f Remove notebooks from .gitignore. this is needed to run the data chain app florez_j 2025-06-04 15:37:46 +02:00
  • 358944ee7f Append previous .dockerignore and requiremnts.txt to the version after renku init, basically trying to restore them back after being overwritten by renku init. florez_j 2025-06-04 14:57:24 +02:00
  • 19f4e6a0f0 renku init florez_j 2025-06-04 14:52:49 +02:00
  • 14c41ce76d Prepare gitrepo for renku init. Remove data/ from .gitignore and Rename Dockerfile by Dockerfile.ascmchain to avoid conflicts with renku. florez_j 2025-06-04 14:49:22 +02:00
  • a4847f0071 Renamed Dockerfile to avoid conflicts with project rekurization/init florez_j 2025-06-04 14:10:24 +02:00
  • effd5b865e Replace nonoperation reviewPannel in app/data_flagging_app.py with date range picker. Cached time column to speed up figure update but it doesnot look there was much improvement. florez_j 2025-06-04 14:03:45 +02:00
  • da6884ef21 Fix bug in app/data_flagging_app.py. This is a TODO/BUG [from Leïla] Correct error when flags are loaded in the app. florez_j 2025-06-04 10:47:48 +02:00
  • c15aa4e828 Merge pull request 'WIP.new_changes_leila' (#1) from new_changes_leila into main florez_j 2025-06-04 09:35:31 +02:00
  • fc6f6708b8 Merge branch 'main' into new_changes_leila florez_j 2025-06-04 09:34:12 +02:00
  • 8afa2f98d1 Update notebooks/acsm_pipeline.ipynb. Step 5.2: added all species for the new uncertainty simon_l 2025-05-28 11:51:36 +02:00
  • 3a23db1a12 Update TODO.md. Added some todos and deleted one that is done now. simon_l 2025-05-28 11:48:26 +02:00
  • 196e237838 Update pipelines/steps/utils.py. Changes uncertainty_estimate simon_l 2025-05-28 08:48:38 +02:00
  • ddfa1273af update dima to latest version. florez_j 2025-05-27 10:14:02 +02:00
  • a730368678 Add step to adjust uncertainties florez_j 2025-05-27 10:03:03 +02:00
  • f3f830487e Extend pipelines/steps/adjust_uncertainty_column_in_nas_file.py to handle list of variables. florez_j 2025-05-27 09:53:12 +02:00
  • 38fe2b8774 Update data chain notebook with step to adjust uncertainties florez_j 2025-05-26 20:00:31 +02:00
  • 08ba10dc48 Implement new step pipelines/steps/adjust_uncertainty_column_in_nas_file.py. florez_j 2025-05-26 19:50:18 +02:00
  • b1b8b426fc Update dima to latest version florez_j 2025-05-26 19:42:57 +02:00
  • fe9ffe7c1b Update README.md. Changed git clone directory changes_leila simon_l 2025-05-26 14:43:23 +02:00
  • b4d07bc2b4 Update README.md. Changed git clone url to gitea simon_l 2025-05-26 14:42:01 +02:00
  • 37dc1d390d Update TODO.md. Changed order of todos simon_l 2025-05-26 14:24:50 +02:00
  • 59489c611f Add cell and comment to manually choose data dirs to analize florez_j 2025-05-26 13:33:50 +02:00
  • 44a696e52f Change submodule url from gitlab to gitea florez_j 2025-05-26 13:18:51 +02:00
  • 989e99078a Merge branch 'main' of https://gitlab.psi.ch/apog/acsmnode This updates todo.md florez_j 2025-05-26 13:12:52 +02:00
  • 52fdb7a8ad Fix number of variables by subtracting one. Start_time is now excluded from count. florez_j 2025-05-26 13:12:40 +02:00
  • e8327f7bd7 Merge branch 'changes/leila' into 'main' florez_j 2025-05-26 13:09:55 +02:00
  • f8ee5b1ce4 Added a todo simon_l 2025-05-26 11:59:56 +02:00
  • e22321f823 Updated to do list simon_l 2025-05-21 18:59:19 +02:00
  • 7a0ce95848 Changed the originator address simon_l 2025-05-21 17:22:09 +02:00
  • f7e1c31550 added len(interpolated_cpc) simon_l 2025-05-21 16:35:50 +02:00
  • a7faf69c96 Changed missing value code generator, any number greater than the largest possible one that can be represented in terms of 9s is capped florez_j 2025-05-21 15:17:25 +02:00
  • ce776610f6 Add new step to remove inletP or in general a column from nas file florez_j 2025-05-21 09:49:05 +02:00
  • e39c23bbad Update generate_flags.py to skip checking for cpc flags when not available florez_j 2025-05-21 09:48:19 +02:00
  • 01769f10e0 Implement new step to remove column from already created nas file. florez_j 2025-05-21 09:43:36 +02:00
  • f880b0f1ba Updated dima to latest version florez_j 2025-05-21 09:27:50 +02:00
  • e87ff83c66 Merge branch 'leila_more_modifications' into 'main' florez_j 2025-05-21 09:22:43 +02:00
  • c181e7abad Update file campaignDescriptor.yaml simon_l 2025-05-20 17:32:43 +02:00
  • 727256cb46 Merge branch 'leila_modifications' into 'main' florez_j 2025-05-20 17:28:45 +02:00
  • a9461cb1aa Added limits on y axis for flags visualization simon_l 2025-05-20 16:27:11 +02:00
  • e4d87080bc Enable all flaggs for use in flagging app and display them in order according to their ranking (see app/flags/ebas_dict.yaml) florez_j 2025-05-19 17:10:16 +02:00
  • ccd4740dba Merge branch 'todos_update' into 'main' florez_j 2025-05-16 14:31:48 +02:00
  • cc1b445d38 Implement binary flags for visualization purposes, and fix bug with cpc flags. florez_j 2025-05-16 14:22:17 +02:00
  • 78d5c22dc3 Flag from diagnostics (456) should override other flags like CPC (652, 460) simon_l 2025-05-15 16:03:08 +02:00
  • 58d7b425aa Add generate cpc flags pipelines/steps/generate_flags.py florez_j 2025-05-15 15:01:11 +02:00
  • 23ee4c412b Update dima to latest version florez_j 2025-05-15 14:58:24 +02:00
  • 9915538442 Update dima submodule to point to dima remote on Gitea.psi.ch florez_j 2025-05-14 10:15:37 +02:00
  • fb3e3904bd Remove defaults channel from conda source channels florez_j 2025-05-13 12:50:33 +02:00
  • 37671a3685 update pipelines/steps/visualize_datatable_vars.py with interactive plots and refactor dependent jupyter nb accordingly florez_j 2025-05-13 11:32:46 +02:00
  • e152c9eefd Update file TODO.md simon_l 2025-05-12 14:38:39 +02:00
  • 0e642d4b9b Update file TODO.md simon_l 2025-05-08 11:19:59 +02:00
  • 1c0a4631aa Update file TODO.md simon_l 2025-05-08 09:20:06 +02:00
  • ae107acea8 Update file TODO.md simon_l 2025-04-11 14:54:35 +02:00
  • 5a54a22ebd Update after run with PAY dataset. florez_j 2025-04-11 11:31:35 +02:00
  • 0353c8492b Added data chain step. This step updates the current parameters with new input folder params florez_j 2025-04-11 11:23:04 +02:00
  • 4408514439 Rename attribute station --> station_abbr florez_j 2025-04-11 11:20:48 +02:00