updated current state; added some checkboxes

This commit is contained in:
2025-04-12 12:07:51 +02:00
parent 9214e8d2f8
commit bae86371ec

View File

@ -1,6 +1,6 @@
# TODO
## Make envs available in jupytera
- [ ] ## Make envs available in jupytera
There's [pixi-kernel](https://github.com/renan-r-santos/pixi-kernel) but it is specifically "per directory", which does not fit our use case.
@ -16,21 +16,25 @@ The only "problem" is in how jupyter shows the env names:
Note: if the `envs` folder is called differently, no prefix is shown at all... This might be an alternative idea.
## Shared features
- [ ] ## Shared features
Pixi supports "features" (i.e., sets of packages that allow the user to do XYZ). This would be very useful for, e.g., a feature like "be able to plot on jupytera", which gives the correct versions of ipympl, matplotlib, etc.
We would need this to be a central file that is somehow made available and/or merged into everyone's individual files.
Pixi does not seem to have this option (yet? opened a [ticket](https://github.com/prefix-dev/pixi/issues/3524)). TOML does not allow to link in further files out of the box. However, there is [tomlincl](https://github.com/qdongxu/tomlincl).
Pixi does not seem to have this option (yet? see below). TOML does not allow to link in further files out of the box. However, there is [tomlincl](https://github.com/qdongxu/tomlincl).
## Running the setup script
Opened a [ticket](https://github.com/prefix-dev/pixi/issues/3524) and the devs proposed a solution. Need to test!
- [x] ## Running the setup script
Currently, there runs a deploy script as part of the deployment. We do NOT want to replace that script, but run after it.
Can this be changed such that the deploy script runs our script at the end? Where would our script live?
## Timeout
**Solution**: Simon calls `/sf/daq/code/snek/autodeploy/setup.sh` at the end of the deploy script with `/sf/alvra/config/python` as working dir.
- [x] ## Timeout
Currently the timeout of the autodeployer is rather short as the expectation is that there are only "filesystem copy tasks" performed.
@ -38,7 +42,9 @@ Conda env creation can take a few minutes even with Pixi.
Can the timeout be made that long without negative implications? Can this, for instance, block other tasks?
## Trigger only on change of specific file
**Solution**: Simon set up a separate docker container with increased time out of 5 mins (to be confirmed this is enough).
- [ ] ## Trigger only on change of specific file
In case of changes to the env, the lock file (`pixi.lock`) should be committed at the end of the setup script to have a history and reproducibility.
@ -46,7 +52,13 @@ Currently, this will trigger an additional autodeployer run which does nothing.
Can we instead trigger the autodeployer only if `pixi.yml` changes?
## Mounts
- [ ] ## Commit from the Autodeployer
In case of changes to the env, the lock file (`pixi.lock`) should be committed at the end of the setup script to have a history and reproducibility.
We need to allow the autodeployer to make commits.
- [x] ## Mounts
### Problem
@ -84,3 +96,4 @@ sudo umount /sf/alvra/config/python
sudo rmdir -p /sf/alvra/config/python
```
**Solution**: bind mounts do not work in unprivileged containers. Simon now mounts the console path when starting the docker container.