master
Cristallina documentation repository
Collection of notes regarding instruments, configuration and general usage. Wiki holds most of the notes.
This is mirrored on /sf/cristallina/config/documentation.
Changelog for Cristallina computational issues
- 27.01.2025
- Rebuilt analysis-stable and jupyter-alpha with updated packages
- Created new cluster_tools repo and updated the tools
- 26.01.2025
- Rebuilt slic and slic-crq environments due to ownership changes, more environments to follow soon
- Migrated cristallina_envs repo to gitea
- 07.11.2025
- updated RHEL on saresc-01, 02, 03, 04, 05, media-01.
- cleaned up saresc-08 --> /var was overflowing and could not download updates anymore.
- updated jupyter_alpha, analysis_edge environments.
- integrated upstream changes to slic --> still needs testing!
- 26.09.2025
- updated RHEL on saresc-01, 02, 03, 04, 05, media-01.
- integrated upstream slic changes from Sven (only partially, there are more WIP items)
- postponed update of analysis_edge --> we should rebuilt this from scratch
- updated jupyter_alpha: jupyterlab 4.4.8 now, jupyter_collaboration from 4.0.2 to 4.11
- 17.04.2025
- the environment analysis_forge rebuilt with Sven's miniforge and now saved in /sf/cristallina/applications/it/envs. The aim is that this will be the default env and a new one analysis-stable lagging behind will be created later. Everything in the env updated and set to be gotten from conda-forge. paulscherrerinstitut packages are taken explicitly from there.
- 02.07.2025
- slic updated to eda977ee06a33e50268c1982cd061954cfd0c9a8 from 23.06.2025
- jupyter_alpha updated
- updated saresc-vcons-01, 02, 03
- May 2025
- updated slic from Sven's upstream repository
- updated jupyter_alpha
- April 2025
- Slic is using new environment slic-crq
- 17.04.2025
- the environment analysis_forge rebuilt with Sven's miniforge and now saved in /sf/cristallina/applications/it/envs. The aim is that this will be the default env and a new one analysis-stable lagging behind will be created later. Everything in the env updated and set to be gotten from conda-forge. paulscherrerinstitut packages are taken explicitly from there.
- 08.01.2025
- updated jupyter, analysis_edge with jupyterlab 4.3.4, matplotlib 3.10, pandas and numba and many smaller changes. All consoles also updated.
- 16.12.2024
- updated minimamba, updated jupyter: jupyterlab 4.3.3, collaboration parts are all newer (pycrdt, pycrdt-websocket, ui, ...), matplotlib and more. This should allow a more stable operation of jupyterlab with the collaboration enabled (and also allow to disable collaboration, which was not really possible before)
- 09.12.2024
- updated jupyter environment: jupyterlab 4.3.2, collaboration 3.0.2, pycrdt as well. Probably still has unresolved issues.
- 28.10.2024
- updated analysis_edge: new jungfrau_utils for IO detector. pycrdt slightly newer.
- updated slic package: small changes from Sven, integrated with local changes.
- 09.10.2024
- updated minimamba environment (sidestepped permissions issue for now. Full cleanup when Mael is back.)
- updated analysis_edge: small updates, preparing for collaboration 3.0 release soon
- updated analysis_forge: jungfrau_utils now in newest version for upgraded 1.5M detector. Many small updates as well (only minor versions though, should not cause breakage).
- pulled newest changes for Dan's diffraction: calculating all reflections works now.
- 02.10.2024
- updated analysis_edge: general and new Jungfrau utils for changed 1.5M detector
- installed diffcalc-core in slic environment
- updated analysis_forge: aborted, file permission issues...
- 10.06.2024
- saresc-cons-02: somehow OS updates were not installed for quite some time (puppet also behind), solved now but will check on other consoles.
- updated several environments:
- minimamba base, only small things
- analysis_edge: pycrdt, ipykernel & small things
- analysis_forge: ipympl, small other things
- slic: only small changes
- 16.04.2024:
- updated base minimamba environment
- updated analysis_edge: many changes, to Jupyterlab 4.1.6, collaboration and joblib 1.4.0 (https://github.com/joblib/joblib/releases/tag/1.4.0). Minor for pandas, matplotlib.
- updated analysis_forge: small changes, pandas, matplotlib.
- updated slic (still need to incorporate Sven's latest changes)
- 21.03.2024:
- updated analysis_edge, analysis_forge and slic. Now on Jupyterlab 4.1.5, collaboration 2.0.3 and smaller other upgrades.
- both saresc-cons-01, and saresc-cons-02 have upgraded GPUs (now RTX A2000, 12 GB).
- 15.02.2024:
- updated analysis_edge, analysis_forge, slic and cristallina_diagnostics environments. Now on Jupyterlab 4.0.12 and numba 0.59. Still waiting for collaboration 2.0.2 which was released 2h ago.
- 08.01.2024:
- updated analysis_edge, analysis_forge, flet, slic environments. Should improve collaboration features, only small changes otherwise.
- checked on general RHEL8 update status. This failed on several consoles due to not enough space on /var.
- 18.12.2023:
- updated environment: analysis_edge for jupyter_collaboration 2.0.0.
- updated Saresc-cons-01 as a test for other consoles as RHEL8 were not applied. Also removed ancient flameshot, now only installed one is 12.1.
- 28.11.2023:
- updated environments: analysis_edge, analysis_forge and slic.
- 13.11.2023:
- updated environments: analysis_edge and analysis_forge: added pytables package to both as it's needed to view the Stand run table.
- 09.10.2023:
- updated environments: analysis_edge and analysis_forge: new Jungfrau utils and small other upgrades. Slic environment: cam_server_client updated.
- 25.09.2023:
- updated environments: analysis_edge and analysis_forge (significant sf_data update to 0.4.0, matplotlib 3.8.0) and slic
- 11.09.2023
- updated minimamba, analysis_edge (small pandas upgrade), analysis_forge (ipython, jupytext, ...)
- 19.07.2023:
- updated analysis (many changes, in particular jupyterlab, numba, pandas, joblib), analysis_forge and analysis_edge (small updates).
- updated analysis (this was rather complicated, hdf5py triggers a lot of dependencies, see also warning in https://docs.h5py.org/en/stable/build.html#install)
- 27.06.2023:
- updated analysis_edge, analysis_forge (jupyterlab 3.6.5, numpy, numba) (only missing necessary package to switch completely to edge is jupytext, some others are untested with 3.11)
- updated analysis (this was rather complicated, hdf5py triggers a lot of dependencies, see also warning in https://docs.h5py.org/en/stable/build.html#install)
- 21.06.2023:
- Complete restore of conda environments after deletion
- 05.06.2023:
- Miniconda (base) environment broken beyond repair, re-installed new Miniconda in same place
- Added a Minimamba environment based on Mambaforge to keep them separate
- Updated analysis_forge, analysis_edge environment (cutting edge, incl. python 3.11 and Jupyterlab 4)
- added cristallina_diagnostics with Voila
- 16.05.2023:
- updated slic environment with newer Jungfrau utils and cam_server client
- 25.04.2023:
- merge upstream changes for Slic from Sven. Still minor issues with CTA sequencer module. Added
dbus-pythonbecause of missing dependency.
- merge upstream changes for Slic from Sven. Still minor issues with CTA sequencer module. Added
- 24.04.2023:
- installed
shutteron saresc-cons-01, 02, 03, 04, 05 and saresc-media-01.
- installed
- 16.04.2023
- updated: analysis_forge environment: minor updates for mamba, pytest, jupyter notebook
- 03.04.2023
- updated: analysis_forge conda environment: especially newer jupyterlab 3.6.3, the widgets, and small things.
- updated: analysis conda environment: especially newer the widgets to 4.0.5 (and ipywidgets to 8.0.4) and sf_data to 0.3.2, and small things.
- 27.03.2023
- updated: analysis_forge conda environment: especially newer sf_data 0.3.2 (small changes) and jupyterlab (3.6.2 with the collaborative save as bug fixed)
- updated: slic environment, newer sf_data as well, and ipywidgets
- 14.03.2023
- updated: analysis conda environment: especially newer sf_data 0.3.1, matplotlib 3.7.1
- updated: analysis_forge conda environment: especially newer sf_data 0.3.1, matplotlib 3.7.1
- updated: slic environment, newer sf_data as well, and cam_server_client
- 01.03.2023
- added grum conda environment and grum package in /sf/cristallina/applications/grum
Description
Languages
Python
64.3%
Roff
23.8%
HTML
11.9%