|
|
18b8635147
|
chore: moved config files part 2
|
2025-08-14 10:42:44 +02:00 |
|
|
|
d470f2e811
|
chore: moved config files
|
2025-08-14 10:41:44 +02:00 |
|
|
|
176dde251f
|
Refactor: remove name key from BC_hist_configs dictionary
|
2025-08-13 17:22:47 +02:00 |
|
|
|
554ec26410
|
Refactor: moved parts of processing code to specific functions in separate modules (join_pbp_with_flow and aggregate_dt)
|
2025-08-13 17:02:47 +02:00 |
|
|
|
053d0d5b75
|
Refactor: separte the workflow for the option to calculate distributions for BC (numb and amss), scattering and time delay
|
2025-08-13 16:26:39 +02:00 |
|
|
|
1038b18187
|
Clean up old parts in the code and re-arranged processing order
|
2025-08-13 16:08:37 +02:00 |
|
|
|
5f3d25817c
|
Refactor: moved calibration of PbP data to new file and clear separation between run_config and instr_config
|
2025-08-13 15:28:57 +02:00 |
|
|
|
6f87b4cc79
|
Refactor: implemented input run_config.yaml file
|
2025-08-13 14:09:58 +02:00 |
|
|
|
fa4cb9e7d4
|
Refactor: moved some functions to respective modules and implemented the timelag hists
|
2025-08-12 15:53:48 +02:00 |
|
|
|
b05853416b
|
Refactor: functions moved from sp2xr_pipeline to corresponding script in the src directory
|
2025-08-08 16:53:29 +02:00 |
|
|
|
7e736803c1
|
Refactor: working version of sp2xr_pipeline but not yet polished
|
2025-08-08 11:54:32 +02:00 |
|
|
|
6fa6fabf03
|
refactor: moved some functions from toolkit_legacy
|
2025-08-06 09:00:16 +02:00 |
|
|
|
3e620c80f0
|
refactor: first draft for the new sp2xr processing pipeline
|
2025-08-06 08:56:32 +02:00 |
|
|
|
63359449d3
|
refactor: split out single-particle calibration into its own module
|
2025-08-04 18:43:25 +02:00 |
|
|
|
74c5a77b48
|
test: manually added case-specific instrument_config parameters
|
2025-08-04 13:03:24 +02:00 |
|
|
|
ad897be5db
|
feat: pre-populate YAML export with calibration and threshold placeholders
|
2025-08-04 12:58:17 +02:00 |
|
|
|
f5c5420209
|
feat: add CLI utility to convert SP2-XR .ini files to editable YAML configs
|
2025-08-04 12:33:09 +02:00 |
|
|
|
1d8f12ee35
|
feat: add ini→yaml conversion and tests for SP2-XR instrument parameters
|
2025-08-04 12:26:03 +02:00 |
|
|
|
83c95a9cdd
|
feat: set default walltime dynamically based on SLURM partition
|
2025-08-04 11:42:13 +02:00 |
|
|
|
2ca7704b7e
|
chore: add bokeh for Dask dashboard support
|
2025-08-04 10:43:44 +02:00 |
|
|
|
6c3bb8ba2f
|
chore: add dask[distributed] and dask-jobqueue to project dependencies
|
2025-08-04 09:52:13 +02:00 |
|
|
|
a1595b1e86
|
feat: add CLI script to convert SP2XR zip/CSV files to parquet using Dask
|
2025-08-04 09:40:00 +02:00 |
|
|
|
5705d88092
|
refactor: move file-finding and chunking utilities to helpers.py
|
2025-08-04 09:24:39 +02:00 |
|
|
|
5690fcdcaf
|
refactor: split read_csv_files_with_dask into modular load, enrich, and save functions
|
2025-07-25 20:28:24 +02:00 |
|
|
|
399df18e81
|
test: add real-data tests for PbP and HK ZIP input files
|
2025-07-25 15:33:33 +02:00 |
|
|
|
06dd589bc7
|
refactor: rename and update schema config generator to support YAML output
|
2025-07-25 15:27:01 +02:00 |
|
|
|
ecd08d4c02
|
chore(meta): update config.yaml with correct column types
|
2025-07-25 14:51:48 +02:00 |
|
|
|
d8c0a4f6c7
|
style: apply pre-commit fixes globally
|
2025-07-25 12:27:12 +02:00 |
|
|
|
b443aa5db8
|
style: Ruff auto‑fixes in SP2XR_toolkit
|
2025-07-25 12:12:38 +02:00 |
|
Bertozzi Barbara
|
51a005f2da
|
style: apply Black auto‑formatting
|
2025-07-24 20:33:12 +02:00 |
|
Bertozzi Barbara
|
68f466c139
|
style: apply Black auto‑formatting
|
2025-07-24 19:53:51 +02:00 |
|
Bertozzi Barbara
|
34367c54af
|
chore: pin Black & Ruff hook versions
|
2025-07-24 19:35:51 +02:00 |
|
Bertozzi Barbara
|
c29a59a4b3
|
ignore .venv virtual-env directory
|
2025-07-24 18:39:50 +02:00 |
|
|
|
b98bbf82ab
|
Add license file
v1.0.0
|
2025-06-06 15:28:12 +02:00 |
|
|
|
62d602a101
|
Update README
|
2025-06-06 11:55:49 +02:00 |
|
|
|
9e0e541c9a
|
keyword level added to control at which level to partition the parquet files
|
2025-06-06 11:45:59 +02:00 |
|
|
|
a5bf02ec69
|
Functions updated
|
2025-06-06 11:39:59 +02:00 |
|
|
|
26274f7e0b
|
Notebook with example for processing calibration data
|
2025-06-06 11:30:36 +02:00 |
|
|
|
076ab19617
|
Updated Readme
|
2024-11-09 15:22:41 +01:00 |
|
|
|
95e8a76bd9
|
Example of meta files for pbp and hk data added
|
2024-11-06 17:40:54 +01:00 |
|
|
|
5047c6f62d
|
.gitignore updated
|
2024-11-06 16:27:13 +01:00 |
|
|
|
bc1c52f4e3
|
Merge branch 'sp2xr_nya_code' into 'main'
Now also for coating-related particle classifications, we consider particles...
See merge request apog/sp2xr!2
|
2024-10-24 14:28:32 +02:00 |
|
|
|
9729b05416
|
Merge branch 'sp2xr_granada_code' into 'main'
Fixed compatibility issue between read_csv_files_with_dask and...
See merge request apog/sp2xr!1
|
2024-10-24 14:08:13 +02:00 |
|
|
|
3a93e73317
|
Fixed compatibility issue between read_csv_files_with_dask and...
|
2024-10-24 14:08:13 +02:00 |
|
|
|
2410483c43
|
Added .gitignore
|
2024-10-17 09:43:15 +02:00 |
|
|
|
454ef54ade
|
Cherry-picked SP2XR_toolkit.py from commit 1703860 from branch sp2xr_nya_code
|
2024-10-17 09:41:12 +02:00 |
|
|
|
17038600e4
|
Now also for coating-related particle classifications, we consider particles as small as 0.3fg(~70nm) (before I was considering only particles larger than ~100nm)
|
2024-09-25 10:28:56 +02:00 |
|
|
|
740a8a1d73
|
fixed small bug for particle classified as thin_noScatt
|
2024-09-25 10:16:18 +02:00 |
|
|
|
144fc61978
|
Added function save_image to save multiple figures in a single pdf
|
2024-09-23 12:54:29 +02:00 |
|
|
|
a4bbf356af
|
Function to read sp2b updated, added fillna(0) before resampling in the function resample_to_dt
|
2024-09-23 12:45:53 +02:00 |
|
