|
|
d6b3f2028f
|
Fix: bug fixed in conversion from BC mass to diam due to density units mismatch in the config file and default values
|
2025-08-22 10:48:08 +02:00 |
|
|
|
bbd21ba7b9
|
Chore: add test data folder to gitignore
|
2025-08-21 11:58:39 +02:00 |
|
|
|
bf0e663449
|
Test: add temporary notebook for tests
|
2025-08-21 11:57:51 +02:00 |
|
|
|
ebd14bcbae
|
Fix: typo in the config reading was blocking calibration
|
2025-08-21 11:39:11 +02:00 |
|
|
|
d7f778d531
|
Fix: the hisotgrams were adding lines with NaNs when the corresponding partition was completely empty. Now it is back to old behavior and no index is added for partitions completely empty.
|
2025-08-21 11:37:23 +02:00 |
|
|
|
063b01e73f
|
Test: PbP and HK parquet files added for testing
|
2025-08-20 19:08:28 +02:00 |
|
|
|
a2cc520ff2
|
feat: possibility to choose between running locally and via slurm cluster
|
2025-08-14 11:48:52 +02:00 |
|
|
|
18b8635147
|
chore: moved config files part 2
|
2025-08-14 10:42:44 +02:00 |
|
|
|
d470f2e811
|
chore: moved config files
|
2025-08-14 10:41:44 +02:00 |
|
|
|
176dde251f
|
Refactor: remove name key from BC_hist_configs dictionary
|
2025-08-13 17:22:47 +02:00 |
|
|
|
554ec26410
|
Refactor: moved parts of processing code to specific functions in separate modules (join_pbp_with_flow and aggregate_dt)
|
2025-08-13 17:02:47 +02:00 |
|
|
|
053d0d5b75
|
Refactor: separte the workflow for the option to calculate distributions for BC (numb and amss), scattering and time delay
|
2025-08-13 16:26:39 +02:00 |
|
|
|
1038b18187
|
Clean up old parts in the code and re-arranged processing order
|
2025-08-13 16:08:37 +02:00 |
|
|
|
5f3d25817c
|
Refactor: moved calibration of PbP data to new file and clear separation between run_config and instr_config
|
2025-08-13 15:28:57 +02:00 |
|
|
|
6f87b4cc79
|
Refactor: implemented input run_config.yaml file
|
2025-08-13 14:09:58 +02:00 |
|
|
|
fa4cb9e7d4
|
Refactor: moved some functions to respective modules and implemented the timelag hists
|
2025-08-12 15:53:48 +02:00 |
|
|
|
b05853416b
|
Refactor: functions moved from sp2xr_pipeline to corresponding script in the src directory
|
2025-08-08 16:53:29 +02:00 |
|
|
|
7e736803c1
|
Refactor: working version of sp2xr_pipeline but not yet polished
|
2025-08-08 11:54:32 +02:00 |
|
|
|
6fa6fabf03
|
refactor: moved some functions from toolkit_legacy
|
2025-08-06 09:00:16 +02:00 |
|
|
|
3e620c80f0
|
refactor: first draft for the new sp2xr processing pipeline
|
2025-08-06 08:56:32 +02:00 |
|
|
|
63359449d3
|
refactor: split out single-particle calibration into its own module
|
2025-08-04 18:43:25 +02:00 |
|
|
|
74c5a77b48
|
test: manually added case-specific instrument_config parameters
|
2025-08-04 13:03:24 +02:00 |
|
|
|
ad897be5db
|
feat: pre-populate YAML export with calibration and threshold placeholders
|
2025-08-04 12:58:17 +02:00 |
|
|
|
f5c5420209
|
feat: add CLI utility to convert SP2-XR .ini files to editable YAML configs
|
2025-08-04 12:33:09 +02:00 |
|
|
|
1d8f12ee35
|
feat: add ini→yaml conversion and tests for SP2-XR instrument parameters
|
2025-08-04 12:26:03 +02:00 |
|
|
|
83c95a9cdd
|
feat: set default walltime dynamically based on SLURM partition
|
2025-08-04 11:42:13 +02:00 |
|
|
|
2ca7704b7e
|
chore: add bokeh for Dask dashboard support
|
2025-08-04 10:43:44 +02:00 |
|
|
|
6c3bb8ba2f
|
chore: add dask[distributed] and dask-jobqueue to project dependencies
|
2025-08-04 09:52:13 +02:00 |
|
|
|
a1595b1e86
|
feat: add CLI script to convert SP2XR zip/CSV files to parquet using Dask
|
2025-08-04 09:40:00 +02:00 |
|
|
|
5705d88092
|
refactor: move file-finding and chunking utilities to helpers.py
|
2025-08-04 09:24:39 +02:00 |
|
|
|
5690fcdcaf
|
refactor: split read_csv_files_with_dask into modular load, enrich, and save functions
|
2025-07-25 20:28:24 +02:00 |
|
|
|
399df18e81
|
test: add real-data tests for PbP and HK ZIP input files
|
2025-07-25 15:33:33 +02:00 |
|
|
|
06dd589bc7
|
refactor: rename and update schema config generator to support YAML output
|
2025-07-25 15:27:01 +02:00 |
|
|
|
ecd08d4c02
|
chore(meta): update config.yaml with correct column types
|
2025-07-25 14:51:48 +02:00 |
|
|
|
d8c0a4f6c7
|
style: apply pre-commit fixes globally
|
2025-07-25 12:27:12 +02:00 |
|
|
|
b443aa5db8
|
style: Ruff auto‑fixes in SP2XR_toolkit
|
2025-07-25 12:12:38 +02:00 |
|
Bertozzi Barbara
|
51a005f2da
|
style: apply Black auto‑formatting
|
2025-07-24 20:33:12 +02:00 |
|
Bertozzi Barbara
|
68f466c139
|
style: apply Black auto‑formatting
|
2025-07-24 19:53:51 +02:00 |
|
Bertozzi Barbara
|
34367c54af
|
chore: pin Black & Ruff hook versions
|
2025-07-24 19:35:51 +02:00 |
|
Bertozzi Barbara
|
c29a59a4b3
|
ignore .venv virtual-env directory
|
2025-07-24 18:39:50 +02:00 |
|
|
|
b98bbf82ab
|
Add license file
v1.0.0
|
2025-06-06 15:28:12 +02:00 |
|
|
|
62d602a101
|
Update README
|
2025-06-06 11:55:49 +02:00 |
|
|
|
9e0e541c9a
|
keyword level added to control at which level to partition the parquet files
|
2025-06-06 11:45:59 +02:00 |
|
|
|
a5bf02ec69
|
Functions updated
|
2025-06-06 11:39:59 +02:00 |
|
|
|
26274f7e0b
|
Notebook with example for processing calibration data
|
2025-06-06 11:30:36 +02:00 |
|
|
|
076ab19617
|
Updated Readme
|
2024-11-09 15:22:41 +01:00 |
|
|
|
95e8a76bd9
|
Example of meta files for pbp and hk data added
|
2024-11-06 17:40:54 +01:00 |
|
|
|
5047c6f62d
|
.gitignore updated
|
2024-11-06 16:27:13 +01:00 |
|
|
|
bc1c52f4e3
|
Merge branch 'sp2xr_nya_code' into 'main'
Now also for coating-related particle classifications, we consider particles...
See merge request apog/sp2xr!2
|
2024-10-24 14:28:32 +02:00 |
|
|
|
9729b05416
|
Merge branch 'sp2xr_granada_code' into 'main'
Fixed compatibility issue between read_csv_files_with_dask and...
See merge request apog/sp2xr!1
|
2024-10-24 14:08:13 +02:00 |
|
