35 Commits
Author SHA1 Message Date
jungfrauandClaude Fable 5.1 5bcb6d993d a warm start keeps the family of the registry version it continues; the 10-23 duplicates of the re-gated v5 versions go
CI / ledger-and-tools (push) Successful in 21s
--skip-train registers the version with the day it runs, so the nano and the yolo26s of
cycle 5 existed twice in the registry (2026-10-23 and 2026-10-25); the runs point at the
10-25 ones, the others are removed. A run whose base weights are a registry version (the
warm start) was named after the file weights.pt; it is now named after that version's family.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_013uu3Bxsu5JqFhaWa9Ftu6z
2026-10-26 10:29:31 +01:00
jungfrau 22192ec1a3 run 2026-10-26_v5h-noflip-mask1: gate_failed 2026-10-26 09:16:33 +01:00
jungfrau 5dc38167c4 run 2026-10-25_v5-warm: gate_failed 2026-10-26 01:43:32 +01:00
jungfrau 09f7f2c4c4 yolo26s-seg-v5-s-noflip-mask1-2026-10-25 promoted by the gate on the honest measure (user decision 2026-10-25): F1 +0.021 in 96 % of draws, masks +0.011 in 90 %
CI / ledger-and-tools (push) Successful in 19s
2026-10-25 22:16:08 +01:00
jungfrau 32f354cde6 run 2026-10-25_v5-amp: gate_failed 2026-10-25 21:37:35 +01:00
jungfrauandClaude Fable 5.1 63ee07fe61 a gold outline the reviewer kept from the model's proposal is not judged
CI / ledger-and-tools (push) Successful in 19s
454 of the 1 029 gold outlines are a proposal kept unchanged (loop 159 of 317, pin 140 of
224, face 140 of 295, crystal 14 of 149): the pre-labelling model's own masks. The
evaluation now ignores them object by object for every model, like a crowd region: they
leave the gold, and an unmatched prediction on one of them is not a false alarm.
tools/gold_kept.py finds them against the studio's batch proposals (mask IoU >= 0.98) and
writes data/gold/kept_machine.json; evaluate_image, evaluate_dirs and gate_stats.per_frame
read it. With it, the frame-level exclusion of 845bd87 is no longer applied (it stays as
the fallback without the file), so the gold set can grow with frames the active model
pre-labelled. Every registry model is measured again on this basis and the three v5 runs
are re-gated, without promotion.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_013uu3Bxsu5JqFhaWa9Ftu6z
2026-10-25 09:48:20 +01:00
jungfrauandClaude Fable 5.1 845bd87bb3 a model is not measured on the gold frames it pre-labelled itself
CI / ledger-and-tools (push) Successful in 21s
Where a reviewer keeps an outline the model proposed, the gold holds the model's own mask,
which overlaps itself perfectly: on the 50 gold frames v4 had pre-labelled it scored a
matched IoU of 0.959 against 0.905 elsewhere, every other model 0.93, and that alone
produced the "mask dip" that failed all three v5 runs. tools/gold_prelabel.py records
which model proposed each gold frame (data/gold/prelabel.json, 265 of 335 frames);
gate_stats.without_own_proposals drops those frames from that model's measure; the unseen
comparison and the gate's paired bootstrap use it, so two models are compared on the
frames neither of them touched. The three v5 runs are re-gated on that basis, without
promotion.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-10-25 02:48:09 +02:00
jungfrau 52e7e78b68 run 2026-10-23_v5-n-1024px: gate_failed 2026-10-25 02:13:35 +02:00
jungfrau 2de7a68509 run 2026-10-23_v5-s-noflip-mask1: gate_failed 2026-10-23 18:53:13 +02:00
jungfrau d3e6e3cb6b run 2026-10-22_v5-noflip-mask1: gate_failed 2026-10-23 03:53:49 +02:00
jungfrau 562b0e13e2 gold grown to 335 frames; every registry model re-measured on it 2026-10-22 11:40:13 +02:00
jungfrauandClaude Fable 5.1 8c3c538244 gold: 285 frames (batch 8 added by mount: 83 corrected frames, 2-per-mount cap, 20 siblings held out); every model re-measured
CI / ledger-and-tools (push) Successful in 20s
231 frames unseen by every model (core 148), 82 crystals on them. v4-noflip-mask1 stays
the best: F1 0.855, mask score 0.798; v3-noflip-mask1 0.848 / 0.793, within noise;
the small cluster model now clearly loses on masks (-0.021, won in 0 % of draws).

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-10-05 15:49:30 +02:00
jungfrauandClaude Fable 5.1 c7d53646ce small cluster model re-gated on the Spark in one environment: gate_passed against v3; comparison after cycle 4
CI / ledger-and-tools (push) Successful in 19s
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-10-02 13:30:10 +02:00
jungfrau f37604f87a run 2026-10-01_v4-noflip-mask1: promoted; comparison updated
CI / ledger-and-tools (push) Successful in 19s
2026-10-02 13:25:46 +02:00
jungfrau a67e6b8e8e run 2026-10-01_v4-recipeA: gate_failed; comparison updated 2026-10-02 13:25:45 +02:00
Duan a9192406d3 yolo26s-seg-v3-s-640px-2026-10-01
CI / ledger-and-tools (push) Successful in 22s
2026-10-02 10:47:39 +02:00
jungfrau 2956303ffe run 2026-09-29_v3-noflip-mask1: promoted; comparison updated
CI / ledger-and-tools (push) Successful in 21s
2026-09-30 13:56:07 +02:00
jungfrauandClaude Fable 5.1 f1a945528e cluster runs on dataset v3: resolution and model-size levers
CI / ledger-and-tools (push) Successful in 18s
Three ledger runs for the cluster, exported on dataset/2026-09-29_v3 with the
promoted recipe: nano at 1024 px, small at 640 px, small at 1024 px. A run can
now carry its own training arguments (train_args in run.json, set with
ledger new --kv), which train_run.py applies under any --set; train.sbatch
forwards extra arguments after the run id (e.g. --batch 8). yolo26s-seg.pt
joins the base weights under LFS. slurm/README lists the runs, the questions
they answer and the commands.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-30 07:18:06 +02:00
jungfrau d562b94671 run 2026-09-29_v3-recipeA: gate_passed; comparison updated 2026-09-29 23:42:41 +02:00
jungfrau 0ec5138409 all models re-measured on the 203-frame gold set; comparison on the unseen frames updated
CI / ledger-and-tools (push) Successful in 18s
2026-09-29 18:00:50 +02:00
jungfrau 3d39d40560 run 2026-09-29_v2-recipeA: gate_failed; comparison updated
CI / ledger-and-tools (push) Successful in 18s
2026-09-29 17:58:39 +02:00
jungfrau 0742281af0 baseline: yolo26n-seg-alc-v1-noflip-mask1-2026-09-29 re-measured on the gold set grown to 203 frames 2026-09-29 17:58:39 +02:00
jungfrau a6efca1c10 base weights yolo26n-seg.pt under LFS, so a cluster clone needs no download 2026-09-29 17:58:39 +02:00
jungfrau e7a02cd1ea run 2026-09-29_alc-v1-noflip-mask1: promoted (same detection as A, tightest masks); loop switches to it
CI / ledger-and-tools (push) Successful in 18s
2026-09-29 11:13:44 +02:00
jungfrau 703bfc2e11 run 2026-09-29_alc-v1-noflip-mask1: gate_passed, comparison updated
CI / ledger-and-tools (push) Successful in 18s
2026-09-29 10:37:36 +02:00
jungfrau 40dc9e54e3 run 2026-09-28_alc-v1-800px: gate_failed 2026-09-29 00:31:02 +02:00
jungfrau 13f4d6e3f7 run 2026-09-28_alc-v1-mask1: gate_failed 2026-09-28 23:54:53 +02:00
jungfrau e84bcfb658 run 2026-09-28_alc-v1-noflip: gate_passed 2026-09-28 21:30:31 +02:00
jungfrau ed208bff95 run 2026-09-28_alc-v1-humanonly: gate passed, not promoted (A/B on clean gold: masks no tighter without accepted-unchanged labels, crystal worse)
CI / ledger-and-tools (push) Successful in 17s
2026-09-28 20:44:27 +02:00
jungfrau 7bfd799c26 run 2026-09-28_alc-v1: promoted by the gate after the mask-term fix (F1 +0.045, mask score 0.678 -> 0.710)
CI / ledger-and-tools (push) Successful in 17s
2026-09-28 19:18:27 +02:00
jungfrau e8475684d4 run 2026-09-28_alc-v1: gate_failed (F1 +0.045, mask IoU -0.022 vs the deployed model)
CI / ledger-and-tools (push) Successful in 17s
2026-09-28 19:08:07 +02:00
jungfrau 71ee34cd17 baseline: gold measure of the deployed yolo26n-seg-overlap-false-2026-04-12 2026-09-28 16:51:45 +02:00
GotthardGandClaude Fable 5.1 4698dbeaf9 training loop: run ledger, studio export importer with an image pool, train_run with gold gate and auto-promotion, SLURM template, CI
CI / ledger-and-tools (push) Successful in 17s
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-28 16:06:06 +02:00
duan_j 4fba05631e track base models with git lfs 2026-04-14 16:15:10 +02:00
duan_j 391c357c84 migration and splitting AareLC 2026-04-14 16:07:31 +02:00