Files
AareLC_train/data
jungfrauandClaude Fable 5.1 845bd87bb3
CI / ledger-and-tools (push) Successful in 21s
a model is not measured on the gold frames it pre-labelled itself
Where a reviewer keeps an outline the model proposed, the gold holds the model's own mask,
which overlaps itself perfectly: on the 50 gold frames v4 had pre-labelled it scored a
matched IoU of 0.959 against 0.905 elsewhere, every other model 0.93, and that alone
produced the "mask dip" that failed all three v5 runs. tools/gold_prelabel.py records
which model proposed each gold frame (data/gold/prelabel.json, 265 of 335 frames);
gate_stats.without_own_proposals drops those frames from that model's measure; the unseen
comparison and the gate's paired bootstrap use it, so two models are compared on the
frames neither of them touched. The three v5 runs are re-gated on that basis, without
promotion.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-10-25 02:48:09 +02:00
..
2026-04-14 16:07:31 +02:00