Files
Jungfraujoch/tools/battery/timing.json
T
leonarski_fandClaude Opus 5.5 234774ff09
Build Packages / Create release (push) Successful in 7s
Build Packages / build:portable:macos-arm64:nocuda (push) Successful in 4m30s
Build Packages / build:portable:linux-x86_64:nocuda (push) Successful in 11m43s
Build Packages / build:rugnux:linux-aarch64:cuda (push) Successful in 7m21s
Build Packages / build:portable:linux-x86_64:cuda (push) Successful in 14m56s
Build Packages / HDF5 consumer tests (DIALS, XDS) (push) Successful in 20m57s
Build Packages / build:portable:windows-x86_64:nocuda (push) Successful in 21m54s
Build Packages / build:jfjoch:rocky8:nocuda (push) Successful in 15m14s
Build Packages / build:jfjoch:ubuntu2204:nocuda (push) Successful in 11m35s
Build Packages / build:portable:windows-x86_64:cuda (push) Successful in 26m0s
Build Packages / build:jfjoch:rocky9:nocuda (push) Successful in 17m21s
Build Packages / build:jfjoch:ubuntu2404:nocuda (push) Successful in 15m35s
Build Packages / build:jfjoch:rocky8:cuda-sls9 (push) Successful in 20m31s
Build Packages / build:jfjoch:rocky8:cuda (push) Successful in 20m41s
Build Packages / Generate python client (push) Successful in 28s
Build Packages / build:jfjoch:rocky9:cuda-sls9 (push) Successful in 22m5s
Build Packages / Build documentation (push) Successful in 1m0s
Build Packages / build:jfjoch:ubuntu2204:cuda (push) Successful in 14m33s
Build Packages / build:jfjoch:rocky9:cuda (push) Successful in 21m10s
Build Packages / build:jfjoch:ubuntu2404:cuda (push) Successful in 15m21s
Build Packages / Unit tests (push) Successful in 1h26m10s
Build Packages / Validation Battery (push) Failing after 1h6m19s
battery: a "standard" timing benchmark on open data, with every model committed
battery.py timing --benchmark standard (now the default) runs 9zlo, 9s02 and
9gjx from their AlphaFold DB models (AF-P17090-F1, AF-P32322-F1, AF-Q65MG6-F1
v6, with their PAE, as the 2026-10-16 AlphaFold MR scan used them; all three
GREEN there) and 4nwv from its deposited model moved by the existing fixed
transform. --benchmark inhouse keeps the earlier myob_x10sa / cytc_x10sa /
4nwv list. Same checks; expected groups are the deposited ones, R-free <= 0.50
for the predictions (0.35 for 4nwv), placement CC >= 0.30.

So that a machine needs only the raw data:
- the deposited coordinates of 9zlo, 9s02, 9gjx, 4nwv and 4dc8 (the inhouse
  myoglobin reference) are committed in tools/battery/models/pdb/ as the
  compressed mmCIF RCSB serves (CC0; 50-660 kB each, 1.6 MB together), and
  model_check.deposition reads an entry there before the pdb_cache, taking
  its refinement record from the file itself - no cache JSON, no network;
- open/inhouse arms default their manifest and reference, so a site config
  is just runs_root plus the data roots (site.timing.example.json);
- baseline_timing is now per benchmark ({"standard": RUN, "inhouse": RUN}).

Verified on the workstation through the GPU lock with a site config whose
pdb_cache is an empty directory (still empty afterwards): standard 4/4 pass
(9zlo 19 s, 9s02 30 s, 9gjx 21 s, 4nwv 89 s), inhouse 3/3 pass.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01PXc1zD1yxHqaR1DGdCTHL4
2026-10-16 16:49:04 +02:00

17 lines
4.0 KiB
JSON

{
"about": "Timing benchmarks (README: 'The timing benchmark'), chosen with battery.py timing --benchmark NAME: each set started from a model rugnux has to place by molecular replacement, timed per step and checked for a right answer. 'standard' needs only open data (the open arm's 9zlo, 9s02, 9gjx and 4nwv); 'inhouse' is the earlier set of two in-house standard proteins and 4nwv. 'start' is the model given to --model: an AlphaFold DB prediction committed in models/ (with its predicted aligned error beside it), or a deposited entry (committed in models/pdb/) moved by a fixed rigid-body transform (strict NCS expanded first, then x' = R (x - c) + c + t, R a rotation by 'deg' about the unit 'axis', c the centroid of the expanded asymmetric unit, t 'shift' in A). The reference model the placement is checked against is the one the battery itself uses for the set (its manifest row's 'model', else the PDB entry of the set id; committed in models/pdb/ for every set here but cytc_x10sa, whose reference_model.cif sits beside its data). 'expect': 'mr_sgno' the space group the placed model is in (the model decides the hand), 'rfree_max' the highest R_FREE accepted, 'cc_min' the lowest correlation of the placed model's intensities with the reference model's (shell-normalised, 10-4 A, best over the lattice's reindexing operators).",
"benchmarks": {
"standard": [
{"set": "9zlo", "arm": "open", "start": {"alphafold": "models/AF-P17090-F1-model_v6.cif", "why": "AlphaFold DB AF-P17090-F1 v6: urease accessory protein UreE, Proteus mirabilis (UniProt P17090), the deposited entity of 9ZLO; two copies to place (P 21 21 21, 2.0 A, EIGER 16M)"}, "expect": {"mr_sgno": 19, "rfree_max": 0.5, "cc_min": 0.3}},
{"set": "9s02", "arm": "open", "start": {"alphafold": "models/AF-P32322-F1-model_v6.cif", "why": "AlphaFold DB AF-P32322-F1 v6: pyrroline-5-carboxylate reductase 1, Homo sapiens (UniProt P32322; 9S02 deposits isoform 3); five copies to place (P 21 21 2, 1.65 A, EIGER2 16M)"}, "expect": {"mr_sgno": 18, "rfree_max": 0.5, "cc_min": 0.3}},
{"set": "9gjx", "arm": "open", "start": {"alphafold": "models/AF-Q65MG6-F1-model_v6.cif", "why": "AlphaFold DB AF-Q65MG6-F1 v6: NADH-dependent nitro/flavin oxidoreductase, Bacillus licheniformis (UniProt Q65MG6), the deposited entity of 9GJX; six copies to place (P 1 21 1, 2.4 A, EIGER 16M)"}, "expect": {"mr_sgno": 4, "rfree_max": 0.5, "cc_min": 0.3}},
{"set": "4nwv", "arm": "open", "start": {"moved": {"pdb": "4nwv", "axis": [0.36, 0.48, 0.8], "deg": 30.0, "shift": [12.0, -18.0, 25.0]}, "why": "the deposited model of 4NWV (I222, a virus capsid: 3 chains and 14 strict NCS operators, 45 chains once expanded), turned 30 deg and shifted 33 A: far outside what the rigid body corrects, so it is rejected and molecular replacement places the whole asymmetric unit"}, "expect": {"mr_sgno": 23, "rfree_max": 0.35, "cc_min": 0.3}}
],
"inhouse": [
{"set": "myob_x10sa", "arm": "inhouse", "start": {"alphafold": "models/AF-P68082-F1-model_v6.cif", "why": "AlphaFold DB AF-P68082-F1 v6: myoglobin, Equus caballus (UniProt P68082), the species of the battery's reference model 4DC8 (horse heart). No heme"}, "expect": {"mr_sgno": 4, "rfree_max": 0.5, "cc_min": 0.3}},
{"set": "cytc_x10sa", "arm": "inhouse", "start": {"alphafold": "models/AF-P62894-F1-model_v6.cif", "why": "AlphaFold DB AF-P62894-F1 v6: cytochrome c, Bos taurus (UniProt P62894), the protein of the battery's reference model (bovine heart, placed with 6FF5). No heme; three copies to place, related by a pseudo-translation"}, "expect": {"mr_sgno": 154, "rfree_max": 0.5, "cc_min": 0.3}},
{"set": "4nwv", "arm": "open", "start": {"moved": {"pdb": "4nwv", "axis": [0.36, 0.48, 0.8], "deg": 30.0, "shift": [12.0, -18.0, 25.0]}, "why": "the deposited model of 4NWV (I222, a virus capsid: 3 chains and 14 strict NCS operators, 45 chains once expanded), turned 30 deg and shifted 33 A: far outside what the rigid body corrects, so it is rejected and molecular replacement places the whole asymmetric unit"}, "expect": {"mr_sgno": 23, "rfree_max": 0.35, "cc_min": 0.3}}
]
}
}