Merge branch 'rc174-all3' into rc174
Build Packages / Create release (push) Successful in 17s
Build Packages / build:viewer:macos-arm64:nocuda (push) Successful in 3m24s
Build Packages / build:rugnux:macos-arm64:nocuda (push) Successful in 2m33s
Build Packages / build:rugnux:linux-aarch64:cuda (push) Successful in 8m38s
Build Packages / build:viewer:linux-x86_64:nocuda (push) Successful in 10m32s
Build Packages / build:rugnux:linux-x86_64:cuda (push) Successful in 10m30s
Build Packages / build:viewer:linux-x86_64:cuda (push) Successful in 13m6s
Build Packages / build:jfjoch:rocky8:nocuda (push) Successful in 18m19s
Build Packages / build:jfjoch:rocky9:nocuda (push) Successful in 19m13s
Build Packages / build:viewer:windows-x86_64:nocuda (push) Successful in 19m33s
Build Packages / HDF5 consumer tests (DIALS, XDS) (push) Successful in 23m49s
Build Packages / build:viewer:windows-x86_64:cuda (push) Successful in 24m43s
Build Packages / build:jfjoch:ubuntu2204:nocuda (push) Successful in 20m45s
Build Packages / build:jfjoch:ubuntu2404:nocuda (push) Successful in 19m3s
Build Packages / Generate python client (push) Successful in 22s
Build Packages / Build documentation (push) Successful in 1m2s
Build Packages / build:jfjoch:rocky8:cuda-sls9 (push) Successful in 20m56s
Build Packages / build:jfjoch:rocky9:cuda-sls9 (push) Successful in 20m41s
Build Packages / build:rugnux:windows-x86_64:cuda (push) Successful in 14m17s
Build Packages / build:jfjoch:rocky8:cuda (push) Successful in 19m1s
Build Packages / build:jfjoch:rocky9:cuda (push) Successful in 19m32s
Build Packages / build:jfjoch:ubuntu2204:cuda (push) Successful in 17m42s
Build Packages / build:jfjoch:ubuntu2404:cuda (push) Successful in 14m0s
Build Packages / Unit tests (push) Successful in 1h18m36s

This commit is contained in:
leonarski_f committed 2026-10-05 14:51:27 +02:00
commit aa4455b18e
21 files changed
+514 -149

No files matched your search

+1 -1
View File
@@ -342,7 +342,7 @@ Not scored: 7k1l (P 6 vs reference P 63: the screw along c is undeterminable fro
- 6pxb (open): we report P 31 1 2, the reference is P 32; accepted as P 32 1 2. The deposition merged in point group 3 (its 55502 unique reflections to 1.747 A are what Laue class -3 holds, twice what -3 1 m would) and refined six chains in P 32. The intensities read point group 312 instead: the three added two-folds correlate at 0.98-0.99, at or above the three-folds nobody disputes (0.98), against 0.37-0.40 for the 321 and 622 operators, POINTLESS on our P1 merge picks P -3 1 m (likelihood 1.000), and the reflections centric in 312 but not in 3 are distributed as centric (+435 nats), which a twin law cannot produce. Against that, the deposited chains pair under the added two-fold at 0.3-0.7 A, more than coordinate error at 1.75 A, and the model tells the two indexings apart (R 0.22 against 0.25), so the two-fold may be a near-exact non-crystallographic one; ZANUDA settles on P 32 2 1, whose operators these data do not support. Neither answer is established, so both are accepted; P 31 1 2, which the data cannot separate from P 32 1 2, is accepted as its hand
- 6toc (open): we report P 42 2 2, the reference is P 42; accepted as P 42 2 2. Our reduction and an independent POINTLESS run on our own P1 merge both read point group 422, and the deposited asymmetric unit's two chains are related by the very two-fold the higher group adds, to 0.16 A CA RMSD over 43 residues - coordinate error at 1.85 A. Merging in P 42 2 2 costs 0.0006 in R_meas for 1.75x the multiplicity and correlates better with the deposited model (0.9802 vs 0.9764). The refinement test is NOT unanimous: ZANUDA 1.097 refines P 42 2 2 to R-free 0.2561 against P 42's 0.2636 at half the parameters and reports the deposited assignment incorrect, while an independent Refmac 5.8.0431 comparison on a symmetry-consistent free set puts P 42 ahead by 0.004-0.020 depending on cycle count - less than the spread between refinement protocols. Neither answer is established: a pseudo-symmetry too exact for any test we have remains a live explanation, and so does the deposited assignment. Either is accepted
- 8xte (open): we report P 31 2 1, the reference is P 32; accepted as P 31 2 1. The evidence favours the higher group here. The twin-immune centric zone of the added two-folds - reflections the higher group makes centric, which are their own twin mates and so cannot be made to read centric by a merohedral twin law - gives <|E^2-1|> = 0.946 +/- 0.012 against a centric expectation of 0.968 and an acentric 0.736, at +707 nats. Re-refinement on a shared free set with the twin law removed from both sides favours P 3_2 2 1 (0.2177/0.2322) over P 3_2 (0.2460/0.2612), and the deposited entry's published R values reproduce only with an undeclared twin law h,-h-k,-l at alpha = 0.50, which is itself a 321-symmetric target. No refinement R can close the question in principle, because a merohedral twin at exactly alpha = 0.5 and true 321 predict identical intensities; the case rests on the centric zone. Both answers are accepted, ours being the better supported
- 8xtg (open): we report P 31 2 1, the reference is P 32; accepted as P 31 2 1. The evidence favours the DEPOSITION here, and this row must not be read as the 8xte one. Every correlation-based instrument we have - our own operator correlations, POINTLESS (0.85 on our P1 merge) - reads point group 321, but our own twin-immune centric-zone test, the only one that separates real symmetry from pseudo-symmetry, reads <|E^2-1|> = 0.869 at -44.9 nats, between the two expectations and on the wrong side, i.e. AGAINST the promotion, with an L-test twin fraction of 0.20-0.26. Whether this crystal is partially twinned or purely pseudo-symmetric is not established. Both answers are accepted, the deposition being the better supported
- 8xtg (open): we report P 31 2 1, the reference is P 32; accepted as P 31 2 1. The evidence favours the DEPOSITION here, and this row must not be read as the 8xte one. Every correlation-based instrument we have - our own operator correlations, POINTLESS (0.85 on our P1 merge) - reads point group 321, but our own twin-immune centric-zone test, the only one that separates real symmetry from pseudo-symmetry, read <|E^2-1|> = 0.869 at -44.9 nats against the promotion when it assumed an untwinned zone; read at the fraction of the crystal's other twin laws (rc174) it now favours the promotion, with an L-test twin fraction of 0.20-0.26. Whether this crystal is partially twinned or purely pseudo-symmetric is not established. Both answers are accepted, the deposition being the better supported
- 9rci (open): we report P 1, the reference is P 1; accepted as cell 35.869 39.297 199.976. The deposited cell is the (0,1/2,1/2)-centred sublattice of the supercell we report, to 0.17%, and both descriptions of this lattice are defensible. The Patterson has an off-origin peak at 62.5% of the origin, so a real translational NCS relates the two halves of our cell: describing the crystal by the doubled cell with the near-translation left in the content, or by its sublattice with the near-translation absorbed into the lattice, is a choice, not a measurement. The alternative cell is the deposited one doubled along c with the centring removed (c' = b + 2c), computed from the deposited cell alone - not from our output
### Per set
+4
View File
@@ -12,8 +12,12 @@
* Rugnux: French-Wilson amplitudes (`F`/`SIGF`) use an anisotropic Wilson prior from the fitted anisotropy tensor, as ctruncate does; intensities are unchanged.
* Rugnux claims a screw axis from a short axial row of a few weak reflections, so such crystals (e.g. P2_1 with a ~30 A unique axis) are no longer written without the screw.
* Rugnux keeps the screw axes it found when a higher point group is adopted after the twin-law check, instead of writing the group without screws (e.g. P 4 2 2 for P4_2 2_1 2).
* Rugnux keeps a nearly perfect merohedral twin in its true point group (e.g. P3_1 rather than P3_121) when the reflections the twin law cannot touch read acentric.
* Rugnux drops a rotation reflection whose spot held a saturated (overloaded) pixel, as XDS does, and reports the count as `OBSERVATIONS_REJECTED_OVERLOAD=`.
* Rugnux fits a rotation sweep's per-frame scale on the partial reflections, even with few reflections per frame, when scaling from the fulls alone leaves no measurable error model.
* Rugnux no longer refuses a genuine high-symmetry point group because one of its operators agrees with the data unusually well; it refuses a group whose operators split into an agreeing subgroup and a disagreeing rest.
* Rugnux no longer adopts an intermediate space group (e.g. C222_1 for a twinned P2_1 on a hexagonal metric) when the higher group was refused and the twin-immune reflections show the added two-folds to be a twin law.
* `rugnux --model` reports the anomalous difference map's mean height at the model's anomalous scatterers (phosphorus and heavier) as `ANOMALOUS_SCATTERER_MEAN_SIGMA=`, with their count as `ANOMALOUS_SCATTERERS=`.
* Rugnux names glide planes in groups without a centre of symmetry (e.g. I-42d, Fdd2), reports a group with the same absences (C2/c and Cc) as an alternative, and states how the centre was decided (`SPACE_GROUP_CENTRE`, `CENTRE_STATISTICS_*`).
### 1.0.0-rc.173
+4 -2
View File
@@ -48,13 +48,15 @@ Both search merges also drop the **frames whose fitted per-frame scale came out
**A confirmed promotion that is refused is decided by the twin-immune zone of its added operators, and only where that is undecided by merging under it.** The zone (§13.2) is the one reading that does not depend on the per-frame scales or on a reference operator: read on the all-observation P1 merge where the two search arms disagree, and on the adopted group's own merge at the remerge, an index-2 promotion whose calibrated zone evidence is acentric by 20 nats stays refused — on all observations, and the first added operator is recorded as the twin law — and one whose zone is centric by 20 nats is taken. Where the zone cannot decide (a higher index, no zone reflections in the shells with signal, within the margin), the merge is asked. Every gate that refuses a *confirmed* higher point group is a **ratio** — the added operators' disagreement against the parent's, or their $R$ against the best-agreeing operator anywhere — and both references are properties of how the crystal was mounted rather than of its symmetry. A 2-fold within a degree of the spindle records its mates on the same detector pixel half a turn later, so it carries no geometry-dependent systematic at all, and by being that clean it makes every other operator look bad against it; the best-agreeing operator can also be one of the operators under test, which collapses the ratio on worse data and raises it on better. So where a promotion is confirmed and then refused, the **merge** is asked instead of the ratio. Both groups are scaled and merged over one pinned resolution range — the adopted group's own cut — and the promotion is taken only if **neither $R_\mathrm{meas}$ nor ISa gets worse**. $R_\mathrm{meas}$ is multiplicity-corrected, so folding non-equivalent reflections together has to inflate it, and the error model is refitted per merge, so ISa says whether the extra multiplicity was bought with systematic disagreement. $CC_{1/2}$ and $\langle I/\sigma\rangle$ cannot arbitrate this: both *rise* on a false promotion too. Two details the comparison turns on: the refused point group's representative is primitive and symmorphic, so the arm merged under it takes the **adopted group's centring** — merged in the bare representative, a centred crystal is handed its centring-absent class as data, which inverts the decision — and the absence stage is asked of the adopted merge, so both arms carry the same absence classes and differ by the added rotations alone. That merge no longer holds the adopted group's screw-absent axial reflections, so the higher group also **keeps the screws the adopted group decided** — among the higher candidates the merge cannot separate, the one that predicts every such axial absence is taken — rather than the lowest-numbered one, which claims none. The cost is two extra merges, and only on a run that records a refusal, which is a few in a hundred.
**On a merge that reads twinned, the search asks the zone itself.** A twin of an index-2 subgroup by exactly the operators a promotion adds defeats every agreement gate once its fraction is high — the added operators then agree like real ones — so where the P1 merge's $\langle|L|\rangle$ lies in the partial-twin band (0.375 to 0.44) and the candidate does not hold every rotation of its lattice (so a twin law outside it is possible), the candidate is refused when the twin-immune zone of one of its index-2 subgroups reads acentric by 20 nats. Below 0.375 something other than a twin compresses the intensities, the zones with them, and they are not read. A $P3_1$ crystal twinned at $\alpha \ge 0.4$ by its 321 law, whose 32 promotion every agreement gate passed, reads −230 nats there.
**The lattice class is re-asked where the metric knows more.** The Bravais class comes from Niggli reduction and a lattice-character lookup (§6), and that lookup can land short of the truth or beside it: near the Niggli type-I/type-II boundary it is decided by the last digits of the refined cell, and a lattice that is nearly but not exactly hexagonal matches the hexagonal character even when no point group that class can host carries the two-folds the data actually have. Two recoveries run, both settled by the intensities. Every rotation the cell metric can host beyond the named class — read off Le Page's two-fold search on the lattice itself, which measures each rotation's obliquity in a primitive basis and owes nothing to the character table — is put to the intensities as a single operator, scored exactly as the search scores its own operators, on the same reflection population and the same $E^2$ normalisation. And where the metric group is larger than the adopted class's holohedry, the merge is reindexed into the metric group's conventional cell and the space-group search is run again there, with every gate live; the reindex is committed only where the search in the new setting confirms a strictly higher point group *and* the centring the new cell describes, so a pseudo-symmetric metric leaves the answer already in hand standing.
### 13.2 Twinning check, and translational pseudo-symmetry
A Padilla–Yeates $L$-test ($\langle|L|\rangle$, $\langle L^2\rangle$ — 0.500 and 0.333 untwinned, 0.375 and 0.200 for a perfect twin) and the second moment $\langle I^2\rangle/\langle I\rangle^2$ (2.0 for untwinned acentric data, 1.5 for a perfect twin) are written to the merged mmCIF as a twinning diagnostic. Both are taken on intensities divided by their resolution-shell mean, over the shells whose $\langle I/\sigma\rangle$ reaches 1, with Wilson outliers rejected; the $L$-test pairs are therefore compared on one scale even where two index steps span a steep fall-off, as in phenix.xtriage and ctruncate, and the selection is by shell, never by the individual reflection's $I/\sigma$, which would cut the weak tail and bias $\langle|L|\rangle$ down. The twin fraction is quoted from the statistic that carries the verdict — the $L$-test unless the call rests on the second moment alone — and a second moment is not turned into a fraction under a detected pseudo-translation, which inflates it. A merohedral twin law exists only where the Laue class is a proper subgroup of the lattice holohedry, so in the high-symmetry holohedral classes ($4/mmm$, $6/mmm$, $m\bar{3}m$, and $\bar{3}m$ on a rhombohedral lattice) no twin is called. The $L$-test is still read there, for a different question: merging $I(h)$ with $I(Th)$ under a false operator $T$ gives $(I(h)+I(Th))/2$ whatever the twin fraction, which has the perfect-twin distribution, so $\langle|L|\rangle$ below 0.42 in a holohedral class is reported as **an adopted operator averaging unequal intensities** — the space group is too high, or a twin law was absorbed into the point group — a warning, never a change to the space group. A genuine operator leaves the untwinned 0.5. Reflections that overlap along a very long axis narrow the distribution the same way, which is one reason it stays a warning. The same numbers measured on the P1 merge the space-group search was given, before any point group was adopted, are reported beside them (`_BEFORE_SEARCH`), with that merge's own pseudo-translation declared and the reflections its lattice centring extinguishes left out. The low-symmetry holohedral classes ($\bar{1}$, $2/m$, $mmm$) also admit no strictly merohedral law, but they stay eligible for the twin call on purpose: *pseudo*-merohedral twinning through an accidentally special metric cannot be ruled out from the symmetry alone, and those are the classes it happens in.
Beside them, on rotation data, the run reports **twin-immune zone evidence** for the operators the adopted point group adds over each of its index-2 subgroups, read on the P1 cross-check merge. Under a twin law $T$, $I_\mathrm{obs}(h)=(1-\alpha)I(h)+\alpha I(Th)$; a reflection whose twin mate is itself up to the subgroup and Friedel is untouched at every $\alpha$, and those are exactly the reflections centric in the group but acentric in the subgroup. They read centric ($\langle|E^2-1|\rangle = 0.968$) if the added operators are real and acentric (0.736) if they are a twin law or a pseudo-symmetry — the one intensity statistic that still separates the two at $\alpha = 0.5$, where every operator statistic reads "real". Each zone is normalised against its own mean in resolution bins (and within the two phase classes of a detected pseudo-translation), read only in shells with $\langle I/\sigma\rangle \ge 5$ because noise inflates every class towards centric, and reported with $n$, a standard error and the centric-over-acentric Wilson log-likelihood ratio in nats (both densities convolved with each reflection's measurement error), beside the acentric control. It is read absolutely, never as the difference to the control: a perfect twin's control (0.541) plus noise inflation would otherwise look like true symmetry. An absolute reading is only as good as the normalisation, though, and the acentric control certifies it: an acentric population reads $-0.130$ nats per reflection when the normalisation is right, and whatever the control reads above that is the normalisation's — anisotropy, a pseudo-translation, a pseudo-centring, noise all inflate every class towards centric alike — so the zone, normalised the same way, carries the same per reflection and the **calibrated** evidence has it taken off (a twinned control reads *below* the expectation, so nothing is taken off a twin). Measured, a 6/m crystal with a 67 Ų anisotropy read its control at $+0.10$ nats per reflection and the zone of a refused 622 the same, so the zone's $+124$ nats were the normalisation's; calibrated it reads $-115$, and genuine promotions keep $+200$ and above. The calibrated zone is what a refused promotion is decided on (above). It is an in-house method: published practice (Yeates' $H$-test, xtriage) excludes these reflections as uninformative about the twin fraction, and no published test was found that uses them positively; the one precedent here is a trigonal crystal whose twin-immune zone read centric and whose higher group was then confirmed by refinement.
Beside them, on rotation data, the run reports **twin-immune zone evidence** for the operators the adopted point group adds over each of its index-2 subgroups, read on the P1 cross-check merge. Under a twin law $T$, $I_\mathrm{obs}(h)=(1-\alpha)I(h)+\alpha I(Th)$; a reflection whose twin mate is itself up to the subgroup and Friedel is untouched at every $\alpha$, and those are exactly the reflections centric in the group but acentric in the subgroup. They read centric ($\langle|E^2-1|\rangle = 0.968$) if the added operators are real and acentric (0.736) if they are a twin law or a pseudo-symmetry — the one intensity statistic that still separates the two at $\alpha = 0.5$, where every operator statistic reads "real". Each zone is normalised against its own mean in resolution bins (and within the two phase classes of a detected pseudo-translation), read only in shells with $\langle I/\sigma\rangle \ge 5$ because noise inflates every class towards centric, and reported with $n$, a standard error and the centric-over-acentric Wilson log-likelihood ratio in nats (both densities convolved with each reflection's measurement error), beside the acentric control. It is read absolutely, never as the difference to the control: a perfect twin's control (0.541) plus noise inflation would otherwise look like true symmetry. An absolute reading is only as good as the normalisation, though, and the acentric control certifies it: an acentric population reads $-0.130$ nats per reflection when the normalisation is right, and whatever the control reads above that is the normalisation's — anisotropy, a pseudo-translation, a pseudo-centring, noise all inflate every class towards centric alike — so the zone, normalised the same way, carries the same per reflection and the **calibrated** evidence has it taken off (a twinned control reads *below* the expectation, so nothing is taken off a twin). The centric side is read **twinned at the fraction the lattice's other operations show** by their own correlation — the strongest CC of a lattice rotation outside the group, relative to the mean CC of the group's own operators, inverted through $\rho = 2\alpha(1-\alpha)/((1-\alpha)^2+\alpha^2)$ — because a twin by another law reaches a genuine zone exactly as it reaches the control: a genuine 321 crystal twinned by a 622 law read its 2-folds at −206 nats against the untwinned centric density and +209 at that law's fraction of 0.07. The operators' own twin law cannot reach their zone, so the acentric side stays untwinned, and the control's expectation is taken at the same fraction. Measured, a 6/m crystal with a 67 Ų anisotropy read its control at $+0.10$ nats per reflection and the zone of a refused 622 the same, so the zone's $+124$ nats were the normalisation's; calibrated it reads $-115$, and genuine promotions keep $+200$ and above. The calibrated zone is what a refused promotion is decided on (above). It is an in-house method: published practice (Yeates' $H$-test, xtriage) excludes these reflections as uninformative about the twin fraction, and no published test was found that uses them positively; the one precedent here is a trigonal crystal whose twin-immune zone read centric and whose higher group was then confirmed by refinement.
**Translational pseudo-symmetry** — two copies of the contents of the asymmetric unit related by a pure translation that is not a lattice vector — is looked for on every merging run, because it is the classic predictor of a failed molecular replacement, and because it raises the second moment where twinning lowers it, so each can mask the other's test. The detection is the native-Patterson route of Read, Adams & McCoy (see the [references](CPU_DATA_ANALYSIS.md#references)): the largest off-origin peak of a Patterson computed from the merged intensities, as a fraction of the origin peak, with the peak vector then refined against the intensity modulation it should produce — the ratio of the strongest to the weakest bin mean of $\langle E^2\rangle$ over the phase $\mathrm{frac}(\mathbf{h}\cdot\mathbf{u})$. Both halves are scored against a null computed for the crystal at hand rather than against a fixed bound — both against the same intensities **permuted within resolution shells** — the peak against that map, the modulation against the same measurement made on the shuffled intensities and started where the measurement starts — because the noise floor of the peak statistic spans an order of magnitude across data sets, so no fixed percentage means the same thing twice. The shuffle leaves the reflection count, the $E^2$ distribution and the phase-bin populations untouched and removes only the correlation between a reflection's intensity and $\mathbf{h}\cdot\mathbf{u}$, which is the thing the modulation claims to see. Re-running the greedy search from random starting vectors over the *same* intensities does not work as a control: a greedy search started anywhere walks into a real modulation's basin, so it measures the search **and** whatever modulation the crystal carries — measured over 110 merged datasets, single draws of that control reached 199× and 6162× on crystals whose own modulation reads 4.0× and 67×, and on 28 of the 110 it came out at or above the signal it is subtracted from. Requiring both halves is what keeps the false-positive rate down; either alone over-calls by about a factor of two. A translation the merged data are **exactly** invariant under is reported as an undeclared lattice translation instead — a translation the data are exactly invariant under is a lattice vector by definition, so the centring or the cell is wrong, not the packing — and the pseudo-symmetry search continues underneath it, so a real pseudo-translation sitting under an undeclared centring is still found. The finding itself is report-only (the `TNCS_*` keys of `<prefix>_report.txt`): it gates nothing and changes no reflection, no scale and no group — but the axial-absence test (§13.1) and the $L$-test here both correct themselves against the modulation it measures.
@@ -239,7 +241,7 @@ $
over the acentric reflections that have both hands (a centric reflection has no anomalous difference, only noise). Turning the model phase back by 90° is what makes the anomalous scattering, which is 90° out of phase with the normal scattering, add up in the real part: the map's peaks then sit on the anomalous scatterers. It is written as `<prefix>_anom.ccp4`. Its hand is the one §14.6 settled: with the mates the wrong way round every peak becomes a trough, so a map of clean peaks is itself a check that the frame is right.
Rather than searching the map for blobs and leaving a list of coordinates, the map is read **at the model's own atom centres** (hydrogens excluded — they scatter no anomalous signal), and the ten highest, in units of the map's r.m.s., are reported in the log and as `ANOMALOUS_SITE_01`…`ANOMALOUS_SITE_10` in the results report. Each site is therefore named — the atom, residue and chain it belongs to — which is what says *what* carries the signal, not just where it is. The reading is cubic, not linear: the map is sampled every $d_\mathrm{min}/3$, and a peak that sharp read by trilinear interpolation comes out up to a quarter low — unevenly enough to reorder the sites. This reading is the one ANODE reports.
Rather than searching the map for blobs and leaving a list of coordinates, the map is read **at the model's own atom centres** (hydrogens excluded — they scatter no anomalous signal), and the ten highest, in units of the map's r.m.s., are reported in the log and as `ANOMALOUS_SITE_01`…`ANOMALOUS_SITE_10` in the results report. Each site is therefore named — the atom, residue and chain it belongs to — which is what says *what* carries the signal, not just where it is. The reading is cubic, not linear: the map is sampled every $d_\mathrm{min}/3$, and a peak that sharp read by trilinear interpolation comes out up to a quarter low — unevenly enough to reorder the sites. This reading is the one ANODE reports. The same reading averaged over the model's **anomalous scatterers** — every atom from phosphorus ($Z = 15$) up: the S of Met and Cys, metals, Cl, I — is reported as `ANOMALOUS_SCATTERER_MEAN_SIGMA` (with their count, `ANOMALOUS_SCATTERERS`): one number for how much anomalous signal the merge carries, which does not depend on which ten atoms happen to come out on top. Below phosphorus (C, N, O, Na, Mg) $f''$ is a fraction of sulfur's at any wavelength these data are taken at, and counting those atoms would only dilute the mean with noise.
Because the map is built on the model's phases and the data's own indexing, it is also the only test of whether the two agree about the **hand** (§14.6). A model and a dataset in opposite hands turn every anomalous peak into a trough, so a map whose deepest hole at an atom is both deeper than $5\sigma$ and deeper than its highest peak says so, and the run reports it as a warning naming that atom. It is not repaired by reindexing: that would make the two agree by construction and destroy the evidence for which of the model and the data is in the wrong hand. Note that R-free cannot see this at all — a mirrored model gives R-free to four decimal places unchanged, and an exactly inverted anomalous map.
+3 -1
View File
@@ -154,7 +154,9 @@ It also writes the σ<sub>A</sub>-weighted maps `<prefix>_2fofc.ccp4` (2mFo−DF
`<prefix>_fofc.ccp4` (mFo−DFc), and the map-coefficient MTZ `<prefix>_maps.mtz`, next to the
merged reflections — and, where the merge kept the Bijvoet split (a rotation merge always does),
`<prefix>_anom.ccp4`, the anomalous difference map whose strongest sites the report names
(`ANOMALOUS_SITE_01`…`10`). The structure itself is not refined; the model is re-fractionalized into
(`ANOMALOUS_SITE_01`…`10`), and the map's mean height at the model's anomalous scatterers - every
atom from phosphorus up - as one number for the anomalous signal (`ANOMALOUS_SCATTERER_MEAN_SIGMA`).
The structure itself is not refined; the model is re-fractionalized into
the data cell and then placed as **one rigid body**, so a deposited model from a crystal that is not
quite isomorphous still sits where the density is. The placement runs on the GPU where there is one
and on the CPU otherwise, with nothing to set; the two agree to rounding, not bit for bit.
@@ -1222,7 +1222,13 @@ AnisotropyResult AnalyzeAnisotropy(const std::vector<MergedReflection> &merged,
result.delta_b = 0.0;
result.delta_b_linear = 0.0;
result.delta_b_flat = 0.0;
result.eigenvalue[0] = result.eigenvalue[1] = result.eigenvalue[2] = 0.0;
// Every frame is a principal frame of a zero tensor; the crystal axes are given, so that the
// tensor built from it (AnisotropyTensorHKL, the French-Wilson prior) is zero and not NaN.
for (int n = 0; n < 3; ++n) {
result.eigenvalue[n] = 0.0;
for (int j = 0; j < 3; ++j)
result.eigenvector[n][j] = n == j ? 1.0 : 0.0;
}
result.verdict = AnisotropyVerdict::NotDetected;
result.band = "no anisotropy is possible in this Laue class";
return result;
+127 -20
View File
@@ -1394,7 +1394,8 @@ SearchSpaceGroupResult SearchSpaceGroup(
// reason as h_ratio: to report the adopted candidate's whether or not it decided.
double r_added = std::numeric_limits<double>::quiet_NaN();
double r_over_floor = std::numeric_limits<double>::quiet_NaN();
// The candidate's OWN operators, worst R over best R (see max_operator_r_spread).
// The widest R gap between a subgroup of the candidate's own and the rest (see
// max_operator_r_spread).
double r_spread = std::numeric_limits<double>::quiet_NaN();
// Report-only, for the finalist ledger: the subgroup b the tests below compared
// this candidate against, whether it survived every consistency test, and - when
@@ -1546,6 +1547,50 @@ SearchSpaceGroupResult SearchSpaceGroup(
if (opt.cell.has_value())
lattice_rotations = gemmi::find_lattice_symmetry(*opt.cell, opt.lattice_centring,
LATTICE_TWIN_OBLIQUITY_DEG);
// The twin fraction the lattice operations OUTSIDE a group imply by their own correlation - what a
// twin law other than the group's operators compresses every reflection by, the zone of a genuine
// operator included (AnalyzeTwinImmuneZones' twin_fraction). The strongest of those operators' CCs,
// as a fraction of the mean CC of the group's own operators: the same noise holds a genuine
// operator's CC short of 1 and a twin law's short of what its fraction puts there. Inverted through
// rho = 2a(1-a) / ((1-a)^2 + a^2), the correlation a twin of fraction a puts between I(h) and I(Th).
// 0 where there is no lattice to ask, or no operator outside the group with pairs enough.
const auto twin_fraction_outside = [&](const auto &pg) {
if (!lattice_rotations || pg.rotations.empty())
return 0.0;
double cc_own = 0.0;
int n_own = 0;
for (const auto &rot : pg.rotations) {
const auto &os = operator_score(rot);
if (rot.rot != gemmi::Op::identity().rot && os.n_pairs >= opt.min_pairs_per_operator) {
cc_own += os.cc;
++n_own;
}
}
double cc_outside = 0.0;
for (const auto &op : lattice_rotations->sym_ops) {
if (op.rot == gemmi::Op::identity().rot
|| std::binary_search(pg.rotation_set.begin(), pg.rotation_set.end(), RotKey(op)))
continue;
const auto &os = operator_score(op);
if (os.n_pairs >= opt.min_pairs_per_operator)
cc_outside = std::max(cc_outside, os.cc);
}
if (n_own == 0 || !(cc_own > 0.0))
return 0.0;
const double rho = std::min(1.0, cc_outside / (cc_own / n_own));
return 0.5 * (1.0 - std::sqrt((1.0 - rho) / (1.0 + rho)));
};
// Whether the merge reads twinned, for the twin-immune zone gate: its <|L|> in the band a partial
// twin puts it in, from the perfect twin's 0.375 up to AnalyzeTwinning's bar of 0.44, the band the
// L-test gate below reads too. Measured once, on first use.
std::optional<bool> twinned;
const auto merge_reads_twinned = [&] {
if (!twinned) {
const auto t = AnalyzeTwinning(merged, nullptr, 20, nullptr, opt.lattice_centring);
twinned = t.l_test_pairs > 0 && t.mean_abs_l >= 0.375 && t.mean_abs_l < 0.44;
}
return *twinned;
};
for (auto& c : pg_cands) {
// A genuine symmetry operator merges equivalent reflections, so it barely changes the reduced
// chi^2 relative to the best subgroup - across the whole rotation-test battery every correct
@@ -1653,11 +1698,12 @@ SearchSpaceGroupResult SearchSpaceGroup(
if (n_new > 0 && pairs_new >= opt.min_pairs_for_h)
r_added = r_new / n_new;
}
// Homogeneity of the candidate's OWN operators: the worst-agreeing over the best-agreeing,
// over all of them, parent and added alike (see max_operator_r_spread).
// Homogeneity of the candidate's OWN operators, parent and added alike (see
// max_operator_r_spread): the largest factor by which every operator outside a subgroup agrees
// worse than every operator inside it. A subgroup that agrees better than all the rest is a
// prefix of the operators sorted by R, so each prefix that closes into a group is one split.
{
double r_lo = std::numeric_limits<double>::infinity(), r_hi = 0.0;
int n_op = 0;
std::vector<std::pair<double, gemmi::Op>> by_r;
for (const auto &rot : c.pg->rotations) {
if (rot.rot == gemmi::Op::identity().rot)
continue;
@@ -1665,10 +1711,19 @@ SearchSpaceGroupResult SearchSpaceGroup(
if (os.n_pairs < opt.min_pairs_per_operator || !std::isfinite(os.r_stat)
|| os.r_stat <= 0.0)
continue;
r_lo = std::min(r_lo, os.r_stat); r_hi = std::max(r_hi, os.r_stat); ++n_op;
by_r.emplace_back(os.r_stat, rot);
}
std::sort(by_r.begin(), by_r.end(),
[](const auto &a, const auto &b) { return a.first < b.first; });
if (by_r.size() >= 2) {
c.r_spread = 1.0;
std::vector<gemmi::Op> subgroup;
for (size_t k = 1; k < by_r.size(); ++k) {
subgroup.push_back(by_r[k - 1].second);
if (GeneratedRotationSet(subgroup).size() == subgroup.size() + 1)
c.r_spread = std::max(c.r_spread, by_r[k].first / by_r[k - 1].first);
}
}
if (n_op >= 2)
c.r_spread = r_hi / r_lo;
}
c.parent_b_used = parent_b;
c.r_added = r_added;
@@ -1732,8 +1787,9 @@ SearchSpaceGroupResult SearchSpaceGroup(
// operators with false ones. The gates above read summaries - mean H, mean R - so a promotion
// that adds two operators at the noise floor together with four several times worse reads a
// mean between them and passes, while the group it names is a mixture that cannot be a
// symmetry of one crystal. Asking instead that the candidate's operators agree with EACH OTHER
// sees the mixture directly (see max_operator_r_spread).
// symmetry of one crystal. Asking instead whether the candidate's operators split into a
// subgroup that agrees and a remainder that does not sees the mixture directly (see
// max_operator_r_spread).
const bool spread_refused = std::isfinite(c.r_spread) && c.r_spread > opt.max_operator_r_spread;
if (spread_refused)
consistent = false;
@@ -1761,15 +1817,16 @@ SearchSpaceGroupResult SearchSpaceGroup(
// - A perfect twin is out of reach by construction: there the unmerged data already read 0.375
// and averaging cannot move them, which is the theorem that no intensity statistic separates
// a perfect twin from the higher group.
bool l_refused = false;
LTestUnderMerge l_test;
if (consistent && !c.pg->rotations.empty() && c.pg->representative && lattice_rotations
const bool holds_lattice = lattice_rotations
&& std::all_of(lattice_rotations->sym_ops.begin(), lattice_rotations->sym_ops.end(),
[&](const gemmi::Op &op) {
return op.rot == gemmi::Op::identity().rot
|| std::binary_search(c.pg->rotation_set.begin(),
c.pg->rotation_set.end(), RotKey(op));
})) {
});
bool l_refused = false;
LTestUnderMerge l_test;
if (consistent && !c.pg->rotations.empty() && c.pg->representative && holds_lattice) {
l_test = AnalyzeLTestUnderMerge(merged, c.pg->rotations, c.pg->representative->centring_type());
constexpr double PERFECT_TWIN_L = 0.375;
constexpr double TWIN_LIKE_L = 0.44; // AnalyzeTwinning's own bar for a twin-like <|L|>
@@ -1782,17 +1839,61 @@ SearchSpaceGroupResult SearchSpaceGroup(
if (l_refused)
consistent = false;
// Twin-immune zone test, for a group that is NOT the whole symmetry of its lattice, on a merge
// that reads twinned: the other half of the twin argument. Where a lattice operation lies
// outside the candidate, a twin of one of its index-2 subgroups by exactly the operators the
// candidate adds over it is possible, and at a high twin fraction it defeats every gate above -
// the added operators then agree like real ones (H, R, chi^2 all read "real"), which is the
// theorem that no statistic of the operators' agreement separates a near-perfect twin from the
// higher group. What it cannot fake are the reflections centric in the candidate but not in the
// subgroup: they are their own twin mates, so the twin leaves them acentric and only a real
// operator makes them centric (AnalyzeTwinImmuneZones, read at the twin fraction the lattice's
// OTHER operations show, so that a twin by some other law does not make a genuine zone read
// acentric - twin_fraction_outside). Refused when a zone reads acentric by 20 nats - the bound a
// refusal's zone verdict is read on in Rugnux (TwinZoneVerdict) - unless the control is
// compressed beyond any twin, where the zones cannot separate the two (zones_ambiguous).
// - Measured: a P3_1 crystal twinned at 0.4 or more by its 321 law, whose 32 promotion every
// gate above passed (contrast 0.87, H ratio 0.97), reads -230 nats; a genuine P3_121
// crystal twinned by a 622 law, read at its other law's fraction 0.07, +209 (-206 read
// untwinned, which is why the fraction is read).
// - Only on a merge whose L-test reads twinned (merge_reads_twinned, on the P1 merge before any
// promotion): without twinning a twin law cannot pass the gates above, and a crystal that is
// not twinned is not asked a twin's question. Below the perfect twin's 0.375 something other
// than a twin compresses the intensities - overlapping spots, or the pseudo-cubic small-
// molecule metric whose zones read 0.64 beside a control at 0.58, below acentric itself - and
// it compresses the zones with them, so they are not read there either.
constexpr double ZONE_DECISIVE_NATS = 20.0;
bool zone_refused = false;
std::string zone_operators;
double zone_evidence = 0.0;
if (consistent && !c.pg->rotations.empty() && c.pg->representative && opt.cell.has_value()
&& lattice_rotations && !holds_lattice && merge_reads_twinned()) {
const auto zones = AnalyzeTwinImmuneZones(merged, *opt.cell, *c.pg->representative, nullptr,
opt.nthreads, twin_fraction_outside(*c.pg));
if (!zones.zones_ambiguous)
for (const auto &z : zones.zones)
if (z.n > 0 && z.calibrated_evidence_nats <= -ZONE_DECISIVE_NATS
&& z.calibrated_evidence_nats < zone_evidence) {
zone_refused = true;
zone_operators = z.operators;
zone_evidence = z.calibrated_evidence_nats;
}
}
if (zone_refused)
consistent = false;
if (!consistent) {
// Same three sentences the highest refusal gets below, but kept per candidate for the
// ledger: short, because the long form is written once for the group the user is told about.
c.why = h_refused ? "H ratio" : r_refused ? "added-operator R"
: spread_refused ? "operator spread" : l_refused ? "L-test under merge" : "merge chi^2";
: spread_refused ? "operator spread" : l_refused ? "L-test under merge"
: zone_refused ? "twin-immune zone" : "merge chi^2";
// Record the highest-order refusal so the caller can say WHY it is processing lower.
if (c.order > refused_order && c.pg->representative) {
refused_order = c.order;
refused_pg_hm = c.pg->representative->point_group_hm();
refused_pg_rep = c.pg->representative;
refused_twin_gate = h_refused || r_refused || spread_refused || l_refused;
refused_twin_gate = h_refused || r_refused || spread_refused || l_refused || zone_refused;
refused_fraction = h_refused ? std::max(0.0, 0.5 - h_added)
: std::numeric_limits<double>::quiet_NaN();
if (h_refused)
@@ -1825,10 +1926,10 @@ SearchSpaceGroupResult SearchSpaceGroup(
+ "x) - at full resolution the added operator relates reflections that "
"disagree far beyond measurement error, i.e. it is not a real symmetry";
else if (spread_refused)
refused_why = "its own operators disagree among themselves - the worst-agreeing "
"reads " + FormatDouble(c.r_spread, 1)
+ "x the intensity-weighted R of the best-agreeing one in the SAME "
"group (bound " + FormatDouble(opt.max_operator_r_spread, 1)
refused_why = "its own operators split in two - every operator outside one of its "
"subgroups reads at least " + FormatDouble(c.r_spread, 1)
+ "x the intensity-weighted R of every operator inside it (bound "
+ FormatDouble(opt.max_operator_r_spread, 1)
+ "x) - so the group pools operators the data support with operators "
"they do not, and cannot be a symmetry of one crystal";
else if (l_refused)
@@ -1838,6 +1939,11 @@ SearchSpaceGroupResult SearchSpaceGroup(
+ FormatDouble(l_test.mean_abs_l_merged, 3) + " averaged over its orbits, "
"on the same " + std::to_string(l_test.pairs) + " pairs - so an operator "
"of it averages unequal intensities";
else if (zone_refused)
refused_why = "the merge reads twinned, and the reflections its operators " + zone_operators
+ " leave as their own twin mates read acentric (" + FormatDouble(zone_evidence, 1)
+ " nats against centric, bound " + FormatDouble(ZONE_DECISIVE_NATS, 0)
+ ") - so they are a twin law of the subgroup, not a symmetry";
else if (std::isfinite(c.chi2) && std::isfinite(chi2_ref))
refused_why = "merge chi^2 is " + FormatDouble(c.chi2 / chi2_ref, 2)
+ "x the subgroup's (bound " + FormatDouble(opt.max_merge_chi2_ratio, 2) + ")";
@@ -1892,6 +1998,7 @@ SearchSpaceGroupResult SearchSpaceGroup(
// ratio of the group it forced rather than of the one Stage A would have taken.
result.global_best_operator_r = std::isfinite(global_best_r) ? global_best_r
: std::numeric_limits<double>::quiet_NaN();
result.twin_fraction_outside = twin_fraction_outside(*best_pg);
for (const auto& c : pg_cands)
if (c.pg == best_pg) {
result.generated_point_group_adopted = c.closure;
+25 -11
View File
@@ -488,17 +488,27 @@ struct SearchSpaceGroupOptions {
// horizontal 2-folds among the six a 622 promotion adds, and their R at the noise floor buys
// the other four a mean well inside the contrast bound. The mixture is invisible to any summary
// of the added set and obvious the moment the candidate's operators are compared with EACH
// OTHER: a point group is the claim that all of its operators are symmetries of one crystal, so
// they must agree with the merge about equally well.
// OTHER: a point group is the claim that all of its operators are symmetries of one crystal.
//
// Measured over the 129 rotation datasets of one battery run that adopted a group of order 3 or
// more, as worst-agreeing over best-agreeing operator WITHIN the adopted group: every correct
// adoption sits at 1.0-2.64, the highest being the weak cubic crystal whose near-spindle 3-fold
// is unusually clean (the same crystal that motivated the contrast above), then 2.30 for a
// fine-sliced tetragonal one. The one over-called point group on that run reads 4.87. 3.2 sits
// in that gap with 0.56 of headroom below and 1.67 above - deliberately well clear of the
// 2.0-2.6 spread a genuine group reaches, which is exactly where the old ratio-to-best gate's
// bound of 2.0 sat and why that gate had to go.
// What a mixture looks like is specific: the operators that are real form a SUBGROUP (the true
// group's intersection with the candidate), and every operator outside it is false. So the
// statistic is the largest factor by which every operator outside some subgroup reads a worse R
// than every operator inside it - a GAP between a subgroup and the rest.
//
// It was worst-over-best until it was measured to divide by an extreme order statistic, the pole
// the contrast above had already been introduced to remove. Genuine operators do not all agree
// equally well: anisotropic systematic error spreads them in a continuum, widest where a few
// dozen strong reflections dominate R. On a weak cubic crystal that spread alone took
// worst-over-best past the bound once dropping its overloaded reflections made its cleanest
// operator cleaner still, and the genuine group was refused; its widest gap stays near 2. A
// real mixture is a gap and reads about the same either way: a c-axis 2-fold and two horizontal
// ones at 0.04-0.06 under a 622 whose other eight operators read 0.23-0.26 give 3.6
// (worst-over-best 6.0), and a 222 that adds two false 2-folds to one real one 3.8 either way.
// The gap is never above worst-over-best, so no group admitted before can be refused now.
//
// The bound was calibrated as worst-over-best over the 129 rotation datasets of one battery run
// that adopted a group of order 3 or more: every correct adoption sat at 1.0-2.64 and the one
// over-called point group on that run at 4.87, and 3.2 sits in that gap.
double max_operator_r_spread = 3.2;
// Above this reduced chi^2 for the best subgroup (chi2_ref), the merged error model is treated as
@@ -724,7 +734,7 @@ struct PointGroupLedgerEntry {
double r_over_best = std::numeric_limits<double>::quiet_NaN(); // ... over the best-agreeing operator anywhere
double r_contrast = std::numeric_limits<double>::quiet_NaN(); // ... 0 = unrelated reflections, 1 = that best operator
double r_over_floor = std::numeric_limits<double>::quiet_NaN(); // ... over the merge's random-noise R floor
double r_spread = std::numeric_limits<double>::quiet_NaN(); // this group's own worst operator R over its best
double r_spread = std::numeric_limits<double>::quiet_NaN(); // widest R gap between a subgroup of its own and the rest
bool adopted = false; // this is the group the search took
bool eligible = false; // it passed every consistency test (so it COULD have been taken)
std::string refused_reason; // why it did not, when it was the highest refusal
@@ -804,6 +814,10 @@ struct SearchSpaceGroupResult {
double r_over_best = std::numeric_limits<double>::quiet_NaN();
double r_contrast = std::numeric_limits<double>::quiet_NaN();
double global_best_operator_r = std::numeric_limits<double>::quiet_NaN();
// The twin fraction the lattice operations outside the ADOPTED point group imply by their own
// correlation with the intensities - what the centric side of its twin-immune zones is read at
// (AnalyzeTwinImmuneZones' twin_fraction). 0 where no cell was given.
double twin_fraction_outside = 0.0;
// The intensity-weighted R of UNRELATED reflections on this merge - shell-matched pairs of
// reflections no symmetry relates. The far end of the contrast scale above: where a false
+101 -34
View File
@@ -616,37 +616,89 @@ namespace {
// A reflection this far above its bin mean is not a Wilson draw (centric P ~ 1e-5): one such
// reflection read 2.33 for a whole zone.
constexpr double ZONE_OUTLIER_E2 = 20.0;
// What CentricOverAcentric averages over an error-free acentric population: with x = E^2 ~ Exp(1),
// <-ln(2 pi x)/2 + x/2> = (1 + gamma_E - ln 2 pi)/2 = -0.130 nats (a centric one reads +0.216).
// Errors move it towards zero, so an error-free baseline takes the larger excess off a noisy
// control - the conservative side.
constexpr double ACENTRIC_EVIDENCE_PER_REFLECTION = -0.1303;
// exp(-y) I0(y), I0 the modified Bessel function of order zero: its power series, and above y = 50
// (where the series would want a hundred terms) the first terms of the asymptotic expansion.
double I0Scaled(double y) {
if (y >= 50.0)
return (1.0 + 1.0 / (8.0 * y) + 9.0 / (128.0 * y * y)) / std::sqrt(2.0 * std::numbers::pi * y);
double term = 1.0, sum = 1.0;
for (int k = 1; term > 1e-17 * sum; ++k) {
term *= y * y / (4.0 * k * k);
sum += term;
}
return std::exp(-y) * sum;
}
// ln p_centric(E^2) - ln p_acentric(E^2) for a measured E^2 with error s: both Wilson densities
// convolved with the measurement error. Without the convolution the centric density, infinite at
// zero, reads every noisy weak reflection as decisive; flooring E^2 at s instead turns the centric
// excess of weak reflections into moderate values and read a genuine centric zone of a 1.2 A
// crystal as acentric. Integrated over u = sqrt(E^2_true), where neither density is singular,
// across +-6 s of the measurement (trapezoid).
double CentricOverAcentric(double e2, double s) {
// The Wilson densities of E^2 = u^2 as densities in u (times dE^2/du = 2u), where neither is
// singular at zero: the untwinned acentric (exponential) one, and the centric one twinned at a
// fraction a - every observed intensity (1 - a) I1 + a I2 of two independent centric reflections.
// That is the density of a weighted sum of two chi^2 variables of one degree of freedom, c1 = 1 - a
// and c2 = a: exp(-x/(2 c1)) exp(-y) I0(y) / (2 sqrt(c1 c2)), y = x (c1 - c2) / (4 c1 c2); at a = 0
// the plain chi^2 density, at a = 0.5 the exponential.
double AcentricDensity(double u) {
return 2.0 * u * std::exp(-u * u);
}
double CentricDensity(double u, double a) {
if (a == 0.0)
return std::sqrt(2.0 / std::numbers::pi) * std::exp(-0.5 * u * u);
const double c1 = 1.0 - a, c2 = a;
return u / std::sqrt(c1 * c2) * std::exp(-u * u / (2.0 * c1))
* I0Scaled(u * u * (c1 - c2) / (4.0 * c1 * c2));
}
// A density of E^2 convolved with the measurement error of one reflection, E^2 measured with error
// s, up to a factor common to every density. Without the convolution the centric density, infinite
// at zero, reads every noisy weak reflection as decisive; flooring E^2 at s instead turns the
// centric excess of weak reflections into moderate values and read a genuine centric zone of a
// 1.2 A crystal as acentric. Integrated over u = sqrt(E^2_true) across +-6 s of the measurement
// (trapezoid).
template <class Density>
double Convolved(double e2, double s, Density density) {
constexpr int n = 200;
const double u_lo = std::sqrt(std::max(0.0, e2 - 6.0 * s));
const double u_hi = std::sqrt(std::max(0.0, e2 + 6.0 * s));
if (!(u_hi > u_lo))
return 0.0;
const double du = (u_hi - u_lo) / n;
double p_centric = 0.0, p_acentric = 0.0;
double p = 0.0;
for (int i = 0; i <= n; ++i) {
const double u = u_lo + i * du;
const double w = (i == 0 || i == n ? 0.5 : 1.0) * std::exp(-0.5 * std::pow((e2 - u * u) / s, 2));
p_centric += w * std::sqrt(2.0 / std::numbers::pi) * std::exp(-0.5 * u * u);
p_acentric += w * 2.0 * u * std::exp(-u * u);
p += (i == 0 || i == n ? 0.5 : 1.0) * std::exp(-0.5 * std::pow((e2 - u * u) / s, 2)) * density(u);
}
return p;
}
// What CentricOverAcentric averages over an error-free acentric population, with the centric side
// twinned at a: -KL(acentric || centric at a), by the midpoint rule in u. At a = 0, with
// x = E^2 ~ Exp(1), <-ln(2 pi x)/2 + x/2> = (1 + gamma_E - ln 2 pi)/2 = -0.130 nats (a centric
// population reads +0.216); -0.038 at a = 0.1 and -0.012 at 0.2, the two densities closing in.
// Errors move it towards zero, so an error-free baseline takes the larger excess off a noisy
// control - the conservative side.
double AcentricEvidencePerReflection(double a) {
constexpr int n = 4000;
constexpr double u_max = 7.0; // exp(-49): nothing of the acentric density is left
const double du = u_max / n;
double sum = 0.0;
for (int i = 0; i < n; ++i) {
const double u = (i + 0.5) * du;
const double p_acentric = AcentricDensity(u);
sum += p_acentric * std::log(CentricDensity(u, a) / p_acentric) * du;
}
return sum;
}
// ln p_centric(E^2) - ln p_acentric(E^2) for a measured E^2 with error s: the centric density at
// twin fraction a, the acentric one untwinned (see AnalyzeTwinImmuneZones).
double CentricOverAcentric(double e2, double s, double a) {
const double p_centric = Convolved(e2, s, [a](double u) { return CentricDensity(u, a); });
const double p_acentric = Convolved(e2, s, [](double u) { return AcentricDensity(u); });
return p_centric > 0.0 && p_acentric > 0.0 ? std::log(p_centric / p_acentric) : 0.0;
}
// `twin_fraction` is the compression the centric hypothesis is read at (CentricOverAcentric).
TwinImmuneZone ReadZone(std::vector<const MergedReflection*> refl, const std::array<double, 3>* tncs,
size_t nthreads) {
size_t nthreads, double twin_fraction) {
TwinImmuneZone z;
// The evidence of each kept reflection is a pure function of its (E^2, error) and costs a few
// hundred exponentials, so the pairs are collected here and evaluated together below; the sum
@@ -698,7 +750,7 @@ namespace {
ParallelChunks(static_cast<int>(kept_e2_s.size()), ThreadsForWork(kept_e2_s.size(), nthreads, 1024),
[&](int lo, int hi) {
for (int i = lo; i < hi; ++i)
evidence[i] = CentricOverAcentric(kept_e2_s[i].first, kept_e2_s[i].second);
evidence[i] = CentricOverAcentric(kept_e2_s[i].first, kept_e2_s[i].second, twin_fraction);
});
for (const double e : evidence)
z.evidence_nats += e;
@@ -715,7 +767,8 @@ namespace {
void Calibrate(TwinImmuneZoneResult& result) {
if (result.control.n > 0)
result.control_excess_per_reflection = std::max(
0.0, result.control.evidence_nats / result.control.n - ACENTRIC_EVIDENCE_PER_REFLECTION);
0.0, result.control.evidence_nats / result.control.n
- AcentricEvidencePerReflection(result.twin_fraction));
result.control.calibrated_evidence_nats =
result.control.evidence_nats - result.control.n * result.control_excess_per_reflection;
for (auto& z : result.zones)
@@ -844,14 +897,17 @@ namespace {
return strong;
}
// The reflections acentric in the group: the control every zone is read beside.
// The reflections acentric in the group: the control every zone is read beside, with the evidence
// read as the zones' is (at the same twin fraction), which is what the calibration measures the
// normalisation's excess on.
TwinImmuneZone ReadControl(const std::vector<MergedReflection>& strong, const gemmi::GroupOps& gops,
const std::array<double, 3>* tncs_vector, size_t nthreads) {
const std::array<double, 3>* tncs_vector, double twin_fraction,
size_t nthreads) {
std::vector<const MergedReflection*> control;
for (const auto& r : strong)
if (!gops.is_reflection_centric(gemmi::Op::Miller{{r.h, r.k, r.l}}))
control.push_back(&r);
TwinImmuneZone z = ReadZone(control, tncs_vector, nthreads);
TwinImmuneZone z = ReadZone(control, tncs_vector, nthreads, twin_fraction);
z.operators = "acentric";
return z;
}
@@ -861,7 +917,8 @@ namespace {
TwinImmuneZone ReadSubgroupZone(const std::vector<MergedReflection>& strong,
const gemmi::GroupOps& gops, const std::vector<gemmi::Op>& rotations,
const std::vector<gemmi::Op>& h_ops,
const std::array<double, 3>* tncs_vector, size_t nthreads) {
const std::array<double, 3>* tncs_vector, double twin_fraction,
size_t nthreads) {
auto contains = [&](const std::vector<gemmi::Op>& set, const gemmi::Op& op) {
return std::any_of(set.begin(), set.end(), [&](const gemmi::Op& o) { return o.rot == op.rot; });
};
@@ -875,7 +932,7 @@ namespace {
if (gops.is_reflection_centric(h) && !centric_in_h)
zone.push_back(&r);
}
TwinImmuneZone z = ReadZone(zone, tncs_vector, nthreads);
TwinImmuneZone z = ReadZone(zone, tncs_vector, nthreads, twin_fraction);
for (const auto& op : rotations)
if (!contains(h_ops, op))
z.operators += (z.operators.empty() ? "" : " ") + op.as_hkl().triplet();
@@ -886,8 +943,10 @@ namespace {
TwinImmuneZoneResult AnalyzeTwinImmuneZone(const std::vector<MergedReflection>& p1_merged,
const gemmi::UnitCell& cell, const gemmi::SpaceGroup& group,
const gemmi::SpaceGroup& subgroup,
const std::array<double, 3>* tncs_vector) {
const std::array<double, 3>* tncs_vector, size_t nthreads,
double twin_fraction) {
TwinImmuneZoneResult result;
result.twin_fraction = twin_fraction;
result.tncs_normalised = tncs_vector != nullptr;
const gemmi::GroupOps gops = group.operations();
const std::vector<gemmi::Op> rotations = ProperRotations(gops);
@@ -895,16 +954,19 @@ TwinImmuneZoneResult AnalyzeTwinImmuneZone(const std::vector<MergedReflection>&
const auto strong = StrongReflections(p1_merged, cell, gops, result);
if (strong.empty())
return result;
result.control = ReadControl(strong, gops, tncs_vector, 1);
result.zones.push_back(ReadSubgroupZone(strong, gops, rotations, h_ops, tncs_vector, 1));
result.control = ReadControl(strong, gops, tncs_vector, twin_fraction, nthreads);
result.zones.push_back(ReadSubgroupZone(strong, gops, rotations, h_ops, tncs_vector, twin_fraction,
nthreads));
Calibrate(result);
return result;
}
TwinImmuneZoneResult AnalyzeTwinImmuneZones(const std::vector<MergedReflection>& p1_merged,
const gemmi::UnitCell& cell, const gemmi::SpaceGroup& group,
const std::array<double, 3>* tncs_vector, size_t nthreads) {
const std::array<double, 3>* tncs_vector, size_t nthreads,
double twin_fraction) {
TwinImmuneZoneResult result;
result.twin_fraction = twin_fraction;
result.tncs_normalised = tncs_vector != nullptr;
const gemmi::GroupOps gops = group.operations();
@@ -955,12 +1017,13 @@ TwinImmuneZoneResult AnalyzeTwinImmuneZones(const std::vector<MergedReflection>&
const auto strong = StrongReflections(p1_merged, cell, gops, result);
if (strong.empty())
return result;
result.control = ReadControl(strong, gops, tncs_vector, nthreads);
result.control = ReadControl(strong, gops, tncs_vector, twin_fraction, nthreads);
// Per hypothesis H, the zone: centric in the group, acentric in H - the reflections some added
// operator sends to -h, i.e. the self-mates of that coset read as a twin law.
for (const auto& h_ops : subgroups)
result.zones.push_back(ReadSubgroupZone(strong, gops, rotations, h_ops, tncs_vector, nthreads));
result.zones.push_back(ReadSubgroupZone(strong, gops, rotations, h_ops, tncs_vector, twin_fraction,
nthreads));
Calibrate(result);
return result;
}
@@ -977,10 +1040,14 @@ std::string TwinImmuneZonesToText(const TwinImmuneZoneResult& result) {
<< " Reflections centric in the group but not in the subgroup are their own twin mates: centric if\n"
<< " the added operators are real, acentric if they are a twin law or a pseudo-symmetry. <|E^2-1|>\n"
<< " reads 0.968 centric, 0.736 acentric; evidence is the centric/acentric log-likelihood ratio\n"
<< " (> 0: the added operators are real). The acentric control reads -0.130 nats per reflection\n"
<< " when the normalisation is right; what it reads above that is the normalisation's (" << std::showpos
<< std::setprecision(3) << result.control_excess_per_reflection << std::noshowpos
<< " here), every\n zone carries the same per reflection, and the calibrated evidence has it taken off.\n";
<< " (> 0: the added operators are real), the centric side twinned at a fraction of "
<< std::setprecision(2) << result.twin_fraction << " - what the\n"
<< " lattice's other twin laws show by their own correlation, and reach a genuine zone with. The\n"
<< " acentric control reads " << std::setprecision(3) << AcentricEvidencePerReflection(result.twin_fraction)
<< " nats per reflection when the normalisation is right; what it reads above\n"
<< " that is the normalisation's (" << std::showpos << result.control_excess_per_reflection << std::noshowpos
<< " here), every zone carries the same per reflection, and the calibrated\n"
<< " evidence has it taken off.\n";
auto row = [&](const TwinImmuneZone& z) {
os << " " << std::left << std::setw(34) << z.operators << std::right << " n " << std::setw(6) << z.n
<< " <|E^2-1|> " << std::setprecision(3) << z.mean_abs_e2_minus_1 << " +- " << z.standard_error
+15 -3
View File
@@ -139,7 +139,8 @@ struct TwinImmuneZone {
// Log-likelihood ratio, centric over acentric Wilson (each convolved with the reflection's error),
// summed over the zone: > 0 favours the operators being real symmetry, < 0 a twin law or
// pseudo-symmetry. About +0.2 nats per reflection for a centric zone and -0.13 for an acentric one
// on error-free data; less either way as the errors grow.
// on error-free untwinned data; less either way as the errors grow. The centric density is the one
// twinned at the fraction the caller gives (TwinImmuneZoneResult::twin_fraction).
double evidence_nats = 0.0;
// The same less n times the control's excess (TwinImmuneZoneResult::control_excess_per_reflection):
// what a verdict is read on.
@@ -159,6 +160,8 @@ struct TwinImmuneZoneResult {
// nats were the normalisation's, and the verdict rescued a twin law. Calibrated, that zone reads
// -115 nats; the zones of genuine promotions keep +140 nats (a 90 deg tetragonal sweep) to +2000.
double control_excess_per_reflection = 0.0;
// The twin fraction the centric side of every zone was read at (AnalyzeTwinImmuneZones).
double twin_fraction = 0.0;
// The control reads more compressed than a PERFECT twin's acentric population (<|E^2-1|> 0.541, by
// more than three standard errors). Twinning cannot do that at any fraction, so something else
// averages each reflection with unrelated ones - overlapping spots of a long cell, neighbour
@@ -174,16 +177,25 @@ struct TwinImmuneZoneResult {
bool tncs_normalised = false; // normalised within the pseudo-translation's two phase classes
};
// `twin_fraction` is what the centric hypothesis is read at. A twin law OTHER than the operators a zone
// is read for averages the zone's reflections with unrelated ones exactly as it does every other
// reflection, so where the crystal is twinned by such a law a genuine centric zone does not read the
// untwinned centric 0.968: at a fraction a it reads 0.88 (a = 0.1), 0.81 (0.2), 0.74 (0.5), and against
// the untwinned centric density it reads acentric - a genuine 321 crystal twinned by a 622 law read its
// genuine 2-folds at -206 nats. The operators' OWN twin law cannot reach their zone, which is the whole
// argument, so the acentric side stays untwinned whatever the fraction. The caller passes the fraction
// the lattice's other twin laws imply (TwinFractionOutsideGroup); 0 reads the untwinned densities.
TwinImmuneZoneResult AnalyzeTwinImmuneZones(const std::vector<MergedReflection>& p1_merged,
const gemmi::UnitCell& cell, const gemmi::SpaceGroup& group,
const std::array<double, 3>* tncs_vector = nullptr,
size_t nthreads = 1);
size_t nthreads = 1, double twin_fraction = 0.0);
// The same for ONE hypothesis: the operators `group` adds over `subgroup` (one zone in the result,
// beside the control). Read where a promotion from the subgroup to the group is in question.
TwinImmuneZoneResult AnalyzeTwinImmuneZone(const std::vector<MergedReflection>& p1_merged,
const gemmi::UnitCell& cell, const gemmi::SpaceGroup& group,
const gemmi::SpaceGroup& subgroup,
const std::array<double, 3>* tncs_vector = nullptr);
const std::array<double, 3>* tncs_vector = nullptr,
size_t nthreads = 1, double twin_fraction = 0.0);
std::string TwinImmuneZonesToText(const TwinImmuneZoneResult& result);
+11
View File
@@ -80,6 +80,10 @@ constexpr double ANOMALOUS_INVERSION_SIGMA = 5.0;
// signal is there and what carries it; a full site list is what the map file is for.
constexpr size_t MAX_ANOMALOUS_SITES = 10;
// The lightest element counted as an anomalous scatterer: phosphorus. Below it (C, N, O, Na, Mg) f''
// is a fraction of sulfur's at any wavelength these data are taken at.
constexpr int ANOMALOUS_SCATTERER_MIN_Z = 15;
// How many random placements of the same model the real fit is compared against. The verdict is
// (real - mean)/sd of this sample, so what matters is not the mean but how well the SPREAD is
// pinned: the relative error on an sd from n draws is 1/sqrt(2(n-1)), and a sample that happens to
@@ -1290,6 +1294,7 @@ ModelValidationResult Validate(const std::vector<MergedReflection> &merged,
const gemmi::Grid<float> grid = map_from_coefficients(mapanom);
const double rms = write_ccp4(grid, output_prefix + "_anom.ccp4");
std::vector<ModelValidationResult::AnomalousSite> sites;
double scatterer_sum = 0;
for (gemmi::Model &m : st.models)
for (gemmi::Chain &ch : m.chains)
for (gemmi::Residue &r : ch.residues)
@@ -1300,7 +1305,13 @@ ModelValidationResult Validate(const std::vector<MergedReflection> &merged,
r.seqid.str()),
rms > 0 ? grid.interpolate_value(a.pos, MAP_INTERPOLATION_ORDER) / rms
: 0.0});
if (a.element.atomic_number() >= ANOMALOUS_SCATTERER_MIN_Z) {
scatterer_sum += sites.back().sigma;
result.anomalous_scatterers++;
}
}
if (result.anomalous_scatterers > 0)
result.anomalous_scatterer_mean_sigma = scatterer_sum / result.anomalous_scatterers;
std::sort(sites.begin(), sites.end(),
[](const auto &x, const auto &y) { return x.sigma > y.sigma; });
+4
View File
@@ -119,6 +119,10 @@ struct ModelValidationResult {
};
std::vector<AnomalousSite> anomalous_sites;
int anomalous_pairs = 0; // Bijvoet pairs the anomalous map was computed from
// The same map's mean height at the model's anomalous scatterers - every atom from phosphorus up
// (S of Met/Cys, metals, Cl, I, ...) - one number for how much anomalous signal the data carry.
int anomalous_scatterers = 0;
double anomalous_scatterer_mean_sigma = NAN;
// Set when the anomalous map is inverted at the model's atoms - deeper troughs than peaks - which
// says the data and the model are in opposite hands. Named so the report can quote the evidence.
+4
View File
@@ -2118,6 +2118,10 @@ ReportDocument BuildReportDocument(const std::string &output_prefix,
}
if (!mv.anomalous_sites.empty()) {
Add(s, KeyInt("ANOMALOUS_BIJVOET_PAIRS", mv.anomalous_pairs));
if (mv.anomalous_scatterers > 0) {
Add(s, KeyInt("ANOMALOUS_SCATTERERS", mv.anomalous_scatterers));
Add(s, KeyReal("ANOMALOUS_SCATTERER_MEAN_SIGMA", mv.anomalous_scatterer_mean_sigma, "{:.2f}"));
}
for (size_t i = 0; i < mv.anomalous_sites.size(); i++)
// Two digits so the ten keys are the same width and the values line up.
Add(s, KeyText(fmt::format("ANOMALOUS_SITE_{:02}", i + 1).c_str(),
+60 -9
View File
@@ -2127,9 +2127,11 @@ namespace {
// The margin is the screw-axis convention (SearchSpaceGroupOptions::min_screw_absence_evidence):
// the same log-likelihood-ratio units, and the same bound of 20 nats. Read over three batteries
// the zones of genuine promotions sit at +60 nats and above and the zones behind the known
// twins at -290 nats and below, with one genuine trigonal crystal at -46 nats whose promotion
// no gate refused - so the bound is not what separates them, and a refusal a gate did fire is
// the only place the verdict is read.
// twins at -290 nats and below, with genuine trigonal crystals at -46 and -206 nats whose
// promotion no gate refused - twinned by a law other than the 2-folds, which reaches their zone.
// Read at the twin fraction those other laws show (twin_fraction_outside) the -206 one reads
// +209, and the search itself now asks the zone of a promotion on a merge that reads twinned
// (SearchSpaceGroup's twin-immune zone test); here it is read where a gate refused.
//
// Read on the CALIBRATED evidence: the zone's less what the acentric control shows the
// normalisation to add per reflection (TwinImmuneZoneResult::control_excess_per_reflection). The
@@ -2148,7 +2150,8 @@ namespace {
if (higher.point_group_order != 2 * lower.point_group_order)
return 0;
const auto z = AnalyzeTwinImmuneZone(p1_merged, cell, *higher.point_group_representative,
*lower.point_group_representative, tncs_vector);
*lower.point_group_representative, tncs_vector, 1,
higher.twin_fraction_outside);
Logger logger("Rugnux");
if (z.zones.empty() || z.zones[0].n == 0) {
logger.Info("Twin-immune zone {} over {}: no zone reflections in the shells with signal "
@@ -2161,9 +2164,10 @@ namespace {
: zone.calibrated_evidence_nats >= DECISIVE_NATS ? +1 : 0;
const std::string text = fmt::format(
"{} over {}: operators {}; n {} <|E^2-1|> {:.3f} +- {:.3f} (control {:.3f}, {:+.3f} nats per "
"reflection above acentric), evidence {:+.1f} nats, calibrated {:+.1f} ({:.2f}-{:.2f} A{}) -> {}",
"reflection above acentric), centric read twinned at {:.2f}, evidence {:+.1f} nats, calibrated "
"{:+.1f} ({:.2f}-{:.2f} A{}) -> {}",
higher.point_group_hm, lower.point_group_hm, zone.operators, zone.n, zone.mean_abs_e2_minus_1,
zone.standard_error, z.control.mean_abs_e2_minus_1, z.control_excess_per_reflection,
zone.standard_error, z.control.mean_abs_e2_minus_1, z.control_excess_per_reflection, z.twin_fraction,
zone.evidence_nats, zone.calibrated_evidence_nats, z.d_max_A, z.d_min_A,
z.tncs_normalised ? ", normalised per pseudo-translation class" : "",
verdict < 0 && z.zones_ambiguous
@@ -7824,8 +7828,53 @@ ProcessResult Rugnux::RunPipeline(RugnuxObserver *observer, bool write_output, b
if (alt.centring_type() == cand.centering) { chosen = alt; break; }
const bool point_group_higher = s2.best_space_group.has_value()
&& s2.point_group_order > sg_search.point_group_order;
const bool higher = point_group_higher
&& chosen->centring_type() == cand.centering;
bool higher = point_group_higher
&& chosen->centring_type() == cand.centering;
// A promotion over a refusal is arbitrated by the twin-immune zone of the added
// operators (TwinZoneVerdict), here as where the two arms disagree: where a twin
// gate of the search in hand refused a higher group, this ask reopens the question
// that gate answered, for whichever of the refused group's operators the new
// lattice holds, and its own search cannot answer it - the gates there are relative
// too, and a twin law or a pseudo-symmetry the refused group's other operators
// diluted passes them alone. Measured on a monoclinic crystal on a hexagonal metric,
// a pseudo-merohedral twin: 622 refused on the added-operator R, the C-centred
// orthorhombic sub-lattice then asked, its two in-plane two-folds at R 0.061 against
// 0.045 for the genuine screw, and C 2 2 21 adopted with the zone of those two-folds
// reading acentric. The group in hand is carried into the candidate's setting for
// it: h -> Q h with Q the reindex from the basis it was found in (read where GEMMI's
// table names the result, as every setting the search enumerates is).
std::string zone_refusal;
if (higher && sg_search.refused_by_twin_gate && sg_search.point_group_representative) {
gemmi::Mat33 q = reindex;
if (commit_reindex)
q = reindex.multiply(commit_reindex->inverse());
const gemmi::Mat33 q_inv = q.inverse();
gemmi::GroupOps lower_ops;
lower_ops.cen_ops = gemmi::centring_vectors(cand.centering);
for (const auto &op : sg_search.point_group_representative->operations().sym_ops) {
// apply_to_hkl uses rot^T, so the Miller-index matrix of op is rot^T / DEN.
gemmi::Mat33 m;
for (int i = 0; i < 3; ++i)
for (int j = 0; j < 3; ++j)
m.a[i][j] = static_cast<double>(op.rot[j][i]) / gemmi::Op::DEN;
const gemmi::Mat33 m_new = q.multiply(m).multiply(q_inv);
gemmi::Op op_new = gemmi::Op::identity();
for (int i = 0; i < 3; ++i)
for (int j = 0; j < 3; ++j)
op_new.rot[i][j] = static_cast<int>(std::lround(m_new[j][i])) * gemmi::Op::DEN;
lower_ops.sym_ops.push_back(op_new);
}
if (const gemmi::SpaceGroup *lower_sg = gemmi::find_spacegroup_by_ops(lower_ops)) {
SearchSpaceGroupResult lower = sg_search;
lower.point_group_representative = *lower_sg;
if (TwinZoneVerdict(merged_all, *o2.cell, s2, lower, result) < 0) {
zone_refusal = sg_search.refused_point_group_hm + " was refused (" +
sg_search.refused_reason + "), and the twin-immune zone of the "
"operators this group adds reads acentric";
higher = false;
}
}
}
const auto &uc = cand.conventional.GetUnitCell();
// The two asks are told apart by what they were asked against: the class a search
// has already been given, or the rotations the intensities have actually confirmed.
@@ -7849,6 +7898,7 @@ ProcessResult Rugnux::RunPipeline(RugnuxObserver *observer, bool write_output, b
s2.best_space_group.has_value() ? s2.best_space_group->xhm() : "nothing",
s2.point_group_order, sg_search.point_group_order,
higher ? " - adopted"
: !zone_refusal.empty() ? " - keeping the group already found; " + zone_refusal
: (point_group_higher
? " - keeping the group already found; the point group IS "
"higher, but no candidate of it carries the centring the "
@@ -9544,7 +9594,8 @@ ProcessResult Rugnux::RunPipeline(RugnuxObserver *observer, bool write_output, b
config_.nthreads);
result.twin_immune_zones = AnalyzeTwinImmuneZones(
p1.merged, gemmi::UnitCell(*result.consensus_cell), *determined,
TranslationalNCSVectorForLTest(p1_tncs), config_.nthreads);
TranslationalNCSVectorForLTest(p1_tncs), config_.nthreads,
result.space_group_search ? result.space_group_search->twin_fraction_outside : 0.0);
if (!result.twin_immune_zones->zones.empty())
logger.Info("{}", TwinImmuneZonesToText(*result.twin_immune_zones));
}
+5
View File
@@ -116,6 +116,11 @@ TEST_CASE("Anisotropy is exactly zero in a cubic Laue class", "[anisotropy]") {
CHECK(result.n_free_parameters == 0);
CHECK(result.delta_b == 0.0);
CHECK(result.verdict == AnisotropyVerdict::NotDetected);
// The French-Wilson prior takes this tensor: it must be the isotropic one, zero, not NaN.
const gemmi::Mat33 q = AnisotropyTensorHKL(result, cell);
for (int i = 0; i < 3; ++i)
for (int j = 0; j < 3; ++j)
CHECK(q[i][j] == 0.0);
}
// The tensor itself: put a known deviatoric B into a tetragonal merge and read it back. The
+38 -7
View File
@@ -227,14 +227,17 @@ namespace {
// Debye-Waller B along c* alone (A^2) - the same in both twin domains, a twin law being a lattice
// operation - and `scale_jitter` a log-normal factor of that width on every observed intensity,
// a nuisance with no direction that no normalisation removes.
std::vector<MergedReflection> WilsonTetragonal(const char *true_group, double twin_fraction,
double anisotropy_b = 0.0, double scale_jitter = 0.0) {
// `twin_super` names the group whose extra operator is the twin law.
std::vector<MergedReflection> WilsonMerge(const char *true_group, const char *twin_super,
const gemmi::UnitCell &cell, double twin_fraction,
double anisotropy_b = 0.0, double scale_jitter = 0.0) {
const gemmi::SpaceGroup &sub = gemmi::get_spacegroup_by_name(true_group);
const gemmi::SpaceGroup &super = gemmi::get_spacegroup_by_name("P 4 2 2");
const gemmi::SpaceGroup &super = gemmi::get_spacegroup_by_name(twin_super);
const gemmi::Op twin = jfjoch_test::TwinLaw(sub, super);
const gemmi::GroupOps gops = sub.operations();
const gemmi::ReciprocalAsu rasu(&sub);
const gemmi::UnitCell cell(47, 47, 63, 90, 90, 90);
const int hmax = static_cast<int>(cell.a / 2.5) + 1, kmax = static_cast<int>(cell.b / 2.5) + 1,
lmax = static_cast<int>(cell.c / 2.5) + 1;
auto true_intensity = [&](const gemmi::Op::Miller &hkl) {
const auto asu = rasu.to_asu(hkl, gops).first;
const double u1 = jfjoch_test::detail::UniformFromHkl(asu);
@@ -246,9 +249,9 @@ namespace {
* std::exp(-anisotropy_b * s_c * s_c / 2.0);
};
std::vector<MergedReflection> out;
for (int h = -19; h <= 19; ++h)
for (int k = -19; k <= 19; ++k)
for (int l = -26; l <= 26; ++l) {
for (int h = -hmax; h <= hmax; ++h)
for (int k = -kmax; k <= kmax; ++k)
for (int l = -lmax; l <= lmax; ++l) {
if (std::make_tuple(h, k, l) <= std::make_tuple(-h, -k, -l))
continue;
const gemmi::Op::Miller hkl{{h, k, l}};
@@ -271,6 +274,12 @@ namespace {
}
return out;
}
std::vector<MergedReflection> WilsonTetragonal(const char *true_group, double twin_fraction,
double anisotropy_b = 0.0, double scale_jitter = 0.0) {
return WilsonMerge(true_group, "P 4 2 2", gemmi::UnitCell(47, 47, 63, 90, 90, 90), twin_fraction,
anisotropy_b, scale_jitter);
}
}
// Reflections centric in the adopted group but acentric in a subgroup are their own twin mates under
@@ -345,6 +354,28 @@ TEST_CASE("Twin-immune zones are normalised for anisotropy and calibrated by the
}
}
// A twin by a law OTHER than the operators a zone is read for averages the zone's reflections with
// unrelated ones like every other reflection, so a genuine 321 crystal twinned by a 622 law reads its
// 2-folds' zone acentric against the untwinned centric density. Read at the twin fraction, it reads
// centric again - while a crystal twinned by the zone's own operators, which cannot reach the zone,
// stays acentric.
TEST_CASE("Twin-immune zones are read at the twin fraction of the other twin laws", "[twinning]") {
const gemmi::SpaceGroup &p321 = gemmi::get_spacegroup_by_name("P 3 2 1");
const gemmi::SpaceGroup &p3 = gemmi::get_spacegroup_by_name("P 3");
const gemmi::UnitCell hexagonal(51, 51, 71, 90, 90, 120);
const auto genuine = WilsonMerge("P 3 2 1", "P 6 2 2", hexagonal, 0.1);
const auto untwinned_read = AnalyzeTwinImmuneZone(genuine, hexagonal, p321, p3);
REQUIRE(untwinned_read.zones.size() == 1);
CHECK(untwinned_read.zones[0].calibrated_evidence_nats < -20.0);
const auto twinned_read = AnalyzeTwinImmuneZone(genuine, hexagonal, p321, p3, nullptr, 1, 0.1);
CHECK(twinned_read.zones[0].calibrated_evidence_nats > 20.0);
// Twinned by the 2-folds themselves, with no other law to read the zone at.
const auto twin = WilsonMerge("P 3", "P 3 2 1", hexagonal, 0.1);
CHECK(AnalyzeTwinImmuneZone(twin, hexagonal, p321, p3).zones[0].calibrated_evidence_nats < -20.0);
}
// Averaging each intensity over its orbit under a group leaves the L-test where it was when the group
// is the crystal's, and narrows it towards the perfect-twin 0.375 when an operator of the group is
// not - read on the same pairs. A perfect twin of the subgroup already reads 0.375 unmerged, so there
+26 -6
View File
@@ -15,7 +15,7 @@ run needed): `cd tools/battery && python3 test_score.py`.
| arm | datasets | reference | manifest |
|---|---|---|---|
| **open** | public PDB depositions of raw diffraction data, plus a few published small-molecule sets | the deposited space group, cell and resolution | `open.json` (committed) |
| **inhouse** | standard test crystals measured at the SLS (lysozyme, thaumatin, insulin, cytochrome C, myoglobin), small-molecule standards (aspirin, citric acid, HEPES, YAG, L-cystine), plus no-crystal controls | XDS, from the `CORRECT.LP` beside each dataset; for the small molecules the space group is the literature's (`ref_override`), as XDS reports only Sohncke groups; L-cystine, which XDS does not index, has only the literature reference | `inhouse.json` (committed) |
| **inhouse** | standard test crystals measured at the SLS (lysozyme, thaumatin, insulin, cytochrome C, myoglobin), small-molecule standards (aspirin, citric acid, HEPES, YAG, L-cystine), plus no-crystal controls | XDS, from the `CORRECT.LP` beside each dataset (the standard proteins also carry a reference model for R-free, reported only: `--model` below); for the small molecules the space group is the literature's (`ref_override`), as XDS reports only Sohncke groups; L-cystine, which XDS does not index, has only the literature reference | `inhouse.json` (committed) |
| **private** | user data | XDS, like inhouse | outside the repository; the local site config gives its path |
Scoring checks these things in order, and the first one that fails decides the verdict: did it
@@ -84,7 +84,7 @@ Every set runs **once**, with one command per arm:
| arm (reference) | command |
|---|---|
| open (deposition) | `rugnux -o p --no-export-unmerged --model <deposited coordinates> <input>`; sets without a deposited model (small molecules, unpublished sets, or coordinates that cannot be downloaded) run the same command without `--model` |
| inhouse, private (XDS) | `rugnux -o p --no-export-unmerged [-A] --report-resolution <XDS d_min>,<XDS d_max> <input>` |
| inhouse, private (XDS) | `rugnux -o p --no-export-unmerged [-A] --report-resolution <XDS d_min>,<XDS d_max> [--model <reference model>] <input>`; `--model` where the set names one (the in-house standard proteins, below) |
Neither `--model` nor `--report-resolution` changes the processing: the merged reflections, the
resolution cut and every decision are the same with and without them (verified bit for bit). So
@@ -103,6 +103,25 @@ the reference:
A model that fits may put its enantiomorph on the space-group label; the scorer reads the
data's own determination instead (`SOHNCKE_SPACE_GROUP` where `SPACE_GROUP_ENANTIOMORPH` is
`ASSUMED_FROM_MODEL`) and keeps the label in `sg_label`.
- **`--model`** (in-house standard proteins): a set may name the PDB entry of its crystal form in
its `model` field - or an mmCIF file beside its data, for a crystal form with no deposited entry
(`rfree_deposited` is then the file's own `_refine` R-free); it is fetched and cached like an
open-arm entry and passed to `--model`, so
the row carries the same model fields (`rfree`, `rmodel_shell_scaled`, `rfree_deposited`,
`rfree_ratio`, `anom_sigma`, ...) - quality on an external yardstick beside the XDS statistics.
They are reported, never scored: the arm is scored against XDS exactly as without them. One
entry per crystal form, chosen by cell and space group and confirmed by `rugnux --model` on our
sets (R-free of the placed model, not refined):
| sets | model | why |
|---|---|---|
| `lyso*` (P4₃2₁2) | 4AXT | hen egg-white lysozyme, 1.1 Å, 100 K, a 78.2 c 37.5 - the middle of our sets' cells (76.9-78.4 / 37.0-37.9); rugnux re-fractionalises the model into the data cell, so the R-free of the placed model rises by a few points per % of cell difference (6G8A, a 78.9 c 36.9: R-free +0.04 on `lyso_x06da_ref`). No ions in the model, so `anom_sigma` is the sulfurs' |
| `thau*` (P4₁2₁2) | 5A47 | thaumatin from *T. daniellii*, 1.2 Å, a 57.9 c 150.6 (6G89, 2.4 Å: R-free +0.06) |
| `insu_I*` (I2₁3) | 2BN3 | bovine insulin, cubic, 1.4 Å, 100 K, a 77.9 (9INS, pig, a 78.9, no R-free deposited: R-free +0.07) |
| `insu_H*` (H3) | 4E7T | bovine T6 2Zn insulin, 1.4 Å, a 81.0 c 33.5 (1MSO, human: R-free +0.08 - our insulin is bovine) |
| `cytc*` (P3₂21) | `reference_model.cif` beside each set's data | bovine heart cytochrome c in a form with no deposited entry: P3₂21, three molecules in the asymmetric unit (two related by a pseudo-translation 0.30 0.70 0.33), c 86.0-88.6 between crystals. Our own model, placed by molecular replacement with 6FF5 and refined against each set's XDS data with rugnux's free flags - one per set, because the 3% spread in c costs a single model ~5 points of R-free in the other crystals. The data cannot tell the hand: the model's settles it. `rfree_deposited` is the R-free of that refinement |
| `myob*` (P2₁) | 4DC8 | horse heart myoglobin (b 28.8 Å; sperm whale's P2₁ form has b 30.8), met form with sulfate, 1.5 Å, 100 K, a 35.4 b 28.8 c 63.1 β 106.1 - our setting; the unexposed control of its deposition, so no ligand or modified heme (5ZZE, same form, R-free 0.235 vs 0.233) |
- **`--report-resolution`** (XDS arms): a second statistics table from the same merge, binned over
XDS's own range (`dmin_xds` and XDS's d_max as given, 999 included, so it covers exactly what
XDS's CORRECT.LP totals cover), and `-A` where XDS merged with `FRIEDEL'S_LAW=FALSE` (`"anomalous": true` in the
@@ -415,9 +434,10 @@ was run `--unforced`), so its forced XDS-arm rows are left out the same way.
| `isa_ratio`, `r_meas_ratio` | refres_isa / isa_ref and refres_r_meas / r_meas_ref |
| `cc_half_noise_ratio` | XDS arms: (1/refres_cc_half - 1) / (1/(cc_half_ref - 0.0005) - 1), reported, not scored |
| `lowres_d`, `lowres_r_meas`, `refres_lowres_d`, `refres_lowres_r_meas`, `lowres_d_ref`, `lowres_r_meas_ref`, `lowres_r_meas_ratio` | the lowest-resolution shell's high-resolution limit and R_meas: rugnux's own table, the reference-range table, XDS's; and refres_lowres_r_meas / lowres_r_meas_ref |
| `model`, `model_note` | open arm: the deposited coordinates given to `--model`, or why there were none |
| `rfree`, `rwork`, `cc_model`, `model_fit`, `rfree_deposited`, `rfree_ratio` | open arm with a model: R_FREE, R_WORK, CC_MODEL_OVERALL and MODEL_FIT as rugnux reports them (placement-only, own free set: trend fields), the published R-free, and rfree / rfree_deposited |
| `rmodel`, `rmodel_shell_scaled`, `radial_misfit` | open arm with a model: R_MODEL, R_MODEL_SHELL_SCALED and MODEL_RADIAL_MISFIT - R over all the reflections, with and without one free scale per resolution shell, and how big that rescale was. `rmodel_shell_scaled` is the R that compares between runs (below) |
| `model`, `model_note` | open arm, and in-house sets with a `model`: the coordinates given to `--model`, or why there were none |
| `rfree`, `rwork`, `cc_model`, `model_fit`, `rfree_deposited`, `rfree_ratio` | any row with a model: R_FREE, R_WORK, CC_MODEL_OVERALL and MODEL_FIT as rugnux reports them (placement-only, own free set: trend fields), the published R-free, and rfree / rfree_deposited |
| `anom_sigma` | any row with a model: ANOMALOUS_SCATTERER_MEAN_SIGMA, the anomalous difference map (F+ - F- on the model's phases) read at every model atom from phosphorus up (S of Met/Cys, metals, Cl, I, ...) and averaged, in map sigma - how much anomalous signal the merge carries; null where the merge kept no Bijvoet split or the model has no such atom |
| `rmodel`, `rmodel_shell_scaled`, `radial_misfit` | any row with a model: R_MODEL, R_MODEL_SHELL_SCALED and MODEL_RADIAL_MISFIT - R over all the reflections, with and without one free scale per resolution shell, and how big that rescale was. `rmodel_shell_scaled` is the R that compares between runs (below) |
| `refmac_rfree`, `refmac_rwork`, `refmac_rfree_depflags`, `refmac_rfree_depdata`, `refmac_rfree_ratio`, `refmac_twin`, `refmac_untwinned`, `refmac_status`, `refmac_reason`, `refmac_refined_*`, `refmac_shared_free_n` | the REFMAC check (`--model-check`, open arm; see its section for which R-free is which) |
| `dep_status`, `dep_reason`, `dep_kind`, `dep_d_min`, `dep_n_common`, `dep_cc_delta_all`, `dep_cc_delta_outer`, `dep_beyond_cc`, `dep_beyond_d` | open arm with a model: our merge against the depositor's data per shell (`depdata_check.py`, above) |
| `shx_*` | small molecule with a `cod` structure: the SHELXL check (`shelx_check.py`, above) |
@@ -437,7 +457,7 @@ SVG, no external files):
the main metrics;
- plots per set (HTML only; hovering a point shows the set): d_min(rugnux) / d_min(reference)
for each arm; on the XDS arms the reference-range ISa, R_meas, lowest-shell R_meas and CC1/2
noise over XDS's; on the open arm R_free / published R_free;
noise over XDS's; on every row with a model R_free / published R_free;
- on the open arm, **against the depositor's data**: the per-shell CC difference and the CC past
the deposited limit, one row per set, sorted by the outer-shell difference;
- on the XDS arms the **like-for-like table**: the reference-range numbers beside XDS's, with the
+16 -9
View File
@@ -29,8 +29,9 @@ $JFJOCH_BATTERY_SITE, else site.json beside this script (not committed; site.exa
Every set runs once, with one command per arm (COMMAND_DOC): the open arm with the deposited model
(--model), the XDS arms with XDS's range as a report-only second
table (--report-resolution). Neither option changes the processing, so the one run is both what a
user gets and the like-for-like comparison.
table (--report-resolution) and, where a set names the PDB entry of its crystal form, that model
(--model). Neither option changes the processing, so the one run is both what a user gets and the
like-for-like comparison.
A run writes <runs_root>/<YYYYMMDD-HHMM>_<rugnux git>_<label>/ holding a copy of the binary,
manifest.json (what was run, on what, with which references), results.json (one row per set),
@@ -73,9 +74,10 @@ PDB_ID = re.compile(r"^[0-9][A-Za-z0-9]{3}$")
COMMAND_DOC = {
"deposition": "`rugnux --model <deposited coordinates> <input>` (without --model where there is no "
"deposited model: small molecules, unpublished sets)",
"xds": "`rugnux --report-resolution <XDS d_min>,<XDS d_max> <input>`: the second statistics "
"table at XDS's range is report-only; where XDS kept Friedel mates apart the scorer "
"reads the run's own per-hand table, which needs no flag",
"xds": "`rugnux --report-resolution <XDS d_min>,<XDS d_max> [--model <reference model>] <input>`: "
"the second statistics table at XDS's range is report-only; where XDS kept Friedel mates "
"apart the scorer reads the run's own per-hand table, which needs no flag. --model where "
"the set names a PDB entry of its crystal form (the standard proteins)",
}
LOCAL_SITE = os.path.join(HERE, "site.json")
@@ -323,8 +325,13 @@ def failure_note(log):
def deposited_model(e, opts):
"""(deposition record from model_check's RCSB cache, None) for the entry a set belongs to, or
(None, why not). A set id may carry a suffix (6h2p_native); the entry is the part before it."""
pdb = e["id"].split("_")[0].lower()
(None, why not). A set id may carry a suffix (6h2p_native); the entry is the part before it.
An in-house set names the entry of its crystal form in its `model` field instead, or an mmCIF
file beside its data: a reference model of our own, refined against that set."""
local = os.path.join(os.path.dirname(e["input_path"]), e.get("model") or "")
if e.get("model") and os.path.isfile(local):
return model_check.refinement_record(e["model"], local), None
pdb = (e.get("model") or e["id"].split("_")[0]).lower()
if not PDB_ID.match(pdb):
return None, "no model: not a PDB entry (small molecule or unpublished set)"
meta = model_check.deposition(pdb, opts["pdb_cache"])
@@ -344,7 +351,7 @@ def run_one(run_dir, binary, e, opts):
row.update(score.judge(e, {}, "no input"))
return row
meta = None
if e["reference"] == "deposition":
if e["reference"] == "deposition" or e.get("model"):
# no deposited model (small molecule, unpublished): the same command without --model
meta, row["model_note"] = deposited_model(e, opts)
if meta:
@@ -369,7 +376,7 @@ def run_one(run_dir, binary, e, opts):
row["wall_s"] = row["rugnux_wall_s"] if row["rugnux_wall_s"] is not None else row["elapsed_s"]
if row["rfree"] and row["rfree_deposited"]:
row["rfree_ratio"] = round(row["rfree"] / row["rfree_deposited"], 4)
if row["model"] and os.path.exists(os.path.join(wd, "p.mtz")):
if e["reference"] == "deposition" and row["model"] and os.path.exists(os.path.join(wd, "p.mtz")):
row.update(depdata_check.check_set(wd, e["id"], opts["pdb_cache"]))
if opts["model_check"] and e["arm"] == "open":
row.update(check_model(e, wd))
+37 -37
View File
@@ -1,41 +1,41 @@
{"arm": "inhouse", "aliases": {"E08_lyso_2_006": "lyso_x10sa_90deg_1", "E08_lyso_2_007": "lyso_x10sa_90deg_2", "lyso_2": "lyso_x06da_atten_wedge", "lyso_6_5keV": "lyso_x06da_5keV", "lysoC_14_f46f0a": "lyso_x06da_ice", "Thau_9": "thau_x10sa_0p1deg", "thau_BL1A_1p9A": "thau_bl1a_6p5keV", "thau_BL1A_2p7A": "thau_bl1a_4p6keV", "thau_BL1A_3p3A": "thau_bl1a_3p8keV", "Ins_H_2_fa9841": "insu_H_x06da_twin", "Ins_H_3_d05684": "insu_H_x06da_notwin", "Ins_I_16": "insu_I_x06da_weak", "Ins_I_2_1a530d": "insu_I_x06da_low_isa", "Ins_I_3_5e90e3": "insu_I_x06da_ref", "Ins_I_6_13keV": "insu_I_x06da_13keV", "Ins_I_6_5keV": "insu_I_x06da_5keV", "Ins_I_6_6keV": "insu_I_x06da_6keV", "Ins_I_7_5keV": "insu_I_x06da_5keV_2", "cytC_10": "cytc_x10sa", "cytC_2_0770b5": "cytc_x06da_1", "cytC_3_874285": "cytc_x06da_2", "MyoB_13": "myob_x10sa", "MyoB_9_446b70": "myob_x06da", "MyoB2-1": "myob_x06da_powder_1", "MyoB2-2": "myob_x06da_powder_2", "MyoB2-4": "myob_x06da_split", "MyoB2-5": "myob_x06da_sparse", "onlyice": "nothing_ice", "nothing_3400ac": "nothing_2", "nothing_9bf604": "nothing_1", "lyso_90deg_1": "lyso_x10sa_90deg_1", "lyso_90deg_2": "lyso_x10sa_90deg_2", "lyso_atten_wedge": "lyso_x06da_atten_wedge", "lyso_5keV": "lyso_x06da_5keV", "lyso_ice": "lyso_x06da_ice", "lyso_ref": "lyso_x06da_ref", "lyso_strong": "lyso_x10sa_strong", "lyso_half_image": "lyso_x06da_half_image", "thau_16keV": "thau_x10sa_16keV", "thau_0p1deg": "thau_x10sa_0p1deg", "thau_1p9A": "thau_bl1a_6p5keV", "thau_2p7A": "thau_bl1a_4p6keV", "thau_3p3A": "thau_bl1a_3p8keV", "thau_injection": "thau_x10sa_injection", "thau_pink": "thau_micromax_pink", "insu_H_twin": "insu_H_x06da_twin", "insu_H_notwin": "insu_H_x06da_notwin", "insu_I_weak": "insu_I_x06da_weak", "insu_I_low_isa": "insu_I_x06da_low_isa", "insu_I_ref": "insu_I_x06da_ref", "insu_I_13keV": "insu_I_x06da_13keV", "insu_I_5keV": "insu_I_x06da_5keV", "insu_I_6keV": "insu_I_x06da_6keV", "insu_I_5keV_2": "insu_I_x06da_5keV_2", "cytc_eiger": "cytc_x10sa", "cytc_pilatus_1": "cytc_x06da_1", "cytc_pilatus_2": "cytc_x06da_2", "myob_eiger": "myob_x10sa", "myob_pilatus": "myob_x06da", "myob_powder_1": "myob_x06da_powder_1", "myob_powder_2": "myob_x06da_powder_2", "myob_split": "myob_x06da_split", "myob_aggregate": "myob_x06da_sparse", "myob_x06da_aggregate": "myob_x06da_sparse"}, "sets": [
{"id": "lyso_x10sa_90deg_1", "input": "lyso_x10sa_90deg_1/lyso_2_006_master.h5", "wavelength": 0.99988, "ref": {"sgno": 92, "cell": [76.879, 76.879, 36.961, 90.0, 90.0, 90.0], "anomalous": true, "isa": 20.75, "completeness": 99.3, "r_meas": 0.182, "cc_half": 0.995, "multiplicity": 3.51, "dmin_low": 5.83, "r_meas_low": 0.049, "dmin": 1.966, "dmin_rule": "xds_range", "dmin_xds": 1.966, "dmax": 50.0}, "tags": ["h5", "lysozyme"]},
{"id": "lyso_x10sa_90deg_2", "input": "lyso_x10sa_90deg_2/lyso_2_007_master.h5", "wavelength": 0.99988, "ref": {"sgno": 92, "cell": [76.904, 76.904, 36.976, 90.0, 90.0, 90.0], "anomalous": true, "isa": 18.14, "completeness": 99.3, "r_meas": 0.18, "cc_half": 0.994, "multiplicity": 3.51, "dmin_low": 5.86, "r_meas_low": 0.051, "dmin": 1.973, "dmin_rule": "xds_range", "dmin_xds": 1.973, "dmax": 50.0}, "tags": ["h5", "lysozyme"]},
{"id": "lyso_x06da_atten_wedge", "input": "lyso_x06da_atten_wedge/lyso_2_002_master.h5", "wavelength": 0.95381, "ref": {"sgno": 92, "cell": [78.235, 78.235, 37.798, 90.0, 90.0, 90.0], "anomalous": true, "isa": 16.56, "completeness": 99.9, "r_meas": 0.239, "cc_half": 0.998, "multiplicity": 10.97, "dmin_low": 3.76, "r_meas_low": 0.069, "dmin": 1.264, "dmin_rule": "xds_range", "dmin_xds": 1.264, "dmax": 50.0}, "tags": ["h5", "lysozyme"]},
{"id": "lyso_x06da_5keV", "input": "lyso_x06da_5keV/lyso_6_001_master.h5", "wavelength": 2.47924, "ref": {"sgno": 92, "cell": [78.225, 78.225, 37.897, 90.0, 90.0, 90.0], "anomalous": true, "isa": 19.36, "completeness": 86.4, "r_meas": 0.064, "cc_half": 0.998, "multiplicity": 8.85, "dmin_low": 7.22, "r_meas_low": 0.047, "dmin": 2.45, "dmin_rule": "xds_range", "dmin_xds": 2.45, "dmax": 50.0}, "tags": ["h5", "lysozyme", "long-wavelength"]},
{"id": "lyso_x06da_ice", "input": "lyso_x06da_ice/lysoC_14_56b5b9_master.h5", "wavelength": 0.95364, "ref": {"sgno": 89, "cell": [78.387, 78.387, 37.427, 90.0, 90.0, 90.0], "anomalous": true, "isa": 23.33, "completeness": 100.0, "r_meas": 0.219, "cc_half": 0.998, "multiplicity": 11.86, "dmin_low": 4.26, "r_meas_low": 0.055, "dmin": 1.431, "dmin_rule": "xds_range", "dmin_xds": 1.431, "dmax": 50.0}, "tags": ["h5", "lysozyme"]},
{"id": "lyso_x06da_ref", "input": "lyso_x06da_ref/hewl_35_001_master.h5", "wavelength": 0.95329, "ref": {"sgno": 89, "cell": [78.091, 78.091, 37.704, 90.0, 90.0, 90.0], "anomalous": true, "isa": 28.31, "completeness": 100.0, "r_meas": 0.045, "cc_half": 1.0, "multiplicity": 13.76, "dmin_low": 3.58, "r_meas_low": 0.029, "dmin": 1.2, "dmin_rule": "xds_range", "dmin_xds": 1.2, "dmax": 50.0}, "tags": ["h5", "lysozyme"], "tiers": {"smoke": "lysozyme reference set"}},
{"id": "lyso_x10sa_strong", "input": "lyso_x10sa_strong/lyso_5_f6ac7e_master.h5", "wavelength": 0.99988, "ref": {"sgno": 92, "cell": [77.769, 77.769, 37.442, 90.0, 90.0, 90.0], "anomalous": false, "isa": 8.63, "completeness": 65.8, "r_meas": 0.112, "cc_half": 0.998, "multiplicity": 11.46, "dmin_low": 3.52, "r_meas_low": 0.077, "dmin": 1.24, "dmin_rule": "cc_half_0.30", "dmin_xds": 1.18, "dmax": 999.0}, "tags": ["h5", "lysozyme"]},
{"id": "lyso_x06da_half_image", "input": "lyso_x06da_half_image/lyso3_7_b81d83_master.h5", "wavelength": 0.95373, "ref": {"sgno": 96, "cell": [77.74, 77.74, 37.386, 90.0, 90.0, 90.0], "anomalous": true, "isa": 6.61, "completeness": 99.6, "r_meas": 0.595, "cc_half": 0.958, "multiplicity": 5.31, "dmin_low": 4.91, "r_meas_low": 0.258, "dmin": 1.65, "dmin_rule": "xds_range", "dmin_xds": 1.65, "dmax": 50.0}, "tags": ["h5", "lysozyme"]},
{"id": "thau_x10sa_16keV", "input": "thau_x10sa_16keV/lyso_4_d2bb9b_master.h5", "wavelength": 0.77491, "ref": {"sgno": 92, "cell": [57.958, 57.958, 150.547, 90.0, 90.0, 90.0], "anomalous": false, "isa": 44.51, "completeness": 94.3, "r_meas": 0.072, "cc_half": 1.0, "multiplicity": 18.36, "dmin_low": 3.89, "r_meas_low": 0.027, "dmin": 1.3, "dmin_rule": "xds_range", "dmin_xds": 1.3, "dmax": 50.0}, "tags": ["h5", "thaumatin"]},
{"id": "thau_x10sa_0p1deg", "input": "thau_x10sa_0p1deg/Thau_9_002_master.h5", "wavelength": 0.99989, "ref": {"sgno": 92, "cell": [58.488, 58.488, 150.788, 90.0, 90.0, 90.0], "anomalous": true, "isa": 9.15, "completeness": 99.0, "r_meas": 0.23, "cc_half": 0.997, "multiplicity": 11.37, "dmin_low": 6.51, "r_meas_low": 0.104, "dmin": 2.197, "dmin_rule": "xds_range", "dmin_xds": 2.197, "dmax": 50.0}, "tags": ["h5", "thaumatin"]},
{"id": "thau_bl1a_6p5keV", "input": "thau_bl1a_6p5keV/JTH14_1p9_50ds_90T_k0_JF4M_01_50001_master.h5", "wavelength": 1.9, "ref": {"sgno": 89, "cell": [58.031, 58.031, 150.577, 90.0, 90.0, 90.0], "anomalous": true, "isa": 34.46, "completeness": 91.8, "r_meas": 0.072, "cc_half": 0.999, "multiplicity": 7.95, "dmin_low": 5.33, "r_meas_low": 0.041, "dmin": 1.78, "dmin_rule": "xds_range", "dmin_xds": 1.78, "dmax": 100.0}, "tags": ["h5", "thaumatin", "long-wavelength"]},
{"id": "thau_bl1a_4p6keV", "input": "thau_bl1a_4p6keV/JTH14_2p7_50ds_19T_k0_JF4M_01_50001_master.h5", "wavelength": 2.7, "ref": {"sgno": 89, "cell": [58.007, 58.007, 150.511, 90.0, 90.0, 90.0], "anomalous": true, "isa": 35.64, "completeness": 92.0, "r_meas": 0.062, "cc_half": 0.998, "multiplicity": 7.94, "dmin_low": 7.56, "r_meas_low": 0.039, "dmin": 2.53, "dmin_rule": "xds_range", "dmin_xds": 2.53, "dmax": 100.0}, "tags": ["h5", "thaumatin", "long-wavelength"]},
{"id": "thau_bl1a_3p8keV", "input": "thau_bl1a_3p8keV/JTH14_3p3_50ds_12T_k0_JF4M_01_50001_master.h5", "wavelength": 3.3, "ref": {"sgno": 89, "cell": [57.895, 57.895, 150.213, 90.0, 90.0, 90.0], "anomalous": true, "isa": 30.8, "completeness": 92.2, "r_meas": 0.057, "cc_half": 0.997, "multiplicity": 7.92, "dmin_low": 9.23, "r_meas_low": 0.039, "dmin": 3.1, "dmin_rule": "xds_range", "dmin_xds": 3.1, "dmax": 100.0}, "tags": ["h5", "thaumatin", "long-wavelength"], "tiers": {"smoke": "long wavelength (3.3 A), KEK BL-1A thaumatin"}},
{"id": "thau_x10sa_injection", "input": "thau_x10sa_injection/lyso_13_0c7e7a_master.h5", "wavelength": 0.99988, "ref": {"sgno": 92, "cell": [57.922, 57.922, 150.678, 90.0, 90.0, 90.0], "anomalous": true, "isa": 36.23, "completeness": 86.2, "r_meas": 0.037, "cc_half": 1.0, "multiplicity": 9.96, "dmin_low": 3.83, "r_meas_low": 0.022, "dmin": 1.28, "dmin_rule": "xds_range", "dmin_xds": 1.28, "dmax": 50.0}, "tags": ["h5", "thaumatin"]},
{"id": "thau_micromax_pink", "input": "thau_micromax_pink/Thau-Thaumatin_2_master.h5", "wavelength": 0.98419, "ref": {"sgno": 92, "cell": [58.784, 58.784, 152.226, 90.0, 90.0, 90.0], "anomalous": true, "isa": 21.18, "completeness": 98.5, "r_meas": 0.08, "cc_half": 0.999, "multiplicity": 9.38, "dmin_low": 4.17, "r_meas_low": 0.04, "dmin": 1.4, "dmin_rule": "xds_range", "dmin_xds": 1.4, "dmax": 50.0}, "tags": ["h5", "thaumatin", "pink-beam"], "tiers": {"smoke": "pink beam"}},
{"id": "lyso_micromax_mono", "input": "lyso_micromax_mono/lysozyme-s6_1_master.h5", "wavelength": 0.95447, "tags": ["h5", "lysozyme"], "ref": {"sgno": 96, "cell": [77.668, 77.668, 37.486, 90.0, 90.0, 90.0], "anomalous": true, "isa": 39.93, "completeness": 100.0, "r_meas": 0.047, "cc_half": 1.0, "multiplicity": 6.22, "dmin_low": 4.54, "r_meas_low": 0.023, "dmin": 1.5, "dmin_rule": "xds_range", "dmin_xds": 1.5, "dmax": 50.0}},
{"id": "lyso_micromax_pink", "input": "lyso_micromax_pink/lysozyme-s6_1_master.h5", "wavelength": 0.95374, "tags": ["h5", "lysozyme", "pink-beam"], "ref": {"sgno": 96, "cell": [77.654, 77.654, 37.483, 90.0, 90.0, 90.0], "anomalous": true, "isa": 37.35, "completeness": 99.9, "r_meas": 0.051, "cc_half": 1.0, "multiplicity": 5.96, "dmin_low": 4.39, "r_meas_low": 0.022, "dmin": 1.45, "dmin_rule": "xds_range", "dmin_xds": 1.45, "dmax": 50.0}},
{"id": "lysoI_micromax_mono", "input": "lysoI_micromax_mono/lysozyme-Is2_1_master.h5", "wavelength": 0.95447, "tags": ["h5", "lysozyme", "iodine"], "ref": {"sgno": 96, "cell": [78.335, 78.335, 37.46, 90.0, 90.0, 90.0], "anomalous": true, "isa": 31.42, "completeness": 100.0, "r_meas": 0.068, "cc_half": 0.999, "multiplicity": 6.78, "dmin_low": 4.99, "r_meas_low": 0.028, "dmin": 1.65, "dmin_rule": "xds_range", "dmin_xds": 1.65, "dmax": 50.0}},
{"id": "lysoI_micromax_pink", "input": "lysoI_micromax_pink/lysozyme-Is2_1_master.h5", "wavelength": 0.95374, "tags": ["h5", "lysozyme", "iodine", "pink-beam"], "ref": {"sgno": 96, "cell": [78.302, 78.302, 37.448, 90.0, 90.0, 90.0], "anomalous": true, "isa": 29.19, "completeness": 100.0, "r_meas": 0.079, "cc_half": 0.999, "multiplicity": 6.8, "dmin_low": 4.99, "r_meas_low": 0.028, "dmin": 1.65, "dmin_rule": "xds_range", "dmin_xds": 1.65, "dmax": 50.0}},
{"id": "insu_H_x06da_twin", "input": "insu_H_x06da_twin/Ins_H_2_fa9841_master.h5", "wavelength": 0.95375, "ref": {"sgno": 146, "cell": [81.393, 81.393, 33.272, 90.0, 90.0, 120.0], "anomalous": true, "isa": 6.82, "completeness": 95.0, "r_meas": 0.118, "cc_half": 0.988, "multiplicity": 3.61, "dmin_low": 4.34, "r_meas_low": 0.106, "dmin": 1.455, "dmin_rule": "xds_range", "dmin_xds": 1.455, "dmax": 50.0}, "tags": ["h5", "insulin"]},
{"id": "insu_H_x06da_notwin", "input": "insu_H_x06da_notwin/Ins_H_3_d05684_master.h5", "wavelength": 0.95375, "ref": {"sgno": 146, "cell": [81.378, 81.378, 33.269, 90.0, 90.0, 120.0], "anomalous": true, "isa": 17.69, "completeness": 97.4, "r_meas": 0.068, "cc_half": 0.998, "multiplicity": 3.52, "dmin_low": 4.61, "r_meas_low": 0.045, "dmin": 1.544, "dmin_rule": "xds_range", "dmin_xds": 1.544, "dmax": 50.0}, "tags": ["h5", "insulin"], "tiers": {"smoke": "rhombohedral insulin (H3)"}},
{"id": "insu_I_x06da_weak", "input": "insu_I_x06da_weak/Ins_16_776a92_master.h5", "wavelength": 0.95373, "ref": {"sgno": 197, "cell": [77.085, 77.085, 77.085, 90.0, 90.0, 90.0], "anomalous": false, "isa": 18.91, "completeness": 92.4, "r_meas": 0.401, "cc_half": 0.999, "multiplicity": 29.04, "dmin_low": 3.22, "r_meas_low": 0.054, "dmin": 1.807, "dmin_rule": "cc_half_0.30", "dmin_xds": 1.08, "dmax": 999.0}, "tags": ["h5", "insulin"]},
{"id": "insu_I_x06da_low_isa", "input": "insu_I_x06da_low_isa/Ins_I_2_1a530d_master.h5", "wavelength": 0.95375, "ref": {"sgno": 197, "cell": [77.582, 77.582, 77.582, 90.0, 90.0, 90.0], "anomalous": true, "isa": 4.15, "completeness": 90.8, "r_meas": 0.22, "cc_half": 0.998, "multiplicity": 13.33, "dmin_low": 3.92, "r_meas_low": 0.167, "dmin": 1.3, "dmin_rule": "xds_range", "dmin_xds": 1.3, "dmax": 50.0}, "tags": ["h5", "insulin"]},
{"id": "insu_I_x06da_ref", "input": "insu_I_x06da_ref/Ins_I_3_5e90e3_master.h5", "wavelength": 0.95375, "ref": {"sgno": 197, "cell": [77.52, 77.52, 77.52, 90.0, 90.0, 90.0], "anomalous": true, "isa": 25.08, "completeness": 100.0, "r_meas": 0.349, "cc_half": 0.998, "multiplicity": 13.82, "dmin_low": 4.82, "r_meas_low": 0.143, "dmin": 1.621, "dmin_rule": "xds_range", "dmin_xds": 1.621, "dmax": 50.0}, "tags": ["h5", "insulin"]},
{"id": "insu_I_x06da_13keV", "input": "insu_I_x06da_13keV/Ins_I_6_001_master.h5", "wavelength": 0.95375, "ref": {"sgno": 197, "cell": [77.468, 77.468, 77.468, 90.0, 90.0, 90.0], "anomalous": true, "isa": 18.83, "completeness": 100.0, "r_meas": 0.279, "cc_half": 0.998, "multiplicity": 17.21, "dmin_low": 4.85, "r_meas_low": 0.093, "dmin": 1.635, "dmin_rule": "xds_range", "dmin_xds": 1.635, "dmax": 50.0}, "tags": ["h5", "insulin"]},
{"id": "insu_I_x06da_5keV", "input": "insu_I_x06da_5keV/Ins_I_6_006_master.h5", "wavelength": 2.47923, "ref": {"sgno": 197, "cell": [77.785, 77.785, 77.785, 90.0, 90.0, 90.0], "anomalous": true, "isa": 17.54, "completeness": 91.7, "r_meas": 0.073, "cc_half": 0.999, "multiplicity": 11.17, "dmin_low": 7.21, "r_meas_low": 0.048, "dmin": 2.45, "dmin_rule": "xds_range", "dmin_xds": 2.45, "dmax": 50.0}, "tags": ["h5", "insulin", "long-wavelength"]},
{"id": "insu_I_x06da_6keV", "input": "insu_I_x06da_6keV/Ins_I_6_004_master.h5", "wavelength": 2.06648, "ref": {"sgno": 197, "cell": [77.71, 77.71, 77.71, 90.0, 90.0, 90.0], "anomalous": true, "isa": 17.95, "completeness": 92.4, "r_meas": 0.065, "cc_half": 0.999, "multiplicity": 12.42, "dmin_low": 6.03, "r_meas_low": 0.047, "dmin": 2.04, "dmin_rule": "xds_range", "dmin_xds": 2.04, "dmax": 50.0}, "tags": ["h5", "insulin", "long-wavelength"]},
{"id": "insu_I_x06da_5keV_2", "input": "insu_I_x06da_5keV_2/Ins_I_7_001_master.h5", "wavelength": 2.47923, "ref": {"sgno": 197, "cell": [77.694, 77.694, 77.694, 90.0, 90.0, 90.0], "anomalous": true, "isa": 20.01, "completeness": 91.8, "r_meas": 0.076, "cc_half": 0.999, "multiplicity": 12.73, "dmin_low": 7.21, "r_meas_low": 0.048, "dmin": 2.45, "dmin_rule": "xds_range", "dmin_xds": 2.45, "dmax": 50.0}, "tags": ["h5", "insulin", "long-wavelength"], "tiers": {"smoke": "cubic insulin at 5 keV (long wavelength), fast"}},
{"id": "cytc_x10sa", "input": "cytc_x10sa/cytC_10_002_master.h5", "wavelength": 0.99989, "ref": {"sgno": 152, "cell": [83.659, 83.659, 86.011, 90.0, 90.0, 120.0], "anomalous": true, "isa": 31.75, "completeness": 99.8, "r_meas": 0.232, "cc_half": 0.999, "multiplicity": 10.65, "dmin_low": 6.05, "r_meas_low": 0.036, "dmin": 2.267, "dmin_rule": "cc_half_0.30", "dmin_xds": 2.039, "dmax": 50.0}, "tags": ["h5", "cytochrome-c"]},
{"id": "cytc_x06da_1", "input": "cytc_x06da_1/cytC_2_0770b5_master.h5", "wavelength": 0.95375, "ref": {"sgno": 152, "cell": [83.836, 83.836, 86.733, 90.0, 90.0, 120.0], "anomalous": true, "isa": 24.49, "completeness": 99.9, "r_meas": 0.084, "cc_half": 0.999, "multiplicity": 7.67, "dmin_low": 5.58, "r_meas_low": 0.033, "dmin": 1.875, "dmin_rule": "xds_range", "dmin_xds": 1.875, "dmax": 50.0}, "tags": ["h5", "cytochrome-c"]},
{"id": "cytc_x06da_2", "input": "cytc_x06da_2/cytC_3_874285_master.h5", "wavelength": 0.95375, "ref": {"sgno": 152, "cell": [83.719, 83.719, 88.617, 90.0, 90.0, 120.0], "anomalous": true, "isa": 26.98, "completeness": 99.9, "r_meas": 0.097, "cc_half": 0.999, "multiplicity": 7.82, "dmin_low": 5.03, "r_meas_low": 0.032, "dmin": 1.69, "dmin_rule": "xds_range", "dmin_xds": 1.69, "dmax": 50.0}, "tags": ["h5", "cytochrome-c"]},
{"id": "myob_x10sa", "input": "myob_x10sa/MyoB_13_110ee0_master.h5", "wavelength": 0.99988, "ref": {"sgno": 4, "cell": [35.229, 28.461, 63.076, 90.0, 106.504, 90.0], "anomalous": true, "isa": 5.21, "completeness": 97.7, "r_meas": 0.247, "cc_half": 0.965, "multiplicity": 3.29, "dmin_low": 5.16, "r_meas_low": 0.186, "dmin": 1.742, "dmin_rule": "xds_range", "dmin_xds": 1.742, "dmax": 50.0}, "tags": ["h5", "myoglobin"]},
{"id": "myob_x06da", "input": "myob_x06da/MyoB_9_446b70_master.h5", "wavelength": 0.95365, "ref": {"sgno": 3, "cell": [35.182, 28.544, 62.83, 90.0, 106.138, 90.0], "anomalous": true, "isa": 7.59, "completeness": 99.4, "r_meas": 0.232, "cc_half": 0.987, "multiplicity": 3.47, "dmin_low": 4.23, "r_meas_low": 0.105, "dmin": 1.422, "dmin_rule": "xds_range", "dmin_xds": 1.422, "dmax": 50.0}, "tags": ["h5", "myoglobin"], "tiers": {"smoke": "monoclinic myoglobin, screw not arbitrable by XDS"}, "ref_override": {"sg": "P 1 21 1", "sgno": 4}, "ref_override_why": "myoglobin, P 1 21 1. XDS does not judge screw axes (it reports P 2)"},
{"id": "myob_x06da_powder_1", "input": "myob_x06da_powder_1/MyoB2-1_75979a_master.h5", "wavelength": 0.95373, "ref": {"sgno": 1, "cell": [28.705, 34.796, 64.373, 74.314, 89.879, 90.057], "anomalous": false, "isa": 5.54, "completeness": 74.2, "r_meas": 0.493, "cc_half": 0.966, "multiplicity": 2.87, "dmin_low": 4.44, "r_meas_low": 0.125, "dmin": 1.495, "dmin_rule": "xds_range", "dmin_xds": 1.495, "dmax": 50.0}, "tags": ["h5", "myoglobin", "twin"], "tiers": {"smoke": "known hard: triclinic twin"}, "ref_override": {"sg": "P 1 21 1", "sgno": 4, "cell": [35.14, 28.88, 64.64, 90.0, 105.9, 90.0]}, "ref_override_why": "myoglobin, P 1 21 1. XDS indexed this sweep (a powder-contaminated crystal) in P 1 on a reduced cell (28.7 34.8 64.4 74.3 89.9 90.1); the monoclinic cell is that cell's conventional setting"},
{"id": "myob_x06da_powder_2", "input": "myob_x06da_powder_2/MyoB2-2_5ddd7d_master.h5", "wavelength": 0.95373, "ref": {"sgno": 3, "cell": [35.576, 28.811, 63.529, 90.0, 105.593, 90.0], "anomalous": false, "isa": 2.19, "completeness": 58.0, "r_meas": 1.106, "cc_half": 0.655, "multiplicity": 4.71, "dmin_low": 2.98, "r_meas_low": 0.706, "dmin": 0.99, "dmin_rule": "xds_range", "dmin_xds": 0.99, "dmax": 999.0}, "tags": ["h5", "myoglobin", "twin"], "ref_override": {"sg": "P 1 21 1", "sgno": 4}, "ref_override_why": "myoglobin, P 1 21 1. XDS does not judge screw axes (it reports P 2)"},
{"id": "myob_x06da_split", "input": "myob_x06da_split/MyoB2-4_079740_master.h5", "wavelength": 0.95373, "ref": {"sgno": 3, "cell": [35.39, 28.783, 63.626, 90.0, 105.544, 90.0], "anomalous": false, "isa": 12.41, "completeness": 77.7, "r_meas": 0.577, "cc_half": 0.984, "multiplicity": 4.38, "dmin_low": 4.48, "r_meas_low": 0.091, "dmin": 1.506, "dmin_rule": "xds_range", "dmin_xds": 1.506, "dmax": 50.0}, "tags": ["h5", "myoglobin", "twin"], "ref_override": {"sg": "P 1 21 1", "sgno": 4}, "ref_override_why": "myoglobin, P 1 21 1. XDS does not judge screw axes (it reports P 2)"},
{"id": "myob_x06da_sparse", "input": "myob_x06da_sparse/MyoB2-5_7cef9c_master.h5", "wavelength": 0.95373, "ref": {"sgno": 3, "cell": [35.388, 28.752, 64.083, 90.0, 106.352, 90.0], "anomalous": false, "isa": 5.46, "completeness": 73.7, "r_meas": 0.326, "cc_half": 0.972, "multiplicity": 5.21, "dmin_low": 5.92, "r_meas_low": 0.146, "dmin": 2.0, "dmin_rule": "xds_range", "dmin_xds": 2.0, "dmax": 50.0}, "tags": ["h5", "myoglobin", "twin"], "ref_override": {"sg": "P 1 21 1", "sgno": 4}, "ref_override_why": "myoglobin, P 1 21 1. XDS does not judge screw axes (it reports P 2)"},
{"id": "lyso_x10sa_90deg_1", "input": "lyso_x10sa_90deg_1/lyso_2_006_master.h5", "wavelength": 0.99988, "ref": {"sgno": 92, "cell": [76.879, 76.879, 36.961, 90.0, 90.0, 90.0], "anomalous": true, "isa": 20.75, "completeness": 99.3, "r_meas": 0.182, "cc_half": 0.995, "multiplicity": 3.51, "dmin_low": 5.83, "r_meas_low": 0.049, "dmin": 1.966, "dmin_rule": "xds_range", "dmin_xds": 1.966, "dmax": 50.0}, "tags": ["h5", "lysozyme"], "model": "4axt"},
{"id": "lyso_x10sa_90deg_2", "input": "lyso_x10sa_90deg_2/lyso_2_007_master.h5", "wavelength": 0.99988, "ref": {"sgno": 92, "cell": [76.904, 76.904, 36.976, 90.0, 90.0, 90.0], "anomalous": true, "isa": 18.14, "completeness": 99.3, "r_meas": 0.18, "cc_half": 0.994, "multiplicity": 3.51, "dmin_low": 5.86, "r_meas_low": 0.051, "dmin": 1.973, "dmin_rule": "xds_range", "dmin_xds": 1.973, "dmax": 50.0}, "tags": ["h5", "lysozyme"], "model": "4axt"},
{"id": "lyso_x06da_atten_wedge", "input": "lyso_x06da_atten_wedge/lyso_2_002_master.h5", "wavelength": 0.95381, "ref": {"sgno": 92, "cell": [78.235, 78.235, 37.798, 90.0, 90.0, 90.0], "anomalous": true, "isa": 16.56, "completeness": 99.9, "r_meas": 0.239, "cc_half": 0.998, "multiplicity": 10.97, "dmin_low": 3.76, "r_meas_low": 0.069, "dmin": 1.264, "dmin_rule": "xds_range", "dmin_xds": 1.264, "dmax": 50.0}, "tags": ["h5", "lysozyme"], "model": "4axt"},
{"id": "lyso_x06da_5keV", "input": "lyso_x06da_5keV/lyso_6_001_master.h5", "wavelength": 2.47924, "ref": {"sgno": 92, "cell": [78.225, 78.225, 37.897, 90.0, 90.0, 90.0], "anomalous": true, "isa": 19.36, "completeness": 86.4, "r_meas": 0.064, "cc_half": 0.998, "multiplicity": 8.85, "dmin_low": 7.22, "r_meas_low": 0.047, "dmin": 2.45, "dmin_rule": "xds_range", "dmin_xds": 2.45, "dmax": 50.0}, "tags": ["h5", "lysozyme", "long-wavelength"], "model": "4axt"},
{"id": "lyso_x06da_ice", "input": "lyso_x06da_ice/lysoC_14_56b5b9_master.h5", "wavelength": 0.95364, "ref": {"sgno": 89, "cell": [78.387, 78.387, 37.427, 90.0, 90.0, 90.0], "anomalous": true, "isa": 23.33, "completeness": 100.0, "r_meas": 0.219, "cc_half": 0.998, "multiplicity": 11.86, "dmin_low": 4.26, "r_meas_low": 0.055, "dmin": 1.431, "dmin_rule": "xds_range", "dmin_xds": 1.431, "dmax": 50.0}, "tags": ["h5", "lysozyme"], "model": "4axt"},
{"id": "lyso_x06da_ref", "input": "lyso_x06da_ref/hewl_35_001_master.h5", "wavelength": 0.95329, "ref": {"sgno": 89, "cell": [78.091, 78.091, 37.704, 90.0, 90.0, 90.0], "anomalous": true, "isa": 28.31, "completeness": 100.0, "r_meas": 0.045, "cc_half": 1.0, "multiplicity": 13.76, "dmin_low": 3.58, "r_meas_low": 0.029, "dmin": 1.2, "dmin_rule": "xds_range", "dmin_xds": 1.2, "dmax": 50.0}, "tags": ["h5", "lysozyme"], "tiers": {"smoke": "lysozyme reference set"}, "model": "4axt"},
{"id": "lyso_x10sa_strong", "input": "lyso_x10sa_strong/lyso_5_f6ac7e_master.h5", "wavelength": 0.99988, "ref": {"sgno": 92, "cell": [77.769, 77.769, 37.442, 90.0, 90.0, 90.0], "anomalous": false, "isa": 8.63, "completeness": 65.8, "r_meas": 0.112, "cc_half": 0.998, "multiplicity": 11.46, "dmin_low": 3.52, "r_meas_low": 0.077, "dmin": 1.24, "dmin_rule": "cc_half_0.30", "dmin_xds": 1.18, "dmax": 999.0}, "tags": ["h5", "lysozyme"], "model": "4axt"},
{"id": "lyso_x06da_half_image", "input": "lyso_x06da_half_image/lyso3_7_b81d83_master.h5", "wavelength": 0.95373, "ref": {"sgno": 96, "cell": [77.74, 77.74, 37.386, 90.0, 90.0, 90.0], "anomalous": true, "isa": 6.61, "completeness": 99.6, "r_meas": 0.595, "cc_half": 0.958, "multiplicity": 5.31, "dmin_low": 4.91, "r_meas_low": 0.258, "dmin": 1.65, "dmin_rule": "xds_range", "dmin_xds": 1.65, "dmax": 50.0}, "tags": ["h5", "lysozyme"], "model": "4axt"},
{"id": "thau_x10sa_16keV", "input": "thau_x10sa_16keV/lyso_4_d2bb9b_master.h5", "wavelength": 0.77491, "ref": {"sgno": 92, "cell": [57.958, 57.958, 150.547, 90.0, 90.0, 90.0], "anomalous": false, "isa": 44.51, "completeness": 94.3, "r_meas": 0.072, "cc_half": 1.0, "multiplicity": 18.36, "dmin_low": 3.89, "r_meas_low": 0.027, "dmin": 1.3, "dmin_rule": "xds_range", "dmin_xds": 1.3, "dmax": 50.0}, "tags": ["h5", "thaumatin"], "model": "5a47"},
{"id": "thau_x10sa_0p1deg", "input": "thau_x10sa_0p1deg/Thau_9_002_master.h5", "wavelength": 0.99989, "ref": {"sgno": 92, "cell": [58.488, 58.488, 150.788, 90.0, 90.0, 90.0], "anomalous": true, "isa": 9.15, "completeness": 99.0, "r_meas": 0.23, "cc_half": 0.997, "multiplicity": 11.37, "dmin_low": 6.51, "r_meas_low": 0.104, "dmin": 2.197, "dmin_rule": "xds_range", "dmin_xds": 2.197, "dmax": 50.0}, "tags": ["h5", "thaumatin"], "model": "5a47"},
{"id": "thau_bl1a_6p5keV", "input": "thau_bl1a_6p5keV/JTH14_1p9_50ds_90T_k0_JF4M_01_50001_master.h5", "wavelength": 1.9, "ref": {"sgno": 89, "cell": [58.031, 58.031, 150.577, 90.0, 90.0, 90.0], "anomalous": true, "isa": 34.46, "completeness": 91.8, "r_meas": 0.072, "cc_half": 0.999, "multiplicity": 7.95, "dmin_low": 5.33, "r_meas_low": 0.041, "dmin": 1.78, "dmin_rule": "xds_range", "dmin_xds": 1.78, "dmax": 100.0}, "tags": ["h5", "thaumatin", "long-wavelength"], "model": "5a47"},
{"id": "thau_bl1a_4p6keV", "input": "thau_bl1a_4p6keV/JTH14_2p7_50ds_19T_k0_JF4M_01_50001_master.h5", "wavelength": 2.7, "ref": {"sgno": 89, "cell": [58.007, 58.007, 150.511, 90.0, 90.0, 90.0], "anomalous": true, "isa": 35.64, "completeness": 92.0, "r_meas": 0.062, "cc_half": 0.998, "multiplicity": 7.94, "dmin_low": 7.56, "r_meas_low": 0.039, "dmin": 2.53, "dmin_rule": "xds_range", "dmin_xds": 2.53, "dmax": 100.0}, "tags": ["h5", "thaumatin", "long-wavelength"], "model": "5a47"},
{"id": "thau_bl1a_3p8keV", "input": "thau_bl1a_3p8keV/JTH14_3p3_50ds_12T_k0_JF4M_01_50001_master.h5", "wavelength": 3.3, "ref": {"sgno": 89, "cell": [57.895, 57.895, 150.213, 90.0, 90.0, 90.0], "anomalous": true, "isa": 30.8, "completeness": 92.2, "r_meas": 0.057, "cc_half": 0.997, "multiplicity": 7.92, "dmin_low": 9.23, "r_meas_low": 0.039, "dmin": 3.1, "dmin_rule": "xds_range", "dmin_xds": 3.1, "dmax": 100.0}, "tags": ["h5", "thaumatin", "long-wavelength"], "tiers": {"smoke": "long wavelength (3.3 A), KEK BL-1A thaumatin"}, "model": "5a47"},
{"id": "thau_x10sa_injection", "input": "thau_x10sa_injection/lyso_13_0c7e7a_master.h5", "wavelength": 0.99988, "ref": {"sgno": 92, "cell": [57.922, 57.922, 150.678, 90.0, 90.0, 90.0], "anomalous": true, "isa": 36.23, "completeness": 86.2, "r_meas": 0.037, "cc_half": 1.0, "multiplicity": 9.96, "dmin_low": 3.83, "r_meas_low": 0.022, "dmin": 1.28, "dmin_rule": "xds_range", "dmin_xds": 1.28, "dmax": 50.0}, "tags": ["h5", "thaumatin"], "model": "5a47"},
{"id": "thau_micromax_pink", "input": "thau_micromax_pink/Thau-Thaumatin_2_master.h5", "wavelength": 0.98419, "ref": {"sgno": 92, "cell": [58.784, 58.784, 152.226, 90.0, 90.0, 90.0], "anomalous": true, "isa": 21.18, "completeness": 98.5, "r_meas": 0.08, "cc_half": 0.999, "multiplicity": 9.38, "dmin_low": 4.17, "r_meas_low": 0.04, "dmin": 1.4, "dmin_rule": "xds_range", "dmin_xds": 1.4, "dmax": 50.0}, "tags": ["h5", "thaumatin", "pink-beam"], "tiers": {"smoke": "pink beam"}, "model": "5a47"},
{"id": "lyso_micromax_mono", "input": "lyso_micromax_mono/lysozyme-s6_1_master.h5", "wavelength": 0.95447, "tags": ["h5", "lysozyme"], "ref": {"sgno": 96, "cell": [77.668, 77.668, 37.486, 90.0, 90.0, 90.0], "anomalous": true, "isa": 39.93, "completeness": 100.0, "r_meas": 0.047, "cc_half": 1.0, "multiplicity": 6.22, "dmin_low": 4.54, "r_meas_low": 0.023, "dmin": 1.5, "dmin_rule": "xds_range", "dmin_xds": 1.5, "dmax": 50.0}, "model": "4axt"},
{"id": "lyso_micromax_pink", "input": "lyso_micromax_pink/lysozyme-s6_1_master.h5", "wavelength": 0.95374, "tags": ["h5", "lysozyme", "pink-beam"], "ref": {"sgno": 96, "cell": [77.654, 77.654, 37.483, 90.0, 90.0, 90.0], "anomalous": true, "isa": 37.35, "completeness": 99.9, "r_meas": 0.051, "cc_half": 1.0, "multiplicity": 5.96, "dmin_low": 4.39, "r_meas_low": 0.022, "dmin": 1.45, "dmin_rule": "xds_range", "dmin_xds": 1.45, "dmax": 50.0}, "model": "4axt"},
{"id": "lysoI_micromax_mono", "input": "lysoI_micromax_mono/lysozyme-Is2_1_master.h5", "wavelength": 0.95447, "tags": ["h5", "lysozyme", "iodine"], "ref": {"sgno": 96, "cell": [78.335, 78.335, 37.46, 90.0, 90.0, 90.0], "anomalous": true, "isa": 31.42, "completeness": 100.0, "r_meas": 0.068, "cc_half": 0.999, "multiplicity": 6.78, "dmin_low": 4.99, "r_meas_low": 0.028, "dmin": 1.65, "dmin_rule": "xds_range", "dmin_xds": 1.65, "dmax": 50.0}, "model": "4axt"},
{"id": "lysoI_micromax_pink", "input": "lysoI_micromax_pink/lysozyme-Is2_1_master.h5", "wavelength": 0.95374, "tags": ["h5", "lysozyme", "iodine", "pink-beam"], "ref": {"sgno": 96, "cell": [78.302, 78.302, 37.448, 90.0, 90.0, 90.0], "anomalous": true, "isa": 29.19, "completeness": 100.0, "r_meas": 0.079, "cc_half": 0.999, "multiplicity": 6.8, "dmin_low": 4.99, "r_meas_low": 0.028, "dmin": 1.65, "dmin_rule": "xds_range", "dmin_xds": 1.65, "dmax": 50.0}, "model": "4axt"},
{"id": "insu_H_x06da_twin", "input": "insu_H_x06da_twin/Ins_H_2_fa9841_master.h5", "wavelength": 0.95375, "ref": {"sgno": 146, "cell": [81.393, 81.393, 33.272, 90.0, 90.0, 120.0], "anomalous": true, "isa": 6.82, "completeness": 95.0, "r_meas": 0.118, "cc_half": 0.988, "multiplicity": 3.61, "dmin_low": 4.34, "r_meas_low": 0.106, "dmin": 1.455, "dmin_rule": "xds_range", "dmin_xds": 1.455, "dmax": 50.0}, "tags": ["h5", "insulin"], "model": "4e7t"},
{"id": "insu_H_x06da_notwin", "input": "insu_H_x06da_notwin/Ins_H_3_d05684_master.h5", "wavelength": 0.95375, "ref": {"sgno": 146, "cell": [81.378, 81.378, 33.269, 90.0, 90.0, 120.0], "anomalous": true, "isa": 17.69, "completeness": 97.4, "r_meas": 0.068, "cc_half": 0.998, "multiplicity": 3.52, "dmin_low": 4.61, "r_meas_low": 0.045, "dmin": 1.544, "dmin_rule": "xds_range", "dmin_xds": 1.544, "dmax": 50.0}, "tags": ["h5", "insulin"], "tiers": {"smoke": "rhombohedral insulin (H3)"}, "model": "4e7t"},
{"id": "insu_I_x06da_weak", "input": "insu_I_x06da_weak/Ins_16_776a92_master.h5", "wavelength": 0.95373, "ref": {"sgno": 197, "cell": [77.085, 77.085, 77.085, 90.0, 90.0, 90.0], "anomalous": false, "isa": 18.91, "completeness": 92.4, "r_meas": 0.401, "cc_half": 0.999, "multiplicity": 29.04, "dmin_low": 3.22, "r_meas_low": 0.054, "dmin": 1.807, "dmin_rule": "cc_half_0.30", "dmin_xds": 1.08, "dmax": 999.0}, "tags": ["h5", "insulin"], "model": "2bn3"},
{"id": "insu_I_x06da_low_isa", "input": "insu_I_x06da_low_isa/Ins_I_2_1a530d_master.h5", "wavelength": 0.95375, "ref": {"sgno": 197, "cell": [77.582, 77.582, 77.582, 90.0, 90.0, 90.0], "anomalous": true, "isa": 4.15, "completeness": 90.8, "r_meas": 0.22, "cc_half": 0.998, "multiplicity": 13.33, "dmin_low": 3.92, "r_meas_low": 0.167, "dmin": 1.3, "dmin_rule": "xds_range", "dmin_xds": 1.3, "dmax": 50.0}, "tags": ["h5", "insulin"], "model": "2bn3"},
{"id": "insu_I_x06da_ref", "input": "insu_I_x06da_ref/Ins_I_3_5e90e3_master.h5", "wavelength": 0.95375, "ref": {"sgno": 197, "cell": [77.52, 77.52, 77.52, 90.0, 90.0, 90.0], "anomalous": true, "isa": 25.08, "completeness": 100.0, "r_meas": 0.349, "cc_half": 0.998, "multiplicity": 13.82, "dmin_low": 4.82, "r_meas_low": 0.143, "dmin": 1.621, "dmin_rule": "xds_range", "dmin_xds": 1.621, "dmax": 50.0}, "tags": ["h5", "insulin"], "model": "2bn3"},
{"id": "insu_I_x06da_13keV", "input": "insu_I_x06da_13keV/Ins_I_6_001_master.h5", "wavelength": 0.95375, "ref": {"sgno": 197, "cell": [77.468, 77.468, 77.468, 90.0, 90.0, 90.0], "anomalous": true, "isa": 18.83, "completeness": 100.0, "r_meas": 0.279, "cc_half": 0.998, "multiplicity": 17.21, "dmin_low": 4.85, "r_meas_low": 0.093, "dmin": 1.635, "dmin_rule": "xds_range", "dmin_xds": 1.635, "dmax": 50.0}, "tags": ["h5", "insulin"], "model": "2bn3"},
{"id": "insu_I_x06da_5keV", "input": "insu_I_x06da_5keV/Ins_I_6_006_master.h5", "wavelength": 2.47923, "ref": {"sgno": 197, "cell": [77.785, 77.785, 77.785, 90.0, 90.0, 90.0], "anomalous": true, "isa": 17.54, "completeness": 91.7, "r_meas": 0.073, "cc_half": 0.999, "multiplicity": 11.17, "dmin_low": 7.21, "r_meas_low": 0.048, "dmin": 2.45, "dmin_rule": "xds_range", "dmin_xds": 2.45, "dmax": 50.0}, "tags": ["h5", "insulin", "long-wavelength"], "model": "2bn3"},
{"id": "insu_I_x06da_6keV", "input": "insu_I_x06da_6keV/Ins_I_6_004_master.h5", "wavelength": 2.06648, "ref": {"sgno": 197, "cell": [77.71, 77.71, 77.71, 90.0, 90.0, 90.0], "anomalous": true, "isa": 17.95, "completeness": 92.4, "r_meas": 0.065, "cc_half": 0.999, "multiplicity": 12.42, "dmin_low": 6.03, "r_meas_low": 0.047, "dmin": 2.04, "dmin_rule": "xds_range", "dmin_xds": 2.04, "dmax": 50.0}, "tags": ["h5", "insulin", "long-wavelength"], "model": "2bn3"},
{"id": "insu_I_x06da_5keV_2", "input": "insu_I_x06da_5keV_2/Ins_I_7_001_master.h5", "wavelength": 2.47923, "ref": {"sgno": 197, "cell": [77.694, 77.694, 77.694, 90.0, 90.0, 90.0], "anomalous": true, "isa": 20.01, "completeness": 91.8, "r_meas": 0.076, "cc_half": 0.999, "multiplicity": 12.73, "dmin_low": 7.21, "r_meas_low": 0.048, "dmin": 2.45, "dmin_rule": "xds_range", "dmin_xds": 2.45, "dmax": 50.0}, "tags": ["h5", "insulin", "long-wavelength"], "tiers": {"smoke": "cubic insulin at 5 keV (long wavelength), fast"}, "model": "2bn3"},
{"id": "cytc_x10sa", "input": "cytc_x10sa/cytC_10_002_master.h5", "wavelength": 0.99989, "ref": {"sgno": 152, "cell": [83.659, 83.659, 86.011, 90.0, 90.0, 120.0], "anomalous": true, "isa": 31.75, "completeness": 99.8, "r_meas": 0.232, "cc_half": 0.999, "multiplicity": 10.65, "dmin_low": 6.05, "r_meas_low": 0.036, "dmin": 2.267, "dmin_rule": "cc_half_0.30", "dmin_xds": 2.039, "dmax": 50.0}, "tags": ["h5", "cytochrome-c"], "model": "reference_model.cif"},
{"id": "cytc_x06da_1", "input": "cytc_x06da_1/cytC_2_0770b5_master.h5", "wavelength": 0.95375, "ref": {"sgno": 152, "cell": [83.836, 83.836, 86.733, 90.0, 90.0, 120.0], "anomalous": true, "isa": 24.49, "completeness": 99.9, "r_meas": 0.084, "cc_half": 0.999, "multiplicity": 7.67, "dmin_low": 5.58, "r_meas_low": 0.033, "dmin": 1.875, "dmin_rule": "xds_range", "dmin_xds": 1.875, "dmax": 50.0}, "tags": ["h5", "cytochrome-c"], "model": "reference_model.cif"},
{"id": "cytc_x06da_2", "input": "cytc_x06da_2/cytC_3_874285_master.h5", "wavelength": 0.95375, "ref": {"sgno": 152, "cell": [83.719, 83.719, 88.617, 90.0, 90.0, 120.0], "anomalous": true, "isa": 26.98, "completeness": 99.9, "r_meas": 0.097, "cc_half": 0.999, "multiplicity": 7.82, "dmin_low": 5.03, "r_meas_low": 0.032, "dmin": 1.69, "dmin_rule": "xds_range", "dmin_xds": 1.69, "dmax": 50.0}, "tags": ["h5", "cytochrome-c"], "model": "reference_model.cif"},
{"id": "myob_x10sa", "input": "myob_x10sa/MyoB_13_110ee0_master.h5", "wavelength": 0.99988, "ref": {"sgno": 4, "cell": [35.229, 28.461, 63.076, 90.0, 106.504, 90.0], "anomalous": true, "isa": 5.21, "completeness": 97.7, "r_meas": 0.247, "cc_half": 0.965, "multiplicity": 3.29, "dmin_low": 5.16, "r_meas_low": 0.186, "dmin": 1.742, "dmin_rule": "xds_range", "dmin_xds": 1.742, "dmax": 50.0}, "tags": ["h5", "myoglobin"], "model": "4dc8"},
{"id": "myob_x06da", "input": "myob_x06da/MyoB_9_446b70_master.h5", "wavelength": 0.95365, "ref": {"sgno": 3, "cell": [35.182, 28.544, 62.83, 90.0, 106.138, 90.0], "anomalous": true, "isa": 7.59, "completeness": 99.4, "r_meas": 0.232, "cc_half": 0.987, "multiplicity": 3.47, "dmin_low": 4.23, "r_meas_low": 0.105, "dmin": 1.422, "dmin_rule": "xds_range", "dmin_xds": 1.422, "dmax": 50.0}, "tags": ["h5", "myoglobin"], "tiers": {"smoke": "monoclinic myoglobin, screw not arbitrable by XDS"}, "ref_override": {"sg": "P 1 21 1", "sgno": 4}, "ref_override_why": "myoglobin, P 1 21 1. XDS does not judge screw axes (it reports P 2)", "model": "4dc8"},
{"id": "myob_x06da_powder_1", "input": "myob_x06da_powder_1/MyoB2-1_75979a_master.h5", "wavelength": 0.95373, "ref": {"sgno": 1, "cell": [28.705, 34.796, 64.373, 74.314, 89.879, 90.057], "anomalous": false, "isa": 5.54, "completeness": 74.2, "r_meas": 0.493, "cc_half": 0.966, "multiplicity": 2.87, "dmin_low": 4.44, "r_meas_low": 0.125, "dmin": 1.495, "dmin_rule": "xds_range", "dmin_xds": 1.495, "dmax": 50.0}, "tags": ["h5", "myoglobin", "twin"], "tiers": {"smoke": "known hard: triclinic twin"}, "ref_override": {"sg": "P 1 21 1", "sgno": 4, "cell": [35.14, 28.88, 64.64, 90.0, 105.9, 90.0]}, "ref_override_why": "myoglobin, P 1 21 1. XDS indexed this sweep (a powder-contaminated crystal) in P 1 on a reduced cell (28.7 34.8 64.4 74.3 89.9 90.1); the monoclinic cell is that cell's conventional setting", "model": "4dc8"},
{"id": "myob_x06da_powder_2", "input": "myob_x06da_powder_2/MyoB2-2_5ddd7d_master.h5", "wavelength": 0.95373, "ref": {"sgno": 3, "cell": [35.576, 28.811, 63.529, 90.0, 105.593, 90.0], "anomalous": false, "isa": 2.19, "completeness": 58.0, "r_meas": 1.106, "cc_half": 0.655, "multiplicity": 4.71, "dmin_low": 2.98, "r_meas_low": 0.706, "dmin": 0.99, "dmin_rule": "xds_range", "dmin_xds": 0.99, "dmax": 999.0}, "tags": ["h5", "myoglobin", "twin"], "ref_override": {"sg": "P 1 21 1", "sgno": 4}, "ref_override_why": "myoglobin, P 1 21 1. XDS does not judge screw axes (it reports P 2)", "model": "4dc8"},
{"id": "myob_x06da_split", "input": "myob_x06da_split/MyoB2-4_079740_master.h5", "wavelength": 0.95373, "ref": {"sgno": 3, "cell": [35.39, 28.783, 63.626, 90.0, 105.544, 90.0], "anomalous": false, "isa": 12.41, "completeness": 77.7, "r_meas": 0.577, "cc_half": 0.984, "multiplicity": 4.38, "dmin_low": 4.48, "r_meas_low": 0.091, "dmin": 1.506, "dmin_rule": "xds_range", "dmin_xds": 1.506, "dmax": 50.0}, "tags": ["h5", "myoglobin", "twin"], "ref_override": {"sg": "P 1 21 1", "sgno": 4}, "ref_override_why": "myoglobin, P 1 21 1. XDS does not judge screw axes (it reports P 2)", "model": "4dc8"},
{"id": "myob_x06da_sparse", "input": "myob_x06da_sparse/MyoB2-5_7cef9c_master.h5", "wavelength": 0.95373, "ref": {"sgno": 3, "cell": [35.388, 28.752, 64.083, 90.0, 106.352, 90.0], "anomalous": false, "isa": 5.46, "completeness": 73.7, "r_meas": 0.326, "cc_half": 0.972, "multiplicity": 5.21, "dmin_low": 5.92, "r_meas_low": 0.146, "dmin": 2.0, "dmin_rule": "xds_range", "dmin_xds": 2.0, "dmax": 50.0}, "tags": ["h5", "myoglobin", "twin"], "ref_override": {"sg": "P 1 21 1", "sgno": 4}, "ref_override_why": "myoglobin, P 1 21 1. XDS does not judge screw axes (it reports P 2)", "model": "4dc8"},
{"id": "nothing_2", "input": "nothing_2/test-28_3400ac_master.h5", "wavelength": 0.99988, "expect": "no_lattice", "tags": ["h5", "control"]},
{"id": "nothing_1", "input": "nothing_1/test-28_9bf604_master.h5", "wavelength": 0.99988, "expect": "no_lattice", "tags": ["h5", "control"]},
{"id": "aspirin_x10sa_20keV", "input": "aspirin_x10sa_20keV/aspirin_1_002_master.h5", "wavelength": 0.61993, "cod": "7050897", "tags": ["h5", "monoclinic", "small-molecule"], "ref": {"sgno": 4, "cell": [11.262, 6.543, 11.257, 90.0, 95.916, 90.0], "anomalous": true, "isa": 27.4, "completeness": 84.0, "r_meas": 0.033, "cc_half": 0.999, "multiplicity": 3.14, "dmin_low": 2.01, "r_meas_low": 0.033, "dmin": 0.68, "dmin_rule": "xds_range", "dmin_xds": 0.68, "dmax": 50.0}, "ref_override": {"sg": "P 1 21/c 1", "sgno": 14}, "ref_override_why": "aspirin form I, P 21/c; COD 7050897 - C. C. Wilson, New J. Chem. 26 (2002) 1733-1739, doi:10.1039/b203775k. XDS reports only Sohncke groups (P 21)"},
+8 -3
View File
@@ -86,6 +86,13 @@ def deposition(pdb_id, cache_dir):
return None
if os.path.exists(meta_path):
return json.load(open(meta_path))
meta = refinement_record(pdb_id, xyz)
json.dump(meta, open(meta_path, "w"), indent=1)
return meta
def refinement_record(name, xyz):
"""The refinement statistics an mmCIF coordinate file states about itself (_refine)."""
block = gemmi.cif.read(xyz).sole_block()
methods = [m.strip("'\"") for m in block.find_values("_exptl.method")]
rows = block.find("_refine.", ["pdbx_refine_id", "?ls_R_factor_R_free", "?ls_R_factor_R_work",
@@ -95,10 +102,8 @@ def deposition(pdb_id, cache_dir):
if "X-RAY" in row.str(0).upper():
ref = {k: (float(row[i]) if row.has(i) and gemmi.cif.is_null(row[i]) is False else None)
for k, i in (("rfree", 1), ("rwork", 2), ("dmin", 3))}
meta = {"id": pdb_id, "methods": methods, "rfree": ref.get("rfree"), "rwork": ref.get("rwork"),
return {"id": name, "methods": methods, "rfree": ref.get("rfree"), "rwork": ref.get("rwork"),
"dmin": ref.get("dmin"), "xyz": xyz}
json.dump(meta, open(meta_path, "w"), indent=1)
return meta
# ------------------------------------------------------------------ lattice / setting matching
+12 -3
View File
@@ -23,6 +23,7 @@ NOISE = {
"rfree": ("abs", 0.005),
"rmodel_shell_scaled": ("abs", 0.005),
"radial_misfit": ("abs", 0.05),
"anom_sigma": ("rel", 0.05),
"refres_r_meas": ("rel", 0.05),
"refres_isa": ("rel", 0.05),
"refres_lowres_r_meas": ("rel", 0.05),
@@ -249,7 +250,7 @@ def changes(ra, rb):
out.append(name)
# The R that is comparable between runs, and the radial profile that decides whether `rfree`
# beside it can be read at all (both only where both runs carry them).
for name in ("rmodel_shell_scaled", "radial_misfit", "rfree"):
for name in ("rmodel_shell_scaled", "radial_misfit", "rfree", "anom_sigma"):
if ra.get(name) is not None and rb.get(name) is not None and beyond_noise(name, ra[name], rb[name]):
out.append(name)
# the like-for-like table only where both runs have one (a pre-schema-3 run has none)
@@ -282,7 +283,7 @@ def arrow(x, y, fmt=lambda v: str(v)):
def compare_table(doc, rows, only_changed=True):
head = ["set", "arm", "verdict", "space group", "d_min", "ISa", "R_meas", "CC1/2",
"cell dev %", "R_model (shell-scaled)", "R_free", "radial misfit",
"cell dev %", "R_model (shell-scaled)", "R_free", "radial misfit", "anom. sigma",
"ref-range R_meas", "ref-range low-res R_meas", "SHELXL R1", "SHELXL wR2", "SHELXL GooF",
"SHELXL EXTI", "time s", "beyond noise"]
out = []
@@ -300,6 +301,7 @@ def compare_table(doc, rows, only_changed=True):
arrow(ra.get("rmodel_shell_scaled"), rb.get("rmodel_shell_scaled"), lambda v: f"{v:.3f}"),
arrow(ra.get("rfree"), rb.get("rfree"), lambda v: f"{v:.3f}"),
arrow(ra.get("radial_misfit"), rb.get("radial_misfit"), lambda v: f"{v:.2f}"),
arrow(ra.get("anom_sigma"), rb.get("anom_sigma"), lambda v: f"{v:.2f}"),
arrow(ra.get("refres_r_meas"), rb.get("refres_r_meas"), lambda v: f"{100 * v:.1f}%"),
arrow(ra.get("refres_lowres_r_meas"), rb.get("refres_lowres_r_meas"),
lambda v: f"{100 * v:.1f}%"),
@@ -439,6 +441,7 @@ def build(run_dir, baseline=None, allow_incomplete=False):
("rfree", "R_free (placement, within-run only)", "{:.3f}"),
("radial_misfit", "radial misfit", "{:.2f}"),
("rfree_ratio", "R_free ratio", "{:.3f}"),
("anom_sigma", "anomalous map at the scatterers, sigma", "{:.2f}"),
("refmac_rfree_ratio", "REFMAC R_free ratio", "{:.3f}"),
("dep_cc_delta_all", "dCC vs depositor, all", "{:+.3f}"),
("dep_cc_delta_outer", "dCC vs depositor, outer 2 shells", "{:+.3f}"),
@@ -618,10 +621,16 @@ def build(run_dir, baseline=None, allow_incomplete=False):
"read in a delta table. Radial misfit is how big that per-shell rescale had to be (the "
"RMS of its logarithm): when it moves between two runs, R_free between them means "
"little. Both are reported for a human to judge; nothing is scored on them.")
if any(r.get("anom_sigma") for r in res):
doc.p("Anom. sigma is the anomalous difference map (F+ - F- on the model's phases) read at the "
"model's anomalous scatterers - every atom from phosphorus up: the S of Met and Cys, "
"metals, Cl, I - and averaged, in units of the map's r.m.s.: how much anomalous signal "
"the merge carries, on the model's yardstick. Reported, never scored.")
model = [("R_model (shell-scaled)", "rmodel_shell_scaled"), ("radial misfit", "radial_misfit"),
("CC model", "cc_model"), ("R_free (within-run)", "rfree"), ("R_work", "rwork"),
("dep R_free", "rfree_deposited"),
("R_free ratio", "rfree_ratio")] if any(r.get("rfree") for r in res) else []
("R_free ratio", "rfree_ratio"),
("anom. sigma", "anom_sigma")] if any(r.get("rfree") for r in res) else []
model += [("REFMAC R_free", "refmac_rfree_depflags"), ("REFMAC dep data", "refmac_rfree_depdata"),
("REFMAC ratio", "refmac_rfree_ratio")] if any(r.get("refmac_status") for r in res) else []
model += [("dCC dep. outer", "dep_cc_delta_outer")] if any(r.get("dep_status") for r in res) else []
+6 -2
View File
@@ -197,9 +197,13 @@ def judge(entry, rep, run_note):
"r_meas_ref": ref.get("r_meas"), "cc_half_ref": ref.get("cc_half"), "isa_ref": ref.get("isa"),
"completeness_ref": ref.get("completeness"), "multiplicity_ref": ref.get("multiplicity"),
"sg_relation": None,
# rugnux's own fit of the deposited model (--model, open arm): a rigid-body placement scored
# on rugnux's own free set, so a trend number, not the depositor's R-free
# rugnux's own fit of the deposited model (--model; the open arm, and the in-house sets that
# name a model): a rigid-body placement scored on rugnux's own free set, so a trend number,
# not the depositor's R-free
"rfree": fnum(rep.get("R_FREE")), "rwork": fnum(rep.get("R_WORK")),
# the anomalous difference map's mean height (sigma) at the model's anomalous scatterers
# (P and heavier: S, metals, Cl, I, ...) - how much anomalous signal the merge carries
"anom_sigma": fnum(rep.get("ANOMALOUS_SCATTERER_MEAN_SIGMA")),
"model_fit": rep.get("MODEL_FIT"), "cc_model": fnum(rep.get("CC_MODEL_OVERALL")),
# R over ALL the reflections, with and without one free scale per resolution shell, and the
# size of that rescale. rfree above describes one run and is not comparable with another's: