Merge branch 'rc188-freedoc' into rc188-int
This commit is contained in:
commit
a3e7516616
9 files changed
+97
-24
No files matched your search
@@ -652,8 +652,8 @@ structure refinement with phenix.refine" (2012), Acta Cryst. D68, 352-367
|
||||
A. T. Brünger, "Free R value: a novel statistical quantity for assessing the accuracy of crystal
|
||||
structures" (1992), Nature 355, 472-475 [doi:10.1038/355472a0](https://doi.org/10.1038/355472a0).
|
||||
|
||||
**What the free set decides** — the free set decides the weights and the displacement model alone, and only
|
||||
where its two measures agree: a candidate is taken where its free $-\ln L$ is lower and its R-free not higher
|
||||
**What the free set decides** — the free set decides the weights, the displacement model and whether the model
|
||||
as given is kept, and only where its two measures agree: a candidate is taken where its free $-\ln L$ is lower and its R-free not higher
|
||||
than the incumbent's by more than the paired standard error of the difference; every other step of the
|
||||
refinement is taken on the work-set target. The approach of deciding on more than one free measure, and of keeping the
|
||||
free set for few choices, is PDB-REDO's: R. P. Joosten, K. Joosten, G. N. Murshudov and A. Perrakis,
|
||||
|
||||
@@ -158,7 +158,7 @@ $
|
||||
R = \frac{\sum \big|\,|F_o| - |F_\mathrm{model}|\,\big|}{\sum |F_o|},
|
||||
$
|
||||
|
||||
with R-free the same sum restricted to the free set. Every parameter $F_\mathrm{model}$ carries — the scaling of §14.2 and the rigid-body placement of §14.8 alike — is fitted on the working set alone, so the free reflections are held out of the fit as well as out of the sum. Two choices are still *selected* with the free set rather than fitted to it, and both are single discrete decisions rather than continuous parameters: the rigid-body step is committed only if it lowers R-free (§14.8), and the alternative indexing of §14.6 is the candidate with the lowest R-free. Both are the conventional use of a test set to accept or reject a step; both leave R-free very slightly optimistic where they fire.
|
||||
with R-free the same sum restricted to the free set. Every parameter $F_\mathrm{model}$ carries — the scaling of §14.2 and the rigid-body placement of §14.8 alike — is fitted on the working set alone, so the free reflections are held out of the fit as well as out of the sum. A few choices are still *selected* with the free set rather than fitted to it, each a single discrete decision rather than a continuous parameter: the rigid-body step is committed only if it lowers R-free (§14.8), the alternative indexing of §14.6 is the candidate with the lowest R-free, the merge the maps come from where a twin hypothesis was written is the one the model fits better on R-free (§14.9), and molecular replacement ranks its placements, copies and groups by R-free (§14.10). Each is the conventional use of a test set to accept or reject a step; each leaves R-free very slightly optimistic where it fires. Every use of the free set, here and in the refinement, is tabulated in [§15.13](CPU_DATA_ANALYSIS_REFINEMENT.md#1513-where-the-free-set-is-used).
|
||||
|
||||
### 14.4 Electron-density maps
|
||||
|
||||
|
||||
@@ -451,7 +451,7 @@ A fraction of the unique reflections (`rfree_fraction`, default 0.05) is flagged
|
||||
|
||||
On small data, where `rfree_fraction` (default 0.05) would give too few test reflections for a statistically stable R-free (Brünger's ~500–2000 rule), the fraction is **floored** so at least ~500 distinct reflections are free — capped at 10 % so a large test set never steals working data. For ordinary data this floor is inactive and the fraction stays flat at `rfree_fraction`, preserving the cross-dataset-identical property above; it only lifts the fraction on genuinely small datasets, where per-dataset R-free stability outweighs cross-dataset identity (and a shared reference set is the way to keep exact identity there).
|
||||
|
||||
When a reference (`--reference`: an MTZ, or a PDB structure-factor mmCIF, which is converted to one with `_refln.status` `f`/`o` becoming flag 0/1) carries a `FreeR_flag` column, its test set is **imported** instead: every merged reflection whose Laue-ASU index matches the reference takes the reference's flag (reflections absent from the reference keep the hash flag). The match is made in the reference's frame — on rotation data the merge is first put onto the reference's axes, choosing among every description of the lattice on them (and every alternative indexing) by the intensity correlation with the reference — and only where the merge then matches it: an intensity CC of at least 0.5 over at least half of the merged reflections in the reference's resolution range. Below that the reference is not the same crystal form on the same axes, its flags would land on unrelated reflections, and they are not imported (`REFERENCE_MISMATCH`). This lets a whole fragment-screening campaign inherit one shared free set from the apo/reference dataset. The CCP4/refmac convention (test set = flag 0, including the historical 0–19 form) is assumed, with the complement taken automatically if flag 0 would be the majority (a phenix-style file where 1 marks free).
|
||||
When a reference (`--reference`: an MTZ, or a PDB structure-factor mmCIF, which is converted to one with `_refln.status` `f`/`o` becoming flag 0/1) carries a `FreeR_flag` column, its test set is **imported** instead: every merged reflection whose Laue-ASU index matches the reference takes the reference's flag (reflections absent from the reference keep the hash flag). The match is made in the reference's frame — on rotation data the merge is first put onto the reference's axes, choosing among every description of the lattice on them (and every alternative indexing) by the intensity correlation with the reference — and only where the merge then matches it: an intensity CC of at least 0.5 over at least half of the merged reflections in the reference's resolution range. Below that the reference is not the same crystal form on the same axes, its flags would land on unrelated reflections, and they are not imported (`REFERENCE_MISMATCH`). This lets a whole fragment-screening campaign inherit one shared free set from the apo/reference dataset. The CCP4/refmac convention (test set = flag 0, including the historical 0–19 form) is assumed, with the complement taken automatically if flag 0 would be the majority (a phenix-style file where 1 marks free). `--free-flags <file>` imports a test set the same way from a file of which nothing else is used - the deposited reflections of a `--model`, typically - applied on the model's axes where the rigid body placed the model (§14.5). Where each flag is then used - what is fitted on the working reflections, which choices the free set takes, and what only reports it - is tabulated in [§15.13](CPU_DATA_ANALYSIS_REFINEMENT.md#1513-where-the-free-set-is-used).
|
||||
|
||||
### 10.8 French–Wilson amplitudes
|
||||
|
||||
|
||||
@@ -346,7 +346,8 @@ chosen late, on the evidence, instead of early at a rule.
|
||||
|
||||
**What the free set decides.** The free set decides the weights - the X-ray weights of the positions and of the B
|
||||
factors and the NCS restraints' $\sigma$ - the displacement model (§15.7, 6.), the reading of the model's TLS groups
|
||||
(§15.1) and whether the model as given is kept over the refinement (7.), and nothing else. Each of these choices asks
|
||||
(§15.1) and whether the model as given is kept over the refinement (7.); the one other free-set decision of the
|
||||
refinement is the twin law against its null (§15.12), and §15.13 tabulates them all. Each of these choices asks
|
||||
both of its measures: a candidate is preferred to the incumbent only where its $-\ln L$ of the free reflections is
|
||||
lower **and** its R-free is not higher by more than the standard error of the difference. The two are scored on the
|
||||
same free reflections, so the difference is paired: R-free is a sum of one term per free reflection (per free twin
|
||||
@@ -767,7 +768,72 @@ The keys are `REFINE_TWIN` (`NO_TWIN_LAW`, `FREE_SET_SPLIT`, `ZERO_FRACTION`, `U
|
||||
`REFINE_UNTWINNED_R_WORK`/`_R_FREE`, the last five of the two refinements where they ended. Where `REFINE_TWIN` is `TWINNED`, every
|
||||
other `REFINE_` key, `REFINE_R_FREE_START` and the `REFINE_SCORE_` terms included, is of the twinned refinement.
|
||||
|
||||
### 15.13 Not yet
|
||||
### 15.13 Where the free set is used
|
||||
|
||||
One table for the whole run: how the free set comes about, what is fitted on which reflections, which choices it
|
||||
decides and which numbers only report it. The merge draws and writes the set (§10.7); model validation and
|
||||
molecular replacement (§14) and the refinement (§15) read it. Every row states the rule as the code applies it.
|
||||
|
||||
**How the free set is obtained.** `R_FREE_FLAGS` names the set a run's validation and refinement used, and
|
||||
`REFINE_FREE_FLAGS` the one `--mode refine` read.
|
||||
|
||||
| Source | How | Reported as |
|
||||
|---|---|---|
|
||||
| Drawn by the merge (§10.7) | A hash of the reflection index over its orbit under the lattice holohedry, Friedel mates included - symmetry mates, Bijvoet mates and twin-law mates share one flag, so does a re-merge in any subgroup. 5 % of the distinct reflections, lifted towards 500 on small data and never above 10 %; no seed, no resolution shells. Drawn again, by the same rule, on the model's axes where a fitting model moves the setting; an indexing-ambiguity reindex leaves it as it was | `R_FREE_FLAGS= DRAWN` |
|
||||
| Inherited from the reference (`-z`) | The reference's `FreeR_flag` (or `_refln.status`), matched on the merging group's Laue ASU where the merge matches the reference (CC ≥ 0.5 over at least half of its reflections); a reflection the reference lacks keeps its drawn flag | `REFERENCE`, `REFERENCE_FREE_FLAGS_INHERITED` |
|
||||
| Taken from `--free-flags` | The same match, nothing else of the file used; applied on the model's axes, and only where the rigid body placed the model (§14.5) | `FILE` |
|
||||
| Read by `--mode refine` | The file's `FreeR_flag`-like column, 0 the test set (the minority value where 0 is the majority); of an sf-mmCIF's classes 0-19, the class the file marks unless the model as given fits another class as it fits its working reflections; a file without flags gets a 5 % set drawn as above | `REFINE_FREE_FLAGS= FILE` / `GENERATED`, `REFINE_FREE_SET_CLASS` |
|
||||
| Closed under the lattice's twin domains (§15.12) | Before a twinned refinement, every orbit under the domain operators is put in one set; a split orbit goes free with the probability of its own free share | `REFINE_TWIN_FREE_CLOSED` |
|
||||
| Carried into another group | A merge expanded to the model's subgroup (§15.1) gives every new mate its parent's flag; the twin hypothesis' file (§13.2) carries the answer's flags | - |
|
||||
|
||||
**What is fitted on which reflections.** The parameters of a fit are never fitted to the free reflections, with
|
||||
two exceptions that are the convention of likelihood refinement:
|
||||
|
||||
| Fitted quantity | Reflections |
|
||||
|---|---|
|
||||
| Overall scale, anisotropic B, bulk solvent (§14.2, §15.3); the rigid body (§14.8); the rotation and translation functions and the likelihood gain of molecular replacement (§14.10); the twin fraction (§14.9, §15.12); the X-ray target and its gradient, so every position, B, U and TLS parameter (§15.2); the side-chain field's energies, the population's averaged map (§15.7); $D$ of the likelihood (§15.3); Hamilton's R-ratio test (§15.7, 6.) | working only |
|
||||
| $\beta$, the variance of the likelihood, per resolution bin (§15.3) | **free**; below 100 free reflections the working ones join them |
|
||||
| $\sigma_A$ per shell for the validation's maps (§14.4) | **free**; a shell below 10 free reflections takes the estimate over the whole free set |
|
||||
|
||||
**Decisions the free set takes.** "Paired rule" is the rule of §15.7: the candidate's $-\ln L$ of the free
|
||||
reflections is lower *and* its R-free is not higher than the incumbent's by more than the standard error of the
|
||||
paired difference; ties go to the incumbent (the trial listed first).
|
||||
|
||||
| Decision | Compared on | Rule | Reported as |
|
||||
|---|---|---|---|
|
||||
| Rigid-body step kept (§14.8) | free | R-free lower than before the step; no standard error | `R_FREE_BEFORE_RIGID_BODY` |
|
||||
| Indexing ambiguity, with a model and no `-z` (§14.6) | free | the indexing with the lowest R-free, where its lead over the runner-up is 3 σ beyond the leads a randomly oriented model takes; the test's resolution is widened until it holds 1000 free reflections | `MODEL_INDEXING_MARGIN*` |
|
||||
| Which merge the maps come from, with a twin hypothesis (§14.9) | free | the lower R-free, the subgroup's plain or twinned against the answer's | `MAPS_FROM` |
|
||||
| Molecular replacement: first copy, further copies, the group, a chain against the whole model, the twin subgroup, a carried placement (§14.10) | free, then both | the lowest R-free; a further copy lowers it by 0.01; another group must trail by 0.03 - within that margin, with as many copies, the paired per-reflection difference over work and free together decides at 3 standard errors, else `UNDECIDED` | `MR_DECISION`, `MR_COPIES` |
|
||||
| Which symmetry hypothesis the model's choice settles on, where both fit within 0.03 before refinement | free | both refined; the rival replaces the validation's choice where its refined R-free is lower by more than 0.01 | `MODEL_CHOICE_DECIDED_BY`, `RIVAL_REFINE_*` |
|
||||
| Reading of the model's TLS groups (§15.1) | free | paired rule, B total against B residual against the B as given | `REFINE_ADP_INPUT` |
|
||||
| X-ray weights of the positions and the B factors, B held or refined (§15.7, 1., 2., 5.) | free | paired rule among the trials of a ladder or a step; a step that keeps the weights is taken on the work-set target instead | `REFINE_XRAY_WEIGHT` |
|
||||
| NCS restraints on or off, and their σ (§15.5, §15.7) | free | paired rule, each rung and step with against without, tightened against loosened | `REFINE_NCS_SIGMA` |
|
||||
| Displacement model: isotropic, the model's U, TLS by chain or cut, U per atom (§15.7, 6.) | work, then free | Hamilton's test on R-work decides where it passes more than 95 % or fewer than 30 % of its tests; between those the paired rule, a larger model also with its R-free lower outright. Which trials run is gated on R-free alone (TLS) or $-\ln L$ free alone (the TLS cuts, the full U weight) | `REFINE_ADP_MODEL` |
|
||||
| Second round of the weights kept (§15.7, 6.) | free or work | as a step: paired rule where its weights or σ changed, the work-set target where they did not | - |
|
||||
| Model as given kept over the refinement (§15.7, 7.) | free and work | paired rule for the model as given, and the refinement not better on both R-work and R-free; only where the set is free to the model as given (not a rigid-body placement on a drawn set) | `REFINE_AS_GIVEN` |
|
||||
| Twin law against its null (§15.12) | free | the paired difference of $\lvert F_o - \lvert F\rvert\rvert$ over the free twin groups, 3 standard errors (2 where the L-test reads twinned); the twinned arm is stopped after its first ladder below 0.5; added domains at 3 | `REFINE_TWIN`, `REFINE_TWIN_NULL_Z`, `REFINE_TWIN_MULTI` |
|
||||
|
||||
**Decided without the free set.** Whether the model fits at all, against its null (§14.5): R-work. The placement
|
||||
stage's rigid bodies and B per residue (§15.1), a trajectory step at unchanged weights, the population's child, the
|
||||
solvent build's rounds and the side-chain field's step (§15.7, §15.10): the work-set target. The twin fraction
|
||||
(§14.9, §15.12), and molecular replacement's tNCS half-vector moves: the working reflections, or every reflection
|
||||
together.
|
||||
|
||||
**Reported only.** `R_WORK`/`R_FREE` and the shell table's `R_FREE` column (the model as placed, §14.3);
|
||||
`REFINE_R_FREE_START`, `_PLACEMENT`, `REFINE_R_FREE` and the `REFINE_SCORE_` terms; `REFINE_TWIN_R_FREE`,
|
||||
`REFINE_UNTWINNED_R_FREE` and `REFINE_TWIN_R_FREE_NULL` (the twin decision reads the null's z, never the two
|
||||
R-frees); `RIVAL_REFINE_R_FREE`; the molecular-replacement table's `R_FREE`; the live page's per-shell and
|
||||
refined R-free; and the flags themselves, written as `FreeR_flag` (0 free, 1 work) in the merged MTZ and the map
|
||||
MTZs' `FREE`, and `_refln.status` `f`/`o` in the mmCIF.
|
||||
|
||||
**Small free sets.** Nothing is cross-validated by folds: a small set is met by the floor on the draw (500
|
||||
reflections, within 10 %), by the working reflections joining the free ones for the likelihood's variance below
|
||||
100, by $\sigma_A$ falling back to one estimate below 10 per shell, and by the indexing test widening its
|
||||
resolution to 1000 free reflections. The paired rule's standard error is taken as 0 where only one free group
|
||||
is left.
|
||||
|
||||
### 15.14 Not yet
|
||||
|
||||
What the refinement does not do yet - each a known gap, not a design choice:
|
||||
|
||||
@@ -785,10 +851,11 @@ What the refinement does not do yet - each a known gap, not a design choice:
|
||||
density, not by refining each in turn.
|
||||
- **Alternative conformations and occupancies**: existing conformers are refined in place; no occupancy is
|
||||
refined and no conformer is added.
|
||||
- **Rotamer and peptide-flip search**, and **Ramachandran restraints**.
|
||||
- **Peptide-flip search** and **Ramachandran restraints** (side chains are searched over their staggered rotamers
|
||||
by the side-chain field, §15.7).
|
||||
- **Real-space refinement**, and **jelly-body or reference-model restraints**.
|
||||
- **A full Metal (Apple GPU) path**: on macOS the model density is gathered on the GPU and the rest of the
|
||||
refinement runs on the CPU.
|
||||
- **A full Metal (Apple GPU) path**: on macOS the model density, the atom-gradient sums, the solvent mask's
|
||||
shrink and the side-chain field's sums run on the GPU and the rest of the refinement runs on the CPU.
|
||||
- **Validation beyond geometry**: the report gives the bond and angle rmsd, the metal-bond rmsd and the
|
||||
number of clashes, not a MolProbity-style analysis (Ramachandran, rotamer and clashscore statistics).
|
||||
|
||||
|
||||
+1
-1
@@ -330,7 +330,7 @@ serial stills; `fft` (GPU) / `fftw` (CPU) index **de novo** and suit strong rota
|
||||
| `--mosaicity <num>` | Diagnostic: fix the scaling mosaicity (°) instead of using the per-image seed |
|
||||
| `--scaling-iterations <num>` | Cap on the per-frame scaling iterations; the loop stops earlier once the scales settle, and a final merge whose scales were still moving when its loop stopped is flagged `SCALING_NOT_CONVERGED` (default: 100) |
|
||||
| `-z, --reference <file>` | Reference data of the same crystal form — an MTZ or a PDB structure-factor mmCIF (`-sf.cif`), gzipped or not, recognised by content; `--reference-mtz` is the same option: fixes the space group, its setting and the cell, resolves the [indexing ambiguity](RUGNUX_ADVANCED.md#the-indexing-ambiguity), hands over the R-free set and reports CC<sub>ref</sub>. Not a scale anchor |
|
||||
| `--free-flags <file>` | Take only the R-free test set of this MTZ or structure-factor mmCIF - e.g. the deposited reflections of the `--model` - for the validation, the refinement and the merged files; nothing else of the file is used, so unlike `-z` it fixes no space group, cell or frame. Taken on the model's axes where the merge matches the file's intensities (`R_FREE_FLAGS=`, see [Free set and model bias](RUGNUX_MODEL_AND_REFERENCE.md#free-set-and-model-bias)) |
|
||||
| `--free-flags <file>` | Take only the R-free test set of this MTZ or structure-factor mmCIF - e.g. the deposited reflections of the `--model` - for the validation, the refinement and the merged files; nothing else of the file is used, so unlike `-z` it fixes no space group, cell or frame. Taken on the model's axes where the rigid body placed the model and the merge matches the file's intensities (`R_FREE_FLAGS=`, see [Free set and model bias](RUGNUX_MODEL_AND_REFERENCE.md#free-set-and-model-bias)) |
|
||||
| `--reference-column <label>` | Reference column to use, by MTZ label — an mmCIF under the labels `gemmi cif2mtz` gives it (default: auto — F-model, else IMEAN/I/…, else FP/FOBS/F) |
|
||||
| `--model <file>` | Validate the merged intensities against this atomic model (PDB or mmCIF, gzipped or not; the format is taken from the file's content) — R-work / R-free and maps (see [Validating against a model](RUGNUX_ADVANCED.md#validating-against-a-model-rugnux---model)). An experimental model is placed as a rigid body, and by molecular replacement where the rigid body does not place it; a prediction (AlphaFold or ModelCIF) goes to molecular replacement straight away (`MODEL_PLACEMENT=`). It also settles the frame the reflections are written in: the enantiomorph, and the [indexing ambiguity](RUGNUX_ADVANCED.md#the-indexing-ambiguity) where no `-z` did; another space group or the twin hypothesis' subgroup it chooses is written beside the answer as `<prefix>_mr.mtz`/`.cif`. It does not change the processing: the merge is the same with and without it. A placed model is then [refined](RUGNUX_MODEL_AND_REFERENCE.md#refinement) against the merge it was placed on (`<prefix>_refined_model.cif`, `<prefix>_refined_maps.mtz`, `<prefix>_blobs.json`, `REFINE_` keys) - seconds on a GPU, typically 2-15 minutes on the CPU - which decides nothing about the processing |
|
||||
| `--mr <file>` | As `--model`, but placed by molecular replacement straight away, without trying the rigid body first: as many copies as the cell holds, in every space group the merge cannot tell apart and in the twin hypothesis' subgroup. A prediction is trimmed to the residues of pLDDT 70 and above, and where the AlphaFold DB's predicted-aligned-error JSON sits beside it under its own name it is cut into rigid domains; any other PDB or mmCIF is taken as an experimental structure, its polymer only (no waters, ligands, hydrogens or alternative conformers). A model of several chains is searched for as a whole and, beside it, one chain of each molecule in it by itself, and the better placement kept (`MR_SEARCH_MODEL=`). It may relabel the enantiomorph of the answer, and a different space group it chooses is written beside the answer as `<prefix>_mr.mtz`/`.cif` with the placed model `<prefix>_mr_model.pdb`. `--mode mx` only; not with `--model` |
|
||||
|
||||
@@ -114,7 +114,7 @@ these letters.
|
||||
| Twinning check (L-test, twin laws) | data | — | — | — | (a) |
|
||||
| Twin hypothesis `<prefix>_twin_<SG>.*` | data (when the group may have absorbed a twin law) | — | — | the model may also *ask* for this merge; written then only where the model chooses it | (a) / (c) |
|
||||
| Anomalous signal, Friedel handling | data (`-A`) | — | — | — (the anomalous map is report-only, and the veto on the hand) | (a) |
|
||||
| R-free test set | hash of the index | — | the reference's flags, where it matches | — (drawn again on the model's axes if the setting moved; never chosen by the model) | (a) |
|
||||
| R-free test set | hash of the index | — | the reference's flags, where it matches | — (drawn again on the model's axes if the setting moved; never chosen by the model; `--free-flags` puts a file's set on those axes where the rigid body placed the model) | (a) |
|
||||
| Merged intensities and sigmas in `p.mtz` | data | — | — | — | (a) |
|
||||
| `p.mtz` space-group label | data | yours | the reference's | hand relabel only | (b) |
|
||||
| `<prefix>_mr.mtz`/`.cif`, `<prefix>_mr_model.*` | not written | — | — | another group or the twin subgroup the model chose | (c) |
|
||||
@@ -293,8 +293,11 @@ refinements whose bond and angle rmsd stay within 0.02 A and 2 degrees - a candi
|
||||
difference over the free reflections: three weights from the placed
|
||||
model, each with the B factors held and refined; then a trajectory of further short refinements from the
|
||||
chosen one, each trying the weights as they are and changed, taken while it lowers the work-set target (the
|
||||
refined target at the chosen weights); then a short final ladder. The free set decides the weights and the
|
||||
displacement model only; every other step is taken on the work-set target. The free set is the merge's own, so the refined R-free judges the refinement against reflections it
|
||||
refined target at the chosen weights); then a short final ladder. The free set decides the weights, the
|
||||
displacement model, the twin law against its null and whether the model as given is kept over the refinement;
|
||||
every other step is taken on the work-set target
|
||||
([where the free set is used](CPU_DATA_ANALYSIS_REFINEMENT.md#1513-where-the-free-set-is-used) tabulates them).
|
||||
The free set is the merge's own, so the refined R-free judges the refinement against reflections it
|
||||
never fitted - but where the model was deposited, those reflections were most likely its depositor's working
|
||||
reflections, and a refinement against new data then moves R-free up from the unrefined value rather than
|
||||
down. `R_WORK`/`R_FREE` of the model as given are never replaced. On a GPU a refinement takes seconds; the CPU
|
||||
@@ -389,14 +392,17 @@ crystal, has been fitted to every reflection, so its R-free on a fresh set reads
|
||||
sometimes - and a refinement from it reads no cross-validation at all. `--free-flags <file>` takes the test set of
|
||||
the reflections it was refined against (the deposited `-sf.cif`, or an MTZ) and nothing else from them: unlike
|
||||
`-z` it fixes no group, cell or frame and steers no processing. The flags are put on the merge once it is on the
|
||||
model's axes, where the merge matches the file's intensities as `-z` requires (CC at least 0.5 over at least half
|
||||
of its reflections); the validation is then made again on them, and the refinement and the merged files carry
|
||||
model's axes, where the rigid body placed the model (a model placed by molecular replacement, or a prediction,
|
||||
keeps the drawn set) and the merge matches the file's intensities as `-z` requires (CC at least 0.5 over at least
|
||||
half of its reflections); the validation is then made again on them, and the refinement and the merged files carry
|
||||
them. `R_FREE_FLAGS=` says which set `R_FREE` and the refinement used: `DRAWN`, `REFERENCE` (`-z`) or `FILE`.
|
||||
|
||||
**What is fitted on which reflections.** Everything fitted to place and scale the model — the
|
||||
overall scale, the anisotropic *B*, the bulk solvent, the rigid body — is fitted on the working
|
||||
reflections only. The free set is then used for a few discrete *selections*: whether the rigid-body
|
||||
step is kept, which indexing wins, and in molecular replacement which placement and which group.
|
||||
step is kept, which indexing wins, which merge the maps come from where a twin hypothesis was written, and in
|
||||
molecular replacement which placement and which group
|
||||
([where the free set is used](CPU_DATA_ANALYSIS_REFINEMENT.md#1513-where-the-free-set-is-used) lists every one).
|
||||
Each of those leaves R-free very slightly optimistic where it fires. For `R_WORK`/`R_FREE` the
|
||||
coordinates, B-factors and occupancies of the model are never refined; the refinement above refines them on
|
||||
the side, under `REFINE_` keys of its own.
|
||||
|
||||
@@ -76,8 +76,8 @@ then gives R-work/R-free and σA-weighted maps. The model never changes how the
|
||||
model density and rotation function on the Apple GPU ([GPU data analysis](GPU_DATA_ANALYSIS.md#molecular-replacement)).
|
||||
|
||||
**Model: refinement.** A placed model is then refined against the merge it was placed on (`--no-refine`
|
||||
skips it): its chains as rigid bodies and B per residue where that lowers R-free, then every atom's position
|
||||
and B by a restrained maximum-likelihood refinement whose weights are chosen by R-free in short trials run
|
||||
skips it): its chains as rigid bodies and B per residue where that lowers the working reflections' likelihood, then every atom's position
|
||||
and B by a restrained maximum-likelihood refinement whose weights are chosen on the free set (free -ln L and R-free agreeing) in short trials run
|
||||
side by side; the refined model gives its own maps and the blobs of unexplained density. Like the
|
||||
validation it decides nothing - the merge, `R_WORK`/`R_FREE` and the placed model's files stay as they
|
||||
were, and the refined results are written beside them under `REFINE_`
|
||||
|
||||
@@ -1544,9 +1544,9 @@ Where a model was placed and refined ([Refinement](RUGNUX_MODEL_AND_REFERENCE.md
|
||||
| `REFINE_ADP_INPUT` | How the model's displacements were read ([§15.1](CPU_DATA_ANALYSIS_REFINEMENT.md#151-what-is-refined-and-in-what-order)): `isotropic`, `ANISOU` (its atoms' own U), or `TLS, B total` / `TLS, B residual` (U from its TLS groups, its B column the total or the residual) |
|
||||
| `REFINE_R_WORK_START`, `REFINE_R_FREE_START` | The model as given, scored as the refinement scores (riding hydrogens, its U as read, the fine solvent mask, the robust scale): REFMAC's 0-cycle R-factors to about 0.002 on the same model and data. Not `R_WORK`/`R_FREE`, which are the validation's own scoring of the placed model |
|
||||
| `REFINE_RIGID_BODIES` | The chains moved as rigid bodies, where that step was kept (0: not kept) |
|
||||
| `REFINE_R_WORK_PLACEMENT`, `REFINE_R_FREE_PLACEMENT` | After the placement stage (rigid bodies, then one B per residue, each kept only where it lowers R-free) |
|
||||
| `REFINE_R_WORK_PLACEMENT`, `REFINE_R_FREE_PLACEMENT` | After the placement stage (rigid bodies, then one B per residue, each kept only where it lowers the -ln L of the working reflections; the free set decides nothing here, [§15.13](CPU_DATA_ANALYSIS_REFINEMENT.md#1513-where-the-free-set-is-used)) |
|
||||
| `REFINE_R_WORK`, `REFINE_R_FREE` | After the restrained stage: the refined model, the one written as `<prefix>_refined_model.cif` |
|
||||
| `REFINE_AS_GIVEN` | `TRUE` where no refinement lowered R-free beyond the tie of the model as given, which is then the model written (as given, scaled to the data) |
|
||||
| `REFINE_AS_GIVEN` | `TRUE` where the free set prefers the model as given to the refinement (its free -ln L lower and its R-free not higher beyond the paired standard error) and the refinement is not better on both R-work and R-free; the model written is then the one given, scaled to the data. Only where the set is free to the model as given ([§15.7](CPU_DATA_ANALYSIS_REFINEMENT.md#157-the-weights-decided-by-trial), 7.) |
|
||||
| `REFINE_RMSD_BONDS`, `REFINE_RMSD_ANGLES` | The refined model's rmsd from the dictionary's bonds (Å) and angles (°); the weight is chosen within 0.02 Å and 2° |
|
||||
| `REFINE_RMSD_METAL_BONDS` | The rmsd of the metal-donor bonds made from the model's LINK records (those within the metal's inner sphere), apart from the covalent bonds. Present where there are any |
|
||||
| `REFINE_RMSD_BONDS_START`, `REFINE_RMSD_ANGLES_START` | *dev*. The same for the model as given |
|
||||
@@ -1590,7 +1590,7 @@ Where a model was placed and refined ([Refinement](RUGNUX_MODEL_AND_REFERENCE.md
|
||||
| `REFINE_SOLVENT_REMOVED` | Waters of the model as given that the build took out (mFo-DFc at -3 sigma or lower at the water) |
|
||||
| `REFINE_SOLVENT_RELABELLED` | Waters and single-atom ions the build relabelled as another species (water, Mg, Na, K, Ca or Cl) where their surroundings and density support it, not ambiguously; each, with the scores, in the report's prose and in `<prefix>_solvent.json`. Not with `--no-refine-solvent` |
|
||||
| `REFINE_SOLVENT_NOT_SOLVENT` | Difference-map peaks of the final model that cannot be a single solvent atom (bonded to the model, beside a displaced atom, a truncated side chain, a cluster or elongated density, denser than S and P): reported, not filled; each with its reason in `<prefix>_solvent.json` |
|
||||
| `REFINE_SOLVENT_BUILD_ROUNDS` | The build's rounds kept (at most two, within the weight search), each kept where refining the solvent it changed lowered R-free |
|
||||
| `REFINE_SOLVENT_BUILD_ROUNDS` | The build's rounds kept (at most two, within the weight search), each kept where it lowered the work-set target at the weights the trajectory ended at ([§15.10](CPU_DATA_ANALYSIS_REFINEMENT.md#1510-the-solvent-audit)); the free set does not see the build |
|
||||
| `REFINE_SOLVENT_BUILD_SECONDS` | The build's time: its maps, audits and refinements of the solvent (REFINE_SECONDS includes it too) |
|
||||
|
||||
A prose paragraph after the blob keys lists the five strongest blobs with their reading, peak, volume, position,
|
||||
|
||||
@@ -24,9 +24,9 @@
|
||||
// Levenberg-Marquardt: nothing there stops k_sol and b_sol reaching values a flat solvent model
|
||||
// is meaningless at (b_sol of 1707 A^2 was measured on this corpus). Here k_sol and b_sol come
|
||||
// from a grid search over the physical ranges, so an unphysical answer cannot be represented.
|
||||
// The box the solvent parameters are searched in. The defaults are the physically reasonable
|
||||
// range reported by Fokine & Urzhumtsev and adopted as phenix's default grid: k_sol in (0.1, 0.8)
|
||||
// and b_sol in (10, 80) A^2, of which phenix searches b_sol 10-80 in steps of 5. A model with high
|
||||
// The box the solvent parameters are searched in: k_sol in (0.10, 0.60) and b_sol in (10, 80) A^2.
|
||||
// The b_sol range is the physically reasonable one reported by Fokine & Urzhumtsev and phenix's
|
||||
// default grid (b_sol 10-80 in steps of 5); their k_sol range reaches 0.8, the box here stops at 0.6. A model with high
|
||||
// atomic B gets a higher b_sol ceiling (SolventBMax).
|
||||
struct ModelScaleBox {
|
||||
double k_lo = 0.10, k_hi = 0.60;
|
||||
|
||||
Reference in new issue
Block a user