GPU memory: a probe pass hands its memory to the card when it ends
The speculative geometry probe and the rotation-scale walk's indexing probes gave their indexers' and image workers' buffers back to the allocation pool only, which kept them reserved under the main line's merge and analyses: 5.5 GB on 8qaw and 5.3 GB on 4nwv on the RTX 5080, until the end of the run. The pool is trimmed (every card: cuda_trim_allocation_pools) when such a probe ends, as IndexerThreadPool::ReleaseIndexers now does through the same helper. Measured (RTX 5080): device memory held at the end of the final merge 8.7 -> 3.4 GB (4nwv), 14.5 -> 7.7 GB (8qaw). Output unchanged: p.hkl byte-identical on cytc_x10sa, myob_x10sa, 4nwv and 8qaw, on this card and with its total read as 8.55 GB. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
1 parent
8f722227e8
commit
2091c0524a
4 files changed
+19
-4
No files matched your search
@@ -286,10 +286,7 @@ void IndexerThreadPool::ReleaseIndexers() {
|
||||
#ifdef JFJOCH_USE_CUDA
|
||||
// Their buffers went back to the allocation pool, which would keep them reserved for the next
|
||||
// buffer of whoever asks; hand them to the card.
|
||||
for (int32_t d = 0; d < get_gpu_count(); d++) {
|
||||
ScopedGpuPin pin(d);
|
||||
cuda_trim_allocation_pool();
|
||||
}
|
||||
cuda_trim_allocation_pools();
|
||||
#endif
|
||||
}
|
||||
|
||||
|
||||
Reference in new issue
Block a user