This release adds 5 notable features for engineering teams evaluating rollout.
✓ No known CVEs patched in this version
Topics
+4 more
Summary
AI summaryAdded new ANN adapter surface and parser/mmap tuning options.
Changes in this release
| Type | Severity | Summary | CVE |
|---|---|---|---|
| Feature | Medium |
Added real `usearch_ann` adapter surface with new/reserve/upsert/query/remove/clear operations. Added real `usearch_ann` adapter surface with new/reserve/upsert/query/remove/clear operations. Source: llm_adapter@2026-05-21 Confidence: high |
— |
| Feature | Medium |
Added parser mode selection in `context_storage_ops` via `CONTEXT_STORAGE_OPS_JSON_PARSER` with auto, simd-first, sonic-first, serde-only modes. Added parser mode selection in `context_storage_ops` via `CONTEXT_STORAGE_OPS_JSON_PARSER` with auto, simd-first, sonic-first, serde-only modes. Source: llm_adapter@2026-05-21 Confidence: high |
— |
| Feature | Medium |
Added mmap path tuning in `context_storage_ops` with `CONTEXT_STORAGE_OPS_MMAP_MIN_BYTES` threshold and `CONTEXT_STORAGE_OPS_MMAP_ADVISE_SEQUENTIAL` advisory hint; fallback to buffered reads under threshold. Added mmap path tuning in `context_storage_ops` with `CONTEXT_STORAGE_OPS_MMAP_MIN_BYTES` threshold and `CONTEXT_STORAGE_OPS_MMAP_ADVISE_SEQUENTIAL` advisory hint; fallback to buffered reads under threshold. Source: llm_adapter@2026-05-21 Confidence: high |
— |
| Feature | Medium |
Added `mimalloc` global allocator to `crates/context_storage_ops` and `services/memory_bank_spike_rs`. Added `mimalloc` global allocator to `crates/context_storage_ops` and `services/memory_bank_spike_rs`. Source: llm_adapter@2026-05-21 Confidence: high |
— |
| Feature | Medium |
Parser mode transition from `serde-only` to `auto` improves `ledger-tail` since-filter performance by 17.08%. Parser mode transition from `serde-only` to `auto` improves `ledger-tail` since-filter performance by 17.08%. Source: llm_adapter@2026-05-21 Confidence: low |
— |
| Performance | Medium |
Expanded `rkyv` fast-path with ledger-tail cache (`*.tail.rkyv`) for repeated tail reads. Expanded `rkyv` fast-path with ledger-tail cache (`*.tail.rkyv`) for repeated tail reads. Source: llm_adapter@2026-05-21 Confidence: high |
— |
| Performance | Medium |
`archive-ndjson` gzip reduced p50 latency by 33.38%; `archive-ndjson` lz4 reduced p50 latency by 38.48%. `archive-ndjson` gzip reduced p50 latency by 33.38%; `archive-ndjson` lz4 reduced p50 latency by 38.48%. Source: llm_adapter@2026-05-21 Confidence: high |
— |
| Performance | Medium |
`ledger-tail` mmap shows 13.43% increase in warm p50 latency after cache materialization. `ledger-tail` mmap shows 13.43% increase in warm p50 latency after cache materialization. Source: llm_adapter@2026-05-21 Confidence: low |
— |
Full changelog
ContextLattice v3.3.24
Rust tranche 1-5 landed on public/main with storage/retrieval-path upgrades:
- Added real
usearch_annadapter surface incontext_retrieval(new/reserve/upsert/query/remove/clear) with feature-gated compile checks. - Added parser mode selection in
context_storage_opsviaCONTEXT_STORAGE_OPS_JSON_PARSER:auto(default)simd-firstsonic-firstserde-only
- Added mmap path tuning in
context_storage_ops:CONTEXT_STORAGE_OPS_MMAP_MIN_BYTESthresholdCONTEXT_STORAGE_OPS_MMAP_ADVISE_SEQUENTIALadvisory hint- fallback to buffered reads under threshold
- Expanded
rkyvfast-path with ledger-tail cache (*.tail.rkyv) for repeated tail reads. - Added
mimallocglobal allocator to:crates/context_storage_opsservices/memory_bank_spike_rs
Perf Matrix (local microbench, baseline commit fee28e9 vs current)
| Case | Baseline p50 (s) | Current p50 (s) | Delta |
|---|---:|---:|---:|
| ledger-tail mmap (steady-state warm) | 0.0220 | 0.0249 | +13.43% |
| archive-ndjson gzip | 0.8048 | 0.5361 | -33.38% |
| archive-ndjson lz4 | 0.4549 | 0.2799 | -38.48% |
| parser mode: serde-only -> auto (ledger-tail since-filter) | 0.0289 | 0.0240 | -17.08% |
Notes:
ledger-tailnow pays a one-time cold cost to materialize cache, then serves warm reads near baseline while enabling repeated low-latency tails.- Archive lanes show substantial p50 improvements in this tranche.
Weekly OSS security release digest.
The CVE patches and breaking changes that affected production tools this week. One email, every Sunday.
No spam, unsubscribe anytime.
Share this release
About sheawinkler/ContextLattice
Private-by-default memory and context layer for agents with Go/Rust runtime, staged retrieval across fused data backends, and long-horizon context continuity.
Related context
Related tools
Beta — feedback welcome: [email protected]