vllm-loop model-improvement progress tracker junk-tokens
models / / #28
▲ MADE POSITIVE PROGRESS

PP6 relay fix adopted + validated (Schaka c1b0907b)

Rebuilt the PP6 overlay from Schaka's latest kit: the kv-group relay now owns the source indexer K cache (layers.20.attn.indexer.k_cache), fixing his prompt-corruption path (44k check 5/10 -> 0/10 wrong). Ours: coherence OK, needle 128k 3/3, multi-needle 44k 5/5, coding 5/5; pure c1…

When (PT)2026-09-12 00:33 PT
ServingTP1xPP6 (7,7,7,7,7,5), util 0.95-0.96, DSpark k=5, fp8_ds_mla
Enginelocalhost/vllm-backport-v41:sm80 Schaka v0.13.0 kit (c1b0907b overlay)
KV

Benchmarks

MetricValueΔ vs previousUnitContextNote
c1_decode_32k_tok_s (c1_decode_32k_tok_s) 102 tok/s 106.5% tok/s PP6 v13 @32k (76.4 @4k)
c1_decode_tok_s (c1_decode_tok_s) 105.1 tok/s 8.5% tok/s PP6 v13, 8-tok prompt

raw JSON: /api/reports/28