* [Bugfix][SM70] Stop compiling prefill kernels for every new prompt length
_qk_norm_rope and _sm70_qwen35_gdn_split_kernel took the token count as a
constexpr, so each prefill chunk length not seen before compiled two Triton
kernels while the request waited: about 0.34 s of TTFT per new length, and
worker RSS that kept growing while serving.
Pass the length-dependent values as runtime arguments instead. Floating-point
behaviour does not change.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
* [SM70] Leave Qwen3.8-27B about 1 GiB more VRAM headroom
With vision enabled and maximum-size images the 27B engine peaked at 32.1 GiB of
32.48 GiB. KV at 0.86 holds 5.85x of 256K, more than eight requests need at
usual context lengths, so trade about 1 GiB of KV for headroom.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
---------
Co-authored-by: yangzhuxinyzx <Susannah_Carterect@gmx.ca>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
