9f970d6288
* [Bugfix][SM70] Stop compiling prefill kernels for every new prompt length _qk_norm_rope and _sm70_qwen35_gdn_split_kernel took the token count as a constexpr, so each prefill chunk length not seen before compiled two Triton kernels while the request waited: about 0.34 s of TTFT per new length, and worker RSS that kept growing while serving. Pass the length-dependent values as runtime arguments instead. Floating-point behaviour does not change. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> * [SM70] Leave Qwen3.8-27B about 1 GiB more VRAM headroom With vision enabled and maximum-size images the 27B engine peaked at 32.1 GiB of 32.48 GiB. KV at 0.86 holds 5.85x of 256K, more than eight requests need at usual context lengths, so trade about 1 GiB of KV for headroom. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> --------- Co-authored-by: yangzhuxinyzx <Susannah_Carterect@gmx.ca> Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>