3 people 2038fbf51b [Release] Bring the bundled V100 launchers up to the 1.5.2 profiles (#1397) ...

serve_flash_next_nvfp4_v100.sh still launched the old 128K, single-sequence
recipe without host KV. It now starts the 1.5.2 release configuration (256K
with FP8 KV history in host memory, eight sequences, utilization 0.89) and
accepts --draft for a separate MTP checkpoint. The 27B launcher's help text
said four sequences; its profile serves eight.

Co-authored-by: yangzhuxinyzx <Susannah_Carterect@gmx.ca>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>

2026-11-06 16:56:50 +08:00

..

autotune_helion_kernels.py

…

serve_flash_next_nvfp4_v100.sh

[Release] Bring the bundled V100 launchers up to the 1.5.2 profiles (#1397)

2026-11-06 16:56:50 +08:00

serve_qwen38_27b_nvfp4_v100.sh

[Release] Bring the bundled V100 launchers up to the 1.5.2 profiles (#1397)

2026-11-06 16:56:50 +08:00