macandClaude Opus 5.5
d836d87d2d
Register the new VLLM_* switches in vllm/envs.py and read them through envs; torch.accelerator instead of torch.cuda; regex instead of re; read the hybrid PLE flag through ple_policy; move the IQ4_NL packed PLE result helpers to kernels/ple/gguf_packed_result.py; type annotations for lazily started expert-cache state; ruff/clang-format/markdown fixes. The layering baseline accepts the opt-in SM70 sparse target sampling hooks in the EAGLE speculator and its greedy-draft rejection kernel. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Configuration Options
This section lists the most common options for running vLLM.
There are three main levels of configuration, from highest priority to lowest priority: