Logo
Explore Help
Register Sign In
admin/1Cat-vLLM
Watch 1
Star 0 Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
Files
fc3901beb45817da7cba2247b0aa8fec00b7a659
1Cat-vLLM/docs/configuration
T
History
yangzhuxinyzx f21b51b96d Merge remote-tracking branch 'onecat/main' into codex/v100-flash-next-mtp-admission-20261002-212208
Signed-off-by: yangzhuxinyzx <153831768+yangzhuxinyzx@users.noreply.github.com>
2026-10-03 08:48:34 +08:00
..
conserving_memory.md
…
engine_args.md
[Docs] Reorganize online serving docs. (#41907)
2026-05-19 14:43:18 +08:00
env_var_reference.md
Merge remote-tracking branch 'onecat/main' into codex/v100-flash-next-mtp-admission-20261002-212208
2026-10-03 08:48:34 +08:00
env_vars.md
[Core] Document environment policy and register legacy reads
2026-10-03 00:24:34 +08:00
model_resolution.md
…
optimization.md
[Bugfix][SM70] Honor explicit compilation settings in Flash-V100 policies
2026-10-02 20:45:01 +08:00
README.md
…
serve_args.md
…

README.md

Configuration Options

This section lists the most common options for running vLLM.

There are three main levels of configuration, from highest priority to lowest priority:

  • Request parameters and input arguments
  • Engine arguments
  • Environment variables
Reference in new issue View Git Blame Copy Permalink
Powered by Gitea Version: 28.3.0 Page: 1163ms Template: 89ms
Auto
English
Bahasa Indonesia Deutsch English Español Français Gaeilge Italiano Latviešu Magyar nyelv Nederlands Polski Português de Portugal Português do Brasil Suomi Svenska Türkçe Čeština Ελληνικά Български Русский Українська فارسی മലയാളം 日本語 简体中文 繁體中文(台灣) 繁體中文(香港) 한국어
Licenses API