admin/1Cat-vLLM

0 Fork 0

Files

T

History

Cyrus Leung 753944fa9b [Doc] Update reproducibility doc and example (#18741 )

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

2025-05-27 07:03:13 +00:00

..

faq.md

…

metrics.md

…

README.md

…

reproducibility.md

[Doc] Update reproducibility doc and example (#18741 )

2025-05-27 07:03:13 +00:00

security.md

…

troubleshooting.md

…

usage_stats.md

…

v1_guide.md

…

README.md

Using vLLM

vLLM supports the following usage patterns:

Inference and Serving: Run a single instance of a model.
Deployment: Scale up model instances for production.
Training: Train or fine-tune a model.