jon-chuangandCody Yu a046f86397 [Core/Bugfix] Add FP8 K/V Scale and dtype conversion for prefix/prefill Triton Kernel (#7208) ...

Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>

2024-08-12 22:47:41 +00:00

..

_static

[Docs] Add RunLLM chat widget (#6857)

2024-07-27 09:24:46 -07:00

_templates/sections

[Doc] Guide for adding multi-modal plugins (#6205)

2024-07-10 14:55:34 +08:00

assets

…

automatic_prefix_caching

…

community

Add Skywork AI as Sponsor (#7314)

2024-08-08 13:59:57 -07:00

dev

[Bugfix] Fix broadcasting logic for multi_modal_kwargs (#6836)

2024-07-31 10:38:45 +08:00

getting_started

[Doc] building vLLM with VLLM_TARGET_DEVICE=empty (#7403)

2024-08-11 14:38:17 -07:00

models

[Core][VLM] Support image embeddings as input (#6613)

2024-08-12 16:16:06 +08:00

performance_benchmark

[Doc] Add documentations for nightly benchmarks (#6412)

2024-07-25 11:57:16 -07:00

quantization

[Core/Bugfix] Add FP8 K/V Scale and dtype conversion for prefix/prefill Triton Kernel (#7208)

2024-08-12 22:47:41 +00:00

serving

[Models] Support Qwen model with PP (#6974)

2024-08-01 12:40:43 -07:00

conf.py

[Doc] Mock new dependencies for documentation (#7245)

2024-08-07 06:43:03 +00:00

generate_examples.py

…

index.rst

[Docs] Update readme (#7316)

2024-08-11 17:13:37 -07:00