Aurick QiaoandAurick Qiao 2c19d96777 [Spec Decode] Integrate Suffix Decoding from Arctic Inference (#25784) ...

Co-authored-by: Aurick Qiao <aurick.qiao@snowflake.com>

2025-11-03 09:23:31 -08:00

..

basic_correctness

[Fix] Skip record_sleep_state logic in PrometheusStatsLogger if not in dev mode (#27789)

2025-10-30 19:26:27 +00:00

benchmarks

Feature/video support in random mm dataset (#25963)

2025-10-29 18:24:52 +08:00

compile

[Misc][qwen2_5_vl][torch.compile] Enable supports_torch_compile on generic nn.Module and demonstrate speedup on Qwen Vision model (#23207)

2025-10-28 22:36:43 +00:00

config

[MM][Core] Decouple ViT backend from LM backend (#27061)

2025-10-21 00:30:10 -07:00

cuda

…

detokenizer

…

distributed

[Bugfix] Fix allocation & free logic of SingleWriterShmRingBuffer (#27117)

2025-10-28 15:01:24 +00:00

engine

[Chore]:Extract math and argparse utilities to separate modules (#27188)

2025-10-26 04:03:32 -07:00

entrypoints

Add ORCA endpoint load metrics support (#24905)

2025-11-03 08:21:31 +00:00

evals

…

kernels

[V1] [Hybrid] Mamba1 Automatic Prefix Caching (#26377)

2025-11-02 04:16:23 -08:00

kv_transfer

…

lora

Early exit for MoE LoRA kernels (#27131)

2025-11-03 20:22:17 +08:00

model_executor

[CI/Build] Fix amd model executor test (#27612)

2025-10-28 08:58:11 +00:00

models

[Model] Add PaddleOCR-VL Model Support (#27758)

2025-11-03 19:04:22 +08:00

multimodal

…

plugins

[Frontend][4/N] Improve all pooling task | Add plugin pooling task (#26973)

2025-10-23 14:46:18 +00:00

plugins_tests

[Frontend][4/N] Improve all pooling task | Add plugin pooling task (#26973)

2025-10-23 14:46:18 +00:00

prompts

…

quantization

[CI Failure] Fix test_kv_cache_model_load_and_run (#27717)

2025-10-30 12:27:53 +00:00

reasoning

[Model] Add DeepSeek-V3.1 reasoning parser (split from PR #24972) (#25589)

2025-10-15 11:09:52 +08:00

samplers

[CI] Replace large models with tiny alternatives in tests (#24057)

2025-10-16 15:51:27 +01:00

standalone_tests

[CI/Build] Move pre-commit only scripts to tools/pre_commit (#27657)

2025-10-29 08:04:33 +00:00

system_messages

…

tokenization

…

tool_use

Fix a robust parsing issue in KimiK2ToolParser that causes IndexError (#27565)

2025-10-28 11:11:50 +00:00

tools

[CI/Build] Move pre-commit only scripts to tools/pre_commit (#27657)

2025-10-29 08:04:33 +00:00

tpu

[Frontend][torch.compile] CompilationConfig Overhaul (#20283): name change compilation level to compilation mode, deprecation compilation level (#26355)

2025-10-15 02:51:16 +00:00

transformers_utils

[Bugfix] Skip gs:// model paths for speculator detection (#27846)

2025-11-03 14:31:03 +00:00

utils_

[Misc] Clean up utils (#27552)

2025-10-27 09:05:40 +00:00

v1

[Spec Decode] Integrate Suffix Decoding from Arctic Inference (#25784)

2025-11-03 09:23:31 -08:00

vllm_test_utils

…

weight_loading

…

__init__.py

…

ci_envs.py

[Model][0/N] Improve all pooling task | clean up (#25817)

2025-10-13 16:44:50 +08:00

conftest.py

[Core] Async scheduling + structured outputs compatibility (#26866)

2025-11-01 00:35:04 +00:00

test_config.py

…

test_embedded_commit.py

…

test_envs.py

[Frontend] [gpt-oss] Mcp type bug (#27689)

2025-10-29 10:01:32 +00:00

test_inputs.py

…

test_logger.py

[torch.compile] Enable attention and allreduce fusion without custom ops enabled (#24604)

2025-10-17 08:10:23 -06:00

test_outputs.py

…

test_pooling_params.py

[Frontend][Doc][5/N] Improve all pooling task | Polish encode (pooling) api & Document. (#25524)

2025-10-30 12:13:05 +00:00

test_regression.py

…

test_routing_simulator.py

…

test_scalartype.py

…

test_seed_behavior.py

…

test_sequence.py

…

test_triton_utils.py

…

test_version.py

…

test_vllm_port.py

…

utils.py

Adds anthropic /v1/messages endpoint to openai api_server (#27882)

2025-11-01 12:45:42 -07:00