sfeiqiangandphaedonsun 8cb24d3aed [KV Connector] Support using FlexKV as KV Cache Offloading option. (#34328) ...

Signed-off-by: phaedonsun <phaedonsun@tencent.com>
Co-authored-by: phaedonsun <phaedonsun@tencent.com>

2026-03-12 00:46:20 -07:00

..

disaggregated-prefill-v1

…

kv_load_failure_recovery

[PD] Change kv_load_failure_policy Default from "recompute" to "fail" (#34896)

2026-02-21 01:34:57 -08:00

logits_processor

docs: add README for logits_processor examples (#35933)

2026-03-04 17:09:19 +00:00

new_weight_syncing

[ROCm][CI] Support async weight transfer example with platform-aware determinism (#35710)

2026-03-04 09:44:14 +08:00

openai_batch

[Docs] Improve documentation (#33799)

2026-02-06 12:57:09 +00:00

qwen2_5_omni

…

qwen3_omni

…

async_llm_streaming.py

…

audio_language.py

[Model] Add support for moonshotai/Kimi-Audio-7B-Instruct (#36127)

2026-03-10 21:24:48 -07:00

automatic_prefix_caching.py

…

batch_llm_inference.py

…

chat_with_tools.py

…

context_extension.py

…

data_parallel.py

…

disaggregated_prefill.py

…

encoder_decoder_multimodal.py

…

extract_hidden_states.py

[Spec Decode] Add hidden states extraction system (#33736)

2026-03-02 14:29:09 -05:00

llm_engine_example.py

…

llm_engine_reset_kv.py

…

load_sharded_state.py

…

lora_with_quantization_inference.py

[Hardware] Replace torch.cuda.empty_cache with torch.accelerator.empty_cache (#30681)

2026-03-04 09:49:47 +00:00

metrics.py

…

mistral-small.py

[Bugfix] Fix Mistral-small --format (#36782)

2026-03-11 04:47:52 -07:00

mlpspeculator.py

…

multilora_inference.py

…

pause_resume.py

[Feat][RL] Pause and Resume with keep requests for single engine (#32351)

2026-02-07 00:08:58 +00:00

prefix_caching_flexkv.py

[KV Connector] Support using FlexKV as KV Cache Offloading option. (#34328)

2026-03-12 00:46:20 -07:00

prefix_caching.py

…

prompt_embed_inference.py

…

qwen_1m.py

…

reproducibility.py

…

rlhf_colocate.py

[Hardware] Replace torch.cuda.synchronize() api with torch.accelerator.synchronize (#36085)

2026-03-05 10:36:39 +00:00

rlhf_online_quant.py

…

rlhf_utils.py

[Hardware] Replace torch.cuda.synchronize() api with torch.accelerator.synchronize (#36085)

2026-03-05 10:36:39 +00:00

rlhf.py

…

routed_experts_e2e.py

Fix routed experts capture for hybrid models (Mamba + Attention) (#35744)

2026-03-11 08:53:10 -07:00

run_one_batch.py

[Misc] Add run one batch script that supports profiling (#32968)

2026-02-10 18:29:49 -08:00

save_sharded_state.py

…

simple_profiling.py

…

skip_loading_weights_in_engine_init.py

…

spec_decode.py

[Bugfix] Fix --trust-remote-code conflict (#34218)

2026-02-10 00:29:10 -08:00

structured_outputs.py

…

torchrun_dp_example.py

…

torchrun_example.py

…

vision_language_multi_image.py

…

vision_language.py

…