Jee Jee LiandB-201 a5bba7d234 [Model] Add Idefics3 support (#9767) ...

Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: B-201 <Joy25810@foxmail.com>
Co-authored-by: B-201 <Joy25810@foxmail.com>

2024-11-06 11:41:17 +00:00

..

async_engine

…

basic_correctness

[Bugfix] Fix pickle of input when async output processing is on (#9931)

2024-11-06 00:39:26 +00:00

compile

[CI/Build] drop support for Python 3.8 EOL (#8464)

2024-11-06 07:11:55 +00:00

core

[CI/Build] drop support for Python 3.8 EOL (#8464)

2024-11-06 07:11:55 +00:00

data

[Bugfix] Fix load config when using bools (#9533)

2024-10-27 13:46:41 -04:00

distributed

[distributed] add function to create ipc buffers directly (#10064)

2024-11-05 22:35:03 -08:00

encoder_decoder

[Encoder Decoder] Add flash_attn kernel support for encoder-decoder models (#9559)

2024-11-01 23:22:49 -07:00

engine

[Core] Make encoder-decoder inputs a nested structure to be more composable (#9604)

2024-11-05 10:07:31 +08:00

entrypoints

[Frontend] Add max_tokens prometheus metric (#9881)

2024-11-04 22:53:24 +00:00

fp8_kv

…

kernels

[CI/Build] drop support for Python 3.8 EOL (#8464)

2024-11-06 07:11:55 +00:00

lora

[Bugfix][CI/Build][Hardware][AMD] Shard ID parameters in AMD tests running parallel jobs (#9279)

2024-11-04 11:37:46 -08:00

metrics

[Frontend] Add max_tokens prometheus metric (#9881)

2024-11-04 22:53:24 +00:00

model_executor

…

models

[Model] Add Idefics3 support (#9767)

2024-11-06 11:41:17 +00:00

mq_llm_engine

[Bugfix][core] replace heartbeat with pid check (#9818)

2024-10-30 09:34:07 -07:00

multi_step

…

multimodal

[Frontend] Multi-Modality Support for Loading Local Image Files (#9915)

2024-11-04 15:34:57 +00:00

plugins/vllm_add_dummy_model

…

prefix_caching

[Bugfix] Fix illegal memory access error with chunked prefill, prefix caching, block manager v2 and xformers enabled together (#9532)

2024-10-31 11:46:36 -07:00

prompt_adapter

…

prompts

…

quantization

…

samplers

[CI/Build] drop support for Python 3.8 EOL (#8464)

2024-11-06 07:11:55 +00:00

spec_decode

[Bugfix][SpecDecode] kv corruption with bonus tokens in spec decode (#9730)

2024-11-06 01:45:45 +00:00

tensorizer_loader

…

tokenization

[CI/Build] drop support for Python 3.8 EOL (#8464)

2024-11-06 07:11:55 +00:00

tool_use

[Misc][OpenAI] deprecate max_tokens in favor of new max_completion_tokens field for chat completion endpoint (#9837)

2024-10-30 18:15:56 -07:00

tpu

…

tracing

…

weight_loading

…

worker

[2/N] executor pass the complete config to worker/modelrunner (#9938)

2024-11-02 07:35:05 -07:00

__init__.py

…

conftest.py

[CI/Build] drop support for Python 3.8 EOL (#8464)

2024-11-06 07:11:55 +00:00

test_cache_block_hashing.py

[Core] Make encoder-decoder inputs a nested structure to be more composable (#9604)

2024-11-05 10:07:31 +08:00

test_config.py

…

test_embedded_commit.py

…

test_inputs.py

…

test_logger.py

[CI/Build] drop support for Python 3.8 EOL (#8464)

2024-11-06 07:11:55 +00:00

test_logits_processor.py

…

test_regression.py

…

test_sampling_params.py

…

test_scalartype.py

…

test_sequence.py

…

test_sharded_state_loader.py

…

test_utils.py

[Bugfix] Fix load config when using bools (#9533)

2024-10-27 13:46:41 -04:00

utils.py

[CI/Build] Fix large_gpu_mark reason (#10070)

2024-11-06 08:50:37 +00:00