tomeras91 ac04a97a9f [Frontend] Add max_tokens prometheus metric (#9881) ...

Signed-off-by: Tomer Asida <tomera@ai21.com>

2024-11-04 22:53:24 +00:00

..

__init__.py

…

test_accuracy.py

[CI] Basic Integration Test For TPU (#9968)

2024-11-04 11:34:26 -08:00

test_audio.py

[Misc][OpenAI] deprecate max_tokens in favor of new max_completion_tokens field for chat completion endpoint (#9837)

2024-10-30 18:15:56 -07:00

test_basic.py

[Frontend] Chat-based Embeddings API (#9759)

2024-11-01 08:13:35 +00:00

test_chat_template.py

…

test_chat.py

[Misc][OpenAI] deprecate max_tokens in favor of new max_completion_tokens field for chat completion endpoint (#9837)

2024-10-30 18:15:56 -07:00

test_chunked_prompt.py

[Bugfix] Fix vLLM UsageInfo and logprobs None AssertionError with empty token_ids (#9034)

2024-10-15 15:40:43 -07:00

test_cli_args.py

[Frontend] Add Early Validation For Chat Template / Tool Call Parser (#9151)

2024-10-08 14:31:26 +00:00

test_completion.py

[Bugfix][Frontend] Guard against bad token ids (#9634)

2024-10-29 14:13:20 -07:00

test_embedding.py

[Frontend] Chat-based Embeddings API (#9759)

2024-11-01 08:13:35 +00:00

test_encoder_decoder.py

…

test_lora_lineage.py

…

test_metrics.py

[Frontend] Add max_tokens prometheus metric (#9881)

2024-11-04 22:53:24 +00:00

test_models.py

…

test_oot_registration.py

…

test_prompt_validation.py

[Bugfix][Frontend] Reject guided decoding in multistep mode (#9892)

2024-11-01 01:09:46 +00:00

test_return_tokens_as_ids.py

…

test_run_batch.py

…

test_serving_chat.py

[Bugfix]: Make chat content text allow type content (#9358)

2024-10-24 05:05:49 +00:00

test_serving_engine.py

…

test_shutdown.py

[CI/Build] Replaced some models on tests for smaller ones (#9570)

2024-10-22 04:52:14 +00:00

test_tokenization.py

[Frontend] Chat-based Embeddings API (#9759)

2024-11-01 08:13:35 +00:00

test_vision_embedding.py

[Frontend] Use a proper chat template for VLM2Vec (#9912)

2024-11-01 14:09:07 +00:00

test_vision.py

[Misc][OpenAI] deprecate max_tokens in favor of new max_completion_tokens field for chat completion endpoint (#9837)

2024-10-30 18:15:56 -07:00