Cyrus Leung b4be5a8adb [Bugfix] Enforce no chunked prefill for embedding models (#10470) ...

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

2024-11-20 05:12:51 +00:00

..

compatibility_matrix.rst

[Bugfix] Enforce no chunked prefill for embedding models (#10470)

2024-11-20 05:12:51 +00:00

deploying_with_bentoml.rst

…

deploying_with_cerebrium.rst

…

deploying_with_docker.rst

…

deploying_with_dstack.rst

…

deploying_with_k8s.rst

…

deploying_with_kserve.rst

…

deploying_with_lws.rst

…

deploying_with_nginx.rst

…

deploying_with_triton.rst

…

distributed_serving.rst

…

env_vars.rst

…

faq.rst

…

integrations.rst

Add docs on serving with Llama Stack (#10183)

2024-11-11 11:28:55 -08:00

metrics.rst

…

openai_compatible_server.md

[Frontend] Automatic detection of chat content format from AST (#9919)

2024-11-16 13:35:40 +08:00

run_on_sky.rst

[Misc][OpenAI] deprecate max_tokens in favor of new max_completion_tokens field for chat completion endpoint (#9837)

2024-10-30 18:15:56 -07:00

serving_with_langchain.rst

…

serving_with_llamaindex.rst

…

serving_with_llamastack.rst

Add docs on serving with Llama Stack (#10183)

2024-11-11 11:28:55 -08:00

tensorizer.rst

…

usage_stats.md

…