Maximilien de Bayser 344cd2b6f4 [Feature] Add support for Llama 3.1 and 3.2 tool use (#8343) ...

Signed-off-by: Max de Bayser <mbayser@br.ibm.com>

2024-09-26 17:01:42 -07:00

..

deploying_with_bentoml.rst

…

deploying_with_cerebrium.rst

[DOC] - Add docker image to Cerebrium Integration (#6510)

2024-07-17 10:22:53 -07:00

deploying_with_docker.rst

…

deploying_with_dstack.rst

[Doc][CI/Build] Update docs and tests to use vllm serve (#6431)

2024-07-17 07:43:21 +00:00

deploying_with_kserve.rst

…

deploying_with_lws.rst

…

deploying_with_triton.rst

…

distributed_serving.rst

[Models] Support Qwen model with PP (#6974)

2024-08-01 12:40:43 -07:00

env_vars.rst

[doc][misc] add note for Kubernetes users (#5916)

2024-06-27 10:07:07 -07:00

faq.rst

[Documentation][Spec Decode] Add documentation about lossless guarantees in Speculative Decoding in vLLM (#7962)

2024-09-05 16:25:29 -04:00

integrations.rst

llama_index serving integration documentation (#6973)

2024-08-14 15:38:37 -07:00

metrics.rst

…

openai_compatible_server.md

[Feature] Add support for Llama 3.1 and 3.2 tool use (#8343)

2024-09-26 17:01:42 -07:00

run_on_sky.rst

[Doc] Update SkyPilot doc for wrong indents and instructions for update service (#4283)

2024-07-26 14:39:10 -07:00

serving_with_langchain.rst

…

serving_with_llamaindex.rst

llama_index serving integration documentation (#6973)

2024-08-14 15:38:37 -07:00

tensorizer.rst

…

usage_stats.md

…