omer-dayan 995f56236b [Core] Loading model from S3 using RunAI Model Streamer as optional loader (#10192) ...

Signed-off-by: OmerD <omer@run.ai>

2024-12-20 16:46:24 +00:00

..

architecture_helm_deployment.png

Add example of helm chart for vllm deployment on k8s (#9199)

2024-12-10 09:19:27 +00:00

deploying_with_bentoml.rst

…

deploying_with_cerebrium.rst

…

deploying_with_docker.rst

[ci][gh200] dockerfile clean up (#11351)

2024-12-19 18:13:06 -08:00

deploying_with_dstack.rst

…

deploying_with_helm.rst

fix(docs): typo in helm install instructions (#11141)

2024-12-12 17:36:32 +00:00

deploying_with_k8s.rst

Update deploying_with_k8s.rst (#10922)

2024-12-15 16:33:58 -08:00

deploying_with_kserve.rst

…

deploying_with_kubeai.rst

[Doc] add KubeAI to serving integrations (#10837)

2024-12-06 17:03:56 +00:00

deploying_with_lws.rst

…

deploying_with_nginx.rst

…

deploying_with_triton.rst

…

distributed_serving.rst

[Docs] hint to enable use of GPU performance counters in profiling tools for multi-node distributed serving (#11235)

2024-12-16 22:20:39 +00:00

integrations.rst

[Doc] add KubeAI to serving integrations (#10837)

2024-12-06 17:03:56 +00:00

metrics.rst

Add small example to metrics.rst (#10550)

2024-11-21 23:43:43 +00:00

openai_compatible_server.md

[Frontend] Add OpenAI API support for input_audio (#11027)

2024-12-16 22:09:58 -08:00

run_on_sky.rst

…

runai_model_streamer.rst

[Core] Loading model from S3 using RunAI Model Streamer as optional loader (#10192)

2024-12-20 16:46:24 +00:00

serving_with_langchain.rst

…

serving_with_llamaindex.rst

…

serving_with_llamastack.rst

Update link to LlamaStack remote vLLM guide in serving_with_llamastack.rst (#11112)

2024-12-12 02:39:21 +00:00

tensorizer.rst

…