omer-dayan 995f56236b [Core] Loading model from S3 using RunAI Model Streamer as optional loader (#10192) ...

Signed-off-by: OmerD <omer@run.ai>

2024-12-20 16:46:24 +00:00

..

_static

…

_templates/sections

…

assets

[Doc] add documentation for disaggregated prefilling (#11197)

2024-12-15 13:31:16 -06:00

automatic_prefix_caching

[doc] format fix (#10789)

2024-11-30 11:38:40 +00:00

community

…

contributing

…

design

[Core] V1: Use multiprocessing by default (#11074)

2024-12-13 16:27:32 -08:00

dev

…

getting_started

[doc] backward compatibility for 0.6.4 (#11359)

2024-12-19 21:33:53 -08:00

models

[Model] Add JambaForSequenceClassification model (#10860)

2024-12-19 22:48:06 +08:00

performance

…

quantization

[[Misc]Upgrade bitsandbytes to the latest version 0.45.0 (#11201)

2024-12-15 03:03:06 +00:00

serving

[Core] Loading model from S3 using RunAI Model Streamer as optional loader (#10192)

2024-12-20 16:46:24 +00:00

usage

[Model] IBM Granite 3.1 (#11307)

2024-12-19 11:27:24 +08:00

conf.py

[Core][Performance] Add XGrammar support for guided decoding and set it as default (#10785)

2024-12-03 15:17:00 +08:00

generate_examples.py

…

index.rst

[Core] Loading model from S3 using RunAI Model Streamer as optional loader (#10192)

2024-12-20 16:46:24 +00:00