Chang Su e254497b66 [Model][Misc] Add e5-mistral-7b-instruct and Embedding API (#3734)

2024-05-11 11:30:37 -07:00

..

fp8

[Core] Refactor model loading code (#4097)

2024-04-16 11:34:39 -07:00

production_monitoring

[Bugfix] Update grafana.json (#4711)

2024-05-09 10:10:13 -07:00

api_client.py

…

aqlm_example.py

AQLM CUDA support (#3287)

2024-04-23 13:59:33 -04:00

gradio_openai_chatbot_webserver.py

[CI] Try introducing isort. (#3495)

2024-03-25 07:59:47 -07:00

gradio_webserver.py

…

llava_example.py

[CI] Add test case to run examples scripts (#3638)

2024-03-28 14:36:10 -07:00

llm_engine_example.py

[CI] Try introducing isort. (#3495)

2024-03-25 07:59:47 -07:00

logging_configuration.md

[MISC] Rework logger to enable pythonic custom logging configuration to be provided (#4273)

2024-05-01 17:34:40 -07:00

multilora_inference.py

[CI] Try introducing isort. (#3495)

2024-03-25 07:59:47 -07:00

offline_inference_arctic.py

[Model] Snowflake arctic model implementation (#4652)

2024-05-09 22:37:14 +00:00

offline_inference_distributed.py

[CI] Try introducing isort. (#3495)

2024-03-25 07:59:47 -07:00

offline_inference_embedding.py

[Model][Misc] Add e5-mistral-7b-instruct and Embedding API (#3734)

2024-05-11 11:30:37 -07:00

offline_inference_neuron.py

[Hardware][Neuron] Refactor neuron support (#3471)

2024-03-22 01:22:17 +00:00

offline_inference_with_prefix.py

[Bugfix] Set enable_prefix_caching=True in prefix caching example (#3703)

2024-03-28 16:26:30 -07:00

offline_inference.py

…

openai_chat_completion_client.py

Add example scripts to documentation (#4225)

2024-04-22 16:36:54 +00:00

openai_completion_client.py

…

openai_embedding_client.py

[Model][Misc] Add e5-mistral-7b-instruct and Embedding API (#3734)

2024-05-11 11:30:37 -07:00

template_alpaca.jinja

…

template_baichuan.jinja

Fix Baichuan chat template (#3340)

2024-03-15 21:02:12 -07:00

template_chatglm2.jinja

Add chat templates for ChatGLM (#3418)

2024-03-14 23:19:22 -07:00

template_chatglm.jinja

Add chat templates for ChatGLM (#3418)

2024-03-14 23:19:22 -07:00

template_chatml.jinja

…

template_falcon_180b.jinja

Add chat templates for Falcon (#3420)

2024-03-14 23:19:02 -07:00

template_falcon.jinja

Add chat templates for Falcon (#3420)

2024-03-14 23:19:02 -07:00

template_inkbot.jinja

…

tensorize_vllm_model.py

[Core] Refactor model loading code (#4097)

2024-04-16 11:34:39 -07:00