youkaichaoandSimon Mo 8893130b63 [doc][misc] further lower visibility of simple api server (#6041) ...

Co-authored-by: Simon Mo <simon.mo@hey.com>

2024-07-01 10:50:56 -07:00

..

fp8

[mypy] Enable type checking for test directory (#5017)

2024-06-15 04:45:31 +00:00

production_monitoring

[Misc] Add OpenTelemetry support (#4687)

2024-06-19 01:17:03 +09:00

api_client.py

[doc][misc] further lower visibility of simple api server (#6041)

2024-07-01 10:50:56 -07:00

aqlm_example.py

[Frontend] Add FlexibleArgumentParser to support both underscore and dash in names (#5718)

2024-06-20 17:00:13 -06:00

gradio_openai_chatbot_webserver.py

…

gradio_webserver.py

…

llava_example.py

[Core] Support image processor (#4197)

2024-06-02 22:56:41 -07:00

llava_next_example.py

[Misc] Add example for LLaVA-NeXT (#5879)

2024-06-26 17:57:16 -07:00

llm_engine_example.py

[Frontend] Add FlexibleArgumentParser to support both underscore and dash in names (#5718)

2024-06-20 17:00:13 -06:00

logging_configuration.md

…

lora_with_quantization_inference.py

[Feature][Kernel] Support bitsandbytes quantization and QLoRA (#4776)

2024-06-01 14:51:10 -06:00

multilora_inference.py

…

offline_inference_arctic.py

[Model] Snowflake arctic model implementation (#4652)

2024-05-09 22:37:14 +00:00

offline_inference_distributed.py

[mypy] Enable type checking for test directory (#5017)

2024-06-15 04:45:31 +00:00

offline_inference_embedding.py

[Model][Misc] Add e5-mistral-7b-instruct and Embedding API (#3734)

2024-05-11 11:30:37 -07:00

offline_inference_mlpspeculator.py

[BugFix] Fix cuda graph for MLPSpeculator (#5875)

2024-06-27 04:12:10 +00:00

offline_inference_neuron.py

Unmark more files as executable (#5962)

2024-06-28 17:34:56 -04:00

offline_inference_openai.md

[Frontend] Support OpenAI batch file format (#4794)

2024-05-15 19:13:36 -04:00

offline_inference_with_prefix.py

[Bugfix] Add warmup for prefix caching example (#5235)

2024-06-03 19:36:41 -07:00

offline_inference.py

…

openai_chat_completion_client.py

…

openai_completion_client.py

…

openai_embedding_client.py

[Model][Misc] Add e5-mistral-7b-instruct and Embedding API (#3734)

2024-05-11 11:30:37 -07:00

openai_example_batch.jsonl

[docs] Fix typo in examples filename openi -> openai (#4864)

2024-05-17 00:42:17 +09:00

openai_vision_api_client.py

[Misc][Doc] Add Example of using OpenAI Server with VLM (#5832)

2024-06-25 20:34:25 -07:00

phi3v_example.py

[Misc] Update Phi-3-Vision Example (#5981)

2024-06-29 14:34:29 +08:00

save_sharded_state.py

[Frontend] Add FlexibleArgumentParser to support both underscore and dash in names (#5718)

2024-06-20 17:00:13 -06:00

template_alpaca.jinja

…

template_baichuan.jinja

…

template_chatglm2.jinja

…

template_chatglm.jinja

…

template_chatml.jinja

…

template_falcon_180b.jinja

…

template_falcon.jinja

…

template_inkbot.jinja

…

template_llava.jinja

[Frontend] Add OpenAI Vision API Support (#5237)

2024-06-07 11:23:32 -07:00

tensorize_vllm_model.py

[Frontend] Add FlexibleArgumentParser to support both underscore and dash in names (#5718)

2024-06-20 17:00:13 -06:00