Logo
Explore Help
Register Sign In
admin/1Cat-vLLM
Watch 1
Star 0 Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
Files
e97f802b2d74861af77997691a7d1c36498f6dca
1Cat-vLLM/examples/offline_inference
T
History
zhou fan 528dbcac7d [Model][Bugfix]: correct Aria model output (#12309)
Signed-off-by: xffxff <1247714429@qq.com>
2025-01-22 11:39:19 +00:00
..
openai
…
aqlm_example.py
…
arctic.py
…
audio_language.py
…
basic_with_model_default_sampling.py
…
basic.py
…
chat_with_tools.py
…
chat.py
…
classification.py
…
cli.py
…
cpu_offload.py
…
distributed.py
…
embedding.py
…
encoder_decoder.py
…
florence2_inference.py
…
gguf_inference.py
[Model] Support GGUF models newly added in transformers 4.46.0 (#9685)
2025-01-13 00:13:44 +00:00
llm_engine_example.py
…
lora_with_quantization_inference.py
…
mlpspeculator.py
…
multilora_inference.py
…
neuron_int8_quantization.py
…
neuron.py
…
pixtral.py
…
prefix_caching.py
…
profiling.py
…
rlhf.py
[core][bugfix] configure env var during import vllm (#12209)
2025-01-20 19:35:59 +08:00
save_sharded_state.py
…
scoring.py
…
simple_profiling.py
…
structured_outputs.py
…
torchrun_example.py
Support torchrun and SPMD-style offline inference (#12071)
2025-01-16 19:58:53 +08:00
tpu.py
…
vision_language_embedding.py
…
vision_language_multi_image.py
[Model] Port deepseek-vl2 processor, remove dependency (#12169)
2025-01-18 13:59:39 +08:00
vision_language.py
[Model][Bugfix]: correct Aria model output (#12309)
2025-01-22 11:39:19 +00:00
whisper.py
…
Powered by Gitea Version: 28.3.0 Page: 1501ms Template: 85ms
Auto
English
Bahasa Indonesia Deutsch English Español Français Gaeilge Italiano Latviešu Magyar nyelv Nederlands Polski Português de Portugal Português do Brasil Suomi Svenska Türkçe Čeština Ελληνικά Български Русский Українська فارسی മലയാളം 日本語 简体中文 繁體中文(台灣) 繁體中文(香港) 한국어
Licenses API