This website requires JavaScript.
Explore
Help
Register
Sign In
admin
/
1Cat-vLLM
Watch
1
Star
0
Fork
0
Code
Issues
Pull Requests
Actions
1
Packages
Projects
Releases
Wiki
Activity
Files
e97f802b2d74861af77997691a7d1c36498f6dca
1Cat-vLLM
/
examples
/
offline_inference
T
History
zhou fan
528dbcac7d
[Model][Bugfix]: correct Aria model output (
#12309
)
...
Signed-off-by: xffxff <
1247714429@qq.com
>
2025-01-22 11:39:19 +00:00
..
openai
…
aqlm_example.py
…
arctic.py
…
audio_language.py
…
basic_with_model_default_sampling.py
…
basic.py
…
chat_with_tools.py
…
chat.py
…
classification.py
…
cli.py
…
cpu_offload.py
…
distributed.py
…
embedding.py
…
encoder_decoder.py
…
florence2_inference.py
…
gguf_inference.py
[Model] Support GGUF models newly added in
transformers
4.46.0 (
#9685
)
2025-01-13 00:13:44 +00:00
llm_engine_example.py
…
lora_with_quantization_inference.py
…
mlpspeculator.py
…
multilora_inference.py
…
neuron_int8_quantization.py
…
neuron.py
…
pixtral.py
…
prefix_caching.py
…
profiling.py
…
rlhf.py
[core][bugfix] configure env var during import vllm (
#12209
)
2025-01-20 19:35:59 +08:00
save_sharded_state.py
…
scoring.py
…
simple_profiling.py
…
structured_outputs.py
…
torchrun_example.py
Support torchrun and SPMD-style offline inference (
#12071
)
2025-01-16 19:58:53 +08:00
tpu.py
…
vision_language_embedding.py
…
vision_language_multi_image.py
[Model] Port deepseek-vl2 processor, remove dependency (
#12169
)
2025-01-18 13:59:39 +08:00
vision_language.py
[Model][Bugfix]: correct Aria model output (
#12309
)
2025-01-22 11:39:19 +00:00
whisper.py
…