Isotr0py 7601cb044d [Core] Support tensor parallelism for GGUF quantization (#7520)

2024-08-19 17:30:14 -04:00

..

__init__.py

…

test_aqlm.py

…

test_bart.py

[Core] Support serving encoder/decoder models (#7258)

2024-08-09 10:39:41 +08:00

test_big_models.py

…

test_blip2.py

[VLM][Core] Support profiling with multiple multi-modal inputs per prompt (#7126)

2024-08-14 17:55:42 +00:00

test_chameleon.py

[Bugfix] Fix weight loading for Chameleon when TP>1 (#7410)

2024-08-13 05:33:41 +00:00

test_danube3_4b.py

[Model] H2O Danube3-4b (#6451)

2024-07-26 20:47:50 -07:00

test_embedding.py

…

test_fp8.py

…

test_fuyu.py

[VLM][Core] Support profiling with multiple multi-modal inputs per prompt (#7126)

2024-08-14 17:55:42 +00:00

test_gguf.py

[Core] Support tensor parallelism for GGUF quantization (#7520)

2024-08-19 17:30:14 -04:00

test_gptq_marlin_24.py

…

test_gptq_marlin.py

…

test_internvl.py

[VLM][Core] Support profiling with multiple multi-modal inputs per prompt (#7126)

2024-08-14 17:55:42 +00:00

test_jamba.py

[Kernel] W8A16 Int8 inside FusedMoE (#7415)

2024-08-16 10:06:51 -07:00

test_llava_image_embeds.py

[Core][VLM] Support image embeddings as input (#6613)

2024-08-12 16:16:06 +08:00

test_llava_next.py

[VLM][Core] Support profiling with multiple multi-modal inputs per prompt (#7126)

2024-08-14 17:55:42 +00:00

test_llava.py

[VLM][Core] Support profiling with multiple multi-modal inputs per prompt (#7126)

2024-08-14 17:55:42 +00:00

test_marlin.py

…

test_minicpmv.py

[VLM][Core] Support profiling with multiple multi-modal inputs per prompt (#7126)

2024-08-14 17:55:42 +00:00

test_mistral.py

…

test_models.py

…

test_oot_registration.py

[misc][ci] fix cpu test with plugins (#7489)

2024-08-13 19:27:46 -07:00

test_paligemma.py

[VLM][Core] Support profiling with multiple multi-modal inputs per prompt (#7126)

2024-08-14 17:55:42 +00:00

test_phi3v.py

[VLM][Core] Support profiling with multiple multi-modal inputs per prompt (#7126)

2024-08-14 17:55:42 +00:00

test_qwen.py

[CI/Build] Add text-only test for Qwen models (#7475)

2024-08-19 07:43:46 +08:00

test_registry.py

[Model] Support SigLIP encoder and alternative decoders for LLaVA models (#7153)

2024-08-06 16:55:31 +08:00

utils.py

[Core] Support serving encoder/decoder models (#7258)

2024-08-09 10:39:41 +08:00