jon-chuangandCody Yu a046f86397 [Core/Bugfix] Add FP8 K/V Scale and dtype conversion for prefix/prefill Triton Kernel (#7208) ...

Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>

2024-08-12 22:47:41 +00:00

..

auto_awq.rst

…

bnb.rst

…

fp8_e4m3_kvcache.rst

[Core/Bugfix] Add FP8 K/V Scale and dtype conversion for prefix/prefill Triton Kernel (#7208)

2024-08-12 22:47:41 +00:00

fp8_e5m2_kvcache.rst

[Core/Bugfix] Add FP8 K/V Scale and dtype conversion for prefix/prefill Triton Kernel (#7208)

2024-08-12 22:47:41 +00:00

fp8.rst

…

supported_hardware.rst

…