1Cat-vLLM

nvfp4_utils.py

…

test_allspark_gemm.py

…

test_awq_triton.py

…

test_awq.py

…

test_block_fp8.py

…

test_block_int8.py

…

test_cpu_fp8_scaled_mm.py

…

test_cutlass_scaled_mm.py

…

test_cutlass_w4a8_moe.py

…

test_cutlass_w4a8.py

…

test_flashinfer_nvfp4_scaled_mm.py

…

test_flashinfer_scaled_mm.py

…

test_fp8_min_max_helper.py

…

test_fp8_quant_group.py

…

test_fp8_quant.py

…

test_ggml.py

…

test_gguf_bitplane_transcode.py

…

test_gguf_compact_storage.py

[Core] Bound original GGUF storage and host KV state on SM70

2026-10-11 01:13:11 +08:00

test_gguf_dense_segments.py

[Kernel] Process small token groups in parallel segment launches

2026-10-06 00:09:14 +08:00

test_gguf_dense_weight_major.py

[Kernel] Reuse dense GGUF weights across M20 verification rows

2026-10-10 02:30:36 +08:00

test_gguf_device_transcode.py

[Core] Type the fast GGUF field reader as a GGUFReader subclass

2026-10-09 12:32:49 -07:00

test_gguf_dmv_clock.py

[Kernel] Add device warp timing for GGUF projection diagnostics (#1018 )

2026-10-07 10:49:56 +08:00

test_gguf_dmv_formats.py

[Kernel] Decode IQ2 signed nibbles with original two-level scales

2026-10-07 03:47:20 +08:00

test_gguf_dmv.py

[Kernel] Share GGUF projection planes with TP2 shards (#1026 )

2026-10-07 16:38:06 +08:00

test_gguf_dp4a_banks.py

[Kernel] Screen bank-aware IQ lookup without expanding weights

2026-10-07 03:47:57 +08:00

test_gguf_dp4a_capabilities.py

[Kernel] Admit calibrated canonical IQ4 expert integer dots

2026-10-06 05:05:49 +08:00

test_gguf_dp4a_scalar_lut.py

[Kernel] Add lossless scalar LUT integer-dot experiment for IQ experts

2026-10-07 02:40:13 +08:00

test_gguf_dp4a.py

[Core] Report shared GGUF storage and qualify routed intermediate packets

2026-10-11 03:12:45 +08:00

test_gguf_embedding_rows.py

[Memory] Keep Qwen3.5 GGUF embeddings in packed row storage

2026-10-07 23:13:31 +08:00

test_gguf_expert_down_dispatch.py

[Model] Dispatch canonical GGUF down vectors by measured rows

2026-10-05 04:30:36 +08:00

test_gguf_expert_down_graph.py

[Test] Check expert down vector and GEMM graph dispatch

2026-10-05 04:31:32 +08:00

test_gguf_expert_gate_up_dispatch.py

[Model] Retain IQ3_XXS original expert rows for joint projections

2026-10-05 10:51:27 +08:00

test_gguf_expert_gate_up_graph.py

[Model] Retain IQ3_XXS original expert rows for joint projections

2026-10-05 10:51:27 +08:00

test_gguf_expert_tp.py

…

test_gguf_fp16_projection.py

[Kernel] Dispatch floating GGUF shards to FP32 row GEMV

2026-10-05 12:58:41 +08:00

test_gguf_guarded_storage.py

[Core] Bound original GGUF storage and host KV state on SM70

2026-10-11 01:13:11 +08:00

test_gguf_head_layout_projection.py

[Benchmark] Measure GGUF head restoration and cover mixed output formats

2026-10-05 14:24:46 +08:00

test_gguf_iq1_m_records.py

[Kernel] Add source-sized IQ1_M shared-activation pair reader

2026-10-05 19:34:45 +08:00

test_gguf_iq2_s_pair_cursor.py

[Kernel] Add source-sized IQ2_S gated-pair reader

2026-10-05 17:52:28 +08:00

test_gguf_iq2_s_records.py

[Kernel] Add source-sized IQ2_S gated-pair reader

2026-10-05 17:52:28 +08:00

test_gguf_iq2_xs_operand.py

[Kernel] Add source-sized IQ2_XXS gated-pair reader

2026-10-05 18:57:35 +08:00

test_gguf_iq2_xs_pair_cursor.py

[Kernel] Add source-sized IQ2_XS gated-pair reader

2026-10-05 18:26:58 +08:00

test_gguf_iq2_xs_records.py

[Kernel] Add source-sized IQ2_XS gated-pair reader

2026-10-05 18:26:58 +08:00

test_gguf_iq2_xxs_pair_cursor.py

[Kernel] Add source-sized IQ2_XXS gated-pair reader

2026-10-05 18:57:35 +08:00

test_gguf_iq2_xxs_records.py

[Kernel] Add source-sized IQ2_XXS gated-pair reader

2026-10-05 18:57:35 +08:00

test_gguf_iq3_gated.py

[Test] Cover GGUF gated pair AOT module capture

2026-10-05 14:11:07 +08:00

test_gguf_iq3_xxs_pair_cursor.py

[Kernel] Add original-byte IQ3_XXS gated pair reader

2026-10-05 15:10:25 +08:00

test_gguf_iq3_xxs_records.py

[Core] Prepare source-sized IQ3_XXS pair records

2026-10-05 14:45:45 +08:00

test_gguf_iq4_float_book.py

[Kernel] Read native IQ4 integers directly from a shared Float table

2026-10-05 16:43:53 +08:00

test_gguf_iq4_native.py

[Kernel] Preserve IQ4_XS source bytes and nested scales (#950 )

2026-10-05 11:11:01 +08:00

test_gguf_lattice_decode.py

…

test_gguf_lattice_prefill.py

…

test_gguf_lattice_transcode.py

…

test_gguf_lm_head_dispatch.py

…

test_gguf_load_prepare.py

[Core] Transcode GGUF expert banks on the GPU and parse metadata once quickly

2026-10-09 12:20:49 -07:00

test_gguf_lut4_experts.py

[Test] Check IQ4 canonical weights against official dequantization

2026-10-06 04:57:52 +08:00

test_gguf_lut_transcode.py

…

test_gguf_mixed_direct_output.py

[Kernel] Write mixed GGUF projections into shared output views

2026-10-05 11:12:22 +08:00

test_gguf_mixed_output_fallback.py

[Bugfix] Preserve imported formats outside canonical mixed families

2026-10-05 12:19:50 +08:00

test_gguf_moe_mma.py

[Test] Establish complete-round ledger and qualify integrated operator policies

2026-10-07 00:42:34 +08:00

test_gguf_native_linear.py

[Test] Preserve dynamic-M dispatch through projection export

2026-10-05 23:50:55 +08:00

test_gguf_native_pair.py

[Test] Check full operator admission for measured fallback

2026-10-06 05:15:55 +08:00

test_gguf_native.py

…

test_gguf_q2_k_pair_cursor.py

[Kernel] Add source-sized Q2_K shared-activation pair reader

2026-10-05 19:30:03 +08:00

test_gguf_q2_k_records.py

[Kernel] Add source-sized Q2_K shared-activation pair reader

2026-10-05 19:30:03 +08:00

test_gguf_q4_k_pair_cursor.py

[Kernel] Add original Q4_K reader to shared-activation pairs

2026-10-05 16:11:15 +08:00

test_gguf_q4_k_records.py

[Kernel] Preserve original Q4_K bytes in pair records

2026-10-05 15:50:51 +08:00

test_gguf_qkv.py

[Kernel] Wire GGUF small-M attention inputs by measured capability

2026-10-06 04:09:09 +08:00

test_gguf_qkvz.py

[Bugfix] Keep floating GDN fallback outside quantized descriptors

2026-10-06 01:56:47 +08:00

test_gguf_raw_grouped_capabilities.py

[Kernel] Isolate original-block expert gate/up in the core build

2026-10-05 05:26:32 +08:00

test_gguf_raw_grouped.py

[Kernel] Isolate original-block expert gate/up in the core build

2026-10-05 05:26:32 +08:00

test_gguf_runtime_dispatch.py

…

test_gguf_small_grouped_capabilities.py

…

test_gguf_small_grouped_vec.py

…

test_gguf_small_output.py

[Kernel] Admit measured shared-activation output projections

2026-10-06 03:50:09 +08:00

test_gguf_three_format_qkv.py

[Kernel] Share GGUF projection planes with TP2 shards (#1026 )

2026-10-07 16:38:06 +08:00

test_gguf_transcode.py

…

test_gguf_turbomind_affine.py

…

test_gguf_turbomind_bitplanes.py

…

test_gguf_turbomind_dequant.py

…

test_gguf_turbomind_lattice.py

…

test_gguf_turbomind_lut4.py

…

test_gguf_turbomind_model_moe.py

[Test] Exercise opaque expert dispatch and mixed fallback graphs

2026-10-05 06:03:19 +08:00

test_gguf_turbomind_model.py

…

test_gguf_turbomind_u2.py

…

test_gguf_u2_transcode.py

…

test_gguf.py

…

test_gptq.py

…

test_hadacore.py

…

test_int8_kernel.py

…

test_int8_quant.py

…

test_machete_mm.py

…

test_marlin_gemm.py

…

test_mxfp4_qutlass.py

…

test_mxfp4_triton_ep.py

…

test_nvfp4_emulation.py

…

test_nvfp4_qpn2_dequant.py

…

test_nvfp4_quant.py

…

test_nvfp4_qutlass.py

…

test_nvfp4_scaled_mm.py

…

test_per_token_group_quant.py

…

test_rdna3_w4a16_selection.py

…

test_rdna3_w4a16.py

…

test_rocm_compressed_tensors_w4a16.py

…

test_rocm_skinny_gemms.py

…

test_scaled_mm_kernel_selection.py

…

test_silu_mul_nvfp4_quant.py

…

test_sm70_dflash2_fp8_m8.py

[Kernel] Replace the draft M8 FP16 pack and retain dynamic fallback

2026-10-05 11:57:31 +08:00

test_sm70_dflash2_fp16_m8.py

…

test_sm70_dflash_context_reduction.py

…

test_sm70_dmv13_side.py

[Kernel] Admit merged BF16 side weights under the FP16 dense contract

2026-10-07 01:11:21 +08:00

test_sm70_gdn_ba_verify.py

…

test_sm70_marlin_policy.py

[Core] Record deterministic Marlin and native owner validation

2026-10-10 09:57:41 +08:00

test_sm70_marlin_splitk.py

…

test_sm70_moe_packed_w13.py

…

test_sm70_mxfp4_e8m0.py

…

test_sm70_native_owner.py

[Core] Record deterministic Marlin and native owner validation

2026-10-10 09:57:41 +08:00

test_sm70_nvfp4_native_layout.py

[Kernel] Record bundled NVFP4 serving validation

2026-10-07 00:49:24 +08:00

test_sm70_nvfp4_output_padding.py

…

test_sm70_nvfp4_prescaled_batch.py

…

test_sm70_nvfp4_qpn2_scales.py

…

test_sm70_nvfp4_raw_scales.py

…

test_sm70_nvfp4_small_prefill.py

…

test_sm70_packed_gemm_lifecycle.py

[Kernel] Share packed GEMM layouts and isolate runtime ownership

2026-10-10 18:14:14 +08:00

test_sm70_prefill_local_layouts.py

…

test_sm70_qpn2_m32_packed_input.py

…

test_sm70_qpn8_block_fp8.py

…

test_sm70_qpn8_local_layouts.py

…

test_sm70_qpn8_m32_packed_input.py

…

test_sm70_quantized_batch_supply.py

…

test_triton_scaled_mm.py

…

test_triton_w4a16.py

…

test_w4a16_kernel_selection.py

…