SparkDiffusion: Accelerating DiT video generation by 265× via joint Sparsity, Distillation, Quantization, etc.
-
Updated
Oct 9, 2026 - Python
SparkDiffusion: Accelerating DiT video generation by 265× via joint Sparsity, Distillation, Quantization, etc.
W8A8/W4A8 inference + optimized SDPA on Apple Silicon — unlocking unused INT8 TensorOps in M5 for 1.2–1.9× faster LLM prefill, plus FlashInfer-inspired GQA decode attention for up to 1.6× SDPA speedup, built as MLX custom primitives.
Open, bit-reproducible low-precision number format (b-posit / AI-Posit) for AI inference — 30–50% less memory, with results identical to the bit on any GPU, CPU, or RISC-V. Reference + conformance suite + CORE-ET RTL
Qwen3.5-397B-A17B W8A8 MTP on 16x Ascend: download verification, TP16 deployment, multimodal/tool calling and benchmarks.
Bounded Posits at IEEE Tensor-Core Throughput on Commodity NVIDIA Blackwell, with Bit-Exact Reproducibility
PyPTO 跨架构后端:目标无关 Core IR + Target/Compiler/Runtime ABI;x86 AVX2/AVX-512、鲲鹏 SVE256、NVIDIA CUDA、AMD HIP,Ascend CCE/CANN 为 target plugin。Qwen3.5-0.8B BF16 真权重已与官方参考对齐。
To associate your repository with the w8a8 topic, visit your repo's landing page and select "manage topics."