Skip to content

Support multi-pass residual quantization emulation for mxfp8_16 in QWIX - #367

Open
copybara-service[bot] wants to merge 1 commit into
mainfrom
test_980022272
Open

copybara-service[bot] wants to merge 1 commit into
mainfrom
test_980022272

Conversation

@copybara-service

@copybara-service copybara-service Bot commented Sep 11, 2026

Copy link
Copy Markdown

Support multi-pass residual quantization emulation for mxfp8_16 in QWIX

  • Support multi-pass residual decomposition (residual_decompose) with arbitrary n_passes.
  • Support multi-pass matrix multiplication modes: 1-pass, 2-pass (lhs_high_precision, rhs_high_precision), 3-pass (triangular), and 4-pass (full_cross) for mxfp8_16.
  • Support multipass_mode in DotGeneralQtConfig for forward and backward passes.
  • Add unit tests in multipass_test verifying algebraic component equivalence, SNR hierarchy across distributions, gradient accuracy, and normal distribution benchmarks (1, 2, 3, 4 passes).

@copybara-service
copybara-service Bot force-pushed the test_980022272 branch 3 times, most recently from 425a26c to 191b699 Compare September 15, 2026 00:13
@copybara-service copybara-service Bot changed the title Add multi-pass emulation and asymmetric mxint matrix multiplication in QWIX Support multi-pass residual quantization emulation for mxfp8_16 in QWIX Sep 15, 2026
@copybara-service
copybara-service Bot force-pushed the test_980022272 branch 2 times, most recently from f21aa79 to 496a824 Compare September 15, 2026 00:20
- Support multi-pass residual decomposition (residual_decompose) with arbitrary n_passes.
- Support multi-pass matrix multiplication modes: 1-pass, 2-pass (lhs_high_precision, rhs_high_precision), 3-pass (triangular), and 4-pass (full_cross) for mxfp8_16.
- Support multipass_mode in DotGeneralQtConfig for forward and backward passes.
- Add unit tests in multipass_test verifying algebraic component equivalence, SNR hierarchy across distributions, gradient accuracy, and normal distribution benchmarks (1, 2, 3, 4 passes).

PiperOrigin-RevId: 980022272
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

0 participants