Skip to content

tests: MUL_MAT_ID cases for the one-column mat-vec store (small K, several expert rows per block) - #295

Open
professorpalmer wants to merge 1 commit into
PrismML-Eng:prismfrom
professorpalmer:cuda-mmvq-mmid-row-bound
Open

professorpalmer wants to merge 1 commit into
PrismML-Eng:prismfrom
professorpalmer:cuda-mmvq-mmid-row-bound

Conversation

@professorpalmer

@professorpalmer professorpalmer commented Sep 29, 2026 •

Copy link
Copy Markdown

Regression test only. The kernel bound from the first version is dropped: prism #258 already bounds the one-column MUL_MAT_ID store (nrows_dst = ids ? stride_channel_dst : stride_col_dst). These cases pass with it: test-backend-ops -o MUL_MAT_ID 1085/1085 on an RTX 4070 (prism c96baf4).

@bri-prism

Copy link
Copy Markdown
Collaborator

Thanks. This still doesn't build on prism: #258 added its own nrows_dst bound in mul_mat_vec_q (ids ? stride_channel_dst : stride_col_dst), so the new declaration at mmvq.cu:620 collides with it. That bound already covers the one-column case: I applied only your test hunk to current prism and all 50 new MUL_MAT_ID cases pass (1085/1085). Could you drop the kernel change and keep the test? Then it's ready to merge as a regression test.

…veral expert rows per block)

The kernel bound from the first version of this PR is dropped: prism PrismML-Eng#258 already bounds the store (nrows_dst = ids ? stride_channel_dst : stride_col_dst), and these cases pass with it. They stay as a regression test.
@professorpalmer
professorpalmer force-pushed the cuda-mmvq-mmid-row-bound branch from 4cdb698 to ed56a5c Compare October 27, 2026 20:02
@professorpalmer

Copy link
Copy Markdown
Author

Thank you. Done in ed56a5cdd, rebased on prism c96baf4ab: I dropped the kernel change and kept only the test cases. Your #258 bound covers the one-column store.

RTX 4070 (sm_89), CUDA 13: test-backend-ops -o MUL_MAT_ID 1085/1085. I changed the title to match: the PR is a regression test now.

@professorpalmer professorpalmer changed the title cuda: bound the one-column MUL_MAT_ID mat-vec store by the expert row count tests: MUL_MAT_ID cases for the one-column mat-vec store (small K, several expert rows per block) Oct 27, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants