Skip to content

Add ragged all-to-all pipeline correctness coverage#4104

Draft
huytransformer wants to merge 1 commit into
AI-Hypercomputer:mainfrom
huytransformer:htn/add-ra2a-pp-correctness-test
Draft

Add ragged all-to-all pipeline correctness coverage#4104
huytransformer wants to merge 1 commit into
AI-Hypercomputer:mainfrom
huytransformer:htn/add-ra2a-pp-correctness-test

Conversation

@huytransformer

@huytransformer huytransformer commented Jun 8, 2026

Copy link
Copy Markdown
Collaborator

Description

Adds pipeline-parallel correctness coverage for DeepSeek dropless expert parallelism, which exercises the ragged_all_to_all path.

This also fixes the pipeline test helper so single_pipeline_stage_class is preserved. Previously the helper constructed the requested stage class, then unconditionally replaced it with SimpleDecoderLayerToLinen, so custom layer tests did not actually run the requested layer.

FIXES: b/430135480

Tests

  • python3 -m py_compile tests/integration/pipeline_parallelism_test.py
  • git diff --check

Checklist

Before submitting this PR, please make sure (put X in square brackets):

  • I have performed a self-review of my code. For an optional AI review, add the gemini-review label.
  • I have necessary comments in my code, particularly in hard-to-understand areas.
  • I have run end-to-end tests tests and provided workload links above if applicable.
  • I have made or will make corresponding changes to the doc if needed, including adding new documentation pages to the relevant Table of Contents (toctree directive) as explained in our documentation.

@codecov

codecov Bot commented Jun 8, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.

📢 Thoughts on this report? Let us know!

@huytransformer huytransformer force-pushed the htn/add-ra2a-pp-correctness-test branch 7 times, most recently from 3f6a2e5 to c6b7a08 Compare June 9, 2026 06:49
@huytransformer huytransformer marked this pull request as draft June 9, 2026 07:23
@huytransformer huytransformer force-pushed the htn/add-ra2a-pp-correctness-test branch from c6b7a08 to 03f5576 Compare June 9, 2026 08:07
@huytransformer huytransformer force-pushed the htn/add-ra2a-pp-correctness-test branch from 03f5576 to e22397a Compare June 9, 2026 08:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant