Skip to content

feat(replay): consume canonical AISimulate speculative decoding #16722

Open

Description

@Harrilee

Dynamo's canonical replay adapter does not advertise AISimulate's generic speculative-decoding or explicit expected-acceptance capabilities. Its AIS timing callback also derives verification width from the old configuration accessor. This prevents the generic engine.speculation interface merged in ai-dynamo/aisimulate#382 from working through the Dynamo runner.

Update the adapter on current main after the canonical configuration migration in #15673. Use matching published Python/Rust AISimulate artifacts from the merged source, preserve scheme identity and acceptance through native execution, and enforce upstream chain, model/backend, fixed-capacity and G2 restrictions. Add installed-wheel coverage for supported MTP/EAGLE3 replay and rejected unsupported combinations.

Implementation PR: #15627. This is an adapter update; it adds no new speculative scheduler or model-family support.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    language::pythonIssues/PRs that reference Python codelanguage::rustIssues/PRs that reference Rust code

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions