All pull requests

Pull requests

• perf(multimodal): the Qwen3 audio frontend stops doing work it throws away

  dependenciesmultimodaltests
  #4770·fanyang-real opened Oct 31, 2026Member·

  ·
  1

• perf(multimodal): a vision processor borrows the batch's images instead of being handed copies

  grpcmodel-gatewaymultimodaltests
  #4769·fanyang-real opened Oct 31, 2026Member·2 of 3 tasks·

  ·
  1

• perf(multimodal): an MP4 with B-frames stops spawning a probe process it does not need

  multimodal
  #4768·fanyang-real opened Oct 31, 2026Member·2 of 3 tasks·

  ·
  1

• test: avoid blocking the runtime while waiting for mock exit

  tests
  #4767·chunfangamd opened Oct 31, 2026Collaborator·

  ·
  3

• fix(release): the installed package version file is a checked mirror

  tests
  #4762·hello-alexmcc opened Oct 31, 2026Collaborator·

  ·
  3

• fix(cache_aware): the mesh hash index is bounded by the text it holds, not only by its entry count

  model-gatewaypython-bindings
  #4761·fparisio opened Oct 30, 2026·3 tasks done·

  ·
  1

  10

• feat(grpc): coordinate SGLang encode with prefill

  grpctests
  #4760·chunfangamd opened Oct 30, 2026Collaborator·

  ·
  4

• feat(grpc): add SGLang encoder transport client

  grpctests
  #4759·chunfangamd opened Oct 30, 2026Collaborator·2 tasks done·

  ·
  5

• feat(sglang): add typed encoder handoff contract

  grpctests
  #4758·chunfangamd opened Oct 30, 2026Collaborator·

  ·
  4

• perf(gateway): a request's parser names are resolved once in preparation, not at each later read

  grpcmodel-gateway
  #4757·hello-alexmcc opened Oct 30, 2026Collaborator·

  ·
  3

• perf(gateway): a request without media resolves no media-part order

  grpcmodel-gateway
  #4756·hello-alexmcc opened Oct 30, 2026Collaborator·

  ·
  5

• feat(release): make release-plan reads the bump the next cut writes, quietly

  documentationtests
  #4755·hello-alexmcc opened Oct 30, 2026Collaborator·

  ·
  9

• fix(ci): exclude container init from job cleanup

  tests
  #4754·chunfangamd opened Oct 29, 2026Collaborator·

  ·
  3

• test(servicer): avoid blocking KV relay fixture teardown

  grpctests
  #4753·chunfangamd opened Oct 29, 2026Collaborator·

  ·
  3

• fix(e2e): recognize structured MCP search errors across SDK versions

  tests
  #4749·chunfangamd opened Oct 29, 2026Collaborator·2 tasks done·

  ·
  2

• test: isolate mocked worker GPU environments

  python-bindingstests
  #4748·chunfangamd opened Oct 29, 2026Collaborator·2 tasks done·

  ·
  2

• fix(tokenizer): the DeepSeek V3.2 renderer renders a developer message as its encoder does

  model-gatewayteststokenizer
  #4746·hello-alexmcc opened Oct 29, 2026Collaborator·2 of 4 tasks·

  ·
  1

• fix(tokenizer): the DeepSeek V3.2 renderer switches thinking on from the enable_thinking alias too

  grpcmodel-gatewayteststokenizer
  #4745·hello-alexmcc opened Oct 29, 2026Collaborator·2 of 4 tasks·

  ·
  4

• fix(zmq): a disconnect queued before the handshake admitted the link does not end it

  #4743·hello-alexmcc opened Oct 29, 2026Collaborator·2 of 4 tasks·

  ·
  5

• fix(release): check, status, publish-plan and notes read a local cut before its push

  documentationtests
  #4742·hello-alexmcc opened Oct 29, 2026Collaborator·

  ·
  10

• fix(release): the gate reads an API error as a failed read, never as a pending check

  tests
  #4740·hello-alexmcc opened Oct 29, 2026Collaborator·

  ·
  9

• test(python): isolate missing-backend import cases

  python-bindingstests
  #4738·chunfangamd opened Oct 29, 2026Collaborator·

  ·
  1

• fix(e2e): keep inherited HIP visibility scoped to each worker

  tests
  #4737·chunfangamd opened Oct 29, 2026Collaborator·

  ·
  5

• fix(bfcl): wait for worker readiness before scoring

  tests
  #4735·chunfangamd opened Oct 28, 2026Collaborator·2 tasks·

  ·
  4

• fix(placement): keep consistent_hashing routing keys clear of the overload veto

  documentationkv-indexmodel-gatewaypython-bindings
  #4734·ai-jz opened Oct 28, 2026Collaborator·2 of 4 tasks·

  ·
  6