All pull requests

Pull requests

• fix: correct mean_input_throughput_tokens_per_s description and a comment typo

  metricssampling
  #246·Avicennasis opened Oct 26, 2026·

  ·

• fix(sampling): accept inline image data URLs

  documentationsampling
  #245·git-jxj opened Oct 15, 2026·5 tasks done·

  ·

• Update ruff requirement from ~=0.15.0 to >=0.15,<0.18

  dependenciesinfrastructurepython
  #244·dependabot[bot] opened Oct 14, 2026Bot·

  ·

• feat(cli): accept space-separated iteration values

  coredocumentation
  #243·wsj040303 opened Oct 13, 2026·5 tasks done·

  ·
  1

• feat(metrics): report lower-tail throughput percentiles

  coredocumentationmetricsui
  #242·wsj040303 opened Oct 13, 2026·5 tasks done·

  ·
  1

• fix(metrics): filter outlier output throughput and latency

  metrics
  #240·wsj040303 opened Oct 9, 2026·4 tasks done·

  ·
  1

• fix(metrics): compute error rate after request count

  metrics
  #237·git-jxj opened Sep 28, 2026·

  ·
  1

• fix: support benchmarking single-output-token scenarios

  metrics
  #236·yunglinchang opened Sep 15, 2026·4 of 5 tasks·

  ·
  1

• feat(cli): honor explicit --iteration-type for embeddings and rerank

  coredocumentation
  #234·yunglinchang opened Sep 15, 2026·4 of 5 tasks·

  ·
  1

• docs: align supported Python versions with project metadata

  documentation
  #232·Betty52455 opened Sep 14, 2026·1 of 5 tasks·

  ·

• feat(metrics): report how many values each statistic was computed over

  metrics
  #231·arthi-arumugam-git opened Aug 16, 2026·

  ·

• Add L40S server GPU type

  core
  #229·tiahuang420 opened Jul 28, 2026·3 of 5 tasks·

  ·
  1

• [Draft](oci-openai): preserve stream timing and ignore_eos

  core
  #228·OpheliaLjh opened Jul 27, 2026Collaborator·

  ·
  3

• feat: add deterministic prefix pools

  coredocumentationsampling
  #225·fredericsun opened Jul 22, 2026·4 of 5 tasks·

  ·
  3

• Bump actions/checkout from 6 to 7

  dependenciesgithub_actionsinfrastructure
  #222·dependabot[bot] opened Jun 24, 2026Bot·

  ·

• feat: add B300 to server-gpu-type choices

  coremetrics
  #221·Juno13340 opened Jun 16, 2026Contributor·1 of 5 tasks·

  ·
  3

• Fix/ssl verify under gevent

  core
  #220·ayapsone opened Jun 12, 2026·

  ·
  4

• feat: add audio-to-text task for speech transcription benchmarking

  coremetricssampling
  #213·OpheliaLjh opened Apr 16, 2026Collaborator·3 tasks·

  ·
  7

• Add support for custom, dynamic backends

  coredocumentation
  #190·mario-at-intercom opened Feb 25, 2026·

  ·
  9

• feat: add video-text-to-text support for OpenAI

  coresampling
  #157·Stephanie0002 opened Jan 26, 2026Contributor·5 tasks done·

  ·
  2

• feat: Add FastOpenAIUser for high-performance concurrency benchmark

  coreinfrastructure
  #143·jbw1046084835 opened Dec 26, 2025Contributor·5 tasks·

  ·
  5

• Jieg/genai jetbrains

  coredocumentationinfrastructuremetricssamplingui
  #132·jiegong-fde opened Dec 8, 2025·5 tasks·

  ·
  1

• Add SGLang server-side profiling support

  coredocumentation
  #128·alisonshao opened Nov 25, 2025·3 of 4 tasks·

  ·
  10

• [Core] Add --request-rate

  coredocumentationmetrics
  #125·TJ5 opened Nov 19, 2025Contributor·5 tasks done·

  ·
  1

  26