Skip to content

[bot] Missing instrumentation for AWS Bedrock AgentCore Runtime Java SDK #142

Description

@braintrust-bot

Summary

The Braintrust Java SDK instruments software.amazon.awssdk:bedrockruntime (direct model invocation) and has an open gap issue (#113) for software.amazon.awssdk:bedrockagentruntime (the older Bedrock Agents/Knowledge-Bases feature). Neither covers software.amazon.awssdk:bedrockagentcore — a distinct, separately versioned AWS SDK v2 module for Amazon Bedrock AgentCore, AWS's newer, framework-agnostic managed runtime for deploying and invoking any agent (not limited to Bedrock-authored agents). This module is completely uninstrumented and is not the same client hierarchy as either existing/tracked Bedrock module.

What is missing

The software.amazon.awssdk:bedrockagentcore module provides these execution-oriented surfaces, none of which are instrumented:

API method Client Description
invokeAgentRuntime() BedrockAgentCoreClient / BedrockAgentCoreAsyncClient Sends a request to an agent (built with any framework — LangGraph, CrewAI, Strands, custom code, etc.) hosted on AgentCore Runtime and streams back its response
Session-scoped invocation BedrockAgentCoreClient Maintains conversation/session state across multiple invokeAgentRuntime calls via a runtime session identifier
AgentCore Memory / Gateway / Code Interpreter / Browser data-plane calls BedrockAgentCoreClient Additional AgentCore execution primitives (short/long-term memory retrieval, tool gateway invocation, sandboxed code execution) exposed by the same client

There is no reference to bedrockagentcore, BedrockAgentCore, or InvokeAgentRuntime anywhere in this repository — no instrumentation module, wrapper, test, example, or dependency.

Why this is not covered by the existing Bedrock work

  • aws_bedrock_2_30_0 (instrumented) targets BedrockRuntimeClientBuilder/BedrockRuntimeAsyncClientBuilder only (model invocation via Converse/InvokeModel).
  • Issue [bot] Missing instrumentation for AWS Bedrock Agent Runtime Java SDK #113 tracks bedrockagentruntime (InvokeAgent, RetrieveAndGenerate, Retrieve) — the older Bedrock Agents/Knowledge-Bases feature tied to agents authored specifically in Bedrock's agent builder.
  • bedrockagentcore is a separate, newer AWS service (Bedrock AgentCore, generally available in 2025) with its own Maven artifact, its own client class (BedrockAgentCoreClient), and its own API operation (InvokeAgentRuntime) for hosting/invoking agents built with any framework. It is not a version bump or superset of bedrockagentruntime — both remain independently published AWS services/SDKs today.

Braintrust docs status

Upstream sources

Local files inspected

  • braintrust-sdk/instrumentation/aws_bedrock_2_30_0/build.gradle — depends on software.amazon.awssdk:bedrockruntime only
  • braintrust-sdk/instrumentation/aws_bedrock_2_30_0/src/main/java/dev/braintrust/instrumentation/awsbedrock/v2_30_0/auto/AWSBedrockInstrumentationModule.javainstanceof checks limit instrumentation to BedrockRuntimeClientBuilder/BedrockRuntimeAsyncClientBuilder
  • settings.gradle (lines 28–33) — lists all instrumentation modules; no AgentCore module present
  • Full-repo grep for bedrockagentcore, BedrockAgentCore, InvokeAgentRuntime — zero matches

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions