Skip to content

docs: Add Confident AI observability docs - #767

Merged
kausmeows merged 1 commit into
agno-agi:mainfrom
A-Vamshi:main
Sep 17, 2026
Merged

kausmeows merged 1 commit into
agno-agi:mainfrom
A-Vamshi:main

Conversation

@A-Vamshi

Copy link
Copy Markdown
Contributor

Description

This PR adds documentation for integrating confident-trace with Agno for observability via OpenTelemetry.

Added:

  • Added observability/confident-ai.mdx for the full documentation on the integration
  • Updated observability/overview.mdx to mention Confident AI among other OpenTelemetry integrations
  • Updated docs.json to list confident-ai.mdx file under observability pages
  • Added images/confident-ai-workflows.png image to show Confident AI's workflows page

Type of Change

  • Bug fix (errors, broken links, outdated info)
  • New content
  • Content improvement
  • Other: ____

Checklist

  • Content is accurate and up-to-date
  • All links tested and working
  • Code examples verified (if applicable)
  • Deterministic scripts pass for the affected examples, imports, installs, and references
  • OpenAPI JSON and YAML were updated together and scripts/make_openapi.py --check passes (if applicable)
  • mint broken-links -t false and mint validate -t false pass
  • Spelling and grammar checked
  • Screenshots updated (if applicable)

@kausmeows kausmeows left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thanks for this @A-Vamshi
also added a corresponding sdk cookbook here- agno-agi/agno#10257

@kausmeows
kausmeows merged commit 1c1bd66 into agno-agi:main Sep 17, 2026
1 check passed
kausmeows added a commit to agno-agi/agno that referenced this pull request Sep 17, 2026
## Summary

Adds a runnable observability cookbook for [Confident
AI](https://www.confident-ai.com/) using its OpenTelemetry-native
`confident-trace` SDK, which detects Agno automatically.

- Add `cookbook/observability/confident_ai.py`: calls `init()` once at
startup, runs a Hacker News agent (OpenAIResponses, `gpt-5.6-luna`)
twice, wraps the second run in `trace_context` to attach tags, metadata,
and a user ID, and calls `shutdown()` in a `finally` block to flush
spans.
- List the example in `cookbook/observability/README.md`.
- Record the test run in `cookbook/observability/TEST_LOG.md`.

Companion docs: agno-agi/docs#767 (Mintlify) and agno-agi/agno-docs#141
(in-house). The in-house examples page links to this cookbook on `main`.

## Type of change

- [ ] Bug fix
- [ ] New feature
- [ ] Breaking change
- [x] Improvement
- [ ] Model update
- [ ] Other:

---

## Checklist

- [x] Code complies with style guidelines
- [x] Ran format/validation scripts (`./scripts/format.sh` and
`./scripts/validate.sh`)
- [x] Self-review completed
- [x] Documentation updated (comments, docstrings)
- [x] Examples and guides: Relevant cookbook examples have been included
or updated (if applicable)
- [x] Tested in clean environment
- [ ] Tests added/updated (if applicable)

### Duplicate and AI-Generated PR Check

- [x] I have searched existing [open pull
requests](https://github.com/agno-agi/agno/pulls) and confirmed that no
other PR already addresses this issue
- [ ] If a similar PR exists, I have explained below why this PR is a
better approach
- [x] Check if this PR was entirely AI-generated (by Copilot, Claude
Code, Cursor, etc.)

---

## Additional Notes

- Verified against `confident-trace==0.1.3`. Its OpenAI integration
patches the Responses API, so `OpenAIResponses` model spans are captured
alongside the Agno agent and tool spans.
- Ran end to end with `CONFIDENT_API_KEY` and `OPENAI_API_KEY` set. Both
runs completed and span batches were accepted by the collector with HTTP
200.
- `CONFIDENT_OTEL_ENDPOINT` must match the project's region. A US
project key sent to the EU endpoint returns 401 on export, so only set
it for EU projects. The module docstring calls this out.
- `cookbook/scripts/check_cookbook_pattern.py` passes for the new file.
The two existing violations it reports in `mlflow_via_autolog.py` are
pre-existing and untouched.

🤖 Generated with [Claude Code](https://claude.com/claude-code)
@A-Vamshi

Copy link
Copy Markdown
Contributor Author

Great! Thank you @kausmeows!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants