Skip to content

Commit 1400c67

Browse files
authored
Merge pull request #2290 from docker/board/update-google-provider-docs-in-pr-2287-45143d67
docs: add Vertex AI Model Garden section to Google provider docs
2 parents 7ee4edc + 03653cb commit 1400c67

1 file changed

Lines changed: 43 additions & 0 deletions

File tree

docs/providers/google/index.md

Lines changed: 43 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -111,3 +111,46 @@ models:
111111
| `google_search` | Enables Google Search grounding for up-to-date info |
112112
| `google_maps` | Enables Google Maps grounding for location queries |
113113
| `code_execution` | Enables server-side code execution for computations |
114+
115+
## Vertex AI Model Garden
116+
117+
You can use non-Gemini models (e.g. Claude, Llama) hosted on Google Cloud's
118+
[Vertex AI Model Garden](https://cloud.google.com/vertex-ai/generative-ai/docs/partner-models/use-partner-models)
119+
through the `google` provider. When a `publisher` is specified in `provider_opts`,
120+
requests are routed through Vertex AI's OpenAI-compatible endpoint instead of the
121+
Gemini SDK.
122+
123+
### Authentication
124+
125+
Vertex AI uses Google Cloud Application Default Credentials (ADC). Make sure you
126+
are authenticated:
127+
128+
```bash
129+
gcloud auth application-default login
130+
```
131+
132+
### Configuration
133+
134+
```yaml
135+
models:
136+
claude-on-vertex:
137+
provider: google
138+
model: claude-sonnet-4-20250514
139+
provider_opts:
140+
project: my-gcp-project # GCP project ID (or set GOOGLE_CLOUD_PROJECT)
141+
location: us-east5 # GCP region (or set GOOGLE_CLOUD_LOCATION)
142+
publisher: anthropic # Model publisher (anthropic, meta, etc.)
143+
```
144+
145+
| Option | Description |
146+
| ----------- | ------------------------------------------------------------------------------------ |
147+
| `project` | GCP project ID. Falls back to `GOOGLE_CLOUD_PROJECT` env var |
148+
| `location` | GCP region (e.g. `us-east5`, `us-central1`). Falls back to `GOOGLE_CLOUD_LOCATION` |
149+
| `publisher` | Model publisher (e.g. `anthropic`, `meta`, `mistral`). Must not be `google` |
150+
151+
<div class="callout callout-info">
152+
<div class="callout-title">ℹ️ Gemini models on Vertex AI
153+
</div>
154+
<p>Setting <code>publisher: google</code> (or omitting <code>publisher</code>) uses the native Gemini SDK path. The Model Garden endpoint is only used for non-Google publishers.</p>
155+
156+
</div>

0 commit comments

Comments
 (0)