Cloudflare AI Gateway exposes an OpenAI-compatible unified API, so you reach multiple vendors through a single endpoint by setting the model id to aDocumentation Index
Fetch the complete documentation index at: https://docs.agno.com/llms.txt
Use this file to discover all available pages before exploring further.
vendor/model route. The default vendor is Workers AI, which needs only a Cloudflare token and account id.
The Cloudflare class defaults to @cf/meta/llama-3.3-70b-instruct-fp8-fast. Agno rewrites any @cf/... id to workers-ai/@cf/... for the gateway.
Authentication
Cloudflare needs an API token and your account id. The AI Gateway id is optional and falls back todefault.
| Variable | Required | Description |
|---|---|---|
CLOUDFLARE_API_TOKEN | Yes | API token. Create one at dash.cloudflare.com. |
CLOUDFLARE_ACCOUNT_ID | Yes | Your account id, found in the Cloudflare dashboard. |
CLOUDFLARE_AI_GATEWAY_ID | No | AI Gateway id. Defaults to default. |
Example
UseCloudflare with your Agent:
View more examples here.
Parameters
| Parameter | Type | Default | Description |
|---|---|---|---|
id | str | "@cf/meta/llama-3.3-70b-instruct-fp8-fast" | The gateway model id. See Model selection. |
name | str | "Cloudflare" | The name of the model |
provider | str | "Cloudflare" | The provider of the model |
api_key | Optional[str] | None | API token (defaults to CLOUDFLARE_API_TOKEN env var) |
account_id | Optional[str] | None | Account id (defaults to CLOUDFLARE_ACCOUNT_ID env var) |
gateway_id | Optional[str] | None | AI Gateway id (defaults to CLOUDFLARE_AI_GATEWAY_ID, or default) |
base_url | Optional[str] | None | Override the gateway URL. Skips env-var lookup when set. |
max_tokens | Optional[int] | None | Maximum tokens to generate |
Cloudflare extends the OpenAI-compatible interface and supports most parameters from the OpenAI model. Use use_json_mode=True for structured output when a model does not support native structured outputs.
Model selection
Pick the route by settingid:
| Vendor | Id format | Notes |
|---|---|---|
| Workers AI | @cf/<org>/<model> | Copy the binding id from the model catalog. Agno prepends workers-ai/. |
| OpenAI, Google, etc | openai/<model>, google/<model> | Requires the vendor’s BYOK key stored in the AI Gateway dashboard. |
| Dynamic route | dynamic/<route> | A route configured in the dashboard for fallbacks. |