# Cloudflare AI Gateway: tool use (/examples/models/cloudflare/tool-use)



Runs a Workers AI chat model through Cloudflare AI Gateway's OpenAI-compatible `/compat` endpoint with a tool. The OpenAI `tools` / `tool_calls` schema is forwarded as-is by the gateway; the upstream Workers AI model must support function calling. `@cf/zai-org/glm-4.7-flash` does.

<Note>
  The current Agno `Cloudflare` adapter uses AI Gateway's `/compat/chat/completions` endpoint. Cloudflare [deprecates this endpoint for single-model calls](https://developers.cloudflare.com/ai-gateway/usage/chat-completion/) while keeping it working for existing integrations. Dynamic routes still require it. For new direct model integrations, follow Cloudflare's [current REST API guide](https://developers.cloudflare.com/ai-gateway/usage/rest-api/).
</Note>

```python title="tool_use.py"
"""
Cloudflare AI Gateway — tool use
================================

Runs a Workers AI chat model through Cloudflare AI Gateway's OpenAI-compatible
``/compat`` endpoint with a tool. The OpenAI ``tools`` / ``tool_calls`` schema
is forwarded as-is by the gateway; the upstream Workers AI model must support
function calling. ``@cf/zai-org/glm-4.7-flash`` does.

Requires:
- CLOUDFLARE_API_TOKEN
- CLOUDFLARE_ACCOUNT_ID

Optional:
- CLOUDFLARE_AI_GATEWAY_ID  (defaults to ``default``)

Install:
    uv pip install ddgs
"""

import asyncio

from agno.agent import Agent
from agno.models.cloudflare import Cloudflare
from agno.tools.websearch import WebSearchTools

agent = Agent(
    model=Cloudflare(id="@cf/zai-org/glm-4.7-flash"),
    tools=[WebSearchTools()],
    markdown=True,
    add_datetime_to_context=True,
)

if __name__ == "__main__":
    # --- Sync ---
    agent.print_response("Whats happening in France?")

    # --- Sync + Streaming ---
    agent.print_response("Whats happening in France?", stream=True)

    # --- Async + Streaming ---
    asyncio.run(agent.aprint_response("Whats happening in France?", stream=True))
```

## Run the Example [#run-the-example]

<Steps>
    <Step title="Set up your virtual environment">
      <CodeBlockTabs defaultValue="Mac">
        <CodeBlockTabsList>
          <CodeBlockTabsTrigger value="Mac">
            Mac
          </CodeBlockTabsTrigger>

          <CodeBlockTabsTrigger value="Windows">
            Windows
          </CodeBlockTabsTrigger>
        </CodeBlockTabsList>

        <CodeBlockTab value="Mac">
          ```bash
          uv venv --python 3.12
          source .venv/bin/activate
          ```
        </CodeBlockTab>

        <CodeBlockTab value="Windows">
          ```bash
          uv venv --python 3.12
          .venv\Scripts\activate
          ```
        </CodeBlockTab>
      </CodeBlockTabs>
    </Step>

  <Step title="Install dependencies">
    ```bash
    uv pip install -U agno ddgs openai
    ```
  </Step>

    <Step title="Set up Cloudflare access">
      Use a Cloudflare account and an API token with the permissions required for [AI Gateway and Workers AI](https://developers.cloudflare.com/ai-gateway/usage/chat-completion/). The default gateway is created on the first request; set `CLOUDFLARE_AI_GATEWAY_ID` only to use another existing gateway.

      <CodeBlockTabs defaultValue="Mac/Linux">
        <CodeBlockTabsList>
          <CodeBlockTabsTrigger value="Mac/Linux">
            Mac/Linux
          </CodeBlockTabsTrigger>

          <CodeBlockTabsTrigger value="Windows">
            Windows
          </CodeBlockTabsTrigger>
        </CodeBlockTabsList>

        <CodeBlockTab value="Mac/Linux">
          ```bash
          export CLOUDFLARE_ACCOUNT_ID="your_cloudflare_account_id_here"
          export CLOUDFLARE_API_TOKEN="your_cloudflare_api_token_here"
          ```
        </CodeBlockTab>

        <CodeBlockTab value="Windows">
          ```powershell
          $Env:CLOUDFLARE_ACCOUNT_ID="your_cloudflare_account_id_here"
          $Env:CLOUDFLARE_API_TOKEN="your_cloudflare_api_token_here"
          ```
        </CodeBlockTab>
      </CodeBlockTabs>

      Workers AI examples use this Cloudflare token. Other providers can require stored provider keys or supported unified billing; configure the selected route in the gateway before switching to it.
    </Step>

  <Step title="Run the example">
    Save the code above as `tool_use.py`, then run:

    ```bash
    python tool_use.py
    ```
  </Step>
</Steps>

Full source: [cookbook/90\_models/cloudflare/tool\_use.py](https://github.com/agno-agi/agno/blob/8f36eaf2d18e91afa7b327eec66a3cd3685dcb87/cookbook/90_models/cloudflare/tool_use.py)