Image Input URL

Point a Vertex AI Claude agent at an image URL and search the web for context.

Pass an image URL with Image(url=...).

Code

from agno.agent import Agent
from agno.media import Image
from agno.models.vertexai.claude import Claude
from agno.tools.websearch import WebSearchTools

agent = Agent(
    model=Claude(id="claude-sonnet-4-6"),
    tools=[WebSearchTools()],
    markdown=True,
)

agent.print_response(
    "Tell me about this image and search the web for more information.",
    images=[
        Image(
            url="https://fastly.picsum.photos/id/237/200/300.jpg?hmac=TmmQSbShHz9CdQm0NkEjx1Dyh_Y984R9LpNrpvH2D_U"
        ),
    ],
    stream=True,
)

Usage

Complete the Vertex project, model enablement, permissions, and CLI prerequisites first. Use a region that serves Sonnet 4.6.

Set up your virtual environment

uv venv --python 3.12
source .venv/bin/activate

Set your environment variables

export CLOUD_ML_REGION="us-east5"
export GOOGLE_CLOUD_PROJECT=xxx

Authenticate your CLI session

gcloud auth application-default login
You don't need to authenticate your CLI every time.

Install dependencies

uv pip install -U 'anthropic[vertex]' ddgs agno

Run Agent

Save the code above as image_input_url.py, then run:

python image_input_url.py