Async Agent with Tools

Run an NVIDIA agent with WebSearchTools asynchronously.

These examples select Mistral Nemotron, which NVIDIA lists with a hosted API endpoint and function calling. The SDK default remains meta/llama-3.3-70b-instruct, whose free hosted endpoint is deprecated; partner and downloadable deployments are separate. Choose a model available to your NVIDIA account.

Code

"""Run `uv pip install ddgs` to install dependencies."""

import asyncio

from agno.agent import Agent
from agno.models.nvidia import Nvidia
from agno.tools.websearch import WebSearchTools

agent = Agent(
    model=Nvidia(id="mistralai/mistral-nemotron"),
    tools=[WebSearchTools()],
    markdown=True,
)

asyncio.run(agent.aprint_response("Whats happening in France?", stream=True))

Usage

Set up your virtual environment

uv venv --python 3.12
source .venv/bin/activate

Set your API key

export NVIDIA_API_KEY=xxx

Install dependencies

uv pip install -U agno openai ddgs

Run Agent

Save the code above as tool_use.py, then run:

python tool_use.py