Skip to main content

​
Code

cookbook/11_models/nvidia/async_basic_stream.py
import asyncio

from agno.agent import Agent
from agno.models.nvidia import Nvidia

agent = Agent(model=Nvidia(id="meta/llama-3.3-70b-instruct"), markdown=True)

asyncio.run(agent.aprint_response("Share a 2 sentence horror story", stream=True))

​
Usage

1

Set up your virtual environment

uv venv --python 3.12
source .venv/bin/activate
2

Set your API key

export NVIDIA_API_KEY=xxx
3

Install dependencies

uv pip install -U agno openai
4

Run Agent

python cookbook/11_models/nvidia/async_basic_stream.py