Nvidia

NVIDIA’s NIM API catalog serves models from NVIDIA and partners like Meta and Mistral, optimized for GPU-accelerated inference. Explore NVIDIA’s models here.

Authentication

Set your NVIDIA_API_KEY environment variable. Get your key from Nvidia here.

export NVIDIA_API_KEY=***

setx NVIDIA_API_KEY ***

Example

Install the openai package:

uv pip install -U agno openai

Use Nvidia with your Agent:

from agno.agent import Agent
from agno.models.nvidia import Nvidia

agent = Agent(model=Nvidia(), markdown=True)

# Print the response in the terminal
agent.print_response("Share a 2 sentence horror story")

View more examples here.

Parameters

Parameter	Type	Default	Description
`id`	`str`	`"meta/llama-3.3-70b-instruct"`	The id of the NVIDIA model to use
`name`	`str`	`"Nvidia"`	The name of the model
`provider`	`str`	`"Nvidia"`	The provider of the model
`api_key`	`Optional[str]`	`None`	The API key for NVIDIA (defaults to NVIDIA_API_KEY env var)
`base_url`	`str`	`"https://integrate.api.nvidia.com/v1"`	The base URL for the NVIDIA API

Nvidia extends the OpenAI-compatible interface and supports most parameters from the OpenAI model.

Async Agent with Tools Basic Agent

⌘I

Get Started

Basics

Advanced

Production

Providers

Other

Additional Resources

Authentication

Example

Parameters

​Authentication

​Example

​Parameters

Authentication

Example

Parameters