SambaNova

Use SambaNova models with Agno agents.

SambaNova serves large language models through an OpenAI-compatible API. Supported models can use function calling.

Authentication

Set your SAMBANOVA_API_KEY environment variable. Get your key from here.

export SAMBANOVA_API_KEY=***

Example

Install the openai package:

uv pip install -U agno openai

Use Sambanova with your Agent:

from agno.agent import Agent
from agno.models.sambanova import Sambanova

agent = Agent(model=Sambanova(id="Meta-Llama-3.3-70B-Instruct"), markdown=True)

# Print the response in the terminal
agent.print_response("Share a 2 sentence horror story.")

The example selects SambaNova's recommended replacement for Meta-Llama-3.1-8B-Instruct, which was removed from SambaCloud on April 14, 2026. The table below records the SDK default; pass an available model ID explicitly.

Params

ParameterTypeDefaultDescription
idstr"Meta-Llama-3.1-8B-Instruct"The id of the SambaNova model to use
namestr"Sambanova"The name of the model
providerstr"Sambanova"The provider of the model
api_keyOptional[str]NoneThe API key for SambaNova (defaults to SAMBANOVA_API_KEY env var)
base_urlstr"https://api.sambanova.ai/v1"The base URL for the SambaNova API

Sambanova also supports the params of OpenAI.