Skip to main content
Sambanova is a platform for providing endpoints for Large Language models. Note that Sambanova currently does not support function calling.

​
Authentication

Set your SAMBANOVA_API_KEY environment variable. Get your key from here. 
export SAMBANOVA_API_KEY=***

​
Example

Use Sambanova with your Agent: 
from agno.agent import Agent
from agno.models.sambanova import Sambanova

agent = Agent(model=Sambanova(), markdown=True)

# Print the response in the terminal
agent.print_response("Share a 2 sentence horror story.")

​
Params

ParameterTypeDefaultDescription
idstr"Meta-Llama-3.1-8B-Instruct"The id of the SambaNova model to use
namestr"SambaNova"The name of the model
providerstr"SambaNova"The provider of the model
api_keyOptional[str]NoneThe API key for SambaNova (defaults to SAMBANOVA_API_KEY env var)
base_urlstr"https://api.sambanova.ai/v1"The base URL for the SambaNova API
Sambanova also supports the params of OpenAI.
⌘I