Many providers like Together, Groq, Nebius, Sambanova, xAI, etc support the OpenAI API format. Use the OpenAILike model to access them by replacing the base_url.

​
Example

from os import getenv
from agno.agent import Agent, RunResponse
from agno.models.openai.like import OpenAILike

agent = Agent(
    model=OpenAILike(
        id="mistralai/Mixtral-8x7B-Instruct-v0.1",
        api_key=getenv("TOGETHER_API_KEY"),
        base_url="https://api.together.xyz/v1",
    )
)

# Print the response in the terminal
agent.print_response("Share a 2 sentence horror story.")

​
Params

ParameterTypeDefaultDescription
idstr"not-provided"The name of the model to be used for generating responses.
namestr"OpenAILike"The name of this chat model instance.
api_keystr"not-provided"The API key for authenticating requests to the service.
override_system_roleboolFalseWhether to override the default system role.
system_message_rolestr"system"The role to use for system messages.
OpenAILike also support all the params of OpenAIChat