Together is a platform for providing endpoints for Large Language models. See their library of models here.

We recommend experimenting to find the best-suited model for your use-case.

Together have tier based rate limits. See the docs for more information.

​
Authentication

Set your TOGETHER_API_KEY environment variable. Get your key from Together here.

export TOGETHER_API_KEY=***

​
Example

Use Together with your Agent:

from agno.agent import Agent, RunResponse
from agno.models.together import Together

agent = Agent(
    model=Together(id="meta-llama/Meta-Llama-3.1-8B-Instruct-Turbo"),
    markdown=True
)

# Print the response in the terminal
agent.print_response("Share a 2 sentence horror story.")
View more examples here.

​
Params

ParameterTypeDefaultDescription
idstr"mistralai/Mixtral-8x7B-Instruct-v0.1"The id of the Together model to use.
namestr"Together"The name of this chat model instance.
providerstr"Together " + idThe provider of the model.
api_keyOptional[str]NoneThe API key to authorize requests to Together. Defaults to environment variable TOGETHER_API_KEY.
base_urlstr"https://api.together.xyz/v1"The base URL for API requests.
monkey_patchboolFalseWhether to apply monkey patching.

Together also supports the params of OpenAI.