Models
Models Compatibility
Core Features
| Agno Supported Models | Tool Support | Response Models | Knowledge | History / Storage | Async Execution | Async Tool Support | Support |
|---|---|---|---|---|---|---|---|
| AIMLAPI | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | OpenAI Chat Compatible |
| Anthropic Claude | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | Native SDK |
| AWS Bedrock | ✅ | ✅ | ✅ | ✅ | Native SDK | ||
| AWS Bedrock Claude | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | Native SDK |
| Azure AI Foundry | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | Native SDK |
| Azure OpenAI | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | OpenAI Chat Compatible |
| Cerebras | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | Native SDK |
| Cerebras OpenAI | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | OpenAI Chat Compatible |
| Cohere | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | Native SDK |
| DashScope | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | OpenAI Chat Compatible |
| DeepInfra | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | OpenAI Chat Compatible |
| DeepSeek | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | OpenAI Chat Compatible |
| Fireworks | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | OpenAI Chat Compatible |
| Gemini | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | Native SDK |
| Groq | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | Native SDK |
| HuggingFace | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | Native SDK |
| IBM WatsonX | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | Native SDK |
| InternLM | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | OpenAI Chat Compatible |
| LangDB | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | Native SDK |
| LiteLLM | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | OpenAI Chat Compatible |
| LiteLLMOpenAI | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | OpenAI Chat Compatible |
| LM Studio | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | OpenAI Chat Compatible |
| Llama | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | Native SDK |
| LlamaOpenAI | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | OpenAI Chat Compatible |
| Mistral | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | Native SDK |
| Nebius | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | Native SDK |
| Nvidia | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | OpenAI Chat Compatible |
| Ollama | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | Native SDK |
| OpenAIChat | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | Native SDK |
| OpenAIResponses | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | Native SDK |
| OpenRouter | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | OpenAI Chat Compatible |
| Perplexity | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | OpenAI Chat Compatible |
| Portkey | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | OpenAI Chat Compatible |
| Sambanova | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | OpenAI Chat Compatible |
| Together | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | OpenAI Chat Compatible |
| Vercel V0 | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | OpenAI Chat Compatible |
| VLLM | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | OpenAI Chat Compatible |
| XAI | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | OpenAI Chat Compatible |
HuggingFace supports tool calling through the Agno framework, but not for streaming
responses.
Perplexity supports tool calling through the Agno framework, but their models don't
natively support tool calls in a straightforward way. This means tool usage may
be less reliable compared to other providers.
Multimodal Support
| Agno Supported Models | Image Input | Audio Input | Audio Responses | Video Input | File Upload |
|---|---|---|---|---|---|
| AIMLAPI | ✅ | ||||
| Anthropic Claude | ✅ | ✅ | |||
| AWS Bedrock | ✅ | ||||
| AWS Bedrock Claude | ✅ | ||||
| Azure AI Foundry | ✅ | ||||
| Azure OpenAI | ✅ | ||||
| Cerebras | |||||
| Cerebras OpenAI | |||||
| Cohere | ✅ | ||||
| DashScope | ✅ | ||||
| DeepInfra | |||||
| DeepSeek | |||||
| Fireworks | |||||
| Gemini | ✅ | ✅ | ✅ | ✅ | |
| Groq | ✅ | ||||
| HuggingFace | ✅ | ||||
| IBM WatsonX | ✅ | ||||
| InternLM | |||||
| LangDB | ✅ | ✅ | |||
| LiteLLM | ✅ | ✅ | |||
| LiteLLMOpenAI | ✅ | ||||
| LM Studio | ✅ | ||||
| Llama | ✅ | ||||
| LlamaOpenAI | ✅ | ||||
| Mistral | ✅ | ||||
| Nebius | |||||
| Nvidia | |||||
| Ollama | ✅ | ||||
| OpenAIChat | ✅ | ✅ | ✅ | ||
| OpenAIResponses | ✅ | ✅ | ✅ | ✅ | |
| OpenRouter | |||||
| Perplexity | |||||
| Portkey | |||||
| Sambanova | |||||
| Together | ✅ | ||||
| Vercel V0 | |||||
| VLLM | |||||
| XAI | ✅ |
Structured Outputs
| Agno Supported Models | Structured Outputs | JSON Mode |
|---|---|---|
| AIMLAPI | ✅ | |
| Anthropic Claude | ✅ | |
| AWS Bedrock | ✅ | |
| AWS Bedrock Claude | ✅ | |
| Azure AI Foundry | ✅ | |
| Azure OpenAI | ✅ | ✅ |
| Cerebras | ✅ | |
| Cerebras OpenAI | ✅ | |
| Cohere | ✅ | |
| DashScope | ✅ | |
| DeepInfra | ✅ | |
| DeepSeek | ✅ | |
| Fireworks | ✅ | ✅ |
| Gemini | ✅ | ✅ |
| Groq | ✅ | ✅ |
| HuggingFace | ✅ | |
| IBM WatsonX | ✅ | |
| InternLM | ✅ | ✅ |
| LangDB | ✅ | ✅ |
| LiteLLM | ✅ | |
| LiteLLMOpenAI | ✅ | ✅ |
| LM Studio | ✅ | ✅ |
| Llama | ✅ | |
| LlamaOpenAI | ✅ | |
| Mistral | ✅ | ✅ |
| Nebius | ✅ | |
| Nvidia | ✅ | |
| Ollama | ✅ | |
| OpenAIChat | ✅ | ✅ |
| OpenAIResponses | ✅ | ✅ |
| OpenRouter | ✅ | ✅ |
| Perplexity | ✅ | ✅ |
| Portkey | ✅ | |
| Sambanova | ✅ | |
| Together | ✅ | ✅ |
| Vercel V0 | ✅ | |
| VLLM | ✅ | |
| XAI | ✅ | ✅ |
LM Studio supports JSON schema output, but not structured outputs.