Models
Compatibility
Models
Compatibility
Core Features
| Agno Supported Models | Tool Support | Response Models | Knowledge | History / Storage | Async Execution | Async Tool Support |
|---|---|---|---|---|---|---|
| Anthropic Claude | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| AWS Bedrock | ✅ | ✅ | ✅ | ✅ | ||
| AWS Bedrock Claude | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| Azure AI Foundry | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| Azure OpenAI | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| Cohere | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| DeepInfra | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| DeepSeek | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| Fireworks | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| Gemini | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| Groq | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| HuggingFace | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| IBM WatsonX | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| InternLM | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| LiteLLM | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| LiteLLMOpenAI | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| LM Studio | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| Mistral | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| Nvidia | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| Ollama | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| OllamaTools | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| OpenAIChat | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| OpenAIResponses | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| OpenRouter | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| Perplexity | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| Sambanova | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| Together | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| XAI | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
HuggingFace supports tool calling through the Agno framework, but not for streaming responses.
Perplexity supports tool calling through the Agno framework, but their models don't natively support tool calls in a straightforward way. This means tool usage may be less reliable compared to other providers.
Multimodal Support
| Agno Supported Models | Image Input | Audio Input | Audio Responses | Video Input | File Upload |
|---|---|---|---|---|---|
| Anthropic Claude | ✅ | ✅ | |||
| AWS Bedrock | ✅ | ||||
| AWS Bedrock Claude | ✅ | ||||
| Azure AI Foundry | ✅ | ||||
| Azure OpenAI | ✅ | ||||
| Cohere | |||||
| AWS Bedrock | ✅ | ||||
| AWS Bedrock Claude | ✅ | ||||
| Azure AI Foundry | ✅ | ||||
| Azure OpenAI | ✅ | ||||
| Cohere | ✅ | ||||
| DeepInfra | |||||
| DeepSeek | |||||
| Fireworks | |||||
| Gemini | ✅ | ✅ | ✅ | ✅ | |
| Groq | ✅ | ||||
| HuggingFace | ✅ | ||||
| IBM WatsonX | ✅ | ||||
| InternLM | |||||
| LiteLLM | |||||
| LiteLLMOpenAI | |||||
| LM Studio | ✅ | ||||
| Mistral | ✅ | ||||
| Nvidia | |||||
| Ollama | ✅ | ||||
| OllamaTools | |||||
| OpenAIChat | ✅ | ✅ | ✅ | ||
| OpenAIResponses | ✅ | ✅ | ✅ | ✅ | |
| OpenRouter | |||||
| Perplexity | |||||
| Sambanova | |||||
| Together | ✅ | ||||
| XAI | ✅ |
Structured Outputs
| Agno Supported Models | Structured Outputs | JSON Mode |
|---|---|---|
| Anthropic Claude | ✅ | |
| AWS Bedrock | ✅ | |
| AWS Bedrock Claude | ✅ | |
| Azure AI Foundry | ✅ | |
| Azure OpenAI | ✅ | ✅ |
| Cohere | ✅ | |
| DeepInfra | ✅ | |
| DeepSeek | ✅ | |
| Fireworks | ✅ | ✅ |
| Gemini | ✅ | ✅ |
| Groq | ✅ | |
| HuggingFace | ✅ | |
| IBM WatsonX | ✅ | |
| InternLM | ✅ | ✅ |
| LiteLLMOpenAI | ✅ | ✅ |
| LiteLLM | ✅ | |
| LM Studio | ✅ | ✅ |
| Mistral | ✅ | ✅ |
| Nvidia | ✅ | |
| Ollama | ✅ | ✅ |
| OllamaTools | ✅ | ✅ |
| OpenAIChat | ✅ | ✅ |
| OpenAIResponses | ✅ | ✅ |
| OpenRouter | ✅ | ✅ |
| Perplexity | ✅ | ✅ |
| Sambanova | ✅ | |
| Together | ✅ | ✅ |
| XAI | ✅ | ✅ |
LM Studio supports JSON schema output, but not structured outputs.
Read more about Structured Outputs and JSON Mode.