Models
Ollama
The Ollama model provides access to locally-hosted open source models.
| Parameter | Type | Default | Description |
|---|---|---|---|
id | str | "llama3.1" | The ID of the model to use. |
name | str | "Ollama" | The name of the model. |
provider | str | "Ollama" | The provider of the model. |
format | Optional[Any] | None | The format of the response. |
options | Optional[Any] | None | Additional options to pass to the model. |
keep_alive | Optional[Union[float, str]] | None | The keep alive time for the model. |
request_params | Optional[Dict[str, Any]] | None | Additional parameters to pass to the request. |
host | Optional[str] | None | The host to connect to. |
timeout | Optional[Any] | None | The timeout for the connection. |
client_params | Optional[Dict[str, Any]] | None | Additional parameters to pass to the client. |
client | Optional[OllamaClient] | None | A pre-configured instance of the Ollama client. |
async_client | Optional[AsyncOllamaClient] | None | A pre-configured instance of the asynchronous Ollama client. |
structured_outputs | bool | False | Whether to use the structured outputs with this Model. |
supports_structured_outputs | bool | True | Whether the Model supports structured outputs. |