DeepInfra
Parameter reference for the DeepInfra model class, which extends OpenAILike.
The DeepInfra model provides access to DeepInfra's hosted language models.
Parameters
| Parameter | Type | Default | Description |
|---|---|---|---|
id | str | "meta-llama/Llama-2-70b-chat-hf" | The id of the DeepInfra model to use |
name | str | "DeepInfra" | The name of the model |
provider | str | "DeepInfra" | The provider of the model |
api_key | Optional[str] | None | The API key for DeepInfra (defaults to DEEPINFRA_API_KEY env var) |
base_url | str | "https://api.deepinfra.com/v1/openai" | The base URL for the DeepInfra API |
supports_native_structured_outputs | bool | False | Whether the model supports native structured outputs |
DeepInfra extends OpenAILike and accepts all of its parameters.