id | str | "meta-llama/Meta-Llama-3.1-70B-Instruct" | The id of the Nebius model to use |
name | str | "Nebius" | The name of the model |
provider | str | "Nebius" | The provider of the model |
api_key | Optional[str] | None | The API key for Nebius (defaults to NEBIUS_API_KEY env var) |
base_url | str | "https://api.tokenfactory.nebius.com/v1" | The base URL for the Nebius API |
retries | int | 0 | Number of retries to attempt before raising a ModelProviderError |
delay_between_retries | int | 1 | Delay between retries, in seconds |
exponential_backoff | bool | False | If True, the delay between retries is doubled each time |
