Skip to main content
The Fireworks model provides access to Fireworks’ language models.

Parameters

ParameterTypeDefaultDescription
idstr"accounts/fireworks/models/llama-v3p1-405b-instruct"The id of the Fireworks model to use
namestr"Fireworks"The name of the model
providerstr"Fireworks"The provider of the model
api_keyOptional[str]NoneThe API key for Fireworks (defaults to FIREWORKS_API_KEY env var)
base_urlstr"https://api.fireworks.ai/inference/v1"The base URL for the Fireworks API
retriesint0Number of retries to attempt before raising a ModelProviderError
delay_between_retriesint1Delay between retries, in seconds
exponential_backoffboolFalseIf True, the delay between retries is doubled each time
Fireworks extends the OpenAI-compatible interface and supports most parameters from OpenAI.