The AWS Bedrock model provides access to models hosted on AWS Bedrock.

ParameterTypeDefaultDescription
idstr"mistral.mistral-large-2402-v1:0"The specific model ID used for generating responses.
namestr"AwsBedrock"The name identifier for the AWS Bedrock agent.
providerstr"AwsBedrock"The provider of the model.
max_tokensint4096The maximum number of tokens to generate in the response.
temperatureOptional[float]"None"The sampling temperature to use, between 0 and 2. Higher values like 0.8 make the output more random, while lower values like 0.2 make it more focused and deterministic.
top_pOptional[float]"None"The nucleus sampling parameter. The model considers the results of the tokens with top_p probability mass.
stop_sequencesOptional[List[str]]"None"A list of sequences where the API will stop generating further tokens.
request_paramsOptional[Dict[str, Any]]"None"Additional parameters for the request, provided as a dictionary.
client_paramsOptional[Dict[str, Any]]"None"Additional client parameters for initializing the AwsBedrock client, provided as a dictionary.