The IBM WatsonX model provides access to IBM’s language models.

Parameters

ParameterTypeDefaultDescription
idstr"ibm/granite-20b-code-instruct"The model ID to use
frequency_penaltyfloatNonePenalty for using frequent tokens. Higher values discourage repetition
presence_penaltyfloatNonePenalty for using tokens already present in the text. Higher values encourage new topics
max_tokensintNoneMaximum number of tokens to generate in the response
temperaturefloatNoneControls randomness in responses. Higher values make output more random
top_pfloatNoneControls diversity of responses via nucleus sampling
logprobsintNoneNumber of log probabilities to return
top_logprobsintNoneNumber of most likely tokens to return log probabilities for
response_formatAnyNoneFormat specification for the response
api_keystrNoneIBM WatsonX API key
project_idstrNoneIBM WatsonX project ID
urlstr"https://eu-de.ml.cloud.ibm.com"IBM WatsonX API endpoint URL
verifyboolTrueWhether to verify SSL certificates
client_paramsDict[str, Any]NoneAdditional parameters to pass to the client