-
Notifications
You must be signed in to change notification settings - Fork 664
Open
Labels
bugSomething isn't workingSomething isn't working
Description
Steps to reproduce
How'd you do it?
- Run Garak with Claude 4.5 on AWS Bedrock with LiteLLM as the generator.
All tests fail instantly as Claude 4.5 on AWS Bedrock wants either temperature or top_p but not both.
Were you following a specific guide/tutorial or reading documentation?
If yes link the guide/tutorial or documentation you were following here, otherwise you may omit this section.
Expected behavior
The tests should just successfully run like it does for other Claude versions.
Current behavior
It fails instantly and I see this error in LiteLLM:
litellm.BadRequestError: BedrockException - {"message":"The model returned the following errors: `temperature` and `top_p` cannot both be specified for this model. Please use only one."}. Received Model Group=eu.anthropic.claude-sonnet-4-5-20250929-v1:0 Available Model Group Fallbacks=None LiteLLM Retried: 1 times, LiteLLM Max Retries: 2
garak version
v0.13.1
Metadata
Metadata
Assignees
Labels
bugSomething isn't workingSomething isn't working