Skip to content

generator: Claude 4.5 on AWS Bedrock with LiteLLM #1410

@JDSmith-F1

Description

@JDSmith-F1

Steps to reproduce

How'd you do it?

  1. Run Garak with Claude 4.5 on AWS Bedrock with LiteLLM as the generator.

All tests fail instantly as Claude 4.5 on AWS Bedrock wants either temperature or top_p but not both.

Were you following a specific guide/tutorial or reading documentation?

If yes link the guide/tutorial or documentation you were following here, otherwise you may omit this section.

Expected behavior

The tests should just successfully run like it does for other Claude versions.

Current behavior

It fails instantly and I see this error in LiteLLM:

litellm.BadRequestError: BedrockException - {"message":"The model returned the following errors: `temperature` and `top_p` cannot both be specified for this model. Please use only one."}. Received Model Group=eu.anthropic.claude-sonnet-4-5-20250929-v1:0 Available Model Group Fallbacks=None LiteLLM Retried: 1 times, LiteLLM Max Retries: 2

garak version

v0.13.1

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions