how to add claude-sonet-4 using bedrock

[iRajul]

I added a model using "BedRock" as Model Provider and AWS ARN id as model name.
it is able to generate a response using manual run.
But when I am using it to generate synthetic data and after click generate topic, it is showing following error. Does anyone know how use Anthropic models using AWS BedRock.

Unexpected error: litellm.UnsupportedParamsError: bedrock does not support parameters: ['tool_choice'], for model=arn:aws:bedrock:us-west-2:999999999999:inference-profile/us.anthropic.claude-3-sonnet-20240229-v1:0. To drop these, set `litellm.drop_params=True` or for proxy: `litellm_settings: drop_params: true` . If you want to use these params dynamically send allowed_openai_params=['tool_choice'] in your request.

[scosman]

We changed that recently, but it's not in a release yet. If you download a daily build (link below) it should no longer try tool_calling by default. This will be in the next release.

Using Sonnet 4 via a pre-configured provider will be slightly more reliable, as it will request the specific JSON schema needed by synthetic data gen. OpenRouter and Anthropic work.

https://github.com/Kiln-AI/Kiln/actions/workflows/build_desktop.yml?query=branch%3Amain++

[iRajul]

@scosman Yes, it works, thank you very much.
One more thing. I also tried using Custom API with LLMLITE proxy server where I setup Claude-Sonet-4. After setting up Custom API, If I tried to create "Topics" in "Synthetic Data" then I don't see any Custom API Name option there to select in dropdown.