set_inference_params

Update Bedrock inference parameters. Only the provided parameters are changed; omitted parameters retain their current values.

Parameters

temperature

float

Generation temperature. Range: 0 to 1.

top_p

float

Nucleus sampling parameter. Range: 0 to 1.

max_tokens

int

Maximum tokens to generate.

Returns

None

Example

1 from signalwire import BedrockAgent
2 
3 agent = BedrockAgent(
4     name="bedrock-assistant",
5     route="/assistant",
6     system_prompt="You are a helpful assistant.",
7 )
8 
9 agent.set_inference_params(temperature=0.3, top_p=0.95, max_tokens=2048)