AgentsBedrockAgent

set_inference_params

View as MarkdownOpen in Claude

Update Bedrock inference parameters. Only the provided parameters are changed; omitted parameters retain their current values.

Parameters

temperature
float

Generation temperature. Range: 0 to 1.

top_p
float

Nucleus sampling parameter. Range: 0 to 1.

max_tokens
int

Maximum tokens to generate.

Returns

None

Example

from signalwire import BedrockAgent
agent = BedrockAgent(
    name="bedrock-assistant",
    route="/assistant",
    system_prompt="You are a helpful assistant.",
)
agent.set_inference_params(temperature=0.3, top_p=0.95, max_tokens=2048)