Skip to content
AWS Machine Learning Blog· Sai Pavan Kasani·· 5d agoAI score40

The Impact of Amazon Bedrock Inference Selection on Costs

Four Amazon Bedrock inference choices that affect cost

AI digest

In the Amazon Bedrock inference service, the request level selection affects the number and rate of processing tokens, which in turn affects costs. Factors such as cache duration, service tier, inference effort, and maximum token count all affect costs without changing the model or prompts. This article introduces how to test each selection and its impact on response metadata, logs, and billing data.

Source:AWS Machine Learning Blog · aws.amazon.com

Event follow-ups · 1

See the full event