AWS Machine Learning Blog· Sai Pavan Kasani·· 5d agoAI score40
The Impact of Amazon Bedrock Inference Selection on Costs
Four Amazon Bedrock inference choices that affect cost
AI digest
In the Amazon Bedrock inference service, the request level selection affects the number and rate of processing tokens, which in turn affects costs. Factors such as cache duration, service tier, inference effort, and maximum token count all affect costs without changing the model or prompts. This article introduces how to test each selection and its impact on response metadata, logs, and billing data.
Source:AWS Machine Learning Blog · aws.amazon.com