Skip to content
AWS Machine Learning Blog· Dustin Liu·· 1d agoAI score42

Amazon Bedrock Open Weight Model Supports Explicit Prompt Caching

Use prompt caching with open-weight models on Amazon Bedrock

AI digest

The Open Weight Model in Amazon Bedrock now supports explicit prompt caching, which can reduce input costs and response latency. Through the Chat Completions API, implicit and explicit caching modes can be used to improve caching efficiency.

Source:AWS Machine Learning Blog · aws.amazon.com