AWS Machine Learning Blog· Dustin Liu·· 1d agoAI score42
Amazon Bedrock Open Weight Model Supports Explicit Prompt Caching
Use prompt caching with open-weight models on Amazon Bedrock
AI digest
The Open Weight Model in Amazon Bedrock now supports explicit prompt caching, which can reduce input costs and response latency. Through the Chat Completions API, implicit and explicit caching modes can be used to improve caching efficiency.
Source:AWS Machine Learning Blog · aws.amazon.com