OpenAI Upgrades GPT-6 API Prompt Caching to Cut Agent Latency and Input Costs
Sign in✓ Signed in
OpenAI has upgraded prompt caching for GPT-6 in the API, aiming to raise cache-hit rates by default so long-running agents can reuse more context, respond faster and qualify for cached-input discounts of up to 90%. The September 22 update also adds monitoring, diagnostics and controls for developers who need to understand why cache misses happen and where reusable prompt prefixes should end.
Continue reading
The rest of this article is for AI News Blitz readers. Choose an option below to keep reading.
Already purchased? Sign in✓ Signed in — this article isn’t included in your current plan.
Unlocking the full article...