BlogAI EngineeringPrompt caching and latencyAI Engineering ·Performance18 Sept 2026· 1 min readPrompt caching and latencyCut cost and time-to-first-token by reusing the prefix.Demo post. Delete any folder named demo-* when done. Section# Some text.
