OpenAI Prompt Caching (AI Gateway)

Lightweight ToolLoopAgent pattern for OpenAI prompt caching through Vercel AI Gateway: stable system instructions, promptCacheKey, and per-turn cachedPromptTokens metrics.

Open Live Preview

View Full Pattern on Desktop

OpenAI Prompt Caching (AI Gateway) preview

Problems Solved

OpenAI prompt caching with promptCacheKey via AI Gateway
Stable system prefix for cache hits across agent turns
Inspect cachedPromptTokens from provider metadata

Use Cases

Reduce cost on repeated agent system prompts
Teach promptCacheKey grouping with ToolLoopAgent
Compare cache metrics across multi-turn sessions

AI SDK APIs

ToolLoopAgentgatewayproviderOptionsstepCountIs

Related Patterns

Anthropic Cache Control (AI Gateway)

Lightweight ToolLoopAgent pattern for Anthropic ephemeral cache control through Vercel AI Gateway: prepareCall injects a cached system breakpoint and reports cache read/write tokens.

aiagents+5

Jun 26

View →

Sub-Agent Orchestrator

Custom Agent implementation demonstrating the Agent interface abstraction with an orchestrator that routes queries to specialized sub-agents (research, analysis, support). Shows options passing and structured outputs.

aiagents+7

View →

Just Bash Skills Agent

Minimal ToolLoopAgent chat demo: on-call-style skills (incident triage + stakeholder comms) on disk, skill tool loads SKILL.md + paths, readFile pulls reference checklists and templates from the sandbox.

aiagents+5

View →