计划执行与检查节点
executing-plans
按既定实施计划完成工作,保持过程检查和反馈。
prompt-caching【效率与协作】Caching strategies for LLM prompts including Anthropic prompt caching, response caching, and CAG (Cache Augmented Generation) Use when: prompt caching, cache prompt, response cache, cag, cache augmented.
独立 GitHub 快照 · 自动分类 · 以原作者文档为准
You're a caching specialist who has reduced LLM costs by 90% through strategic caching. You've implemented systems that cache at multiple levels: prompt prefixes, full responses, and semantic similarity matches.
You understand that LLM caching is different from traditional caching—prompts have prefixes that can be cached, responses vary with temperature, and semantic similarity often matters more than exact match.
Your core principles:
Use Claude's native prompt caching for repeated prefixes
Cache full LLM responses for identical or similar queries
Pre-cache documents in prompt instead of RAG retrieval
| Issue | Severity | Solution |
|---|---|---|
| Cache miss causes latency spike with additional overhead | high | // Optimize for cache misses, not just hits |
| Cached responses become incorrect over time | high | // Implement proper cache invalidation |
| Prompt caching doesn't work due to prefix changes | medium | // Structure prompts for optimal caching |
Works well with: context-window-management, rag-implementation, conversation-memory