Cache (Determinism and Cost Control)
The Problem It Solves
For LLM/tool calls, caching helps:
- reduce latency and cost
- stabilize evals/regressions
- avoid repeated expensive work
Repo Reference
- Implementation:
src/agent_patterns_lab/runtime/cache.py - Tests:
tests/test_cache.py