Expand description
Cost tracking and savings computation.
Tracks per-model token usage and estimated spend, computes what the all-cloud baseline cost would have been, and reports savings.
Thread-safe: all counters use atomic operations for lock-free reads and writes under concurrent pipeline access.
Also provides SessionBudgetTracker for per-session spending limits.
Structsยง
- Cost
Snapshot - Point-in-time snapshot of cost tracking metrics.
- Cost
Tracker - Per-model cost tracking and savings computation.
- Session
Budget Tracker - Per-session spending limits and accumulated spend.