Expand description
Pre-flight cost estimation for LLM requests.
Provides token-count heuristics, per-model pricing, and budget-checking before a request is dispatched so that callers can decide whether to proceed, choose a cheaper model, or reject the request entirely.
Structs§
- Budget
Config - Spending limits used to check whether a request is within budget.
- Cost
Estimate - Full cost estimate including budget compliance.
- Cost
Estimator - Pre-flight cost estimation engine.
- Token
Estimate - Input/output token count estimate for a request.
Enums§
- Task
Type - Characterises the kind of work being requested, which influences the expected output token count.