Expand description
Model fallback chains for resilience — automatic failover across model tiers.
Structs§
- Fallback
Chain - Ordered list of models with failure tracking and cooldown management.
- Fallback
Manager - Thread-safe wrapper around
FallbackChainthat executes closures against the best available model, retrying down the chain on failure. - Fallback
Model - A single model in a fallback chain.
- Fallback
Report - Report about a single model in the chain.
Enums§
- Model
Error - Errors that can be returned by a model inference call.