Expand description
Multi-provider LLM manager with failover, load-balancing, and rate-limit tracking.
Structs§
- Provider
- Configuration for a single LLM provider.
- Provider
Health - Point-in-time health snapshot for a provider.
- Provider
Manager - Central registry of LLM providers with health, stats, and rate-limit tracking.
- Provider
Stats - Cumulative statistics for a single provider.
Enums§
- Provider
Selection - Strategy used to choose which provider handles a request.