Skip to main content

Module provider_manager

Module provider_manager 

Source
Expand description

Multi-provider LLM manager with failover, load-balancing, and rate-limit tracking.

Structs§

Provider
Configuration for a single LLM provider.
ProviderHealth
Point-in-time health snapshot for a provider.
ProviderManager
Central registry of LLM providers with health, stats, and rate-limit tracking.
ProviderStats
Cumulative statistics for a single provider.

Enums§

ProviderSelection
Strategy used to choose which provider handles a request.