Struct ProviderManager 

pub struct ProviderManager { /* private fields */ }

Central registry of LLM providers with health, stats, and rate-limit tracking.

Implementations

impl ProviderManager

pub fn new() -> Self

Create an empty manager.

pub fn register(&mut self, provider: Provider)

Register (or replace) a provider.

pub fn set_cost_per_token(&mut self, provider_id: &str, cost: f64)

Set the estimated cost per token (USD) for a provider.

Used by best_provider_for_budget.

pub fn update_health(&mut self, health: ProviderHealth)

Replace the stored health snapshot for a provider.

pub fn select_provider( &mut self, selection: &ProviderSelection, now: u64, ) -> Option<&Provider>

Choose a provider according to selection.

Rate-limited or disabled providers are skipped. Returns None if no eligible provider exists.

pub fn failover_chain(&self) -> Vec<&Provider>

Return healthy, enabled providers sorted by ascending priority (lowest = best).

pub fn record_request( &mut self, provider_id: &str, tokens: u64, latency_ms: u64, success: bool, )

Record the outcome of a request to a provider.

pub fn provider_stats(&self, provider_id: &str) -> Option<ProviderStats>

Return the cumulative stats for a provider, if any requests have been recorded.

pub fn best_provider_for_budget( &self, cost_per_token_limit: f64, ) -> Option<&Provider>

Return the cheapest healthy provider whose cost-per-token is ≤ cost_per_token_limit.

Trait Implementations

impl Debug for ProviderManager

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for ProviderManager

fn default() -> ProviderManager

Returns the “default value” for a type.