Struct SmartRouter 

pub struct SmartRouter { /* private fields */ }

Routes incoming requests to the cheapest (or highest-quality) provider that satisfies all SLA constraints.

Implementations

impl SmartRouter

pub fn new(pricing: Vec<ModelPricing>, health: ProviderHealthMonitor) -> Self

Create a new router with the given pricing table and health monitor.

Panics

Never panics.

pub async fn route(&self, req: &RoutingRequirements) -> Option<RoutingDecision>

Route a request, returning the best RoutingDecision or None if no suitable provider exists after applying all filters.

Panics

Never panics.

pub fn default_pricing() -> Vec<ModelPricing>

Return the built-in pricing table for common LLM models.

Prices are in USD per 1 million tokens as of early 2025.

Panics

Never panics.

pub fn load_pricing_toml(&mut self, toml_str: &str) -> Result<usize, String>

Hot-reload pricing from a TOML string.

The TOML document must contain a top-level [[model]] array, where each entry has the fields: provider_id, model, input_per_million, output_per_million, quality_score, typical_p95_ms.

On success, replaces the current pricing table and returns the number of models loaded. On parse failure, the existing table is not modified.

Errors

Returns Err(String) describing the parse failure.

Panics

Never panics.