Struct ModelRouter 

pub struct ModelRouter { /* private fields */ }

Intelligent model router.

Combines prompt complexity scoring, threshold-based routing, adaptive threshold adjustment, and cost tracking into a single entry point.

Thread-safe: all mutable state uses atomics or interior RwLock.

Panics

This type and its methods never panic.

Implementations

impl ModelRouter

pub fn new(config: RoutingConfig) -> Self

Create a new router with the given configuration.

Arguments

• config — Routing thresholds, cost rates, and adaptive settings.

Returns

A new ModelRouter ready to route prompts.

Panics

This function never panics.

pub fn route(&self, prompt: &str) -> RoutingDecision

Route a prompt to the appropriate worker.

Arguments

• prompt — The raw prompt text to analyse and route.

Returns

A RoutingDecision indicating which worker(s) to use.

Panics

This function never panics.

pub fn record_outcome( &self, decision: &RoutingDecision, success: bool, tokens: u64, )

Record the outcome of a routing decision.

For RoutingDecision::LocalWithFallback outcomes, this feeds the adaptive threshold algorithm. When enough samples accumulate and the local failure rate exceeds adaptive.failure_ceiling, the effective cloud threshold is lowered (sending more requests directly to cloud).

Arguments

• decision — The routing decision that was made.
• success — Whether the primary worker succeeded.
• tokens — Number of tokens processed (for cost tracking).

Panics

This function never panics.

pub fn cost_tracker(&self) -> &CostTracker

Return a reference to the underlying cost tracker.

Panics

This function never panics.

pub fn effective_cloud_threshold(&self) -> f64

Return the current effective cloud threshold.

This may differ from config.cloud_threshold if adaptive adjustment has been triggered.

Panics

This function never panics.

pub fn scorer(&self) -> &ComplexityScorer

Return a reference to the scorer for external breakdown queries.

Panics

This function never panics.

Trait Implementations

impl Debug for ModelRouter

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.