Struct CostOptimizer 

pub struct CostOptimizer { /* private fields */ }

Analyses cost patterns and generates (or applies) optimisation suggestions.

Implementations

impl CostOptimizer

pub fn new(config: CostOptimizerConfig) -> Result<Arc<Self>, CostOptimizerError>

Create a new optimizer with the given configuration.

Errors

Returns CostOptimizerError::InvalidConfig if window_size is zero or cache_candidate_threshold is outside [0, 1].

pub fn record( &self, prompt: &str, model: &str, response: &str, ) -> Result<(), CostOptimizerError>

Record a completed inference call.

pub fn suggestions( &self, ) -> Result<Vec<OptimizationSuggestion>, CostOptimizerError>

Return a list of optimisation suggestions based on observed patterns.

pub fn auto_apply(&self) -> Result<Vec<AutoApplyAction>, CostOptimizerError>

Apply all pending suggestions (only when auto_optimize = true).

Returns the list of actions taken.

pub fn model_override(&self, prompt: &str) -> Option<String>

Return the model override for an intent (applied by auto-optimizer), if any.

pub fn total_cost_usd(&self) -> Result<f64, CostOptimizerError>

Return total cost recorded across all observations.

pub fn intent_count(&self) -> Result<usize, CostOptimizerError>

Number of distinct intents tracked.