Struct MultiPipelineRouter 

pub struct MultiPipelineRouter { /* private fields */ }

Routes incoming prompts across multiple named pipeline instances.

Build via MultiPipelineRouter::builder().

Implementations

impl MultiPipelineRouter

pub fn builder() -> MultiPipelineRouterBuilder

Create a new builder.

pub fn classify(&self, request: &PromptRequest) -> PromptClass

Classify a prompt request using the heuristic classifier.

Respects an optional "pipeline_class" key in request.meta for explicit override.

pub async fn route( &self, request: PromptRequest, ) -> Result<(), OrchestratorError>

Route a request to the best-fit pipeline.

Routing priority:

1. Pipeline whose target_class matches the classified prompt.
2. Any pipeline that lists the class in also_serves.
3. First pipeline (default/general fallback).

Errors

Returns OrchestratorError::ChannelClosed if the selected pipeline’s input channel is closed.

pub fn stats(&self) -> Vec<PipelineRoutingStats>

Return a snapshot of routing statistics per pipeline.

pub fn record_latency(&self, pipeline_name: &str, latency_ms: f64)

Record observed latency for a pipeline (called by the pipeline consumer).