Expand description
Model routing logic.
The ModelRouter combines a ComplexityScorer
with a RoutingConfig and a
CostTracker to decide which worker backend should
serve each prompt and to adaptively adjust routing thresholds based on
observed outcomes.
Structs§
- Model
Router - Intelligent model router.
Enums§
- Routing
Decision - The routing decision for a single prompt.