Skip to main content

Module model_registry

tokio_prompt_orchestrator

Module model_registry 

Source
Expand description

§Model Registry

Tracks LLM model metadata, capabilities, pricing, and rate limits. Provides routing hints and deprecation warnings.

Structs§

ModelMetadata
Rich metadata for a single LLM model.
ModelRegistry
Concurrent registry of ModelMetadata keyed by model ID.
RoutingHint
Routing suggestion produced by ModelRegistry::suggest_routing.

Enums§

ModelCapability
A capability a model may support.
ModelTier
Tier classification for a model, reflecting quality and price.