pub enum ModelError {
RateLimit,
ContextTooLong,
InvalidRequest(String),
ServerError(String),
Timeout,
Unavailable,
}Expand description
Errors that can be returned by a model inference call.
Variants§
RateLimit
HTTP 429 / token-bucket exhausted.
ContextTooLong
Prompt + completion would exceed the model’s context window.
InvalidRequest(String)
The request itself was malformed (bad parameters, etc.).
ServerError(String)
The provider returned a 5xx or equivalent error.
Timeout
No response received within the allowed time window.
The model endpoint is temporarily unavailable.
Implementations§
Source§impl ModelError
impl ModelError
Sourcepub fn is_retryable(&self) -> bool
pub fn is_retryable(&self) -> bool
Returns true for errors that are worth retrying on the same model.
Sourcepub fn suggests_fallback(&self) -> bool
pub fn suggests_fallback(&self) -> bool
Returns true for errors that should trigger a move to the next model in the chain.
Trait Implementations§
Source§impl Clone for ModelError
impl Clone for ModelError
Source§fn clone(&self) -> ModelError
fn clone(&self) -> ModelError
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for ModelError
impl Debug for ModelError
Source§impl PartialEq for ModelError
impl PartialEq for ModelError
Source§fn eq(&self, other: &ModelError) -> bool
fn eq(&self, other: &ModelError) -> bool
Tests for
self and other values to be equal, and is used by ==.impl StructuralPartialEq for ModelError
Auto Trait Implementations§
impl Freeze for ModelError
impl RefUnwindSafe for ModelError
impl Send for ModelError
impl Sync for ModelError
impl Unpin for ModelError
impl UnsafeUnpin for ModelError
impl UnwindSafe for ModelError
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<T> FutureExt for T
impl<T> FutureExt for T
§fn with_context(self, otel_cx: Context) -> WithContext<Self>
fn with_context(self, otel_cx: Context) -> WithContext<Self>
§fn with_current_context(self) -> WithContext<Self>
fn with_current_context(self) -> WithContext<Self>
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoRequest<T> for T
impl<T> IntoRequest<T> for T
Source§fn into_request(self) -> Request<T>
fn into_request(self) -> Request<T>
Wrap the input message
T in a tonic::Request