pub struct HookMetrics {
pub elapsed_ms: u64,
pub prompt_tokens: Option<u64>,
pub completion_tokens: Option<u64>,
pub estimated_cost_usd: f64,
}Expand description
Metrics snapshot passed to pre- and post-inference hooks.
Values are best-effort estimates at the time the hook fires. Hooks must
not modify any field — the struct is Clone for convenience only.
Fields§
§elapsed_ms: u64Elapsed wall-clock time since the request entered the pipeline (ms).
prompt_tokens: Option<u64>Approximate number of prompt tokens (provider-reported or estimated).
completion_tokens: Option<u64>Approximate number of completion tokens.
estimated_cost_usd: f64Estimated cost of this request in USD (0.0 if not available).
Trait Implementations§
Source§impl Clone for HookMetrics
impl Clone for HookMetrics
Source§fn clone(&self) -> HookMetrics
fn clone(&self) -> HookMetrics
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreAuto Trait Implementations§
impl Freeze for HookMetrics
impl RefUnwindSafe for HookMetrics
impl Send for HookMetrics
impl Sync for HookMetrics
impl Unpin for HookMetrics
impl UnsafeUnpin for HookMetrics
impl UnwindSafe for HookMetrics
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<T> FutureExt for T
impl<T> FutureExt for T
§fn with_context(self, otel_cx: Context) -> WithContext<Self>
fn with_context(self, otel_cx: Context) -> WithContext<Self>
§fn with_current_context(self) -> WithContext<Self>
fn with_current_context(self) -> WithContext<Self>
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoRequest<T> for T
impl<T> IntoRequest<T> for T
Source§fn into_request(self) -> Request<T>
fn into_request(self) -> Request<T>
Wrap the input message
T in a tonic::Request