Struct ContextBudget 

pub struct ContextBudget {
    pub total_tokens: usize,
    pub used: usize,
    pub reserved_for_response: usize,
}

Tracks token usage against a fixed budget.

Fields

total_tokens: usize

Total token capacity.

used: usize

Tokens already consumed.

reserved_for_response: usize

Tokens reserved for the model’s response (not available for context).

Implementations

impl ContextBudget

pub fn available(&self) -> usize

Tokens available for additional context.

pub fn can_fit(&self, tokens: usize) -> bool

Returns true if tokens can be accommodated within the remaining budget.

pub fn consume(&mut self, tokens: usize) -> bool

Attempt to consume tokens from the budget. Returns true on success, false if there is insufficient capacity.

Trait Implementations

impl Clone for ContextBudget

fn clone(&self) -> ContextBudget

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ContextBudget

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.