Struct OutputCache 

pub struct OutputCache {
    pub entries: HashMap<CacheKey, CachedOutput>,
    pub capacity: usize,
    pub policy: EvictionPolicy,
    pub hits: u64,
    pub misses: u64,
    pub lcg_state: u64,
}

In-memory output deduplication cache.

Fields

entries: HashMap<CacheKey, CachedOutput>

Live entries.

capacity: usize

Maximum number of entries.

policy: EvictionPolicy

Eviction policy applied when entries.len() == capacity.

hits: u64

Lifetime hit counter.

misses: u64

Lifetime miss counter.

lcg_state: u64

Internal LCG state used by EvictionPolicy::Random.

Implementations

impl OutputCache

pub fn new(capacity: usize, policy: EvictionPolicy) -> Self

Create a new cache with the given capacity and eviction policy.

pub fn get(&mut self, key: &CacheKey, now_ms: u64) -> Option<&str>

Look up key. Returns None if the entry is absent or expired. On a hit the entry’s access_count is incremented and the hit stat updated.

pub fn insert( &mut self, key: CacheKey, response: String, tokens: u64, ttl_ms: u64, now_ms: u64, )

Insert a new entry, evicting one existing entry first if at capacity.

pub fn evict_one(&mut self, now_ms: u64)

Evict one entry: expired entries take priority; otherwise apply policy.

pub fn prune_expired(&mut self, now_ms: u64) -> usize

Remove all expired entries and return how many were removed.

pub fn hit_rate(&self) -> f64

Ratio of hits to total lookups, or 0.0 if no lookups have been made.

pub fn stats(&self, now_ms: u64) -> CacheStats

Return a statistics snapshot for the current moment now_ms.