Struct SessionManager 

pub struct SessionManager { /* private fields */ }

Concurrent, lock-free store of Sessions keyed by u64 ID.

All methods are &self and safe to call from multiple Tokio tasks.

Implementations

impl SessionManager

pub fn new() -> Self

Create a new manager with an empty store.

pub fn create(&self, system_prompt: Option<String>) -> u64

Create a new session, optionally pre-loading a system message.

Returns the new session’s ID.

pub fn append( &self, session_id: u64, role: Role, content: String, ) -> Result<(), SessionError>

Append a message to an existing session.

Token count is estimated as word count when not supplied.

pub fn get(&self, session_id: u64) -> Result<Session, SessionError>

Return a copy of the session, or Err(SessionError::NotFound).

pub fn delete(&self, session_id: u64) -> bool

Delete a session, returning true if it existed.

pub fn get_context( &self, session_id: u64, max_tokens: usize, ) -> Result<Vec<Message>, SessionError>

Return messages for a session trimmed to fit within max_tokens.

Strategy:

1. The system message (if any) is always retained.
2. Non-system messages are trimmed from the oldest end until the total fits within max_tokens.

pub fn summarize_if_needed( &self, session_id: u64, threshold_tokens: usize, summarizer: &dyn Fn(&str) -> String, ) -> Result<(), SessionError>

If the session’s total tokens exceed threshold_tokens, call summarizer on the oldest non-system messages and replace them with a single assistant summary message.

pub fn stats(&self) -> SessionStats

Collect aggregate statistics across all stored sessions.

Trait Implementations

impl Clone for SessionManager

fn clone(&self) -> SessionManager

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for SessionManager

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for SessionManager

fn default() -> Self

Returns the “default value” for a type.