Expand description
Session tracking and context-window management.
SessionManager owns a collection of Session objects behind a
RwLock<HashMap>. Each session stores a rolling VecDeque of
Message records and enforces a maximum context-token budget.
Structsยง
- Message
- A single turn in a conversation session.
- Session
- A conversation session with bounded context-window management.
- Session
Manager - Thread-safe store for active
Sessionobjects.