Struct RateLimiter 

pub struct RateLimiter { /* private fields */ }

A per-session token-bucket rate limiter.

Two backend implementations are available:

• Simple (always available) — a sliding-window counter per session stored in a [dashmap::DashMap]. Accurate to the granularity of the configured window.
• Governor (requires feature rate-limiting) — a true token-bucket backed by the governor crate, with sub-millisecond accuracy.

Examples

use tokio_prompt_orchestrator::enhanced::RateLimiter;

let limiter = RateLimiter::new(100, 60); // 100 requests per 60-second window

if limiter.check("user-123").await {
    // allowed
} else {
    // rate limit exceeded
}

Isolation

Each session (identified by a string key) has its own independent counter. Exhausting one session’s quota does not affect others.

Implementations

impl RateLimiter

pub fn new(max_requests: usize, window_secs: u64) -> Self

Create simple rate limiter

• max_requests: Maximum requests allowed
• window_secs: Time window in seconds

pub async fn check(&self, session_id: &str) -> bool

Check if request is allowed for session

Returns true if allowed, false if rate limit exceeded

pub async fn reset(&self, session_id: &str)

Reset rate limit for session

pub fn get_usage(&self, session_id: &str) -> Option<RateLimitInfo>

Get current usage for session

Trait Implementations

impl Clone for RateLimiter

fn clone(&self) -> RateLimiter

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.