Struct PromptRequest 

pub struct PromptRequest {
    pub session: SessionId,
    pub request_id: String,
    pub input: String,
    pub meta: HashMap<String, String>,
    pub deadline: Option<Instant>,
}

Initial prompt request from client

Fields

session: SessionId

Session this request belongs to. Used for affinity sharding and deduplication key generation.

request_id: String

Unique ID for distributed trace correlation across all pipeline stages.

input: String

The raw prompt text to send to the inference backend.

meta: HashMap<String, String>

Arbitrary key-value metadata forwarded unchanged through the pipeline.

deadline: Option<Instant>

Optional absolute deadline for this request. When Some, the inference stage drops the request and increments requests_expired_total if the deadline has already passed at dequeue time.

Implementations

impl PromptRequest

pub fn with_deadline(self, duration: Duration) -> Self

Builder-style helper that sets an absolute deadline duration from now.

This is an infallible convenience wrapper around try_with_deadline. It accepts any positive Duration; for validated input (e.g. user-supplied values) prefer try_with_deadline which rejects zero or excessively large timeouts at the call site.

Example

use std::collections::HashMap;
use std::time::Duration;
use tokio_prompt_orchestrator::{PromptRequest, SessionId};

let req = PromptRequest {
    session: SessionId::new("s1"),
    request_id: "r1".to_string(),
    input: "hello".to_string(),
    meta: HashMap::new(),
    deadline: None,
}
.with_deadline(Duration::from_secs(5));

assert!(req.deadline.is_some());

Panics

This function does not panic.

pub fn try_with_deadline( self, timeout_seconds: u64, ) -> Result<Self, OrchestratorError>

Validated builder that sets an absolute deadline timeout_seconds from now.

Accepts a timeout expressed as a whole number of seconds and validates it before storing the deadline.

Errors

Returns Err(OrchestratorError::ConfigError(_)) when:

• timeout_seconds is 0 — a zero-second deadline expires immediately.
• timeout_seconds exceeds 3600 — unreasonably large timeouts are rejected to prevent accidental resource leaks.

Example

use std::collections::HashMap;
use tokio_prompt_orchestrator::{PromptRequest, SessionId};

let req = PromptRequest {
    session: SessionId::new("s1"),
    request_id: "r1".to_string(),
    input: "hello".to_string(),
    meta: HashMap::new(),
    deadline: None,
}
.try_with_deadline(30)
.expect("30s is a valid timeout");

assert!(req.deadline.is_some());

Panics

This function does not panic.

Trait Implementations

impl Clone for PromptRequest

fn clone(&self) -> PromptRequest

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for PromptRequest

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.