Struct ChannelSizes 

pub struct ChannelSizes {
    pub rag_to_assemble: Option<usize>,
    pub assemble_to_inference: Option<usize>,
    pub inference_to_post: Option<usize>,
    pub post_to_stream: Option<usize>,
    pub stream_output: Option<usize>,
}

Per-channel capacity overrides for the five inter-stage pipeline channels.

All fields are optional; when absent the stage default is used (512, 512, 1024, 512, 256 respectively).

Panics

This type never panics.

Fields

rag_to_assemble: Option<usize>

Capacity of the RAG → Assemble channel (default: 512).

assemble_to_inference: Option<usize>

Capacity of the Assemble → Inference channel (default: 512).

inference_to_post: Option<usize>

Capacity of the Inference → Post channel (default: 1024).

post_to_stream: Option<usize>

Capacity of the Post → Stream channel (default: 512).

stream_output: Option<usize>

Capacity of the Stream output channel (default: 256).

Trait Implementations

impl Clone for ChannelSizes

fn clone(&self) -> ChannelSizes

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ChannelSizes

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for ChannelSizes

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl PartialEq for ChannelSizes

fn eq(&self, other: &ChannelSizes) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Serialize for ChannelSizes

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for ChannelSizes