Skip to main content

Module streaming_processor

Module streaming_processor 

Source
Expand description

Streaming token processor for SSE/streaming LLM responses.

Structs§

AccumulatorResult
Result produced by TokenAccumulator::finish.
StreamBuffer
Bounded queue of StreamEvents with backpressure support.
StreamStats
Running statistics for a StreamingProcessor.
StreamingProcessor
Parses SSE chunks from LLM streaming endpoints, accumulates tokens, and maintains a bounded StreamBuffer with backpressure.
TokenAccumulator
Accumulates token fragments and tracks timing statistics.

Enums§

StreamEvent
Events emitted by the streaming processor.