Expand description
Streaming token processor for SSE/streaming LLM responses.
Structs§
- Accumulator
Result - Result produced by
TokenAccumulator::finish. - Stream
Buffer - Bounded queue of
StreamEvents with backpressure support. - Stream
Stats - Running statistics for a
StreamingProcessor. - Streaming
Processor - Parses SSE chunks from LLM streaming endpoints, accumulates tokens, and
maintains a bounded
StreamBufferwith backpressure. - Token
Accumulator - Accumulates token fragments and tracks timing statistics.
Enums§
- Stream
Event - Events emitted by the streaming processor.