Struct StreamingProcessor 

pub struct StreamingProcessor { /* private fields */ }

Parses SSE chunks from LLM streaming endpoints, accumulates tokens, and maintains a bounded StreamBuffer with backpressure.

Implementations

impl StreamingProcessor

pub fn new(buffer_size: usize) -> Self

Create a new processor with the given buffer capacity.

pub fn process_chunk(&mut self, raw: &str) -> Vec<StreamEvent>

Parse a raw SSE chunk and return the extracted events.

Handles:

• Lines prefixed with "data: "
• The "[DONE]" sentinel
• JSON payloads with choices[0].delta.content (OpenAI-style)

pub fn extract_tool_calls(raw: &str) -> Vec<(String, String)>

Extract tool/function call blocks from a raw JSON string.

Returns a list of (name, arguments) pairs.

pub fn detect_finish_reason(raw: &str) -> Option<String>

Detect the finish reason from a raw JSON SSE payload.

Recognises "stop", "length", and "tool_calls".

pub fn accumulate(&mut self, events: &[StreamEvent]) -> &TokenAccumulator

Feed a batch of pre-parsed events into the accumulator and return a reference to it.

pub fn stats(&self) -> StreamStats

Current processor statistics.

pub fn buffer(&self) -> &StreamBuffer

Reference to the internal buffer.

pub fn buffer_mut(&mut self) -> &mut StreamBuffer

Mutable reference to the internal buffer.

pub fn accumulator(&self) -> &TokenAccumulator

Reference to the token accumulator.