Struct AnthropicWorker 

pub struct AnthropicWorker { /* private fields */ }

Anthropic Claude API worker

Requires ANTHROPIC_API_KEY environment variable.

Example

let worker = Arc::new(
    AnthropicWorker::new("claude-3-5-sonnet-20241022")?
        .with_max_tokens(1024)
        .with_temperature(1.0)
);

Resilience

AnthropicWorker does not retry internally. Retry logic is handled by the pipeline’s inference stage. See ModelWorker for details.

Implementations

impl AnthropicWorker

pub fn new(model: impl Into<String>) -> Result<Self, OrchestratorError>

Create a new AnthropicWorker for the given model.

Reads the API key from the ANTHROPIC_API_KEY environment variable and constructs an HTTP client configured for the Anthropic Messages API. Default settings: 1024 max tokens, temperature 1.0, 60 s timeout. All defaults are overridable via the builder methods.

Environment Variables

Variable	Required	Description
ANTHROPIC_API_KEY	Yes	API key sent via x-api-key header

Errors

Returns OrchestratorError::ConfigError if ANTHROPIC_API_KEY is not set in the environment.

Examples

use tokio_prompt_orchestrator::AnthropicWorker;
use std::sync::Arc;

// ANTHROPIC_API_KEY must be set in the environment.
let worker = Arc::new(
    AnthropicWorker::new("claude-3-5-sonnet-20241022")
        .expect("ANTHROPIC_API_KEY must be set")
        .with_max_tokens(1024)
        .with_temperature(1.0),
);

pub fn with_max_tokens(self, max_tokens: u32) -> Self

Set maximum tokens to generate

pub fn with_temperature(self, temperature: f32) -> Self

Set temperature (0.0 – 1.0 for Anthropic).

Values outside [0.0, 1.0] are clamped and a WARN-level log line is emitted. The Anthropic API rejects values outside this range with HTTP 400.

pub fn with_timeout(self, timeout: Duration) -> Self

Set request timeout

pub fn with_base_url(self, url: impl Into<String>) -> Self

Override the API base URL.

Useful for Anthropic-compatible endpoints or for pointing at a mock server in tests. Default: "https://api.anthropic.com/v1".

Trait Implementations

impl Debug for AnthropicWorker

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl ModelWorker for AnthropicWorker

fn infer<'life0, 'life1, 'async_trait>( &'life0 self, prompt: &'life1 str, ) -> Pin<Box<dyn Future<Output = Result<Vec<String>, OrchestratorError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

Perform inference on the given prompt.

fn infer_stream<'life0, 'life1, 'async_trait>( &'life0 self, prompt: &'life1 str, ) -> Pin<Box<dyn Future<Output = Result<TokenStream, OrchestratorError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

Stream inference tokens as they arrive from the provider.