Configuration¶

Configure TestAgent behavior with TestConfig.

graph LR
    subgraph "Configuration"
        A[TestConfig] --> B[model]
        A --> C[threshold]
        A --> D[temperature]
        A --> E[verbose]
        A --> F[cache_enabled]
    end

    classDef config fill:#6366F1,stroke:#7C90A0,color:#fff
    class A,B,C,D,E,F config

TestConfig Options¶

Option	Type	Default	Description
`model`	`str`	`"gpt-4o-mini"`	LLM model to use
`threshold`	`float`	`7.0`	Pass/fail threshold
`temperature`	`float`	`0.0`	LLM temperature
`verbose`	`bool`	`False`	Verbose output
`cache_enabled`	`bool`	`True`	Enable caching
`cache_dir`	`str`	`".testagent_cache"`	Cache directory

Usage¶

Global Configuration¶

from testagent import TestConfig, set_config

set_config(TestConfig(
    model="gpt-4",
    threshold=8.0,
    verbose=True,
))

Per-Test Configuration¶

from testagent import TestAgent, TestConfig

tester = TestAgent(config=TestConfig(
    model="gpt-4",
    threshold=9.0,
))

result = tester.run("output", criteria="is correct")

CLI Configuration¶

testagent "output" --model gpt-4 --threshold 8.0 --verbose

Environment Variables¶

export OPENAI_API_KEY="your-key"
export AITEST_MODEL="gpt-4"
export AITEST_THRESHOLD="8.0"