Command-line interface for TestAgent.
Test any output with AI.
| Option | Short | Type | Default | Description |
|--------|-------|------|---------|-------------|
| --criteria | -c | str | - | Evaluation criteria |
--criteria
-c
str
| --expected | -e | str | - | Expected output |
--expected
-e
| --threshold | -t | float | 7.0 | Pass threshold |
--threshold
-t
float
7.0
| --model | -m | str | - | LLM model |
--model
-m
| --verbose | -v | bool | False | Verbose output |
--verbose
-v
bool
False
| --json | | bool | False | JSON output |
--json
Test against criteria.
---
Run AI tests.
| --pattern | -p | str | - | File pattern |
--pattern
-p
| --durations | | int | - | Show N slowest |
--durations
int
| --durations-min | | float | 0.005 | Min duration |
--durations-min
0.005
| --exitfirst | -x | bool | False | Exit on first failure |
--exitfirst
-x
Discover tests without running.
| Option | Short | Type | Description |
|--------|-------|------|-------------|
| --pattern | -p | str | File pattern |
Clear the test cache.
Show cache statistics.
Show version.
| Code | Meaning |
|------|---------|
| 0 | All tests passed |
0
| 1 | Some tests failed |
1
| 2 | Error occurred |
2
| 5 | No tests collected |
5