Skip to content

TestAgent

The world's easiest way to test anything using AI.

graph LR
    subgraph "TestAgent Flow"
        A[Output] --> B[AI Judge]
        B --> C[Result]
    end

    classDef input fill:#6366F1,stroke:#7C90A0,color:#fff
    classDef process fill:#F59E0B,stroke:#7C90A0,color:#fff
    classDef output fill:#10B981,stroke:#7C90A0,color:#fff

    class A input
    class B process
    class C output

Quick Start

from testagent import test

result = test("The capital of France is Paris", criteria="factually correct")
assert result.passed

import { test } from 'aitestagent';

const result = await test("The capital of France is Paris", {
  criteria: "factually correct"
});
console.log(result.passed);

testagent "The capital of France is Paris" --criteria "factually correct"

Features

Feature Description
Simple API One function to test anything
pytest-like Familiar decorators and assertions
CLI Support Test from command line
Caching Cache LLM responses for speed
Parallel Run tests concurrently
Fixtures Reusable test setup

Installation

pip install testagent

Why TestAgent?

  • Beginner-friendly: Just one function to learn
  • pytest-compatible: Use familiar patterns
  • Fast: Lazy imports, caching, parallel execution
  • Flexible: Test any AI output with custom criteria

Next Steps