Skip to content

Examples

Worked examples showing how to use OpenAgent Eval in practice. Each tutorial is a runnable Jupyter notebook in the examples/ directory of the repository.

Tutorial What it covers Run it
Colab Quickstart Zero-setup, end-to-end evaluation that runs in the browser — no API keys required Open In Colab
RAG Evaluation A complete RAG pipeline scored with all 18 retrieval, generation, performance and cost metrics Local Jupyter
Corpus Health Auditor Corpus health checks (staleness, duplicates, coverage, contradiction), failure diagnosis and synthetic test-case generation Local Jupyter

Running the notebooks locally

pip install openagent-eval jupyter
git clone https://github.com/OpenAgentHQ/openagent-eval
cd openagent-eval/examples
jupyter notebook

The Colab Quickstart needs no local setup at all — open it directly in your browser.

More examples

For copy-paste snippets covering common workflows, see the Quickstart. The scripts/ directory in the repository holds additional runnable examples.