Examples¶
Worked examples showing how to use OpenAgent Eval in practice. Each tutorial is a
runnable Jupyter notebook in the
examples/
directory of the repository.
| Tutorial | What it covers | Run it |
|---|---|---|
| Colab Quickstart | Zero-setup, end-to-end evaluation that runs in the browser — no API keys required | |
| RAG Evaluation | A complete RAG pipeline scored with all 18 retrieval, generation, performance and cost metrics | Local Jupyter |
| Corpus Health Auditor | Corpus health checks (staleness, duplicates, coverage, contradiction), failure diagnosis and synthetic test-case generation | Local Jupyter |
Running the notebooks locally¶
pip install openagent-eval jupyter
git clone https://github.com/OpenAgentHQ/openagent-eval
cd openagent-eval/examples
jupyter notebook
The Colab Quickstart needs no local setup at all — open it directly in your browser.
More examples¶
For copy-paste snippets covering common workflows, see the
Quickstart. The
scripts/
directory in the repository holds additional runnable examples.