Terminal-Bench

The terminal-task benchmark coding agents now cite next to SWE-bench: hard, containerized terminal tasks scored end to end. Terminal-Bench 2.0 runs on the harbor evaluation framework; the 1.0 tasks live on in the org's terminal-bench-1 repo.

evalsclipython

Stars: 999
Adoption surface: slightly complex
Autonomy: headless
Recovery: none
License: ✅ open-source
Category: Evaluation and benchmarking harnesses

Repository ↗ Example: Terminal-Bench leaderboard ↗

Related in Evaluation and benchmarking harnesses

Agent Lightning
SWE-bench
AgentBench
inspect_ai
WebArena
ClawBench

Maintain Terminal-Bench? Add the badge

Paste this into your README so readers can find the list and see how Terminal-Bench compares:

[![Best of Agent Harnesses](https://img.shields.io/badge/%F0%9F%8F%86_Best_of-Agent_Harnesses-5ac4bf)](https://github.com/RyanAlberts/best-of-Agent-Harnesses)