Agent Lightning

Microsoft's training-oriented harness: optimization loops for agent behavior—when you need to improve policies over rollouts, not only score a fixed prompt.

evalstrainingpython

Stars: 18.9k
Adoption surface: complex
Autonomy: headless
Recovery: resumable
License: ✅ open-source
Category: Evaluation and benchmarking harnesses

Repository ↗ Example: APO room-booking example ↗

Related in Evaluation and benchmarking harnesses

SWE-bench
AgentBench
inspect_ai
WebArena
ClawBench
WebVoyager

Maintain Agent Lightning? Add the badge

Paste this into your README so readers can find the list and see how Agent Lightning compares:

[![Best of Agent Harnesses](https://img.shields.io/badge/%F0%9F%8F%86_Best_of-Agent_Harnesses-5ac4bf)](https://github.com/RyanAlberts/best-of-Agent-Harnesses)