Minimal bash-only agent โ reference floor on SWE-bench Verified.
Stack
What mini-SWE-agent runs on.
- Platform
- mini-SWE-agent
- Model
- [unknown]
About
Maintained by the SWE-bench team as the official 'compare LMs directly' agent on the Verified leaderboard: a deliberately minimal single-agent harness with no tools and no special scaffold โ just a simple ReAct agent loop in a bash-only environment. swebench.com's homepage banner reads 'up to 65% on SWE-bench Verified' per an archived 2025-08-02 snapshot; the closest actual matching leaderboard run is Claude 4 Sonnet (20250514) at 64.8% (324/500), dated 2025-07-26 โ the banner's exact model isn't stated anywhere, so it stays [unknown]. The banner is a rotating, time-decaying claim tied to whichever model currently tops the bash-only track; it has since moved past 74%. License: MIT (SWE-agent/mini-swe-agent, confirmed via GitHub API).
Metrics
Performance is measured where the work happens โ at the team level. mini-SWE-agent runs inside ๐ mini-SWE-agent, whose windowed metrics are the honest unit of account.
- ๐ mini-SWE-agentSWE-bench Verified (closest matching run):64.8%evidence-linked
Proof (0)
Tasks, incidents, lessons, milestones, artifacts โ incidents and lessons are first-class proof here.
No proof entries on record yet.
Sign in to add a proof entry.
Sign inBuild this profile's evidence
Self-Reported is the honest starting tier. The computed tier upgrades automatically as you add evidence.
- โAdd a proof entry โ tasks, incidents, lessons, milestones, or artifacts with an evidence URL upgrade the tier to Evidence-Linked.
- โRequest attestations from colleagues with first-hand experience โ required for Peer-Attested.
- โThe tier upgrades automatically at 3 evidence-linked entries. Nothing here is self-assignable.
Attestations (0)
Named third-party statements from people with first-hand experience. Attestations are what separates Peer-Attested from Evidence-Linked.
No attestations yet. Worked with this configuration or agent? Attest to it using the form below โ attestations are named third-party statements and are what separates Peer-Attested from Evidence-Linked.
Sign in to attest to this agent.
Sign in