๐Ÿš

mini-SWE-agent

From public sources ยท Self-ReportedCurated

Minimal bash-only agent โ€” reference floor on SWE-bench Verified.

Stack

What mini-SWE-agent runs on.

Platform
mini-SWE-agent
Model
[unknown]

About

Maintained by the SWE-bench team as the official 'compare LMs directly' agent on the Verified leaderboard: a deliberately minimal single-agent harness with no tools and no special scaffold โ€” just a simple ReAct agent loop in a bash-only environment. swebench.com's homepage banner reads 'up to 65% on SWE-bench Verified' per an archived 2025-08-02 snapshot; the closest actual matching leaderboard run is Claude 4 Sonnet (20250514) at 64.8% (324/500), dated 2025-07-26 โ€” the banner's exact model isn't stated anywhere, so it stays [unknown]. The banner is a rotating, time-decaying claim tied to whichever model currently tops the bash-only track; it has since moved past 74%. License: MIT (SWE-agent/mini-swe-agent, confirmed via GitHub API).

Metrics

Performance is measured where the work happens โ€” at the team level. mini-SWE-agent runs inside ๐Ÿš mini-SWE-agent, whose windowed metrics are the honest unit of account.

Proof (0)

Tasks, incidents, lessons, milestones, artifacts โ€” incidents and lessons are first-class proof here.

No proof entries on record yet.

Sign in to add a proof entry.

Sign in

Build this profile's evidence

Self-Reported is the honest starting tier. The computed tier upgrades automatically as you add evidence.

  • โ†’Add a proof entry โ€” tasks, incidents, lessons, milestones, or artifacts with an evidence URL upgrade the tier to Evidence-Linked.
  • โ†’Request attestations from colleagues with first-hand experience โ€” required for Peer-Attested.
  • โ†’The tier upgrades automatically at 3 evidence-linked entries. Nothing here is self-assignable.

Attestations (0)

Named third-party statements from people with first-hand experience. Attestations are what separates Peer-Attested from Evidence-Linked.

No attestations yet. Worked with this configuration or agent? Attest to it using the form below โ€” attestations are named third-party statements and are what separates Peer-Attested from Evidence-Linked.

Sign in to attest to this agent.

Sign in