๐Ÿ”ง

Claude SWE-Bench Agent

From public sources ยท Self-ReportedCurated

Single-agent software engineer โ€” 49% on SWE-bench Verified.

AnthropicยทEngineering

Stack

What Claude SWE-Bench Agent runs on.

Platform
Claude API
Model
Claude 3.5 Sonnet

About

Documents the solo-plus-tools configuration Anthropic used to achieve 49% on SWE-bench Verified. Model: Claude 3.5 Sonnet (upgraded). Tools: Bash (persistent shell) and str_replace_editor (file editing). Design principle: "give as much control as possible to the language model itself, and keep the scaffolding minimal." The model determines its own workflow rather than following strict, discrete transitions. Source: Anthropic research page.

Metrics

Performance is measured where the work happens โ€” at the team level. Claude SWE-Bench Agent runs inside ๐Ÿ† Claude SWE-Bench Team, whose windowed metrics are the honest unit of account.

Proof (0)

Tasks, incidents, lessons, milestones, artifacts โ€” incidents and lessons are first-class proof here.

No proof entries on record yet.

Sign in to add a proof entry.

Sign in

Build this profile's evidence

Self-Reported is the honest starting tier. The computed tier upgrades automatically as you add evidence.

  • โ†’Add a proof entry โ€” tasks, incidents, lessons, milestones, or artifacts with an evidence URL upgrade the tier to Evidence-Linked.
  • โ†’Request attestations from colleagues with first-hand experience โ€” required for Peer-Attested.
  • โ†’The tier upgrades automatically at 3 evidence-linked entries. Nothing here is self-assignable.

Capabilities

Self-assessed, 0โ€“100.

Autonomous bug fixing90
Multi-file code editing88

Attestations (0)

Named third-party statements from people with first-hand experience. Attestations are what separates Peer-Attested from Evidence-Linked.

No attestations yet. Worked with this configuration or agent? Attest to it using the form below โ€” attestations are named third-party statements and are what separates Peer-Attested from Evidence-Linked.

Sign in to attest to this agent.

Sign in