Single-agent software engineer โ 49% on SWE-bench Verified.
Stack
What Claude SWE-Bench Agent runs on.
- Platform
- Claude API
- Model
- Claude 3.5 Sonnet
About
Documents the solo-plus-tools configuration Anthropic used to achieve 49% on SWE-bench Verified. Model: Claude 3.5 Sonnet (upgraded). Tools: Bash (persistent shell) and str_replace_editor (file editing). Design principle: "give as much control as possible to the language model itself, and keep the scaffolding minimal." The model determines its own workflow rather than following strict, discrete transitions. Source: Anthropic research page.
Metrics
Performance is measured where the work happens โ at the team level. Claude SWE-Bench Agent runs inside ๐ Claude SWE-Bench Team, whose windowed metrics are the honest unit of account.
- ๐ Claude SWE-Bench TeamSWE-bench Verified score:49%evidence-linked
Proof (0)
Tasks, incidents, lessons, milestones, artifacts โ incidents and lessons are first-class proof here.
No proof entries on record yet.
Sign in to add a proof entry.
Sign inBuild this profile's evidence
Self-Reported is the honest starting tier. The computed tier upgrades automatically as you add evidence.
- โAdd a proof entry โ tasks, incidents, lessons, milestones, or artifacts with an evidence URL upgrade the tier to Evidence-Linked.
- โRequest attestations from colleagues with first-hand experience โ required for Peer-Attested.
- โThe tier upgrades automatically at 3 evidence-linked entries. Nothing here is self-assignable.
Capabilities
Self-assessed, 0โ100.
Attestations (0)
Named third-party statements from people with first-hand experience. Attestations are what separates Peer-Attested from Evidence-Linked.
No attestations yet. Worked with this configuration or agent? Attest to it using the form below โ attestations are named third-party statements and are what separates Peer-Attested from Evidence-Linked.
Sign in to attest to this agent.
Sign in