πŸ•ΉοΈ

Magentic-One

From public sources Β· Self-ReportedCuratedReference design

Microsoft Research generalist 5-agent system: GAIA 32.33%, WebArena 32.8%.

Microsoft ResearchΒ· Introduced Nov 7, 2024Β· Reference design

Run this team?

Claim it to edit the profile, add proof and be notified when someone asks about it.

Claim this profile

The claim covers the owner profile Microsoft Research, with its teams.

We review claims within 2 business days. The decision appears on your account page.

Reference design β€” not an operated team.

Documented from a research paper, benchmark prototype or one-off experiment; no one is known to run this team in production.

The source: Research system evaluated on benchmarks.

Documented by AgentCV from public sources β€” not submitted by this team.

Not claimed by or endorsed by the team or its organization. Metrics are cited only as the sources state them; absent metrics render as [unknown].

Sources: arXiv 2411.04468 β€” Magentic-One (arxiv.org)

Is this your team? Claim it Β· Ask us to remove it

Recent activity

Version cuts and proof, newest first β€” the living track record.

  1. Artifact Β· Magentic-One paper published (arXiv 2411.04468) Β· 1y ago

Spec sheet

The benchmark fields β€” designed for comparison across teams.

Topology
Supervisor
Agent count
5
Platform
AutoGen
Runs on
AutoGen Γ—5
Industries
researchsoftware-deliverydata-extraction
Task kinds
web-navigationfile-operationscode-executioncomplex-reasoning
Trust tier
From public sources Β· Self-Reported
Proof entries
1

Topology & roster

Supervisor

Hierarchical. The Orchestrator (lead agent) plans, tracks progress, and re-plans to recover from errors, directing four specialist agents: WebSurfer (web browser), FileSurfer (file navigation), Coder (Python), and ComputerTerminal (code execution). Modular: "agents to be added or removed from the team without additional prompt tuning or training."

System wiring

Typical Supervisor layout β€” schematic, not verified wiring
Typical role-level schematic β€” not verified wiringdirectsdispatchesdispatchesreportsreportsHuman operatorHumanoperatorHUMANGATESupervisorSupervisorORCHESTRATORWorker agent AWorker agentABUILDERWorker agent BWorker agentBBUILDER
Node details

Typical Supervisor layout β€” schematic, not verified wiring

HumanHuman operatorHuman gate
Tool
Human operator
Autonomy
Human-gated
Sends
  • directs β†’ Supervisor
OrchestratorSupervisor
Tool
Supervisor
Autonomy
Runs autonomously
Sends
  • dispatches β†’ Worker agent A
  • dispatches β†’ Worker agent B
Receives
  • directs ← Human operator
  • reports ← Worker agent A
  • reports ← Worker agent B
BuilderWorker agent A
Tool
Worker agent A
Autonomy
Runs autonomously
Sends
  • reports β†’ Supervisor
Receives
  • dispatches ← Supervisor
BuilderWorker agent B
Tool
Worker agent B
Autonomy
Runs autonomously
Sends
  • reports β†’ Supervisor
Receives
  • dispatches ← Supervisor

How a typical Supervisor team handles a task

Typical Supervisor layout β€” schematic, not verified wiring

  1. Task arrives

    Human operator directs Supervisor.

  2. The orchestrator routes the work

    Supervisor dispatches build work to Worker agent A and dispatches build work to Worker agent B.

  3. The builders execute

    Worker agent A and Worker agent B build the work.

  4. Human holds the last word

    Human operator holds final approval.

Replicate a typical Supervisor setup

Typical Supervisor layout β€” schematic, not verified wiring

Ingredients

  • HumanHuman operator
  • OrchestratorSupervisor
  • BuilderWorker agent A
  • BuilderWorker agent B

Setup order

  1. 1.Stand up the orchestrator: Supervisor.
  2. 2.Wire Worker agent A: it receives "dispatches" from Supervisor and sends "reports" to Supervisor. Wire Worker agent B: it receives "dispatches" from Supervisor and sends "reports" to Supervisor.
  3. 3.Declare the human gate: Human operator holds final approval.

Performance metrics

Windowed metrics with provenance. [unknown] means it was not tracked β€” an honest hole beats an invented figure.

GAIA benchmark score
32.3%
evidence-linked

Β±5.3 confidence interval; default GPT-4o-2024-05-13 configuration. Source: arXiv 2411.04468 [evidence_linked]

as of Nov 7, 2024
WebArena score
32.8%
evidence-linked

Β±3.2 confidence interval; default GPT-4o configuration. Source: arXiv 2411.04468 [evidence_linked]

as of Nov 7, 2024
AssistantBench accuracy
25.3%
evidence-linked

Β±6.3; default GPT-4o-2024-05-13. Source: arXiv 2411.04468 [evidence_linked]

as of Nov 7, 2024

Token economics

Cost transparency is part of the honesty architecture. [unknown] means it was not tracked β€” not that it is zero.

No cost metrics on record. Cost tracking is hard across runtimes; honest absence beats invented figures.

Blueprint

Operational DNA β€” why it works, how it was built, and how it is overseen. Not files for sale; knowledge of the design.

Why it works

Specialist agents each own a specific skill (web, files, code) that the Orchestrator cannot perform directly. The Orchestrator re-plans on error rather than failing silently. Modularity allows extending the team without retraining. GAIA benchmark: 32.33% (Β±5.3) with GPT-4o; 38.00% (Β±5.5) with GPT-4o + o1-preview.

How it was built

Built on AutoGen (Microsoft). Default model: GPT-4o-2024-05-13, with optional integration of o1-preview for enhanced reasoning. Evaluation tool AutoGenBench provides built-in controls for repetition and isolation. Open-source.

Oversight model

No human-in-the-loop described in the paper; evaluated on automated benchmarks. Designed as a generalist agentic system for complex tasks requiring multi-step reasoning.

Proof (1)

The team's shared track record β€” tasks, incidents, lessons, milestones. Per-entry provenance tags are always visible.

  1. ArtifactNov 7, 2024evidence-linked

    Magentic-One paper published (arXiv 2411.04468)

    Five-agent system achieves GAIA 32.33% (Β±5.3), WebArena 32.8% (Β±3.2), AssistantBench 25.3% accuracy (Β±6.3) with GPT-4o. With o1-preview: GAIA 38.00% (Β±5.5).

    https://arxiv.org/abs/2411.04468

Sign in to add a proof entry.

Sign in

Attestations (0)

Named third-party statements from people with first-hand experience. Attestations are what separates Peer-Attested from Evidence-Linked.

No attestations yet. Worked with this configuration or agent? Attest to it using the form below β€” attestations are named third-party statements and are what separates Peer-Attested from Evidence-Linked.

Sign in to attest to this team.

Sign in