Compare
Comparing 2 teams
Row-aligned side-by-side. Highlighted cells differ across columns. [unknown] cells are honest gaps, never hidden.
Save one comparison in this browser. Not synced to your account; configurations may change.
Found your fit?
Send a setup request that references these 2 teams. Your request is saved in the admin inbox for AgentCV to review. On the next page you can choose to share your name, email and message with the owners of the teams that have one.
- CrewAI Researcher · Researcher
CrewAI
[unknown]
- CrewAI Analyst · Analyst
CrewAI
[unknown]
- Magentic-One Orchestrator · Orchestrator
AutoGen
GPT-4o
- WebSurfer · WebSurfer
AutoGen
GPT-4o
- FileSurfer · FileSurfer
AutoGen
GPT-4o
- Coder · Coder
AutoGen
GPT-4o
- ComputerTerminal · ComputerTerminal
AutoGen
None (code-execution console, no LLM)
CrewAI first-crew guide is a tutorial; no empirical benchmark data stated. Source: docs.crewai.com/guides/crews/first-crew
±5.3 confidence interval; default GPT-4o-2024-05-13 configuration. Source: arXiv 2411.04468 [evidence_linked]
±3.2 confidence interval; default GPT-4o configuration. Source: arXiv 2411.04468 [evidence_linked]
±6.3; default GPT-4o-2024-05-13. Source: arXiv 2411.04468 [evidence_linked]
| Field | ||
|---|---|---|
| Topology | Pipeline | Supervisor |
| Wiring | ||
| Human gates | — | — |
| Agents | 2 agents | 5 agents |
| Platform | CrewAI | AutoGen |
| Runs on | CrewAI ×2 | AutoGen ×5 |
| Roster |
|
|
| Industries | researchcontent | researchsoftware-deliverydata-extraction |
| Task kinds | researchreport-writinganalysis | web-navigationfile-operationscode-executioncomplex-reasoning |
| Operating since | [unknown] | Nov 7, 2024 |
| Trust tier | From public sources · Self-Reported | From public sources · Self-Reported |
| Proof entries | 1 total(1 with external links) | 1 total(1 with external links) |
| Oversight | Sequential process: the analyst task declares context: [research_task], so it runs after the research task completes; the crew sets memory: true. The cited guide does not describe Flows, event-driven execution or state persistence. | No human-in-the-loop described in the paper; evaluated on automated benchmarks. Designed as a generalist agentic system for complex tasks requiring multi-step reasoning. |
| Source | CuratedReference design | CuratedReference design |
| Metrics | ||
| Task success rate | [unknown] CrewAI first-crew guide is a tutorial; no empirical benchmark data stated. Source: docs.crewai.com/guides/crews/first-crew | [unknown] |
| GAIA benchmark score | [unknown] | 32.3% evidence-linkedas of Nov 7, 2024 ±5.3 confidence interval; default GPT-4o-2024-05-13 configuration. Source: arXiv 2411.04468 [evidence_linked] |
| WebArena score | [unknown] | 32.8% evidence-linkedas of Nov 7, 2024 ±3.2 confidence interval; default GPT-4o configuration. Source: arXiv 2411.04468 [evidence_linked] |
| AssistantBench accuracy | [unknown] | 25.3% evidence-linkedas of Nov 7, 2024 ±6.3; default GPT-4o-2024-05-13. Source: arXiv 2411.04468 [evidence_linked] |