terminal-bench@2.0 Leaderboard

Note: submissions may not modify timeouts or resources
harbor run -d terminal-bench@2.0 -a "agent" -m "model" -k 5
Note: submissions may not modify timeouts or resources
harbor run -d terminal-bench@2.0 --agent-import-path "path.to.agent:SomeAgent" -k 5

Showing 69 entries

RankAgentModelDateAgent OrgModel Org

Accuracy

1
DroidClaude Opus 4.52025-12-11FactoryAnthropic

63.1%± 2.7

2
WarpMultiple2025-12-12WarpMultiple

61.2%± 3.0

3
Codex CLIGPT-5.1-Codex-Max2025-11-24OpenAIOpenAI

60.4%± 2.7

4
WarpMultiple2025-11-20WarpMultiple

59.1%± 2.8

5
II-AgentGemini 3 Pro2025-11-24Intelligent InternetGoogle

58.9%± 2.9

6
Abacus AI DesktopMultiple2025-12-11Abacus.AIMultiple

58.4%± 2.8

7
Codex CLIGPT-5.1-Codex2025-11-16OpenAIOpenAI

57.8%± 2.9

8
Terminus 2Claude Opus 4.52025-11-22StanfordAnthropic

57.8%± 2.5

9
GooseClaude Opus 4.52025-12-11BlockAnthropic

54.3%± 2.6

10
Terminus 2Gemini 3 Pro2025-11-18StanfordGoogle

54.2%± 2.4

11
Terminus 2GPT-5.22025-12-12StanfordOpenAI

54.0%± 2.9

12
WarpMultiple2025-11-11WarpMultiple

50.1%± 2.7

13
Codex CLIGPT-52025-11-04OpenAIOpenAI

49.6%± 2.9

14
Terminus 2GPT-5.12025-11-16StanfordOpenAI

47.6%± 2.8

15
Codex CLIGPT-5-Codex2025-11-04OpenAIOpenAI

44.3%± 2.7

16
OpenHandsGPT-52025-11-02OpenHandsOpenAI

43.8%± 3.0

17
Terminus 2GPT-5-Codex2025-10-31StanfordOpenAI

43.4%± 2.9

18
Codex CLIGPT-5.1-Codex-Mini2025-11-17OpenAIOpenAI

43.1%± 3.0

19
GooseClaude Sonnet 4.52025-12-11BlockAnthropic

43.1%± 2.6

20
Terminus 2Claude Sonnet 4.52025-10-31StanfordAnthropic

42.8%± 2.8

21
OpenHandsClaude Sonnet 4.52025-11-02OpenHandsAnthropic

42.6%± 2.8

22
Mini-SWE-AgentClaude Sonnet 4.52025-11-03PrincetonAnthropic

42.5%± 2.8

23
Mini-SWE-AgentGPT-5-Codex2025-11-03PrincetonOpenAI

41.3%± 2.8

24
Claude CodeClaude Sonnet 4.52025-11-04AnthropicAnthropic

40.1%± 2.9

25
Terminus 2Claude Opus 4.12025-10-31StanfordAnthropic

38.0%± 2.6

26
Terminus 2GPT-5.1-Codex2025-11-17StanfordOpenAI

36.9%± 3.2

27
OpenHandsClaude Opus 4.12025-11-02OpenHandsAnthropic

36.9%± 2.7

28
Terminus 2Kimi K2 Thinking2025-11-11StanfordMoonshot AI

35.7%± 2.8

29
GooseClaude Haiku 4.52025-12-11BlockAnthropic

35.5%± 2.9

30
Terminus 2GPT-52025-10-31StanfordOpenAI

35.2%± 3.1

31
Mini-SWE-AgentClaude Opus 4.12025-11-03PrincetonAnthropic

35.1%± 2.5

32
Claude CodeClaude Opus 4.12025-11-04AnthropicAnthropic

34.8%± 2.9

33
Mini-SWE-AgentGPT-52025-11-03PrincetonOpenAI

33.9%± 2.9

34
Terminus 2Gemini 2.5 Pro2025-10-31StanfordGoogle

32.6%± 3.0

35
Codex CLIGPT-5-Mini2025-11-04OpenAIOpenAI

31.9%± 3.0

36
Terminus 2MiniMax M22025-11-01StanfordMiniMax

30.0%± 2.7

37
Mini-SWE-AgentClaude Haiku 4.52025-11-03PrincetonAnthropic

29.8%± 2.5

38
OpenHandsGPT-5-Mini2025-11-02OpenHandsOpenAI

29.2%± 2.8

39
Terminus 2Claude Haiku 4.52025-10-31StanfordAnthropic

28.3%± 2.9

40
Terminus 2Kimi K2 Instruct2025-11-01StanfordMoonshot AI

27.8%± 2.5

41
Claude CodeClaude Haiku 4.52025-11-04AnthropicAnthropic

27.5%± 2.8

42
OpenHandsGrok 42025-11-02OpenHandsxAI

27.2%± 3.1

43
OpenHandsKimi K2 Instruct2025-11-02OpenHandsMoonshot AI

26.7%± 2.7

44
Dakou AgentQwen 3 Coder 480B2025-12-11iflowAlibaba

26.3%± 2.4

45
Mini-SWE-AgentGemini 2.5 Pro2025-11-03PrincetonGoogle

26.1%± 2.5

46
Mini-SWE-AgentGrok Code Fast 12025-11-03PrincetonxAI

25.8%± 2.6

47
OpenHandsQwen 3 Coder 480B2025-11-02OpenHandsAlibaba

25.4%± 2.6

48
Mini-SWE-AgentGrok 42025-11-03PrincetonxAI

25.4%± 2.9

49
Terminus 2GLM 4.62025-11-01StanfordZ.ai

24.5%± 2.4

50
Terminus 2GPT-5-Mini2025-10-31StanfordOpenAI

24.0%± 2.5

51
Terminus 2Qwen 3 Coder 480B2025-11-01StanfordAlibaba

23.9%± 2.8

52
Terminus 2Grok 42025-10-31StanfordxAI

23.1%± 2.9

53
Mini-SWE-AgentGPT-5-Mini2025-11-03PrincetonOpenAI

22.2%± 2.6

54
Gemini CLIGemini 2.5 Pro2025-11-04GoogleGoogle

19.6%± 2.9

55
Terminus 2GPT-OSS-120B2025-11-01StanfordOpenAI

18.7%± 2.7

56
Mini-SWE-AgentGemini 2.5 Flash2025-11-03PrincetonGoogle

17.1%± 2.5

57
Terminus 2Gemini 2.5 Flash2025-10-31StanfordGoogle

16.9%± 2.4

58
OpenHandsGemini 2.5 Pro2025-11-02OpenHandsGoogle

16.4%± 2.8

59
OpenHandsGemini 2.5 Flash2025-11-02OpenHandsGoogle

16.4%± 2.4

60
Gemini CLIGemini 2.5 Flash2025-11-04GoogleGoogle

15.4%± 2.3

61
Mini-SWE-AgentGPT-OSS-120B2025-11-03PrincetonOpenAI

14.2%± 2.3

62
Terminus 2Grok Code Fast 12025-10-31StanfordxAI

14.2%± 2.5

63
OpenHandsClaude Haiku 4.52025-11-02OpenHandsAnthropic

13.9%± 2.7

64
Codex CLIGPT-5-Nano2025-11-04OpenAIOpenAI

11.5%± 2.3

65
OpenHandsGPT-5-Nano2025-11-02OpenHandsOpenAI

9.9%± 2.1

66
Terminus 2GPT-5-Nano2025-10-31StanfordOpenAI

7.9%± 1.9

67
Mini-SWE-AgentGPT-5-Nano2025-11-03PrincetonOpenAI

7.0%± 1.9

68
Mini-SWE-AgentGPT-OSS-20B2025-11-03PrincetonOpenAI

3.4%± 1.4

69
Terminus 2GPT-OSS-20B2025-11-01StanfordOpenAI

3.1%± 1.5

Results in this leaderboard correspond to terminal-bench@2.0.

Send us an email to submit your agents' results: alex@laude.org mikeam@cs.stanford.edu

A Terminal-Bench team member ran the evaluation and verified the results.

Displaying 69 of 69 available entries