13 个模型与 4 个 Agent 在 Go、Java、Python、Rust 和 TS SWE 任务上的表现
英文标题：🔶 13 Models and 4 Agents on SWE Tasks: Go, Java, Python, Rust, TS
这份结果片段汇总了 13 个模型和 4 个 Agent 在 Go、Java、Python、Rust、TS 等软件工程（SWE）任务上的测试数据。已给出的 17 条有效结果中，首项百分比指标最高为 64.5%±1.41%，最低为 17.1%±1.07%；对应的另一项百分比指标范围为 36.9% 至 81.1%。单次成本字段从 0.10 美元到 4.40 美元不等，且多数记录显示较高的缓存命中比例。大量模型条目尚未提供结果，开发者在据此选型时应同时关注性能、成本、Token 消耗和缓存使用情况。
725.9 KB
725.9 KB
中文
注：原始文本未提供各指标列的名称；以下按原始字段顺序保留数据。空白条目及 N/A 均按原文保留。
| 序号 | 模型/条目 | 字段 1 | 字段 2 | 字段 3 | 字段 4 |
|---|---|---|---|---|---|
| 1 | 64.5%± 1.41% | 78.4% | $4.40 | 2,518,30894.9% cached | |
| 2 | 63.8%± 0.60% | 77.5% | $1.47 | 2,429,42492.6% cached | |
| 3 | 63.4%± 1.35% | 74.8% | $3.47 | 4,322,14395.7% cached | |
| 4 | 62.9%± 1.19% | 81.1% | $1.40 | 5,524,89292.1% cached | |
| 5 | 62.3%± 1.83% | 79.3% | $0.85 | 605,34084.7% cached | |
| 6 | 61.8%± 0.54% | 73.9% | $0.81 | 1,684,50185.9% cached | |
| 7 | 60.4%± 1.03% | 75.7% | $3.39 | 3,341,58193.4% cached | |
| 8 | 58.0%± 1.29% | 73.0% | $1.59 | 2,070,97694.6% cached | |
| 9 | 56.8%± 0.94% | 74.8% | $1.43 | 4,645,61796.4% cached | |
| 10 | 51.7%± 0.84% | 65.8% | $0.41 | 1,827,00294.3% cached | |
| 11 | 47.2%± 1.13% | 69.4% | $0.95 | 13,869,45997.0% cached | |
| 12 | 46.5%± 0.54% | 65.8% | $0.10 | 4,687,98795.7% cached | |
| 13 | 43.6%± 1.47% | 59.5% | $0.11 | 395,52285.2% cached | |
| 14 | 40.2%± 1.29% | 64.0% | $0.15 | 3,955,41491.2% cached | |
| 15 | 31.2%± 1.68% | 57.7% | $0.62 | 3,078,97076.8% cached | |
| 16 | 24.7%± 0.79% | 43.2% | $0.27 | 3,726,06187.5% cached | |
| 17 | 17.1%± 1.07% | 36.9% | $0.99 | 5,939,22772.3% cached | |
| 18 | N/A | N/A | N/A | N/A | |
| 19 | N/A | N/A | N/A | N/A | |
| 20 | N/A | N/A | N/A | N/A | |
| 21 | N/A | N/A | N/A | N/A | |
| 22 | N/A | N/A | N/A | N/A | |
| 23 | N/A | N/A | N/A | N/A | |
| 24 | N/A | N/A | N/A | N/A | |
| 25 | N/A | N/A | N/A | N/A | |
| 26 | N/A | N/A | N/A | N/A | |
| 27 | N/A | N/A | N/A | N/A | |
| 28 | N/A | N/A | N/A | N/A | |
| 29 | N/A | N/A | N/A | N/A | |
| 30 | N/A | N/A | N/A | N/A | |
| 31 | N/A | N/A | N/A | N/A | |
| 32 | N/A | N/A | N/A | N/A | |
| 33 | N/A | N/A | N/A | N/A | |
| 34 | MistralDevstral-2-123B-Instruct-2512 | N/A | N/A | N/A | N/A |
| 35 | MistralDevstral-Small-2-24B-Instruct-2512 | N/A | N/A | N/A | N/A |
| 36 | N/A | N/A | N/A | N/A | |
| 37 | N/A | N/A | N/A | N/A | |
| 38 | N/A | N/A | N/A | N/A | |
| 39 | N/A | N/A | N/A | N/A | |
| 40 | N/A | N/A | N/A | N/A | |
| 41 | N/A | N/A | N/A | N/A | |
| 42 | N/A | N/A | N/A | N/A | |
| 43 | N/A | N/A | N/A | N/A | |
| 44 | Geminigemini-2.5-flash-preview-05-20 no-thinking | N/A | N/A | N/A | N/A |
| 45 | Geminigemini-2.5-flash-preview-05-20 no-thinking | N/A | N/A | N/A | N/A |
| 46 | N/A | N/A | N/A | N/A | |
| 47 | N/A | N/A | N/A | N/A | |
| 48 | N/A | N/A | N/A | N/A | |
| 49 | N/A | N/A | N/A | N/A | |
| 50 | N/A | N/A | N/A | N/A | |
| 51 | N/A | N/A | N/A | N/A | |
| 52 | N/A | N/A | N/A | N/A | |
| 53 | N/A | N/A | N/A | N/A | |
| 54 | N/A | N/A | N/A | N/A | |
| 55 | N/A | N/A | N/A | N/A | |
| 56 | N/A | N/A | N/A | N/A | |
| 57 | N/A | N/A | N/A | N/A | |
| 58 | N/A | N/A | N/A | N/A | |
| 59 | N/A | N/A | N/A | N/A | |
| 60 | N/A | N/A | N/A | N/A | |
| 61 | N/A | N/A | N/A | N/A | |
| 62 | N/A | N/A | N/A | N/A | |
| 63 | N/A | N/A | N/A | N/A | |
| 64 | N/A | N/A | N/A | N/A | |
| 65 | N/A | N/A | N/A | N/A | |
| 66 | OpenAIgpt-5-mini-2025-08-07-high | N/A | N/A | N/A | N/A |
| 67 | OpenAIgpt-5-mini-2025-08-07-medium | N/A | N/A | N/A | N/A |
| 68 | N/A | N/A | N/A | N/A | |
| 69 | N/A | N/A | N/A | N/A | |
| 70 | OpenAIgpt-5.2-2025-12-11-medium | N/A | N/A | N/A | N/A |
| 71 | N/A | N/A | N/A | N/A | |
| 72 | N/A | N/A | N/A | N/A | |
| 73 | N/A | N/A | N/A | N/A | |
| 74 | N/A | N/A | N/A | N/A | |
| 75 | OpenAIgpt-5.4-2026-03-05-medium | N/A | N/A | N/A | N/A |
| 76 | OpenAIgpt-5.5-2026-04-23-medium | N/A | N/A | N/A | N/A |
| 77 | N/A | N/A | N/A | N/A | |
| 78 | N/A | N/A | N/A | N/A | |
| 79 | N/A | N/A | N/A | N/A | |
| 80 | N/A | N/A | N/A | N/A | |
| 81 | N/A | N/A | N/A | N/A | |
| 82 | N/A | N/A | N/A | N/A | |
| 83 | N/A | N/A | N/A | N/A | |
| 84 | N/A | N/A | N/A | N/A | |
| 85 | N/A | N/A | N/A | N/A | |
| 86 | N/A | N/A | N/A | N/A | |
| 87 | N/A | N/A | N/A | N/A | |
| 88 | N/A | N/A | N/A | N/A | |
| 89 | N/A | N/A | N/A | N/A | |
| 90 | N/A | N/A | N/A | N/A | |
| 91 | MetaLlama-4-Maverick-17B-128E-Instruct | N/A | N/A | N/A | N/A |
| 92 | MetaLlama-4-Scout-17B-16E-Instruct | N/A | N/A | N/A | N/A |
| 93 | N/A | N/A | N/A | N/A | |
| 94 | N/A | N/A | N/A | N/A | |
| 95 | N/A | N/A | N/A | N/A | |
| 96 | N/A | N/A | N/A | N/A | |
| 97 | N/A | N/A | N/A | N/A | |
| 98 | N/A | N/A | N/A | N/A | |
| 99 | N/A | N/A | N/A | N/A | |
| 100 | QwenQwen2.5-Coder-32B-Instruct | N/A | N/A | N/A | N/A |
| 101 | N/A | N/A | N/A | N/A | |
| 102 | QwenQwen3-235B-A22B no-thinking | N/A | N/A | N/A | N/A |
| 103 | N/A | N/A | N/A | N/A | |
| 104 | QwenQwen3-235B-A22B-Instruct-2507 | N/A | N/A | N/A | N/A |
| 105 | QwenQwen3-235B-A22B-Thinking-2507 | N/A | N/A | N/A | N/A |
| 106 | QwenQwen3-30B-A3B-Instruct-2507 | N/A | N/A | N/A | N/A |
| 107 | QwenQwen3-30B-A3B-Thinking-2507 | N/A | N/A | N/A | N/A |
| 108 | N/A | N/A | N/A | N/A | |
| 109 | N/A | N/A | N/A | N/A | |
| 110 | N/A | N/A | N/A | N/A | |
| 111 | QwenQwen3-Coder-30B-A3B-Instruct | N/A | N/A | N/A | N/A |
| 112 | QwenQwen3-Coder-480B-A35B-Instruct | N/A | N/A | N/A | N/A |
| 113 | N/A | N/A | N/A | N/A | |
| 114 | QwenQwen3-Next-80B-A3B-Instruct | N/A | N/A | N/A | N/A |
| 115 | N/A | N/A | N/A | N/A | |
| 116 | N/A | N/A | N/A | N/A | |
| 117 | N/A | N/A | N/A | N/A |
English / 原文
1| | 64.5%± 1.41%| 78.4%| $4.40| 2,518,30894.9% cached
2| | 63.8%± 0.60%| 77.5%| $1.47| 2,429,42492.6% cached
3| | 63.4%± 1.35%| 74.8%| $3.47| 4,322,14395.7% cached
4| | 62.9%± 1.19%| 81.1%| $1.40| 5,524,89292.1% cached
5| | 62.3%± 1.83%| 79.3%| $0.85| 605,34084.7% cached
6| | 61.8%± 0.54%| 73.9%| $0.81| 1,684,50185.9% cached
7| | 60.4%± 1.03%| 75.7%| $3.39| 3,341,58193.4% cached
8| | 58.0%± 1.29%| 73.0%| $1.59| 2,070,97694.6% cached
9| | 56.8%± 0.94%| 74.8%| $1.43| 4,645,61796.4% cached
10| | 51.7%± 0.84%| 65.8%| $0.41| 1,827,00294.3% cached
11| | 47.2%± 1.13%| 69.4%| $0.95| 13,869,45997.0% cached
12| | 46.5%± 0.54%| 65.8%| $0.10| 4,687,98795.7% cached
13| | 43.6%± 1.47%| 59.5%| $0.11| 395,52285.2% cached
14| | 40.2%± 1.29%| 64.0%| $0.15| 3,955,41491.2% cached
15| | 31.2%± 1.68%| 57.7%| $0.62| 3,078,97076.8% cached
16| | 24.7%± 0.79%| 43.2%| $0.27| 3,726,06187.5% cached
17| | 17.1%± 1.07%| 36.9%| $0.99| 5,939,22772.3% cached
18| | N/A| N/A| N/A| N/A
19| | N/A| N/A| N/A| N/A
20| | N/A| N/A| N/A| N/A
21| | N/A| N/A| N/A| N/A
22| | N/A| N/A| N/A| N/A
23| | N/A| N/A| N/A| N/A
24| | N/A| N/A| N/A| N/A
25| | N/A| N/A| N/A| N/A
26| | N/A| N/A| N/A| N/A
27| | N/A| N/A| N/A| N/A
28| | N/A| N/A| N/A| N/A
29| | N/A| N/A| N/A| N/A
30| | N/A| N/A| N/A| N/A
31| | N/A| N/A| N/A| N/A
32| | N/A| N/A| N/A| N/A
33| | N/A| N/A| N/A| N/A
34| MistralDevstral-2-123B-Instruct-2512| N/A| N/A| N/A| N/A
35| MistralDevstral-Small-2-24B-Instruct-2512| N/A| N/A| N/A| N/A
36| | N/A| N/A| N/A| N/A
37| | N/A| N/A| N/A| N/A
38| | N/A| N/A| N/A| N/A
39| | N/A| N/A| N/A| N/A
40| | N/A| N/A| N/A| N/A
41| | N/A| N/A| N/A| N/A
42| | N/A| N/A| N/A| N/A
43| | N/A| N/A| N/A| N/A
44| Geminigemini-2.5-flash-preview-05-20 no-thinking| N/A| N/A| N/A| N/A
45| Geminigemini-2.5-flash-preview-05-20 no-thinking| N/A| N/A| N/A| N/A
46| | N/A| N/A| N/A| N/A
47| | N/A| N/A| N/A| N/A
48| | N/A| N/A| N/A| N/A
49| | N/A| N/A| N/A| N/A
50| | N/A| N/A| N/A| N/A
51| | N/A| N/A| N/A| N/A
52| | N/A| N/A| N/A| N/A
53| | N/A| N/A| N/A| N/A
54| | N/A| N/A| N/A| N/A
55| | N/A| N/A| N/A| N/A
56| | N/A| N/A| N/A| N/A
57| | N/A| N/A| N/A| N/A
58| | N/A| N/A| N/A| N/A
59| | N/A| N/A| N/A| N/A
60| | N/A| N/A| N/A| N/A
61| | N/A| N/A| N/A| N/A
62| | N/A| N/A| N/A| N/A
63| | N/A| N/A| N/A| N/A
64| | N/A| N/A| N/A| N/A
65| | N/A| N/A| N/A| N/A
66| OpenAIgpt-5-mini-2025-08-07-high| N/A| N/A| N/A| N/A
67| OpenAIgpt-5-mini-2025-08-07-medium| N/A| N/A| N/A| N/A
68| | N/A| N/A| N/A| N/A
69| | N/A| N/A| N/A| N/A
70| OpenAIgpt-5.2-2025-12-11-medium| N/A| N/A| N/A| N/A
71| | N/A| N/A| N/A| N/A
72| | N/A| N/A| N/A| N/A
73| | N/A| N/A| N/A| N/A
74| | N/A| N/A| N/A| N/A
75| OpenAIgpt-5.4-2026-03-05-medium| N/A| N/A| N/A| N/A
76| OpenAIgpt-5.5-2026-04-23-medium| N/A| N/A| N/A| N/A
77| | N/A| N/A| N/A| N/A
78| | N/A| N/A| N/A| N/A
79| | N/A| N/A| N/A| N/A
80| | N/A| N/A| N/A| N/A
81| | N/A| N/A| N/A| N/A
82| | N/A| N/A| N/A| N/A
83| | N/A| N/A| N/A| N/A
84| | N/A| N/A| N/A| N/A
85| | N/A| N/A| N/A| N/A
86| | N/A| N/A| N/A| N/A
87| | N/A| N/A| N/A| N/A
88| | N/A| N/A| N/A| N/A
89| | N/A| N/A| N/A| N/A
90| | N/A| N/A| N/A| N/A
91| MetaLlama-4-Maverick-17B-128E-Instruct| N/A| N/A| N/A| N/A
92| MetaLlama-4-Scout-17B-16E-Instruct| N/A| N/A| N/A| N/A
93| | N/A| N/A| N/A| N/A
94| | N/A| N/A| N/A| N/A
95| | N/A| N/A| N/A| N/A
96| | N/A| N/A| N/A| N/A
97| | N/A| N/A| N/A| N/A
98| | N/A| N/A| N/A| N/A
99| | N/A| N/A| N/A| N/A
100| QwenQwen2.5-Coder-32B-Instruct| N/A| N/A| N/A| N/A
101| | N/A| N/A| N/A| N/A
102| QwenQwen3-235B-A22B no-thinking| N/A| N/A| N/A| N/A
103| | N/A| N/A| N/A| N/A
104| QwenQwen3-235B-A22B-Instruct-2507| N/A| N/A| N/A| N/A
105| QwenQwen3-235B-A22B-Thinking-2507| N/A| N/A| N/A| N/A
106| QwenQwen3-30B-A3B-Instruct-2507| N/A| N/A| N/A| N/A
107| QwenQwen3-30B-A3B-Thinking-2507| N/A| N/A| N/A| N/A
108| | N/A| N/A| N/A| N/A
109| | N/A| N/A| N/A| N/A
110| | N/A| N/A| N/A| N/A
111| QwenQwen3-Coder-30B-A3B-Instruct| N/A| N/A| N/A| N/A
112| QwenQwen3-Coder-480B-A35B-Instruct| N/A| N/A| N/A| N/A
113| | N/A| N/A| N/A| N/A
114| QwenQwen3-Next-80B-A3B-Instruct| N/A| N/A| N/A| N/A
115| | N/A| N/A| N/A| N/A
116| | N/A| N/A| N/A| N/A
117| | N/A| N/A| N/A| N/A