Copilot 影响力仪表盘上线“行业对比”功能,支持基准效能对标
英文标题:Industry comparisons in the Copilot impact dashboard
GitHub 宣布在 Copilot 影响力仪表盘(Copilot impact dashboard)中正式推出“行业对比”(Industry comparison)板块。企业与组织可选择性加入该计划,将其 Copilot Agent 采用率和研发杠杆等指标与同规模、同行业的匿名聚合基准进行横向对标。该功能通过提供同行中位数及前 10% 顶尖水平等参考数据,解决了管理者以往无法评估自身 AI 工具落地成效是领先还是落后的痛点,为技术团队制定落地目标和弥补采用差距提供了量化依据。
126.0 KB
16.1 KB
186.1 KB
中文
Copilot 影响力仪表盘现已新增“行业对比”(Industry comparison)板块。企业以及非企业所有的组织,可以将自身的 Copilot Agent 化采用率(agentic adoption)和杠杆效能与参与同行的聚合基准数据进行对比。该功能采取自愿加入机制(opt-in),且默认处于禁用状态。
- Agent 采用率与杠杆基准(Agentic adoption and leverage benchmarks) —— 查看你团队中“Agent 优先”(agent-first)或“多 Agent”(multi-agent)用户的百分比,以及使用 Agent 的用户相较于非 Agent 用户的 Pull Request 合并率对比。一旦有足够多的企业加入,各项得分将与 28 天报告周期内的同行中位数进行排名;随着同行群体的扩大,还会对标前 10%(top decile)的水平。
- 按公司规模与行业划分的同行群体(Peer groups by company size and industry) —— 选择公司规模(例如 1–999、1,000–4,999 或 5,000+ 名员工)以及十个行业之一,即可在特定行业与所有行业之间切换对比。如果你所在行业的同行群体样本过小,对比范围将自动扩大到你所在公司规模的所有行业,且仪表盘会明确标注所采用的同行群体。
- Copilot 指标行业对比策略(Copilot metrics industry comparison policy) —— 可在仪表盘中开启,或从企业/组织的 Copilot 策略中进行集中管理。两处使用相同的策略配置,因此在任一位置关闭该功能,都会同时停止贡献数据以及查看对比数据。
企业管理者以往可以衡量自身的 Copilot 采用情况,但在之前无法得知自己的进度相比同类企业是处于领先还是落后。行业对比功能补充了同行上下文,有助于设定切合实际的目标、找出采用差距并向上汇报进展。
- 只有在有足够数量的企业加入并形成同行群体后,才会显示排名。尤其在功能上线初期,你可能只会看到中位数、比所选范围更广泛的同行群体,或者在更多同行加入之前暂不显示排名。此外,当无法计算你自身的得分时(例如当你的所有用户都已经是 Agent 优先或多 Agent 用户,导致没有非 Agent 基准来计算杠杆时),也不会显示排名。
- 对比数据每日刷新。当你选择退出时,对比数据将立即停止显示,并且从下一次每日更新开始彻底排除你的数据。聚合基准数据不包含任何可识别信息,并在 30 天后删除。
- 在启用了数据驻留(data residency)的 GitHub Enterprise Cloud 上,你仅与同一区域内的参与者进行对比,数据绝不会跨区域合并。
- 属于某一企业的组织通过其所属企业参与,仅用于分配 Copilot Business 许可证的企业无法参与。企业所有者以及未归属于企业的组织所有者可以开启此功能并设定同行群体。任何有权查看 Copilot 影响力仪表盘的人都可以查看对比结果。前提是必须启用 Copilot 使用指标策略(Copilot usage metrics policy)。
- 行业对比仅在仪表盘中显示,不包含在 Copilot usage metrics API、NDJSON 导出或数据下载中。
访问 Copilot impact dashboard documentation 即可开始使用。
English / 原文
The Copilot impact dashboard now includes an “Industry comparison” section. Enterprises, and organizations that aren’t owned by an enterprise, can compare their Copilot agentic adoption and leverage with aggregated benchmarks from participating peers. Participation is opt-in and disabled by default.
- Agentic adoption and leverage benchmarks — See the percentage of your users who are agent-first or multi-agent, and how the pull request merge rate of agentic users compares with nonagentic users. Once enough businesses have opted in, each score is ranked against the peer median for the 28-day reporting period and against the top decile as the peer group grows.
- Peer groups by company size and industry — Choose a company size (e.g., 1–999, 1,000–4,999, or 5,000+ employees) and one of ten industries, then switch between your industry and all industries. If your industry’s peer group is too small, the comparison widens to all industries for your company size, and the dashboard labels the peer group it used.
- Copilot metrics industry comparison policy — Opt in from the dashboard or centrally from your enterprise or organization Copilot policies. Both places use the same policy, so turning it off in either place stops both contributing data and seeing comparisons.
Enterprise leaders can measure their own Copilot adoption, but until now they couldn’t tell whether it was leading or lagging comparable businesses. Industry comparisons add the peer context needed to set realistic goals, identify adoption gaps, and communicate progress.
- Rankings appear only after enough businesses have opted in to form a peer group. Especially soon after launch, you might see only the median, a broader peer group than you selected, or no ranking until more peers join. Rankings also aren’t shown when your own score can’t be calculated such as when all your users are already agent-first or multi-agent, leaving no nonagentic baseline for leverage.
- Comparisons refresh daily. When you opt out, comparisons stop appearing right away and your data is excluded starting with the next daily update. Aggregated benchmarks contain no identifying data and are deleted after 30 days.
- On GitHub Enterprise Cloud with data residency, you’re compared only with participants in the same region. Data is never combined across regions.
- Organizations owned by an enterprise participate through their enterprise, and enterprises used only to assign Copilot Business licenses can’t participate. Enterprise owners, and owners of organizations that aren’t owned by an enterprise, can opt in and set the peer group. Anyone who can view the Copilot impact dashboard can see the results. The Copilot usage metrics policy must be enabled.
- Industry comparisons appear only in the dashboard. They aren’t included in the Copilot usage metrics API, NDJSON exports, or downloads.
Visit the Copilot impact dashboard documentation to get started.