Skip to content

Commit c928e1f

Browse files
sophiethekingvgrl
andauthored
[2026-02-27] Copilot metrics PR metric parity for org-level endpoints [Public Preview] (#59818)
Co-authored-by: Vanessa <vgrl@github.com>
1 parent 7597c92 commit c928e1f

3 files changed

Lines changed: 20 additions & 9 deletions

File tree

content/copilot/concepts/agents/coding-agent/about-coding-agent.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -69,9 +69,9 @@ You can create specialized {% data variables.copilot.custom_agents_short %} for
6969

7070
## Measuring pull request outcomes for {% data variables.copilot.copilot_coding_agent %}
7171

72-
Enterprise administrators can use {% data variables.product.prodname_copilot_short %} usage metrics to analyze pull request outcomes for pull requests created by {% data variables.copilot.copilot_coding_agent %}.
72+
Enterprise administrators and organization owners can use {% data variables.product.prodname_copilot_short %} usage metrics to analyze pull request outcomes for pull requests created by {% data variables.copilot.copilot_coding_agent %}.
7373

74-
The enterprise-level {% data variables.product.prodname_copilot_short %} usage metrics API includes pull request lifecycle metrics such as:
74+
The {% data variables.product.prodname_copilot_short %} usage metrics APIs include pull request lifecycle metrics such as:
7575

7676
* The total number of pull requests created and merged
7777
* The number of pull requests created by {% data variables.copilot.copilot_coding_agent %} that have been merged

content/copilot/concepts/copilot-usage-metrics/copilot-metrics.md

Lines changed: 9 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -115,7 +115,15 @@ For example, all usage data for a Monday (which closes at midnight UTC) will be
115115

116116
**Lines of Code (LoC) metrics** measure the number of lines {% data variables.product.prodname_copilot_short %} suggested, added, or deleted in the editor, providing a directional view of {% data variables.product.prodname_copilot_short %}’s tangible output. For example, "Lines added" shows how much code was actually accepted and inserted into the editor.
117117

118-
**Pull request lifecycle metrics** measure how {% data variables.product.prodname_copilot_short %} activity relates to pull request outcomes and delivery flow. These metrics include pull request creation and merge counts, median time to merge, and review suggestion activity. By comparing overall pull request activity with pull requests created by {% data variables.product.prodname_copilot_short %}, you can evaluate how AI-assisted workflows influence throughput and cycle time across your enterprise.
118+
**Pull request lifecycle metrics** measure how {% data variables.product.prodname_copilot_short %} activity relates to pull request outcomes and delivery flow. These metrics include pull request creation and merge counts, median time to merge, and review suggestion activity. By comparing overall pull request activity with pull requests created by {% data variables.product.prodname_copilot_short %}, you can evaluate how AI-assisted workflows influence throughput and cycle time at the organization or enterprise level.
119+
120+
### Interpreting pull request lifecycle metrics across scopes
121+
122+
Pull request lifecycle metrics are available at both the organization and enterprise level. When comparing reports, keep the following in mind:
123+
124+
* **Deduplication**: Enterprise-level reports deduplicate users across organizations. Organization-level reports do not.
125+
* **Pull request-only data**: Pull request lifecycle metrics may appear even if IDE usage metrics are absent, since pull request data is derived from repository activity.
126+
* **Attribution timing**: If a repository or organization is transferred between owners, pull request creation, review, and merge events may be attributed to different entities depending on when each event occurred.
119127

120128
## How can I use these metrics?
121129

content/copilot/reference/copilot-usage-metrics/copilot-usage-metrics.md

Lines changed: 9 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -97,18 +97,21 @@ These fields appear in the exported NDJSON reports and in the {% data variables.
9797

9898
### Pull request activity fields (API only)
9999

100-
These fields capture daily pull request creation, review, merge, and suggestion activity across the enterprise, including activity performed by {% data variables.product.prodname_copilot_short %}.
100+
> [!IMPORTANT]
101+
> Organization- and enterprise-level reports may show different totals due to differences in user deduplication and attribution timing. For guidance on interpreting pull request metrics across scopes, see [AUTOTITLE](/copilot/concepts/copilot-usage-metrics/copilot-metrics#interpreting-pull-request-lifecycle-metrics-across-scopes).
102+
103+
These fields capture daily pull request creation, review, merge, and suggestion activity at the enterprise or organization scope, including activity performed by {% data variables.product.prodname_copilot_short %}.
101104

102105
| Field | Description |
103106
|:--|:--|
104-
| `pull_requests.total_created` | Total number of pull requests created across the enterprise on this specific day. <br/><br/>Creation is a one-time event. Each pull request is counted only on the day it is created. |
105-
| `pull_requests.total_reviewed` | Total number of pull requests reviewed across the enterprise on this specific day. <br/><br/>The same pull request may be counted on multiple days if it receives reviews on multiple days. Within a single day, each pull request is counted once, even if multiple review actions occur. |
106-
| `pull_requests.total_merged` | Total number of pull requests merged across the enterprise on this specific day. <br/><br/>Merging is a one-time event. Each pull request is counted only on the day it is merged. |
107+
| `pull_requests.total_created` | Total number of pull requests created on this specific day. <br/><br/>Creation is a one-time event. Each pull request is counted only on the day it is created. |
108+
| `pull_requests.total_reviewed` | Total number of pull requests reviewed on this specific day. <br/><br/>The same pull request may be counted on multiple days if it receives reviews on multiple days. Within a single day, each pull request is counted once, even if multiple review actions occur. |
109+
| `pull_requests.total_merged` | Total number of pull requests merged on this specific day. <br/><br/>Merging is a one-time event. Each pull request is counted only on the day it is merged. |
107110
| `pull_requests.median_minutes_to_merge` | Median time, in minutes, between pull request creation and merge for pull requests merged on this specific day. <br/><br/>Median is used to reduce the impact of outliers from unusually long-running pull requests. |
108111
| `pull_requests.total_suggestions` | Total number of pull request review suggestions generated on this specific day, regardless of author. |
109112
| `pull_requests.total_applied_suggestions` | Total number of pull request review suggestions that were applied on this specific day, regardless of author. |
110-
| `pull_requests.total_created_by_copilot` | Number of pull requests created by {% data variables.product.prodname_copilot_short %} across the enterprise on this specific day. |
111-
| `pull_requests.total_reviewed_by_copilot` | Number of pull requests reviewed by {% data variables.product.prodname_copilot_short %} across the enterprise on this specific day. <br/><br/>A pull request may be counted on multiple days if {% data variables.product.prodname_copilot_short %} reviews it on multiple days. |
113+
| `pull_requests.total_created_by_copilot` | Number of pull requests created by {% data variables.product.prodname_copilot_short %} on this specific day. |
114+
| `pull_requests.total_reviewed_by_copilot` | Number of pull requests reviewed by {% data variables.product.prodname_copilot_short %} on this specific day. <br/><br/>A pull request may be counted on multiple days if {% data variables.product.prodname_copilot_short %} reviews it on multiple days. |
112115
| `pull_requests.total_merged_created_by_copilot` | Number of pull requests created by {% data variables.product.prodname_copilot_short %} that were merged on this specific day. Each pull request is counted only on the day it is merged. |
113116
| `pull_requests.median_minutes_to_merge_copilot_authored` | Median time, in minutes, between pull request creation and merge for pull requests created by {% data variables.product.prodname_copilot_short %} and merged on this specific day. |
114117
| `pull_requests.total_copilot_suggestions` | Number of pull request review suggestions generated by {% data variables.product.prodname_copilot_short %} on this specific day. |

0 commit comments

Comments
 (0)