You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: content/copilot/concepts/agents/coding-agent/about-coding-agent.md
+2-2Lines changed: 2 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -69,9 +69,9 @@ You can create specialized {% data variables.copilot.custom_agents_short %} for
69
69
70
70
## Measuring pull request outcomes for {% data variables.copilot.copilot_coding_agent %}
71
71
72
-
Enterprise administrators can use {% data variables.product.prodname_copilot_short %} usage metrics to analyze pull request outcomes for pull requests created by {% data variables.copilot.copilot_coding_agent %}.
72
+
Enterprise administrators and organization owners can use {% data variables.product.prodname_copilot_short %} usage metrics to analyze pull request outcomes for pull requests created by {% data variables.copilot.copilot_coding_agent %}.
73
73
74
-
The enterprise-level {% data variables.product.prodname_copilot_short %} usage metrics API includes pull request lifecycle metrics such as:
74
+
The {% data variables.product.prodname_copilot_short %} usage metrics APIs include pull request lifecycle metrics such as:
75
75
76
76
* The total number of pull requests created and merged
77
77
* The number of pull requests created by {% data variables.copilot.copilot_coding_agent %} that have been merged
Copy file name to clipboardExpand all lines: content/copilot/concepts/copilot-usage-metrics/copilot-metrics.md
+9-1Lines changed: 9 additions & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -115,7 +115,15 @@ For example, all usage data for a Monday (which closes at midnight UTC) will be
115
115
116
116
**Lines of Code (LoC) metrics** measure the number of lines {% data variables.product.prodname_copilot_short %} suggested, added, or deleted in the editor, providing a directional view of {% data variables.product.prodname_copilot_short %}’s tangible output. For example, "Lines added" shows how much code was actually accepted and inserted into the editor.
117
117
118
-
**Pull request lifecycle metrics** measure how {% data variables.product.prodname_copilot_short %} activity relates to pull request outcomes and delivery flow. These metrics include pull request creation and merge counts, median time to merge, and review suggestion activity. By comparing overall pull request activity with pull requests created by {% data variables.product.prodname_copilot_short %}, you can evaluate how AI-assisted workflows influence throughput and cycle time across your enterprise.
118
+
**Pull request lifecycle metrics** measure how {% data variables.product.prodname_copilot_short %} activity relates to pull request outcomes and delivery flow. These metrics include pull request creation and merge counts, median time to merge, and review suggestion activity. By comparing overall pull request activity with pull requests created by {% data variables.product.prodname_copilot_short %}, you can evaluate how AI-assisted workflows influence throughput and cycle time at the organization or enterprise level.
119
+
120
+
### Interpreting pull request lifecycle metrics across scopes
121
+
122
+
Pull request lifecycle metrics are available at both the organization and enterprise level. When comparing reports, keep the following in mind:
123
+
124
+
***Deduplication**: Enterprise-level reports deduplicate users across organizations. Organization-level reports do not.
125
+
***Pull request-only data**: Pull request lifecycle metrics may appear even if IDE usage metrics are absent, since pull request data is derived from repository activity.
126
+
***Attribution timing**: If a repository or organization is transferred between owners, pull request creation, review, and merge events may be attributed to different entities depending on when each event occurred.
Copy file name to clipboardExpand all lines: content/copilot/reference/copilot-usage-metrics/copilot-usage-metrics.md
+9-6Lines changed: 9 additions & 6 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -97,18 +97,21 @@ These fields appear in the exported NDJSON reports and in the {% data variables.
97
97
98
98
### Pull request activity fields (API only)
99
99
100
-
These fields capture daily pull request creation, review, merge, and suggestion activity across the enterprise, including activity performed by {% data variables.product.prodname_copilot_short %}.
100
+
> [!IMPORTANT]
101
+
> Organization- and enterprise-level reports may show different totals due to differences in user deduplication and attribution timing. For guidance on interpreting pull request metrics across scopes, see [AUTOTITLE](/copilot/concepts/copilot-usage-metrics/copilot-metrics#interpreting-pull-request-lifecycle-metrics-across-scopes).
102
+
103
+
These fields capture daily pull request creation, review, merge, and suggestion activity at the enterprise or organization scope, including activity performed by {% data variables.product.prodname_copilot_short %}.
101
104
102
105
| Field | Description |
103
106
|:--|:--|
104
-
|`pull_requests.total_created`| Total number of pull requests created across the enterprise on this specific day. <br/><br/>Creation is a one-time event. Each pull request is counted only on the day it is created. |
105
-
|`pull_requests.total_reviewed`| Total number of pull requests reviewed across the enterprise on this specific day. <br/><br/>The same pull request may be counted on multiple days if it receives reviews on multiple days. Within a single day, each pull request is counted once, even if multiple review actions occur. |
106
-
|`pull_requests.total_merged`| Total number of pull requests merged across the enterprise on this specific day. <br/><br/>Merging is a one-time event. Each pull request is counted only on the day it is merged. |
107
+
|`pull_requests.total_created`| Total number of pull requests created on this specific day. <br/><br/>Creation is a one-time event. Each pull request is counted only on the day it is created. |
108
+
|`pull_requests.total_reviewed`| Total number of pull requests reviewed on this specific day. <br/><br/>The same pull request may be counted on multiple days if it receives reviews on multiple days. Within a single day, each pull request is counted once, even if multiple review actions occur. |
109
+
|`pull_requests.total_merged`| Total number of pull requests merged on this specific day. <br/><br/>Merging is a one-time event. Each pull request is counted only on the day it is merged. |
107
110
|`pull_requests.median_minutes_to_merge`| Median time, in minutes, between pull request creation and merge for pull requests merged on this specific day. <br/><br/>Median is used to reduce the impact of outliers from unusually long-running pull requests. |
108
111
|`pull_requests.total_suggestions`| Total number of pull request review suggestions generated on this specific day, regardless of author. |
109
112
|`pull_requests.total_applied_suggestions`| Total number of pull request review suggestions that were applied on this specific day, regardless of author. |
110
-
|`pull_requests.total_created_by_copilot`| Number of pull requests created by {% data variables.product.prodname_copilot_short %} across the enterprise on this specific day. |
111
-
|`pull_requests.total_reviewed_by_copilot`| Number of pull requests reviewed by {% data variables.product.prodname_copilot_short %} across the enterprise on this specific day. <br/><br/>A pull request may be counted on multiple days if {% data variables.product.prodname_copilot_short %} reviews it on multiple days. |
113
+
|`pull_requests.total_created_by_copilot`| Number of pull requests created by {% data variables.product.prodname_copilot_short %} on this specific day. |
114
+
|`pull_requests.total_reviewed_by_copilot`| Number of pull requests reviewed by {% data variables.product.prodname_copilot_short %} on this specific day. <br/><br/>A pull request may be counted on multiple days if {% data variables.product.prodname_copilot_short %} reviews it on multiple days. |
112
115
|`pull_requests.total_merged_created_by_copilot`| Number of pull requests created by {% data variables.product.prodname_copilot_short %} that were merged on this specific day. Each pull request is counted only on the day it is merged. |
113
116
|`pull_requests.median_minutes_to_merge_copilot_authored`| Median time, in minutes, between pull request creation and merge for pull requests created by {% data variables.product.prodname_copilot_short %} and merged on this specific day. |
114
117
|`pull_requests.total_copilot_suggestions`| Number of pull request review suggestions generated by {% data variables.product.prodname_copilot_short %} on this specific day. |
0 commit comments