Issues resolved per hour
VerifiedAgents without accessAbout 14% average increase; 35% for novice/low-skill agents
2020–2021 · 5,179 agents
Anonymous company; staggered observational rollout; heterogeneous effects.
AI can diffuse expert practice, with value concentrated among novices.

Executive brief
Skill distribution is an operating metric.
AI value · Issues resolved per hour
VerifiedAbout 14% average increase; 35% for novice/low-skill agents
Anonymous company; staggered observational rollout; heterogeneous effects.
Before
Reads the incoming chat, searches available knowledge, and drafts a response. → Resolves the issue or escalates when managerial intervention is needed.
After
Observes the live chat and proposes response text based on patterns from prior interactions. → Accepts, edits, or ignores the suggestion and owns the sent response and escalation.
Human boundary
Agent owns every sent response; managers own escalation.
Why it matters
AI can diffuse expert practice, with value concentrated among novices.
Before
How the work ran before the change.
Customer-support agent
Reads the incoming chat, searches available knowledge, and drafts a response.
ControlControl group had no generative assistant; agents could handle concurrent chats.
Support agent or manager
Resolves the issue or escalates when managerial intervention is needed.
ControlHuman resolution and escalation authority.
What changed
AI can diffuse expert practice, with value concentrated among novices.
Decision rightHuman moves from creator to judge
After
How the same work runs now.
Generative conversational assistant
Observes the live chat and proposes response text based on patterns from prior interactions.
ControlSuggestion only; the working paper does not disclose the company or vendor.
Support agent
Accepts, edits, or ignores the suggestion and owns the sent response and escalation.
ControlHuman acceptance control; effects must be monitored by agent skill because top-agent gains were minimal.
Exception path
Incorrect suggestions are ignored or escalated.
Decision authority
Agent owns every sent response; managers own escalation.
| # | Actor | Action | Control |
|---|---|---|---|
| 01 | Customer-support agent | Reads the incoming chat, searches available knowledge, and drafts a response. | Control group had no generative assistant; agents could handle concurrent chats. |
| 02 | Support agent or manager | Resolves the issue or escalates when managerial intervention is needed. | Human resolution and escalation authority. |
| # | Actor | Action | Control |
|---|---|---|---|
| 01 | Generative conversational assistant | Observes the live chat and proposes response text based on patterns from prior interactions. | Suggestion only; the working paper does not disclose the company or vendor. |
| 02 | Support agent | Accepts, edits, or ignores the suggestion and owns the sent response and escalation. | Human acceptance control; effects must be monitored by agent skill because top-agent gains were minimal. |
Work that left the path
Human role before
Customer-support agents read incoming chats, searched available knowledge, drafted replies, and escalated cases requiring managerial intervention.
Human role after
Agents accept, edit or ignore suggestions and own resolution.
AI role
Observes chats and suggests responses in real time.
Agents without accessAbout 14% average increase; 35% for novice/low-skill agents
2020–2021 · 5,179 agents
Anonymous company; staggered observational rollout; heterogeneous effects.
Anti-pattern
Do not apply the average uniformly.
Questions
Portability conditions
Reputation risk
low