Issues resolved per hour
VerifiedAgents without access→About 14% average increase; 35% for novice/low-skill agents
2020–2021 · 5,179 agents
Anonymous company; staggered observational rollout; heterogeneous effects.
Anonymous Fortune 500 software company
Verified evidenceCreator to judgeAI can diffuse expert practice, with value concentrated among novices.
Software engineering · Multiple locations

Executive brief
Skill distribution is an operating metric.
AI value · Issues resolved per hour
VerifiedAbout 14% average increase; 35% for novice/low-skill agents
Anonymous company; staggered observational rollout; heterogeneous effects.
Before
Reads the incoming chat, searches available knowledge, and drafts a response. → Resolves the issue or escalates when managerial intervention is needed.
After
Observes the live chat and proposes response text based on patterns from prior interactions. → Accepts, edits, or ignores the suggestion and owns the sent response and escalation.
Human boundary
Agent owns every sent response; managers own escalation.
Why it matters
AI can diffuse expert practice, with value concentrated among novices.
Before
How the work ran before the change.
Customer-support agent
Reads the incoming chat, searches available knowledge, and drafts a response.
ControlControl group had no generative assistant; agents could handle concurrent chats.
Support agent or manager
Resolves the issue or escalates when managerial intervention is needed.
ControlHuman resolution and escalation authority.
What changed
AI can diffuse expert practice, with value concentrated among novices.
Decision rightHuman moves from creator to judge
After
How the same work runs now.
Generative conversational assistant
Observes the live chat and proposes response text based on patterns from prior interactions.
ControlSuggestion only; the working paper does not disclose the company or vendor.
Support agent
Accepts, edits, or ignores the suggestion and owns the sent response and escalation.
ControlHuman acceptance control; effects must be monitored by agent skill because top-agent gains were minimal.
Exception path
Incorrect suggestions are ignored or escalated.
Work removed
Decision authority
Agent owns every sent response; managers own escalation.
Before
Customer-support agent
Reads the incoming chat, searches available knowledge, and drafts a response.
Control: Control group had no generative assistant; agents could handle concurrent chats.
Support agent or manager
Resolves the issue or escalates when managerial intervention is needed.
Control: Human resolution and escalation authority.
After
Generative conversational assistant
Observes the live chat and proposes response text based on patterns from prior interactions.
Control: Suggestion only; the working paper does not disclose the company or vendor.
Support agent
Accepts, edits, or ignores the suggestion and owns the sent response and escalation.
Control: Human acceptance control; effects must be monitored by agent skill because top-agent gains were minimal.
Work that left the path
Human role before
Customer-support agents read incoming chats, searched available knowledge, drafted replies, and escalated cases requiring managerial intervention.
Human role after
Agents accept, edit or ignore suggestions and own resolution.
AI roleObserves chats and suggests responses in real time.
Agents without access→About 14% average increase; 35% for novice/low-skill agents
2020–2021 · 5,179 agents
Anonymous company; staggered observational rollout; heterogeneous effects.
Anti-pattern
Do not apply the average uniformly.
Questions
Portability conditions
Reputation risk
low
Evidence and authority
Current · updated
2 independent; publication outcomes are verified.
Bundle 1.0.0 · reviewed 2026-08-23 · stable ID 6ff380bc84cd5443
Google · Creator to judge
Large migrations can combine machine-found locations, LLM edits, automated checks, and engineer review.
GitHub Copilot research experiment · Creator to judge
Inline generation can compress a bounded task but not prove lifecycle productivity.
Meta (Facebook) · Creator to judge
Routine static-analysis bugs can receive machine-proposed patches behind compilation and analyzer-clean gates.
Accenture · Creator to judge
Developers can accept, edit, or reject inline suggestions while build, review, and merge controls remain.