Boston Consulting Group
Verified evidenceCreator to judgeThat access to a general model improves all apparently similar knowledge tasks.
Engineering design · Global BCG consultant population
Collections: Negative results
Executive brief
The operating control is task classification, not generic prompt training; users need a way to recognize when the model is outside its frontier.
AI value · Task completion speed and correctness by task type
VerifiedInside the frontier: 25.1% faster, 12.2% more tasks, over 40% higher quality; outside the frontier: 19 percentage points less likely to be correct
Experimental tasks approximated consulting work but were not client delivery; the negative out-of-frontier result is as important as the positive averages.
Before
Analyze source materials, generate ideas, and draft recommendations unaided by GPT-4. → Check coherence and submit the work.
After
Delegate or interleave ideation, analysis, and drafting with the model. → Verify, revise, and submit model-assisted work.
Human boundary
The model proposes content and analysis; the consultant owns verification and the submitted answer.
Why it matters
That access to a general model improves all apparently similar knowledge tasks.
Before
How the work ran before the change.
Consultant
Analyze source materials, generate ideas, and draft recommendations unaided by GPT-4.
Consultant
Check coherence and submit the work.
What changed
That access to a general model improves all apparently similar knowledge tasks.
Decision rightHuman moves from creator to judge
After
How the same work runs now.
Consultant with GPT-4
Delegate or interleave ideation, analysis, and drafting with the model.
ControlUser prompting and task choice
Consultant
Verify, revise, and submit model-assisted work.
ControlHuman final decision
Exception path
For tasks outside the model's capability frontier, consultants must solve independently or validate against source evidence rather than accept the model's confident answer.
Work removed
Decision authority
The model proposes content and analysis; the consultant owns verification and the submitted answer.
Before
Consultant
Analyze source materials, generate ideas, and draft recommendations unaided by GPT-4.
Control: Professional judgment
Consultant
Check coherence and submit the work.
Control: Human accountability
After
Consultant with GPT-4
Delegate or interleave ideation, analysis, and drafting with the model.
Control: User prompting and task choice
Consultant
Verify, revise, and submit model-assisted work.
Control: Human final decision
Work that left the path
Human role before
Consultants performed every analytical and drafting step directly.
Human role after
Consultants decide when to delegate, when to integrate, and when to distrust the model.
AI roleGeneral-purpose GPT-4 assistance across realistic consulting tasks.
Randomized no-AI control consultants→Inside the frontier: 25.1% faster, 12.2% more tasks, over 40% higher quality; outside the frontier: 19 percentage points less likely to be correct
2023 preregistered experiment · 758 BCG consultants, about 7% of individual-contributor consultants
Experimental tasks approximated consulting work but were not client delivery; the negative out-of-frontier result is as important as the positive averages.
Anti-pattern
Applying the positive average to all knowledge work or assuming prompt training eliminates frontier risk.
Questions
Portability conditions
Reputation risk
low
Evidence and authority
Current · updated
2 independent; publication outcomes are verified.
Bundle 1.0.0 · reviewed 2026-08-23 · stable ID 0dc0a03188456b2e
Be My Eyes · Creator to judge
A blind or low-vision user can get immediate, private scene descriptions before choosing human assistance.
NASA JPL · Creator to judge
Communication latency requires local path authority.
Commonwealth of Pennsylvania · Creator to judge
Hinge: state employees can use a governed generative-AI workspace for drafting, research, summarization, brainstorming, and IT support while employees retain judgment and organized labor participates in adoption design.
United States Internal Revenue Service · Creator to judge
Authenticated self-service can resolve common collection questions and eligible payment-plan transactions.