Skip to content

R0007/2026-03-20/C010 — Assessment

BLUF

Confirmed. Brynjolfsson, Li, and Raymond (2023) studied 5,172 customer service agents. They found 14% average productivity improvement, with 34% improvement for novice/low-skilled workers and minimal impact on experienced workers. Published as NBER Working Paper 31161.

Probability

Rating: Almost certain (95-99%) Confidence in assessment: High Confidence rationale: Based on web-accessible evidence.

Reasoning Chain

  1. Brynjolfsson, Li, and Raymond studied the staggered introduction of a generative AI conversational assistant using data from 5,172 customer support agents. Access to the tool increased productivity by 14% on average (measured by issues resolved per hour), including a 34% improvement for novice and low-skilled workers but minimal impact on experienced and highly skilled workers. [SRC01-E01, High reliability, High relevance]

Evidence Base Summary

Source Description Reliability Relevance Key Finding
SRC01 Generative AI at Work High High See BLUF
## Collection Synthesis
Dimension Assessment
----------- ------------
Evidence quality Medium to Robust
Source agreement High
Source independence Assessed per claim
Outliers None
### Detail
Brynjolfsson, Li, and Raymond studied the staggered introduction of a generative AI conversational assistant using data from 5,172 customer support agents. Access to the tool increased productivity by 14% on average (measured by issues resolved per hour), including a 34% improvement for novice and low-skilled workers but minimal impact on experienced and highly skilled workers.
## Gaps
Missing Evidence Impact on Assessment
----------------- ---------------------
Full-text access Low to Moderate
## Researcher Bias Check
Declared biases: None.
Influence assessment: Standard verification.
## Cross-References
Entity ID File
-------- ---- ------
Hypotheses H1, H2, H3 hypotheses/
Sources SRC01 sources/
ACH Matrix ach-matrix.md
Self-Audit self-audit.md