R0007/2026-03-20/C004 — Assessment¶
BLUF¶
Sackman et al. (1968) established large individual differences (ratios of 20:1 in coding time, 25:1 in debugging). This finding has been repeatedly confirmed. The 2023 study finding log-normal distributions with a 2.44x ratio is by Magne Jorgensen, not "Oliveira." The paper "Characteristics and generative mechanisms of software development productivity distributions" was published in Information and Software Technology, Vol. 159.
Probability¶
Rating: Likely (55-80%)
Confidence in assessment: Medium
Confidence rationale: The substantive findings are well-confirmed but the author attribution error is clear.
Reasoning Chain¶
- Sackman, Erikson, and Grant (1968) found 20:1 coding time ratios and 25:1 debugging time ratios [SRC01-E01, High reliability, High relevance]
- Multiple studies since then confirmed large variation: Curtis 1981, Mills 1983, DeMarco & Lister 1985, etc. [SRC03-E01, Medium reliability, High relevance]
- Jorgensen (2023) — not Oliveira — found log-normal distributions with 2.44x ratio between top and bottom halves [SRC02-E01, High reliability, High relevance]
- No "Oliveira (2023)" paper on software developer productivity distributions was found
Evidence Base Summary¶
| Source | Description | Reliability | Relevance | Key Finding |
|---|---|---|---|---|
| SRC01 | Sackman et al. (1968) | High | High | 20:1 coding, 25:1 debugging ratios |
| SRC02 | Jorgensen (2023) | High | High | Log-normal, 2.44x ratio |
| SRC03 | Construx review | Medium | High | Confirms long history of variation findings |
Collection Synthesis¶
| Dimension | Assessment |
|---|---|
| Evidence quality | Robust for the substantive claim; clear on the attribution error |
| Source agreement | High — all sources agree on large variation |
| Source independence | High — multiple independent research teams over 55 years |
| Outliers | None |
Detail¶
The substantive claim about large individual variation is among the most replicated findings in software engineering. The attribution error is the only issue.
Gaps¶
| Missing Evidence | Impact on Assessment |
|---|---|
| Whether an "Oliveira (2023)" paper exists on this topic | Moderate |
Researcher Bias Check¶
Declared biases: None provided.
Influence assessment: The variation finding supports the article's narrative. The attribution error appears to be unintentional.
Cross-References¶
| Entity | ID | File |
|---|---|---|
| Hypotheses | H1, H2, H3 | hypotheses/ |
| Sources | SRC01, SRC02, SRC03 | sources/ |
| ACH Matrix | — | ach-matrix.md |
| Self-Audit | — | self-audit.md |