R0051/2026-03-31/Q003/SRC04
Warren et al. (2025) — Practitioner evidence of the confidence methodology gap
Source
| Field |
Value |
| Title |
Show Me the Work: Fact-Checkers' Requirements for Explainable Automated Fact-Checking |
| Publisher |
ACM / CHI 2025 |
| Author(s) |
Greta Warren, Irina Shklovski, Isabelle Augenstein |
| Date |
2025 |
| URL |
https://arxiv.org/html/2502.09083v1 |
| Type |
Research paper |
Summary
| Dimension |
Rating |
| Reliability |
High |
| Relevance |
High |
| Bias: Missing data |
Low risk |
| Bias: Measurement |
Low risk |
| Bias: Selective reporting |
Low risk |
| Bias: Randomization |
N/A — not an RCT |
| Bias: Protocol deviation |
N/A — not an RCT |
| Bias: COI/Funding |
Low risk |
Rationale
| Dimension |
Rationale |
| Reliability |
CHI 2025 publication — premier HCI venue. |
| Relevance |
Provides practitioner-level evidence of the confidence methodology gap — fact-checkers themselves cannot make sense of structured confidence. |
| Bias flags |
No apparent concerns. |
| Evidence ID |
Summary |
| SRC04-E01 |
Practitioners confused by numerical confidence — documented gap in structured methodology |