Q004 — Self-Audit¶


Research	R0023 — Counterproductive advice and prompt lifecycle
Run	2026-03-25
Query	Q004

ROBIS 4-Domain Audit¶

Domain 1: Eligibility Criteria¶

Rating: Pass

Criterion	Assessment
Evidence criteria defined before searching	Yes — sought published frameworks with defined methodology, distinguishing from vendor product pages
Criteria applied consistently	Yes

Domain 2: Search Comprehensiveness¶

Rating: Some concerns

Criterion	Assessment
Multiple search strategies used	Yes — 3 queries
All results dispositioned	Yes — 30 results
Source diversity achieved	Limited — vendor guidance, one academic paper, one industry article

Notes: Academic database searches (ACM DL, IEEE Xplore) were not performed. These might surface additional peer-reviewed work on prompt lifecycle methodology.

Domain 3: Evaluation Consistency¶

Rating: Pass

Criterion	Assessment
All sources scored using same framework	Yes
ACH matrix applied	Yes

Domain 4: Synthesis Fairness¶

Rating: Pass

Criterion	Assessment
All hypotheses given fair hearing	Yes
Gaps acknowledged	Yes — limited academic coverage noted

Overall Assessment¶

Overall risk of bias: Low risk

Researcher Bias Check¶

Absence as evidence risk: The absence of comprehensive frameworks in search results is treated as a finding. However, limited search scope (web search only, no academic database searches) means this absence could reflect search limitations rather than true absence.