R0020/2026-03-25/Q004/SRC02/E01¶
Theory-practice disconnects: static defenses, simplicity advantage, user behavior gap
URL: https://www.lakera.ai/blog/prompt-engineering-guide
Extract¶
Four theory-practice disconnects identified:
-
Static defenses fail: "No static filter is enough" against evolving adversarial techniques; defenses require continuous iteration. Published guidance often presents techniques as one-time implementations.
-
Simplicity advantage: The most successful real-world prompts follow modular, clear patterns, yet many practitioners attempt overly complex, verbose inputs following guide advice to "be thorough."
-
User behavior vs. design intent: Viral prompt trends reveal that users discover unexpected effective patterns (multilingual evasion, roleplay exploitation) that designers hadn't anticipated. Published guidance cannot anticipate these emergent behaviors.
-
Safety assumptions: The gap between "good alignment in testing" and "robustness under actual use" is significant; prompt scaffolding alone cannot substitute for layered defenses.
Relevance to Hypotheses¶
| Hypothesis | Relationship | Strength |
|---|---|---|
| H1 | Supports | Four specific disconnects identified between theory and practice |
| H2 | Contradicts | The disconnects are documented evidence of a gap |
| H3 | Supports | Some gaps are being addressed (security) while others persist |
Context¶
The "simplicity advantage" finding is particularly relevant to complex prompt development: practitioners building sophisticated prompts may be adding complexity that hurts rather than helps, following guide advice that doesn't apply to their use case. This mirrors the Aakash Gupta finding that "structure matters more than verbosity."