R0027/2026-03-26/Q001/SRC01/E02¶
Task-dependent variation in native vs English prompt effectiveness
URL: https://arxiv.org/abs/2505.11665
Extract¶
"Performance comparisons between Native-Basic and En-Basic vary depending on the specific NLP task, with Native-Basic outperforming En-Basic in tasks such as Emotion/Sentiment Understanding and Coreference Resolution." This indicates the relationship between prompt language and performance is not uniform — it depends on the task type.
Relevance to Hypotheses¶
| Hypothesis | Relationship | Strength |
|---|---|---|
| H1 | Supports | Confirms that performance does vary across languages |
| H2 | Contradicts | Shows measurable differences exist |
| H3 | Supports | Directly demonstrates task-dependent conditionality — native prompts win on some tasks, English on others |
Context¶
This finding is critical because it shows the answer is not simply "English is always better" or "native is always better" — the optimal prompt language depends on the task.