Who Brought Easter Eggs to Eid? Auditing LLM-Generated Cultural Translation of Math Word Problems Across Languages and Regions

Research evaluating advanced large language models, including Claude Opus 4, GPT-4.1, and Gemini 2.5 Pro, demonstrates the complexities of automated cultural adaptation in educational materials. Auditing 6,489 entity transformations across 60 math word problems translated into seven languages spanning India, Pakistan, and Italy reveals critical inconsistencies in how models preserve, localize, or alter cultural entities across high- and low-resource linguistic contexts. Note that the research abstract is truncated, limiting visibility into full empirical findings.

As generative AI systems are adopted for global personalized education at scale, unvetted automated translation risks introducing cultural incongruities that degrade pedagogical efficacy. Systemic failures in cross-cultural entity localization can alienate regional user bases and undermine institutional credibility. Ensuring equitable performance across both high-resource and under-studied languages is vital for mitigating cultural homogenization in AI deployment.

Claude Opus 4, GPT-4.1, and Gemini 2.5 Pro were benchmarked on their ability to culturally translate 60 English math word problems.

Forward consideration, not a verified fact.