Research Summary: Playing Bias: Epistemic Games for Interpreting Text-to-Image Models

Research from arXiv's Computers and Society domain introduces an epistemic framework to evaluate bias in text-to-image (T2I) artificial intelligence systems. The authors argue that while conventional technical audits effectively quantify demographic disparities, they fail to cultivate the critical literacy required to evaluate how generative outputs encode stereotypes and confer authority through visual staging such as pose, camera angles, props, costume, and settings. To address this, the study introduces a three-part humanities-informed framework—Interpret, Interrogate, and Expose—using structured prompt techniques to surface and debate cultural defaults.

Why it matters

This research matters because generative AI systems encode and circulate subtle representational defaults that cannot be resolved solely through statistical parity metrics. Organizations deploying generative visual media face reputational, cultural, and ethical exposure if they lack qualitative mechanisms to interrogate how models construct authority and visual norms. Developing qualitative auditing methodologies is critical for comprehensive AI risk management and governance.

Key insights

• Text-to-image systems establish normative visual defaults across elements such as pose, camera perspective, costume, props, and setting.
• Traditional technical and statistical audits quantify disparities but lack methods to foster qualitative literacy on how imagery constructs authority and stereotypes.
• The proposed three-stage framework utilizes 'Interpret' (art-historical visual examination), 'Interrogate' (counter-intent prompt exploration), and 'Expose' (paired prompts holding motifs constant while altering a specific 'BiasSlot' cue).
• The methodology was piloted within an educational setting involving undergraduate participants, though full empirical findings are truncated in the source text.

Source

arXiv — Computers and Society — https://arxiv.org/abs/2610.32159