Skip to main content
Intelligence

ai

The One-Word Census: Answer-Choice Conformity Across 105 Language Models

arXiv: Computers and SocietyInternationalHigh confidence1 min

What changed

A research study evaluating 105 language models from over twenty laboratories demonstrates pronounced answer-choice conformity across large option spaces, finding that models repeatedly converge on identical single-word responses. Using 96 category-based prompts tested across eight iterations per model, the analysis revealed severe behavioral homogeneity, with single answers capturing at least 80% of total responses in 28 categories.

Why it matters

This matters because pervasive monoculture and response convergence across ostensibly competing language models create systemic blind spots and correlated points of failure. Organizations deploying artificial intelligence solutions risk false consensus and reduced diversity of thought, mistaking shared training artifacts for objective truth. Consequently, strategic decision-making that relies on multi-model consensus may inherit unmonitored epistemic bias across distinct vendors.

What to watch

Across 105 language models from more than 20 labs, asking the models to 'pick a word' resulted in the selection of 'serendipity' 46% of the time.

Forward consideration, not a verified fact.

Reported by arXiv: Computers and Society, International. The document itself is not reproduced here.

Read the original publication