ai
The One-Word Census: Answer-Choice Conformity Across 105 Language Models
arXiv: Computers and SocietyInternationalHigh confidence1 min
What changed
A research study evaluating 105 language models from over twenty laboratories demonstrates pronounced answer-choice conformity across large option spaces, finding that models repeatedly converge on identical single-word responses. Using 96 category-based prompts tested across eight iterations per model, the analysis revealed severe behavioral homogeneity, with single answers capturing at least 80% of total responses in 28 categories.
Why it matters
This matters because pervasive monoculture and response convergence across ostensibly competing language models create systemic blind spots and correlated points of failure. Organizations deploying artificial intelligence solutions risk false consensus and reduced diversity of thought, mistaking shared training artifacts for objective truth. Consequently, strategic decision-making that relies on multi-model consensus may inherit unmonitored epistemic bias across distinct vendors.
What to watch
Across 105 language models from more than 20 labs, asking the models to 'pick a word' resulted in the selection of 'serendipity' 46% of the time.
Forward consideration, not a verified fact.
Reported by arXiv: Computers and Society, International. The document itself is not reproduced here.
Read the original publication