ai
Prestige over merit: An adapted audit of LLM bias in peer review
- Source
- arXiv — Computers and Society
- Published
- Last verified
- 13 Aug 2026
- Confidence
- High
- Evidence
- Original document retained
- Reading time
- 1 min
- Country
- International
- Relevant to
- Research & Evidence, Risk & Compliance, Technology & Data
- Topics
- airesearchcompliance
Executive summary
What happened, and why should leadership care?
Research indicates that Large Language Models (LLMs) used in academic peer review reproduce human biases, particularly favoring perceived author prestige over manuscript quality. A multi-role LLM simulation of editors and reviewers revealed that disclosing author identities significantly reduced rejection recommendations, with institutional prestige being the primary influencing factor.
Why this matters
Why is this strategically important?
This research highlights a significant risk in the increasing adoption of AI tools within critical evaluation processes, demonstrating that current LLM implementations can perpetuate systemic biases. This has implications for fairness, equity, and the integrity of outcomes in any domain relying on such evaluations, potentially undermining merit-based systems.
Key insights
What should be noted from the evidence?
- LLMs, despite their growing informal role in scholarly peer review, are shown to reproduce biases similar to those observed in human decision-making.
- An adapted resume-style audit, simulating editor/reviewer roles, evaluated high-quality manuscripts across diverse scientific domains.
- Randomizing author identities (institutional prestige, gender, race) allowed for the isolation of bias factors.
- Revealing author identities reduced reviewer rejection recommendations by approximately 25% of the mean rejection rate, even for identical content.
- Institutional prestige was identified as the dominant cue influencing review outcomes, overriding manuscript quality.
Evidence and confidence
How far can this assessment be trusted?
High confidence. Named institution, original document retained and analysis corroborated.
Analysis is prepared editorially by Aziz Shuaib Ausi. The original publication remains the authoritative record, and executive judgement remains entirely human.
Source
Where does this originate?
Reported by arXiv — Computers and Society · International. This briefing summarises the publication for executive use; the document itself is not reproduced here.
Read the original publication