Most biomedical publications show signs of LLM-assisted writing

A research paper from arXiv suggests that a significant majority of biomedical publications now exhibit characteristics consistent with Large Language Model (LLM)-assisted writing. The study, utilizing a novel method based on changing word frequencies, estimates that by late 2025, approximately 89% of open-access biomedical papers from Pubmed Central will show signs of LLM influence. This trend, while potentially beneficial for overcoming language barriers, also raises concerns regarding research integrity and potential misconduct.

Why it matters

The widespread adoption of LLM-assisted writing in scholarly publications, particularly in critical fields like biomedicine, fundamentally impacts the perceived integrity and reliability of research outputs. This necessitates a strategic re-evaluation of publication standards, ethical guidelines, and verification processes across academic and research institutions to maintain trust and scientific rigor.

Key insights

• LLM-powered chatbots and agents are widely adopted for academic writing.
• LLM assistance can aid in overcoming language barriers but also poses risks of misconduct and fraud.
• A new unbiased methodology was developed to estimate LLM usage in textual corpora based on changing word frequencies.
• Application of this method to open-access biomedical papers from Pubmed Central indicates an estimated 89% prevalence of LLM-assisted writing by the end of 2025.

Source

arXiv — Computers and Society — https://arxiv.org/abs/2608.10715