AI in Search Reduces Publisher Referrals Without Improving User Experience: Experimental Evidence

Experimental research indicates that the integration of generative AI features, specifically 'AI Overviews' and 'AI Mode,' into a dominant online search platform significantly reduces user click-through rates to original publishers. This reduction occurs without a corresponding improvement in user experience or trust in the information provided. The study suggests that AI-synthesized answers divert traffic from content creators, potentially impacting their visibility and revenue models.

Why it matters

The findings underscore a potential systemic shift in information consumption and content monetization models. Organisations relying on organic search traffic for visibility, engagement, or revenue generation may face significant headwinds as AI integration in search becomes more prevalent. This necessitates re-evaluation of digital strategy and engagement channels.

Key insights

• Integrating generative AI into web search changes how users navigate and assess information.
• A preregistered field experiment on a dominant search platform (N=1,100) measured the causal effects of AI Overviews and AI Mode.
• Removing AI Overviews and AI Mode increased click-through rates to publishers.
• An 'AI Mode-only' experience reduced click-through rates and negatively impacted user experience.
• User trust in information found on the platform was eroded by the AI Mode-only experience.
• The findings suggest that generative AI in search reduces publisher referrals without improving user experience.

Source

arXiv — Computers and Society — https://arxiv.org/abs/2608.18352