Why Better Models Can Create Riskier Systems: Evidence from LLM Agents in Financial Markets

Recent research from arXiv highlights a critical paradox in the deployment of Large Language Models (LLMs): while individual model capability improves, system-level outcomes, particularly in financial markets, can degrade. This degradation is attributed to increasingly correlated behaviors among more capable LLMs, stemming from shared training and architectures. This correlation introduces a non-diversifiable risk, challenging conventional assumptions about risk mitigation through diversification in systems heavily reliant on advanced AI agents.

Why it matters

This research is strategically important as it exposes a fundamental risk amplification mechanism inherent in the deployment of increasingly capable AI, particularly LLMs. It necessitates a re-evaluation of current risk management frameworks and diversification strategies in technology-driven sectors, challenging the intuitive assumption that advanced AI always leads to more robust systems.

Key insights

• Improved individual LLM capability can lead to a deterioration in overall system-level outcomes.
• Shared training and architectural designs can cause more capable LLMs to exhibit highly correlated actions, preventing diversification of risk.
• A general framework demonstrates that such correlation establishes a non-diversifiable risk floor in systems.
• In financial markets, agent-based simulations using LLM traders show that frontier LLMs demonstrate significantly correlated behavior, which intensifies with increased capability.
• The inherent correlation among advanced LLMs introduces a novel and persistent source of system-level risk, especially in consequential domains.

Source

arXiv — Computers and Society — https://arxiv.org/abs/2609.04373