Are LLMs becoming similarly creative? Evidence from three years of models

Research is underway to assess the evolving performance of Large Language Models (LLMs) on open-ended tasks, specifically focusing on creativity, originality, and diversity, rather than just verifiable answers. A preliminary analysis examines LLM outputs over three years, using real-world user queries (Infinity-Chat100) and a psychometric creativity assessment (Alternate Uses Task) to understand trends in their creative capabilities.

As Large Language Models increasingly integrate into processes requiring ideation and creative outputs, understanding their evolving capabilities in originality, diversity, and creativity is paramount. This insight enables strategic planning for future human-AI collaboration models and innovation pipelines, ensuring technology adoption aligns with organizational creative objectives.

Traditional LLM benchmarks often focus on tasks with verifiable answers, overlooking performance on open-ended challenges.

Forward consideration, not a verified fact.