Smart Enough to Go Extinct? An Evolutionary Challenge to the Value of General Intelligence and Its Ethical Implications for AGI

Research from arXiv challenges the long-held premise that general intelligence, as observed in humans, is inherently valuable. The paper argues that while the pursuit of Artificial General Intelligence (AGI) is based on this assumption, evolutionary timescales suggest that general intelligence's adaptive value is not empirically proven. Simpler life forms have persisted significantly longer than Homo sapiens, raising questions about the ultimate utility and potential ethical implications of AGI development.

Why it matters

This analysis is strategically important as it challenges fundamental assumptions underpinning significant technological and research investments in Artificial General Intelligence. If the premise of general intelligence's inherent value is flawed, it could necessitate a re-evaluation of long-term strategic objectives and ethical frameworks in AI development. Understanding this perspective is crucial for senior executives guiding innovation and risk management in fields reliant on advanced AI.

Key insights

• The inherent value of general intelligence, a core premise for AGI development, is being critically re-examined.
• Evolutionary history suggests that many non-intelligent taxa have endured for far longer periods than Homo sapiens.
• The adaptive value of general intelligence over evolutionary timescales is presented as not empirically established.
• The paper aims to provide an 'evolutionary challenge' to the value of general intelligence.
• Ethical implications for AGI are raised concerning this re-evaluation of general intelligence's inherent value.

Source

arXiv — Computers and Society — https://arxiv.org/abs/2608.10730