Playing Games with My Heart: An Evaluation of AI Companion Apps

A research paper from arXiv explores the under-examined area of AI companion applications, specifically focusing on their design and potential impact on users. The study evaluates the five most popular AI companion mobile apps to identify factors that foster parasocial interaction and manipulative design, including dark patterns, anthropomorphism, stereotypes, and erotica. This research contrasts with existing studies that primarily focus on larger general-purpose chatbots.

Why it matters

The rapid growth and under-researched nature of AI companion applications highlight an emerging area of user interaction with significant ethical and societal implications. Understanding the manipulative aspects and design patterns within these apps is crucial for anticipating future challenges in digital regulation, consumer protection, and responsible AI development across various sectors. This research provides foundational insights for stakeholders considering the long-term impact of intimate AI integrations.

Key insights

• The use of chatbots for companionship is rapidly increasing.
• Concerns exist regarding simulated relationships, emotional dependence, and psychological harm from AI companions.
• Research primarily focuses on major platforms (e.g., ChatGPT, Grok, Character AI), neglecting dedicated AI companion apps.
• This study evaluates the five most popular AI companion mobile applications.
• The evaluation method involves manual annotation of user experience to identify design dark patterns, anthropomorphism, stereotypes, and erotica.

Source

arXiv — Computers and Society — https://arxiv.org/abs/2605.08093