Skip to main content
Intelligence

ai

Evaluating Personal Information Output from Conversational Interactions in Generative AI Systems

arXiv: Computers and SocietyInternationalModerate confidence1 min

What changed

An exploratory pilot study evaluated the scope and perceived accuracy of personal information output from generative AI systems (GPT-5.2 Instant and GPT-5.2 Thinking) during conversational interactions. The study, involving 15 Japanese participants, categorized outputs as Fact, Inference, and Confidence. Key findings indicate that model design differences had limited impact on personal information output patterns. 'Fact' type outputs demonstrated a more conservative pattern than 'Inference' types. Core Personal attributes, such as identification information, were handled conservatively, while Behavioral and Linguistic attributes showed higher output rates.

Why it matters

This research highlights the varying propensity of generative AI systems to output different categories of personal information during conversations. Understanding these tendencies is crucial for developing robust data governance frameworks and privacy safeguards, particularly as these systems become more integrated into business operations and public-facing services. Organizations must assess the risks associated with such outputs to maintain trust and ensure compliance with data protection regulations.

What to watch

Differences in generative AI model design (GPT-5.2 Instant and GPT-5.2 Thinking) had limited impact on personal information output tendencies during conversational interactions.

Forward consideration, not a verified fact.

Reported by arXiv: Computers and Society, International. The document itself is not reproduced here.

Read the original publication