Reference-Distribution Dependence in LLM-Based Synthetic Persona Data: Diagnosis and Post Hoc Adjustment of Demographic Distributions

Research has diagnosed the fidelity of demographic distributions in LLM-based synthetic persona data, specifically identifying that the primary source of error in matching external distributions is attributable to the choice of the reference distribution, rather than the data generator itself. A case study comparing 1,000,000 synthetic records against Korean official statistics revealed a bias bound of 1.81 percentage points across sex, age group, and province variables.

The fidelity of synthetic data is critical for robust analytical applications, strategic planning, and policy development, particularly in areas requiring accurate demographic representation. Understanding that reference distribution choice is a major error source highlights the need for careful selection and validation of ground truth, which can significantly impact the reliability and trustworthiness of insights derived from synthetic datasets.

The accuracy of demographic distributions in LLM-based synthetic persona data is significantly influenced by the chosen external reference distribution.

Forward consideration, not a verified fact.