Successive Training Stages and Large Language Model Persuasion: Effects of Misalignment, Supervised Fine-Tuning, and Preference Optimization

A research study investigated how sequential post-training interventions, specifically misalignment through supervised fine-tuning (SFT) on conspiracy data, persuasive SFT on argumentative data, and Identity Preference Optimization (IPO), impact the persuasive power of large language models. The evaluation measured human responses among 835 participants tested against five distinct conditions across ten divisive political topics using personalized content.

Understanding the cumulative impact of post-training stages is vital for determining where models acquire disproportionate persuasive power and manipulation risks. This informs systemic risk management regarding how fine-tuning pipelines can intentionally or accidentally amplify influence on polarized political issues. Institutional leaders must understand which training layers drive behavioral and attitudinal shifts to establish effective guardrails.

The study isolates three sequential training phases: conspiracy-based SFT misalignment, argumentative SFT, and Identity Preference Optimization (IPO).

Forward consideration, not a verified fact.