Verifiable, Articulable, and Tacit Components of Preference

Recent research highlights that human preferences in various domains, including creative fields, often contain components that are difficult to articulate or verify, termed 'tacit.' While modern AI models are typically improved through articulated rules and verifiers, these tacit components are frequently overlooked. A new large dataset, CreativePreferences, has been introduced to study these aspects, revealing 'articulability gaps' and 'verifiability gaps' in preference modeling.

This research underscores a fundamental limitation in current AI development regarding the nuanced understanding of human preferences, particularly in subjective or creative contexts. Addressing these 'tacit' components is crucial for developing AI systems that can genuinely align with complex human values and decision-making, impacting product design, user experience, and automated content generation.

Human preferences across diverse domains include 'tacit' components that resist clear articulation or verification.

Forward consideration, not a verified fact.