Activating the Annotator: Operationalising Lived Experience in Data Annotation

A research study introduces AXLE, a method designed to activate annotators' lived experiences in subjective natural language processing tasks. Moving beyond standard demographic questionnaires that treat positionality as a static covariate, the framework employs pre-annotation scenario vignettes and conversational micro-narratives to dynamically prime annotator perspectives before labelling commences.

This research addresses a core methodological flaw in how subjective machine learning training data is collected and contextualised. By establishing ways to actively prime lived experience rather than relying on passive demographic surveys, institutions can achieve more faithful representations of human judgment in artificial intelligence models. This matters because model alignment and fairness initiatives risk systematic failure if the underlying annotator ground truth misrepresents human perspective.

Perspectivist natural language processing currently lacks operational methods to effectively integrate annotator positionality into data labelling.

Forward consideration, not a verified fact.