Retrieval Sensitivity to Identity Signals in Queries

Research indicates that dense retrieval systems, crucial for determining document access and influencing language models, exhibit sensitivity to identity signals embedded in user queries. Specifically, these systems show a bias towards retrieving content aligned with the political ideology expressed in a query and perform less effectively for queries framed in African American Language compared to White Mainstream English. This sensitivity was observed across multiple retrieval models in political news and consumer-health domains.

The observed biases in information retrieval systems have significant implications for fair access to information, potentially reinforcing existing disparities and echo chambers. Organizations relying on these systems must address these sensitivities to ensure equitable and unbiased information dissemination, especially in critical domains like health and public discourse.

Retrieval systems, including dense retrievers and a sparse baseline, consistently return articles aligning with the political lean expressed in a user's query.

Forward consideration, not a verified fact.