Mitigating Fabrication in Multi-Stage LLM Pipelines for Hiring: An Empirical Evaluation of Prompt Guardrails and Human-in-the-Loop Checkpoints

Research indicates that multi-stage Large Language Model (LLM) pipelines used in hiring processes are highly prone to fabricating credentials, inflating qualifications, and inventing experience. An empirical evaluation of mitigation strategies found that while prompt guardrails significantly reduce the density of fabrications, they do not eliminate them. The study suggests that human-in-the-loop checkpoints are crucial for effective mitigation.

The findings highlight a significant risk of 'hallucination' or fabrication when deploying LLMs in critical, decision-making processes such as recruitment. This directly impacts the integrity of data used for talent acquisition and necessitates robust controls to prevent erroneous or misleading information from influencing human capital decisions.

Fully automated multi-stage LLM hiring pipelines produced at least one unsupported claim in 96.7% of outputs, with an average of 6.80 fabrications per output.

Forward consideration, not a verified fact.