GenAIT: Development and Validation of an Objective Generative AI Literacy Test for High School Students

A new objective assessment tool, the Generative AI Literacy Test (GenAIT), has been developed and validated to measure conceptual knowledge of Generative AI (GenAI) among high school students. This 18-item multiple-choice test covers technical, practical, and human-impact domains of GenAI, with initial validation conducted on 7,432 Estonian high school students.

Why it matters

The development of objective assessment tools for Generative AI literacy is critical for understanding the baseline knowledge of emerging generations regarding this transformative technology. This enables the formulation of targeted educational strategies and curricula, ensuring future workforces and citizens are adequately prepared for a GenAI-integrated society.

Key insights

• An objective, 18-item multiple-choice test (GenAIT) has been developed for assessing GenAI literacy in high school students.
• The GenAIT measures conceptual knowledge across technical, practical, and human-impact domains of GenAI.
• Content validity was established through expert review focusing on relevance, clarity, and comprehensiveness.
• Psychometric functioning of the Estonian-language GenAIT was evaluated using confirmatory factor analysis and classical test theory in a large-scale survey of 7,432 high school students in Estonia.

Source

arXiv — Computers and Society — https://arxiv.org/abs/2608.25815