TUX: Measuring Human--AI Tacit Understanding

This research introduces TUX (Tacit Understanding Index), a new metric designed to measure the alignment between human and AI judgments in collaborative settings where explicit objectives or feedback are absent. The study utilizes a spectrum-placement task, similar to the game Wavelength, to operationalize and evaluate this tacit understanding.

The development of TUX is crucial for advancing human-AI collaboration beyond explicit task performance, enabling assessment of deeper, more nuanced alignment. This capability is vital as AI systems increasingly operate as partners in complex, subjective domains where unspoken understanding influences success.

Traditional human-AI alignment evaluations often focus on explicit task success or reward optimization.

Forward consideration, not a verified fact.