Gaze-based Prediction of Cognitive Load in Augmented Reality
1 HeXD Lab, The University of Texas at Dallas
2 Virginia Tech
Abstract
Cognitive load affects learning and task performance; specifically, increased cognitive load hinders an individual's ability to process information. In augmented reality (AR) interfaces, distracting notifications can also heighten cognitive load. Integrated gaze tracking offers a non-intrusive way to monitor cognitive states and provides the opportunity to predict and adapt to changes in cognitive load.
In this paper, we demonstrate how cognitive load prediction models can leverage built-in gaze-tracking data in AR to accurately predict cognitive load during search tasks. We collected gaze data from participants under both cognitively overloaded and non-overloaded states and analyzed gaze feature signatures to identify load-dependent patterns. We compared individual and group-trained models for predictive performance and generalizability. We initially used logistic regression, then tested tree-based ensemble models to improve performance. The best-performing XGBoost group model achieves a test AUC-ROC of 0.85. This work demonstrates robust cognitive load monitoring for AR tasks using built-in eye-tracking measurements.
Experiment: dual-task AR color-matching with load alerts on Magic Leap 2 (60 Hz gaze).
Signals: preprocessed gaze streams and engineered gaze features for classification.
Results: overload vs. non-overload prediction (e.g., group XGBoost test AUC-ROC 0.85).
Study video
BibTeX
@article{nerella2026gaze,
author = {Nerella, Greeshma and Gan, Daisy and David-John, Brendan and Alghofaili, Rawan},
title = {Gaze-based Prediction of Cognitive Load in Augmented Reality},
year = {2026},
issue_date = {May 2026},
publisher = {Association for Computing Machinery},
address = {New York, NY, USA},
volume = {10},
number = {3},
url = {https://doi.org/10.1145/3806040},
doi = {10.1145/3806040},
journal = {Proc. ACM Hum.-Comput. Interact.},
month = {may},
articleno = {ETRA026},
numpages = {18},
}