Do It Fast, Forget It Fast: How Timing and Limb Visualizations Affect First-Person Augmented Reality Instructions

Clara Sayffaerth, Ehbal Ablimit, Annika Köhler, Jonas Wombacher, Albrecht Schmidt, Florian Müller

CHI 2026

Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems

TL;DR

What we did: We conducted a controlled experiment to investigate the effects of imitation timing (parallel vs. sequential) and limb visualizations (hand vs. full arm) on user performance and experience in first-person Augmented Reality instructions.

What we found: We found that parallel imitation resulted in faster performance and greater embodiment, while sequential imitation improved memory retention and comfort, with hands-only visualizations enhancing order recall.

Takeaway: Our findings inform the design of Augmented Reality instruction systems, suggesting that timing and limb representation should be carefully considered to balance speed, retention, and user experience.

Abstract

Acquiring tacit knowledge and practical skills often depends on direct observation and in situ training. AR offers an alternative by overlaying first-person step-by-step instructions that guide users through tasks such as assembly and repair. Previous work demonstrates the effectiveness of AR instruction for specific applications. In our experimental work, we systematically explore aspects of the broader design space. We conducted a controlled experiment (n = 40) to investigate three key factors identified in learning theory and XR embodiment research: imitation timing (parallel vs. sequential), limb visualization (hand vs. full arm), and limb visibility (opaque vs. semi-transparent). Across all conditions, participants followed AR instructions and afterward repeated the tasks from memory. We assessed performance, user experience, and retention. Our results show that parallel imitation is faster and increases embodiment, whereas sequential imitation enhances memory retention and comfort. Our findings provide guidance for the temporal and visual design of first-person AR tutorials.