When XR and AI Meet - A Scoping Review on Extended Reality and Artificial Intelligence

Teresa Hirzle, Florian Müller, Fiona Draxler, Martin Schmitz, Pascal Knierim, Kasper Hornbæk

CHI 2023

Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

TL;DR

What we did: We conducted a scoping review of 311 publications to explore the intersection of Extended Reality and Artificial Intelligence research published between 2017 and 2021.

What we found: We found five main research topics, including using Artificial Intelligence to create Extended Reality worlds and understand user interactions, highlighting a vibrant yet under-explored field.

Takeaway: We emphasize the need for enhanced collaboration, ethical consideration, and methodological rigor in future research at the intersection of Extended Reality and Artificial Intelligence.

Abstract

Research on Extended Reality (XR) and Artificial Intelligence (AI) is booming, which has led to an emerging body of literature in their intersection. However, the main topics in this intersection are unclear, as are the benefits of combining XR and AI. This paper presents a scoping review that highlights how XR is applied in AI research and vice versa. We screened 2619 publications from 203 international venues published between 2017 and 2021, followed by an in-depth review of 311 papers. Based on our review, we identify five main topics at the intersection of XR and AI, showing how research at the intersection can benefit each other. Furthermore, we present a list of commonly used datasets, software, libraries, and models to help researchers interested in this intersection. Finally, we present 13 research opportunities and recommendations for future work in XR and AI research.

Abstract

Talk