What we did:We built CloudBits, an augmented reality system for head-mounted displays that visualizes and retrieves information proactively during conversations.
What we found:We found that CloudBits enhances mutual awareness and re-engagement in conversations by providing shared, spatially organized, and contextually relevant information bits.
Takeaway:Our work contributes guidelines for designing conversation support systems that leverage spatial interaction and allow for selective sharing of private and public information.
Abstract
The retrieval of additional information from public (e.g., map data) or private (e.g., e-mail) information sources using personal smart devices is a common habit in today’s co-located conversations. This behavior of users imposes challenges in two main areas: 1) cognitive focus switching and 2) information sharing. In this paper, we explore a novel approach for conversation support through augmented information bits, allowing users to see and access information right in front of their eyes. To that end, we investigate the requirements for the design of a user interface to support conversations through proactive information retrieval in an exploratory study. Based on the results, we 2) present CloudBits: A set of visualization and interaction techniques to provide mutual awareness and enhance coupling in conversations through augmented zero-query search visualization along with its prototype implementation. Finally, we 3) report the findings of a qualitative evaluation and conclude with guidelines for the design of user interfaces for conversation support.
Talk
Playing videos on this website requires sharing information with YouTube and
accepting cookies.
We conducted an in-the-wild study to explore user expectations of proactive artificial intelligence systems across various use cases and proactivity levels with 272 participants using our mobile application ProfileMe.
We conducted a user study to investigate the effects of shared gaze on collaboration in collocated Augmented Reality by varying gaze visibility, task types, and interaction spaces across three collaborative tasks.