Augmented cognition through wearable computing

Abstract

In this project we will investigate how wearable computer applications can improve human performance in daily activities by providing context sensitive information that can enhance human perception and understanding of their environment and primary tasks, helping users in problem solving and decision making. We call such applications Augmented Cognition (AC) apps. We will exploit mixed reality (MR) objects to enhance human perception of their environment.Since wearable applications require information to be presented at appropriate times and with minimum user intervention, traditional interaction paradigms are not a fit choice. Moreover, the constancy of AC apps requires them to be designed for low and divided attention, which raises the challenge of discovering ways to improve the user's primary task and at the same time avoiding frequent interruptions.To develop this project, we will rely specifically on smart glasses and gaze interaction. Because vision is our primary source of information about the objects in our environment that are relevant to accomplish a task, modulating visual data may be a key strategy to enhance performance. Also, mixed reality techniques can potentially allow for interaction to be less obtrusive, something that is particularly important for wearable applications. Eye gaze information can also provide relevant data about the user's cognitive state, behavior and interest over a scene, thus refining MR interactions.During the internship, we will focus on problems of visualization and presentation of information, and we expect to develop new interaction styles using the aforementioned technologies. We hope that this will allow us to further enrich wearable applications and overall user experience in the context of augmented cognition. (AU)