TitleFinding the FOO: a pilot study for a multimodal interface
Publication TypeConference Paper
Year of Publication2003
AuthorsPerzanowski, D, Brock, DP, Adams, W, Bugajska, MD, Schultz, AC, Trafton, JG, Blisard, S, Skubic, M
Conference NameSystems, Man and Cybernetics, 2003. IEEE International Conference on
Date Published10/2003
Keywordsdynamic autonomy, gestural inputs, gesture recognition, headphone, human computer interaction, human-robot interaction, intelligent communication, intelligent robots, man-machine systems, mobile robots, multimodal interface, natural language interfaces, object recognition, speech inputs, speech recognition, touch screen, wireless microphone, wizard-of-Oz pilot study

In our research on intuitive means for humans and intelligent, mobile robots to collaborate, we use a multimodal interface that supports speech and gestural inputs. As a preliminary step to evaluate our approach and to identify practical areas for future work, we conducted a wizard-of-Oz pilot study with five participants who each collaborated with a robot on a search task in a separate room. The goal was to find a sign in the robot's environment with the word "FOO" printed on it. Using a subset of our multimodal interface, participants were told to direct the collaboration. As their subordinate, the robot would understand their utterances and gestures, and recognize objects and structures in the search space. Participants conversed with the robot through a wireless microphone and headphone and, for gestural input, used a touch screen displaying alternative views of the robot's environment to indicate locations and objects.

Full Text
NRL Publication Release Number: