Participant uses NRL's experimental multimodal, multitask testbed.
Experimental multimodal, multitask testbed

This project, known as the "Auditory Principles" project, is basic research seeking to identify and model attentional principles for integrated uses of virtual audio information in Navy watchstanding operations.

Navy watchstanding operations increasingly involve environments in which operators must attend to more than one critical task display at a time. In response, the Navy is pursuing a model-based understanding of human performance in multitask settings.

Related research at NRL has demonstrated that the manner in which different types of spatialized (3D) auditory information are organized and presented can meaningfully improve associated task performance through principled management of operators’ attentional resources. Little of this work, however, has addressed multitask designs in which mixed uses of sound coexist in the same virtual listening space (e.g., voice communications and non-speech auditory cues); nor have the operational tasks that have been studied in this work been close analogues of Navy watchstanding functions. Accordingly, the primary objectives of this research are 1) to reconfigure NRL’s multimodal, multitask test bed with a suite of more Navy-relevant information tasks, 2) to study the integration of separate task-related uses of auditory information and identify principles of auditory organization that are correlated with optimal measures of attention, effort, and performance, and 3) to model explanations for, and the consequences of, these principles through cognitive models in the EPIC cognitive architecture.

Contact:
Derek Brock
Code 5512, Interactive Systems
Naval Research Laboratory
Washington, DC 20375
Email: w5512 "at" aic.nrl.navy.mil

Selected Publications

D. P. Brock, Peres, S. C., and McClimens, B., Evaluating Listeners’ Attention to, and Comprehension of, Serially Interleaved, Rate-accelerated Speech, in The 18th International Conference on Auditory Display, Atlanta, GA, 2012. Download PDF (615.75 KB)
B. McClimens and Brock, D. P., Effect of Decreasing Accuracy in the Temporal Processor for Attention Switches in a Complex Dual Task, in The 21st Behavior Representation in Modeling and Simulation (BRIMS) Conference, Behavior Representation in Modeling and Simulations , 2012. Download PDF (1.71 MB)
E. Martinson and Brock, D. P., Auditory Perspective Taking, IEEE Transactions on Systems, Man and Cybernetics Part A: Systems and Humans, 2012. Download PDF (884.63 KB)
C. Wasylyshyn, Brock, D. P., and McClimens, B., Comprehending Synthetically Accelerated Speech: The Relationship Between Performance and Self-Confidence, in The 17th Annual International Conference on Auditory Display, Budapest, Hungary, 2011. Download PDF (2.43 MB)
D. P. Brock, Wasylyshyn, C., McClimens, B., and Perzanowski, D., Facilitating the Watchstander's Voice Communications Task in Future Navy Operations, in 2011 IEEE Military Communications Conference, Washington, DC, 2011. Download PDF (433.78 KB)
D. P. Brock and McClimens, B., To What Extent Do Listeners Use Aural Information When It Is Present?, in The 17th Annual International Conference on Auditory Display, Budapest, Hungary, 2011. Download PDF (220.44 KB)
B. McClimens and Brock, D. P., Modeling Attention Allocation in a Complex Dual Task With and Without Auditory Cues, in The 16th International Conferenece on Human Computer Interaction, Orlando, FL, 2011. Download PDF (148.29 KB)
B. McClimens and Brock, D. P., Sonification of NRL Dual-task Data, in The 16th International Conference on Auditory Display, Washington, DC, 2010. Download PDF (106.53 KB)
C. Wasylyshyn, McClimens, B., and Brock, D. P., Comprehension of Speech Presented At Synthetically Accelerated Rates: Evaluating Training and Practice Effects, in The 16th International Conference on Auditory Display, Washington, DC, 2010. Download PDF (64.91 KB)
D. P. Brock, McClimens, B., and McCurry, M. J., Virtual Auditory Cueing Revisted, in The 16th International Conference on Auditory Display, Washington, DC, 2010. Download PDF (610.59 KB)