Sound Research WIKINDX

WIKINDX Resources

Hermann, T., & Ritter, H. (2004). Sound and meaning in auditory data display. Proceedings of the IEEE, 92(4), 730–741. 
Added by: sirfragalot (05/10/2013 02:48:13 PM)   Last edited by: sirfragalot (06/25/2013 12:29:07 PM)
Resource type: Journal Article
Peer reviewed
BibTeX citation key: Hermann2004
View all bibliographic details
Categories: Sound Design
Keywords: Evolution and Sound, Fear, Semantic categorization, Sonification
Creators: Hermann, Ritter
Collection: Proceedings of the IEEE
Views: 4/355
Abstract
Auditory data display is an interdisciplinary field linking auditory perception research, sound engineering, data mining, and human–computer interaction in order to make semantic contents of data perceptually accessible in the form of (nonverbal) audible sound. For this goal it is important to understand the different ways in which sound can encode meaning. We discuss this issue from the perspectives of language, music, functionality, listening modes, and physics, and point out some limitations of current techniques for auditory data display, in particular when targeting high-dimensional data sets. As a promising, potentially very widely applicable approach, we discuss the method of model-based sonification (MBS) introduced recently by the authors and point out how its natural semantic grounding in the physics of a sound generation process supports the design of sonifications that are accessible even to untrained, everyday listening. We then proceed to show that MBS also facilitates the design of an intuitive, active navigation through “acoustic aspects,” somewhat analogous to the use of successive two-dimensional views in three-dimensional visualization. Finally, we illustrate the concept with a first prototype of a “tangible” sonification interface which allows us to “perceptually map” sonification responses into active exploratory hand motions of a user, and give an outlook on some planned extensions.

  
Quotes
p.731   "Taking a perspective motivated by ecological acoustics, we will then gradually work backward in evolutionary history to bring into view increasingly more basic constituents of auditory perception that became particularly apparent as “ basic expression,” and will connect these to more elementary dimensions of meaning, whose deepest roots ultimately can be seen in physics, reflecting very fundamental laws that connect physical and geometrical properties of our environment to sound characteristics in a rather universal manner, invariant over a wide range of conditions and time scales, so that evolution found ample occasion and time to imprint these regularities deeply into the brains of our predecessors and ourselves."   Added by: sirfragalot
Keywords:   Acoustic ecology Embodied cognition Sonification
p.733   "...the laws of physics themselves can be viewed as a kind of context information for extracting meaning from sound events. Compared to other contexts, the context given by physical laws was stable all the time, so that evolution had ample time to adapt our brains extremely well to the ways how physics links sounds and their causes."   Added by: sirfragalot
Keywords:   Embodied cognition Evolution and Sound
p.734   "pitch at the extremal ends of the frequency spectrum reinforces the threatening character of intense sounds and the comforting character of weak sounds."   Added by: sirfragalot
Keywords:   perception Acoustic ecology Embodied cognition
WIKINDX 6.4.9 | Total resources: 1084 | Username: -- | Bibliography: WIKINDX Master Bibliography | Style: American Psychological Association (APA)


PHP execution time: 0.10778 s
SQL execution time: 0.07949 s
TPL rendering time: 0.00492 s
Total elapsed time: 0.19219 s
Peak memory usage: 9.5682 MB
Memory at close: 9.4356 MB
Database queries: 69