This paper presents a general model for sonification of large spatial data sets (e.g. seismic data, medical data) based on ideas from ecological acoustics. The model incorporates not only what we hear (the sounds), but also how we listen (the interaction). Metaphorically speaking the interpreter is walking along paths in areas of the data set, listening to locally and globally defined sound objects. The time aspects of sonification are given special attention, introducing the notion of temporalization. Some features of a preliminary Windows NT implementation are summarized. Keywords Sonification, ecological acoustics, everyday listening, interaction, model

Abstract: In this paper, we report on our ongoing research into multimodal investigation of geoscientific data. Our system integrates three-dimensional, interactive computer graphics, touch (haptics) and real-time sound synthesis into a multimodal interface. We present applications of multimodal investigations of geoscientific data that pertain to surface meshes on which several typical properties were mapped and to geophysical volume data. Finally, we report on the preliminary results of a psychological study, which is being conducted to increase our understanding of the recognition of audio value in an absolute sense. 1.