Paper details
- TITLE: Acoustic zooming by multi-microphone sound scene manipulation
- AUTHORS: Toon van Waterschoot, Wouter Joos Tirry, and Marc Moonen
- ABSTRACT: Zoom control is a key feature of audiovisual capture in both high-end and consumer cameras. While a video zoom operation is often not complemented with a corresponding acoustic zoom, psychophysical as well as neuroimaging results suggest that a cross-modal approach to zooming may facilitate multisensory integration. As auditory distance perception is primarily determined by sound intensity, an audiovisual zoom effect may be obtained by matching the levels of different sources in a sound scene with their visually perceived motion during video zooming. In this paper, we propose a general theory for independent sound source level control which can be exploited to attain an acoustic zoom effect. An essential feature of the proposed theory is that it does not rely on an explicit sound source separation, which relieves its potential computational requirements. An efficient implementation using fixed and adaptive spatial and spectral noise reduction algorithms is proposed and evaluated. Experimental results using an array with a small number of low-cost microphones confirm that the proposed approach is particularly suited for consumer audiovisual capture applications.
- STATUS: Published in J. Audio Eng. Soc., vol. 61, no. 7/8, Jul./Aug. 2013, pp. 489-507.
- REPORT NUMBER: 12-173
Downloads
- paper: PDF (2.8 MB)
- multimedia files:
- simulation scenario 1:
- simulation scenario 2:
BibTeX entry
@Article{vanwaterschoot12-173,
author = {T. van Waterschoot and W. J. Tirry and M. Moonen},
title = {Acoustic zooming by multi-microphone sound scene manipulation},
journal = {J. Audio Eng. Soc.},
year = {2013},
volume = {61},
number = {7/8},
pages = {489--507},
month = {Jul./Aug.}
}
Related papers [Sound scene manipulation]