Binaural unmasking is phenomenon of auditory perception discovered by Ira Hirsh.[1] In binaural unmasking, the brain combines information from the two ears in order to improve signal detection and identification in noise. The phenomenon is most commonly observed when there is a difference between the interaural phase of the signal and the interaural phase of the noise. When such a difference is present there is an improvement in masking threshold compared to a reference situation in which the interaural phases are the same, or when the stimulus has been presented monaurally. Those two cases usually give very similar thresholds. The size of the improvement is known as the "binaural masking level difference" (BMLD), or simply as the "masking level difference".
Binaural unmasking is most effective at low frequencies. The BMLD for pure tones in broadband noise reaches a maximum value of about 15 decibels (dB) at 250 Hz and progressively declines to 2-3 dB at 1500 Hz. The BMLD then stabilises at 2-3 dB for all higher frequencies, up to at least 4 kHz.[2] Binaural unmasking can also be observed for narrowband masking noises, but the effect behaves differently: larger BMLDs can be observed and there is little evidence of a decline with increasing frequency.[3]
Improved identification of speech in noise was first reported by J.C.R. Licklider.[4] Licklider noted that a difference in interaural phase that was being used in unmasking is similar to interaural time difference, which varies with the direction of a sound source and is involved in sound localisation. The fact that speech can be unmasked and the underlying cues vary with sound direction raised the possibility that binaural unmasking plays a role in the cocktail party effect.
Labelling system
editA systematic labelling system for different stimulus configurations, first used by Jeffress,[5] has been adopted by most authors in the area. The condition names are written NxSy, where x is interaural configuration of the noise and y is the interaural configuration of the signal. Some common values for x and y include:
- 0 means that the signal or noise is identical at the two ears
- π means that the signal or noise has an interaural phase difference of π radians
- τ means that the signal or noise has an interaural time difference, where the exact value of the time difference, τ, is specified elsewhere.
- ρ means that the noise has an interaural correlation of less than one, the exact correlation being specified elsewhere.
- u means that the signal or noise is uncorrelated across the two ears.
- m means that the signal or noise is monaural.
Theories
editBinaural unmasking has two main explanatory frameworks. These are based on interaural cross-correlation [6] and interaural subtraction.[7]
The cross-correlation account relies on the existence of a coincidence detection network in the midbrain similar to that proposed by Lloyd A. Jeffress[8] to account for sensitivity to interaural time differences in sound localization. Each coincidence detector receives a stream of action potentials from the two ears via a network of axons that introduce differential transmission delays. Detection of a signal is thought to occur when the response rate of the most active coincidence detector is reduced by the presence of a signal. Cross-correlation of the signals at the two ears is often used as mathematical surrogate for modelling such an array of coincidence detecting neurons; the reduced response rate is translated into a reduction in the cross-correlation maximum.
The subtractive account is known as "equalization-cancellation" or "EC" theory. In this account, the waveforms at the two ears (or their internal representations) are temporally aligned (equalized) by the brain, before being subtracted one from the other. In effect, the coincidence detectors are replaced with neurons that are excited by action potentials from one ear, but inhibited by action potentials from the other. However, EC theory is not generally framed in such explicit neurological terms, and no suitable neural substrate has been identified in the brain. Nonetheless, EC theory has proved a very popular modelling framework, and has fared well in direct comparison with cross-correlation models in psychoacoustic experiments [9]
Perceptual cues
editThe ear filters incoming sound into different frequencies: a given place in the cochlea, and a given auditory nerve fibre, respond only to a limited range of frequencies. Consequently, researchers have examined the cues that are generated by mixtures of speech and noise at the two ears within a narrow frequency band around the signal. When a signal and narrowband noise are added, a vector summation occurs in which the resultant amplitude and phase differ from those of the noise or signal alone. For a binaural unmasking stimulus, the differences between the interaural parameters of the signal and noise mean that there will be a different vector summation at each ear.[5] Consequently, regardless of the stimulus construction, there tend to be fluctuations in both the level and phase differences of the stimuli at the listener's ears.
Experiments have examined which of these cues the auditory system can best detect. These have shown that, at low frequencies (specifically 500 Hz), the auditory system is most sensitive to the interaural time differences.[10] At higher frequencies, however, there seems to be a transition to using interaural level differences.[11]
Practical implications
editIn everyday life, speech is more easily understood in noise when speech and noise come from different directions, a phenomenon known as "spatial release from masking". In this situation, the speech and noise have distinct interaural time differences and interaural level differences. The time differences are produced by the differences in the length of the sound path to the two ears and the level differences are caused by the acoustic shadowing effect of the head. These two cues play a major role in sound localisation, and have both been shown to have independent effects in spatial release from masking.[12] The interaural level differences can give rise to one ear or the other having a better signal-to-noise ratio, which would allow the listener to gain an intelligibility improvement by simply listening to that ear. However, the interaural time differences can only be exploited by comparing the waveforms at the two ears. Successful models of spatial release from masking tend to use equalization-cancellaton theory to generate the effects of interaural time differences.[13]
References
edit- ^ Hirsh IJ (1948). "The influence of interaural phase on interaural summation and inhibition". J. Acoust. Soc. Am. 20 (4): 536–544. Bibcode:1948ASAJ...20..536H. doi:10.1121/1.1906407.
- ^ Hirsh IJ, Burgeat M (1958). "Binaural Effects in Remote Masking". J. Acoust. Soc. Am. 30 (9): 827–832. Bibcode:1958ASAJ...30..827H. doi:10.1121/1.1909781.
- ^ McFadden D, Pasanen EG (1978). "Binaural detection at high frequencies with time-delayed waveforms". J. Acoust. Soc. Am. 34 (4): 1120–1131. Bibcode:1978ASAJ...63.1120M. doi:10.1121/1.381820. PMID 649871.
- ^ Licklider JC (1948). "The influence of interaural phase relations upon the masking of speech by white noise". J. Acoust. Soc. Am. 20 (2): 150–159. Bibcode:1948ASAJ...20..150L. doi:10.1121/1.1906358.
- ^ a b Jeffress LA, Blodgett HC, Sandel TT, Wood CL (1956). "Masking of Tonal Signals". J. Acoust. Soc. Am. 28 (3): 416–426. Bibcode:1956ASAJ...28..416J. doi:10.1121/1.1908346.
- ^ Colburn HS (1977). "Theory of binaural interaction based on auditory-nerve data. II. Detection of tones in noise". J. Acoust. Soc. Am. 61 (2): 525–533. Bibcode:1977ASAJ...61..525C. doi:10.1121/1.381294. PMID 845314.
- ^ Durlach NI (1963). "Equalization and cancellation theory of binaural masking-level differences". J. Acoust. Soc. Am. 35 (8): 416–426. doi:10.1121/1.1918675.
- ^ Jeffress, L.A. (1948). "A Place Theory of Sound Localization". Journal of Comparative and Physiological Psychology. 41 (1): 35–9. doi:10.1037/h0061495. PMID 18904764.
- ^ Culling JF (2007). "Evidence specifically favoring the equalization-cancellation theory of binaural unmasking". J Acoust Soc Am. 122 (5): 2803–2813. Bibcode:2007ASAJ..122.2803C. doi:10.1121/1.2785035. PMID 18189570. S2CID 24476950.
- ^ Van Der Heijden M, Joris PX (2010). "Interaural correlation fails to account for detection in a classic binaural task: Dynamic ITDs dominate N0Sπ detection". J Assoc Res Otolaryngol. 11 (1): 113–131. doi:10.1007/s10162-009-0185-8. PMC 2820206. PMID 19760461.
- ^ Culling JF (2011). "Subcomponent cues in binaural unmasking" (PDF). J Acoust Soc Am. 129 (6): 3846–3855. Bibcode:2011ASAJ..129.3846C. doi:10.1121/1.3560944. PMID 21682408.
- ^ Bronkhorst AW, Plomp, R (1988). "The effect of head-induced interaural time and level differences on speech intelligibility in noise". J Acoust Soc Am. 83: 1508–1516. doi:10.1121/1.395906. PMID 3372866.
- ^ Beutelmann R, Brand T (2006). "Prediction of speech intelligibility in spatial noise and reverberation for normal-hearing and hearing-impaired listeners". J Acoust Soc Am. 120 (1): 331–342. Bibcode:2006ASAJ..120..331B. doi:10.1121/1.2202888. PMID 16875230.