| 1. |
- Koelewijn, Thomas, et al.
(författare)
-
The effect of monetary reward on listening effort and sentence recognition
- 2021
-
Ingår i: Hearing Research. - : Elsevier. - 0378-5955 .- 1878-5891. ; 406
-
Tidskriftsartikel (refereegranskat)abstract
- Recently we showed that higher reward results in increased pupil dilation during listening (listening effort). Remarkably, this effect was not accompanied with improved speech reception. Still, increased listening effort may reflect more in-depth processing, potentially resulting in a better memory representation of speech. Here, we investigated this hypothesis by also testing the effect of monetary reward on recognition memory performance. Twenty-four young adults performed speech reception threshold (SRT) tests, either hard or easy, in which they repeated sentences uttered by a female talker masked by a male talker. We recorded the pupil dilation response during listening. Participants could earn a high or low reward and the four conditions were presented in a blocked fashion. After each SRT block, participants performed a visual sentence recognition task. In this task, the sentences that were presented in the preceding SRT task were visually presented in random order and intermixed with unfamiliar sentences. Participants had to indicate whether they had previously heard the sentence or not. The SRT and sentence recognition were affected by task difficulty but not by reward. Contrary to our previous results, peak pupil dilation did not reflect effects of reward. However, post-hoc time course analysis (GAMMs) revealed that in the hard SRT task, the pupil response was larger for high than low reward. We did not observe an effect of reward on visual sentence recognition. Hence, the current results provide no conclusive evidence that the effect of monetary reward on the pupil response relates to the memory encoding of speech. (c) 2021 The Author(s). Published by Elsevier B.V. This is an open access article under the CC BY license ( http://creativecommons.org/licenses/by/4.0/ )
|
|
| 2. |
- Koelewijn, Thomas, et al.
(författare)
-
The effect of reward on listening effort as reflected by the pupil dilation response
- 2018
-
Ingår i: Hearing Research. - : ELSEVIER SCIENCE BV. - 0378-5955 .- 1878-5891. ; 367, s. 106-112
-
Tidskriftsartikel (refereegranskat)abstract
- Listening to speech in noise can be effortful but when motivated people seem to be more persevering. Previous research showed effects of monetary reward on autonomic responses like cardiovascular reactivity and pupil dilation while participants processed auditory information. The current study examined the effects of monetary reward on the processing of speech in noise and related listening effort as reflected by the pupil dilation response. Twenty-four participants (median age 21 yrs) performed two speech reception threshold (SRT) tasks, one tracking 50% correct (hard) and one tracking 85% correct (easy), both of which they listened to and repeated sentences uttered by a female talker. The sentences were presented with a single male talker or, in a control condition, in quiet. Participants were told that they could earn a high (5 euros) or low (0.20 euro) reward when repeating 70% or more of the sentences correctly. Conditions were presented in a blocked fashion and during each trial, pupil diameter was recorded. At the end of each block, participants rated the effort they had experienced, their performance, and their tendency to quit listening. Additionally, participants performed a working memory capacity task and filled in a need-for-recovery questionnaire as these tap into factors that influence the pupil dilation response. The results showed no effect of reward on speech perception performance as reflected by the SRT. The peak pupil dilation showed a significantly larger response for high than for low reward, for the easy and hard conditions, but not the control condition. Higher need for recovery was associated with a higher subjective tendency to quit listening. Consistent with the Framework for Understanding Effortful Listening, we conclude that listening effort as reflected by the peak pupil dilation is sensitive to the amount of monetary reward. (C) 2018 The Authors. Published by Elsevier B.V.
|
|
| 3. |
|
|
| 4. |
|
|
| 5. |
- Wendt, Dorothea, et al.
(författare)
-
Toward a more comprehensive understanding of the impact of masker type and signal-to-noise ratio on the pupillary response while performing a speech-in-noise test
- 2018
-
Ingår i: Hearing Research. - : Elsevier. - 0378-5955 .- 1878-5891. ; 369, s. 67-78
-
Tidskriftsartikel (refereegranskat)abstract
- Difficulties arising in everyday speech communication often result from the acoustical environment, which may contain interfering background noise or competing speakers. Thus, listening and understanding speech in noise can be exhausting. Two experiments are presented in the current study that further explored the impact of masker type and Signal-to-Noise Ratio (SNR) on listening effort by means of pupillometry. In both studies, pupillary responses of participants were measured while performing the Danish Hearing in Noise Test (HINT; Nielsen and Dau, 2011). The first experiment aimed to replicate and extend earlier observed effects of noise type and semantic interference on listening effort (Koelewijn et al., 2012). The impact of three different masker types, i.e. a fluctuating noise, a 1-talker masker and a 4-talker masker on listening effort was examined at a fixed speech intelligibility. In a second experiment, effects of SNR on listening effort were examined while presenting the HINT sentences across a broad range of fixed SNRs corresponding to intelligibility scores ranging from 100% to 0% correct performance. A peak pupil dilation (PPD) was calculated and a Growth Curve Analysis (GCA) was performed to examine listening effort involved in speech recognition as a function of SNR. The results of two experiments showed that the pupil dilation response is highly affected by both masker type and SNR when performing the HINT. The PPD was highest, suggesting the highest level of effort, for speech recognition in the presence of the 1-talker masker in comparison to the 4-talker babble and the fluctuating noise masker. However, the disrupting effect of one competing talker disappeared for intelligibly levels around 50%. Furthermore, it was demonstrated that the pupillary response strongly varied as a function of SNRs. Listening effort was highest for intermediate SNRs with performance accuracies ranging between 30% and 70% correct. GCA revealed time-dependent effects of the SNR on the pupillary response that were not reflected in the PPD. (C) 2018 Elsevier B.V. All rights reserved.
|
|
| 6. |
- Besser, Jana, et al.
(författare)
-
How Linguistic Closure and Verbal Working Memory Relate to Speech Recognition in Noise-A Review
- 2013
-
Ingår i: Trends in Amplification. - : Sage Publications. - 1084-7138. ; 17:2, s. 75-93
-
Tidskriftsartikel (refereegranskat)abstract
- The ability to recognize masked speech, commonly measured with a speech reception threshold (SRT) test, is associated with cognitive processing abilities. Two cognitive factors frequently assessed in speech recognition research are the capacity of working memory (WM), measured by means of a reading span (Rspan) or listening span (Lspan) test, and the ability to read masked text (linguistic closure), measured by the text reception threshold (TRT). The current article provides a review of recent hearing research that examined the relationship of TRT and WM span to SRTs in various maskers. Furthermore, modality differences in WM capacity assessed with the Rspan compared to the Lspan test were examined and related to speech recognition abilities in an experimental study with young adults with normal hearing (NH). Span scores were strongly associated with each other, but were higher in the auditory modality. The results of the reviewed studies suggest that TRT and WM span are related to each other, but differ in their relationships with SRT performance. In NH adults of middle age or older, both TRT and Rspan were associated with SRTs in speech maskers, whereas TRT better predicted speech recognition in fluctuating nonspeech maskers. The associations with SRTs in steady-state noise were inconclusive for both measures. WM span was positively related to benefit from contextual information in speech recognition, but better TRTs related to less interference from unrelated cues. Data for individuals with impaired hearing are limited, but larger WM span seems to give a general advantage in various listening situations.
|
|
| 7. |
|
|
| 8. |
- Koelewijn, Thomas, et al.
(författare)
-
Processing Load Induced by Informational Masking Is Related to Linguistic Abilities
- 2012
-
Ingår i: International Journal of Otolaryngology. - : Hindawi Publishing Corporation. - 1687-9201 .- 1687-921X.
-
Tidskriftsartikel (refereegranskat)abstract
- It is often assumed that the benefit of hearing aids is not primarily reflected in better speech performance, but that it is reflected in less effortful listening in the aided than in the unaided condition. Before being able to assess such a hearing aid benefit the present study examined how processing load while listening to masked speech relates to inter-individual differences in cognitive abilities relevant for language processing. Pupil dilation was measured in thirty-two normal hearing participants while listening to sentences masked by fluctuating noise or interfering speech at either 50% and 84% intelligibility. Additionally, working memory capacity, inhibition of irrelevant information, and written text reception was tested. Pupil responses were larger during interfering speech as compared to fluctuating noise. This effect was independent of intelligibility level. Regression analysis revealed that high working memory capacity, better inhibition, and better text reception were related to better speech reception thresholds. Apart from a positive relation to speech recognition, better inhibition and better text reception are also positively related to larger pupil dilation in the single-talker masker conditions. We conclude that better cognitive abilities not only relate to better speech perception, but also partly explain higher processing load in complex listening conditions.
|
|
| 9. |
- Koelewijn, Thomas, et al.
(författare)
-
Pupil Dilation Uncovers Extra Listening Effort in the Presence of a Single-Talker Masker
- 2012
-
Ingår i: Ear and Hearing. - : Lippincott, Williams and Wilkins. - 0196-0202 .- 1538-4667. ; 33:2, s. 291-300
-
Tidskriftsartikel (refereegranskat)abstract
- Objectives: Recent research has demonstrated that pupil dilation, a measure of mental effort (cognitive processing load), is sensitive to differences in speech intelligibility. The present study extends this outcome by examining the effects of masker type and age on the speech reception threshold (SRT) and mental effort. less thanbrgreater than less thanbrgreater thanDesign: In young and middle-aged adults, pupil dilation was measured while they performed an SRT task, in which spoken sentences were presented in stationary noise, fluctuating noise, or together with a single-talker masker. The masker levels were adjusted to achieve 50% or 84% sentence intelligibility. less thanbrgreater than less thanbrgreater thanResults: The results show better SRTs for fluctuating noise and a single-talker masker compared with stationary noise, which replicates results of previous studies. The peak pupil dilation, reflecting mental effort, was larger in the single-interfering speaker condition compared with the other masker conditions. Remarkably, in contrast to the thresholds, no differences in peak dilation were observed between fluctuating noise and stationary noise. This effect was independent of the intelligibility level and age. less thanbrgreater than less thanbrgreater thanConclusions: To maintain similar intelligibility levels, participants needed more mental effort for speech perception in the presence of a single-talker masker and then with the two other types of maskers. This suggests an additive interfering effect of speech information from the single-talker masker. The dissociation between these performance and mental effort measures underlines the importance of including measurements of pupil dilation as an independent index of mental effort during speech processing in different types of noisy environments and at different intelligibility levels.
|
|
| 10. |
- Koelewijn, Thomas, et al.
(författare)
-
The influence of informational masking on speech perception and pupil response in adults with hearing impairment
- 2014
-
Ingår i: Journal of the Acoustical Society of America. - : American Institute of Physics (AIP). - 0001-4966 .- 1520-8524. ; 135:3, s. 1596-1606
-
Tidskriftsartikel (refereegranskat)abstract
- A recent pupillometry study on adults with normal hearing indicates that the pupil response during speech perception (cognitive processing load) is strongly affected by the type of speech masker. The current study extends these results by recording the pupil response in 32 participants with hearing impairment (mean age 59 yr) while they were listening to sentences masked by fluctuating noise or a single-talker. Efforts were made to improve audibility of all sounds by means of spectral shaping. Additionally, participants performed tests measuring verbal working memory capacity, inhibition of interfering information in working memory, and linguistic closure. The results showed worse speech reception thresholds for speech masked by single-talker speech compared to fluctuating noise. In line with previous results for participants with normal hearing, the pupil response was larger when listening to speech masked by a single-talker compared to fluctuating noise. Regression analysis revealed that larger working memory capacity and better inhibition of interfering information related to better speech reception thresholds, but these variables did not account for inter-individual differences in the pupil response. In conclusion, people with hearing impairment show more cognitive load during speech processing when there is interfering speech compared to fluctuating noise. (C) 2014 Acoustical Society of America.
|
|
| 11. |
- Koelewijn, Thomas, et al.
(författare)
-
The pupil response is sensitive to divided attention during speech processing
- 2014
-
Ingår i: Hearing Research. - : Elsevier. - 0378-5955 .- 1878-5891. ; 312, s. 114-120
-
Tidskriftsartikel (refereegranskat)abstract
- Dividing attention over two streams of speech strongly decreases performance compared to focusing on only one. How divided attention affects cognitive processing load as indexed with pupillometry during speech recognition has so far not been investigated. In 12 young adults the pupil response was recorded while they focused on either one or both of two sentences that were presented dichotically and masked by fluctuating noise across a range of signal-to-noise ratios. In line with previous studies, the performance decreases when processing two target sentences instead of one. Additionally, dividing attention to process two sentences caused larger pupil dilation and later peak pupil latency than processing only one. This suggests an effect of attention on cognitive processing load (pupil dilation) during speech processing in noise.
|
|
| 12. |
- Koelewijn, Thomas, et al.
(författare)
-
The pupil response reveals increased listening effort when it is difficult to focus attention
- 2015
-
Ingår i: Hearing Research. - : Elsevier. - 0378-5955 .- 1878-5891. ; 323, s. 81-90
-
Tidskriftsartikel (refereegranskat)abstract
- Recent studies have shown that prior knowledge about where, when, and who is going to talk improves speech intelligibility. How related attentional processes affect cognitive processing load has not been investigated yet. In the current study, three experiments investigated how the pupil dilation response is affected by prior knowledge of target speech location, target speech onset, and who is going to talk. A total of 56 young adults with normal hearing participated. They had to reproduce a target sentence presented to one ear while ignoring a distracting sentence simultaneously presented to the other ear. The two sentences were independently masked by fluctuating noise. Target location (left or right ear), speech onset, and talker variability were manipulated in separate experiments by keeping these features either fixed during an entire block or randomized over trials. Pupil responses were recorded during listening and performance was scored after recall. The results showed an improvement in performance when the location of the target speech was fixed instead of randomized. Additionally, location uncertainty increased the pupil dilation response, which suggests that prior knowledge of location reduces cognitive load. Interestingly, the observed pupil responses for each condition were consistent with subjective reports of listening effort. We conclude that communicating in a dynamic environment like a cocktail party (where participants in competing conversations move unpredictably) requires substantial listening effort because of the demands placed on attentional processes. (C) 2015 The Authors. Published by Elsevier B.V. This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/).
|
|
| 13. |
- Zekveld, Adriana, 1981-, et al.
(författare)
-
The application of pupillometry to assess processing load during listening to speech in challenging conditions
- 2012
-
Ingår i: Proceedings of the International Conference on Noise Control Engineering.
-
Konferensbidrag (övrigt vetenskapligt/konstnärligt)abstract
- Within the field of Audiology, a reliable measure of cognitive load while listening to speech is highly needed. A promising method is measurement of the pupil response. The reliability and validity of this application of pupillometry is discussed by combining and comparing the results of five studies assessing the influence of speech perception difficulty (speech-to-noise ratio) on cognitive load during listening. The results show consistently larger pupil responses in more difficult listening conditions. Furthermore, the data indicate that the pupil response provides information additional to speech recognition performance and subjective measures. Overall, the potential of pupillometry as a sensitive and valid cognitive load index is confirmed by the data.
|
|
| 14. |
- Zekveld, Adriana, et al.
(författare)
-
The Pupil Dilation Response to Auditory Stimuli: Current State of Knowledge
- 2018
-
Ingår i: TRENDS IN HEARING. - : SAGE PUBLICATIONS INC. - 2331-2165. ; 22
-
Forskningsöversikt (refereegranskat)abstract
- The measurement of cognitive resource allocation during listening, or listening effort, provides valuable insight in the factors influencing auditory processing. In recent years, many studies inside and outside the field of hearing science have measured the pupil response evoked by auditory stimuli. The aim of the current review was to provide an exhaustive overview of these studies. The 146 studies included in this review originated from multiple domains, including hearing science and linguistics, but the review also covers research into motivation, memory, and emotion. The present review provides a unique overview of these studies and is organized according to the components of the Framework for Understanding Effortful Listening. A summary table presents the sample characteristics, an outline of the study design, stimuli, the pupil parameters analyzed, and the main findings of each study. The results indicate that the pupil response is sensitive to various task manipulations as well as interindividual differences. Many of the findings have been replicated. Frequent interactions between the independent factors affecting the pupil response have been reported, which indicates complex processes underlying cognitive resource allocation. This complexity should be taken into account in future studies that should focus more on interindividual differences, also including older participants. This review facilitates the careful design of new studies by indicating the factors that should be controlled for. In conclusion, measuring the pupil dilation response to auditory stimuli has been demonstrated to be sensitive method applicable to numerous research questions. The sensitivity of the measure calls for carefully designed stimuli.
|
|
