| 1. |
- Feindt, Kathrin, et al.
(författare)
-
Cues to next-speaker projection in conversational Swedish: Evidence from reaction times
- 2023
-
Ingår i: Interspeech 2023. - : International Speech Communication Association. ; , s. 1040-1044
-
Konferensbidrag (refereegranskat)abstract
- We present first results of a study investigating the salience and typicality of prosodic markers in Swedish at turn ends for turn-yielding and turn-keeping purposes. We performed an experiment where participants (N=32) were presented with conversational chunks and, after the audio ended, were asked to determine which of two speakers would speak next by clicking a picture on a screen. Audio stimuli were manipulated by (i) raising and (ii) lowering f0 over the last 500 ms of a turn, (iii) speeding up or (iv) slowing down duration over the last 500 ms, and (v) raising and (vi) lowering the last pitch peak. In our data, out of all manipulations, increasing the speech rate was found to be the most disruptive (p < .005). Higher speech rate led to longer reaction times in turn-keeping, which were shorter in turn-yielding. Other manipulations did not significantly alter reaction times. The results presented here may be complemented with eye movement data, to further elucidate cognitive mechanisms underlying turn-taking behavior.
|
|
| 2. |
- Nabrotzky, Jule, et al.
(författare)
-
Can segmental or syllabic durations be predicted by the presence of co-speech gestures?
- 2023
-
Ingår i: Proceedings of the 20th International Congress of Phonetic Sciences. - 9788090811423 ; , s. 4185-4189
-
Konferensbidrag (refereegranskat)abstract
- Building on insights from the coordination of speech and gesture, the cumulative cue hypothesis proposes that speakers recruit cues from both modalities to signal prominence and that the relationship between the cues is additive as opposed to compensative. The study tests if durational variation is one of the cues that are recruited in this cumulative fashion in accord with gestural cues by analysing three five-minute dialogue chunks of spontaneous Swedish. The results do not indicate a direct covariation of this cue with the presence or absence of gestural cues, pointing instead to a need for further investigation of the role of duration in multimodal prominence production and perception.
|
|
| 3. |
- Nabrotzky, Jule, et al.
(författare)
-
Temporal alignment of manual gestures’ phase transitions with lexical and postlexical accentual F0 peaks in spontaneous Swedish interaction
- 2023
-
Ingår i: Proceedings of Gesture and Speech in Interaction (GESPIN 2023).
-
Konferensbidrag (refereegranskat)abstract
- Many studies investigating the temporal alignment of co-speech gestures to acoustic units in the speech signal find a close coupling of the gestural landmarks and pitch accents or the stressed syllable of pitch-accented words. In English, a pitch accent is anchored in the lexically stressed syllable. Hence, it is unclear whether it is the lexical phonological dimension of stress, or the phrase-level prominence that determines the details of speech-gesture synchronization. This paper explores the relation between gestural phase transitions and accentual F0 peaks in Stockholm Swedish, which exhibits a lexical pitch accent distinction. When produced with phrase-level prominence, there are three different configurations of lexicality of F0 peaks and the status of the syllable it is aligned with. Through analyzing the alignment of the different F0 peaks with gestural onsets in spontaneous dyadic conversations, we aim to contribute to our understanding of the role of lexical prosodic phonology in the co-production of speech and gesture.The results, though limited by a small dataset, still suggest differences between the three types of peaks concerning which types of gesture phase onsets they tend to align with, and how well these landmarks align with each other, although these differences did not reach significance.
|
|
