| 1. |
|
|
| 2. |
- Eyben, Florian, et al.
(författare)
-
Emotion in the singing voice—a deeper look at acoustic features in the light of automatic classification
- 2015
-
Ingår i: EURASIP Journal on Audio, Speech, and Music Processing. - : Springer Science and Business Media LLC. - 1687-4714 .- 1687-4722.
-
Tidskriftsartikel (refereegranskat)abstract
- We investigate the automatic recognition of emotions in the singing voice and study the worth and role of a variety of relevant acoustic parameters. The data set contains phrases and vocalises sung by eight renowned professional opera singers in ten different emotions and a neutral state. The states are mapped to ternary arousal and valence labels. We propose a small set of relevant acoustic features basing on our previous findings on the same data and compare it with a large-scale state-of-the-art feature set for paralinguistics recognition, the baseline feature set of the Interspeech 2013 Computational Paralinguistics ChallengE (ComParE). A feature importance analysis with respect to classification accuracy and correlation of features with the targets is provided in the paper. Results show that the classification performance with both feature sets is similar for arousal, while the ComParE set is superior for valence. Intra singer feature ranking criteria further improve the classification accuracy in a leave-one-singer-out cross validation significantly.
|
|
| 3. |
- Friberg, Anders, Professor, et al.
(författare)
-
Prediction of three articulatory categories in vocal sound imitations using models for auditory receptive fields
- 2018
-
Ingår i: Journal of the Acoustical Society of America. - : Acoustical Society of America (ASA). - 0001-4966 .- 1520-8524. ; 144:3, s. 1467-1483
-
Tidskriftsartikel (refereegranskat)abstract
- Vocal sound imitations provide a new challenge for understanding the coupling between articulatory mechanisms and the resulting audio. In this study, we have modeled the classification of three articulatory categories, phonation, supraglottal myoelastic vibrations, and turbulence from audio recordings. Two data sets were assembled, consisting of different vocal imitations by four professional imitators and four non-professional speakers in two different experiments. The audio data were manually annotated by two experienced phoneticians using a detailed articulatory description scheme. A separate set of audio features was developed specifically for each category using both time-domain and spectral methods. For all time-frequency transformations, and for some secondary processing, the recently developed Auditory Receptive Fields Toolbox was used. Three different machine learning methods were applied for predicting the final articulatory categories. The result with the best generalization was found using an ensemble of multilayer perceptrons. The cross-validated classification accuracy was 96.8 % for phonation, 90.8 % for supraglottal myoelastic vibrations, and 89.0 % for turbulence using all the 84 developed features. A final feature reduction to 22 features yielded similar results.
|
|
| 4. |
- Gerholm, Tove, et al.
(författare)
-
The Swedish MINT Project : modelling infant language acquisition from parten-child interaction
- 2015
-
Konferensbidrag (övrigt vetenskapligt/konstnärligt)abstract
- The MINT-project is a longitudinal study of verbal and nonverbal interaction between 73 Swedish children and their parents, recorded in lab environment from 3 months to 3 years of age. The overall goal of the project is to deepen our understanding of how language acquisition takes place in a multimodal and interactional framework.
|
|
| 5. |
|
|
| 6. |
|
|
| 7. |
|
|
| 8. |
|
|
| 9. |
|
|
| 10. |
|
|
| 11. |
|
|
| 12. |
|
|
| 13. |
|
|
| 14. |
|
|
| 15. |
- Salomão, Gláucia Laís
(författare)
-
Expressão vocal de emoções [Vocal expression of emotions] : metáfora sonora, fala e canto [Sound metaphors, speech and singing]
- 2016
-
Ingår i: Sonoridades [Sonorities]. - : Pontíficia Universidade Católica de São Paulo. - 9788560453320 ; , s. 31-43
-
Bokkapitel (refereegranskat)abstract
- The communication of emotions is crucial to social relationships and plays a fundamental role in maintaining the social order between people. In this chapter we are looking at the communication of emotions through two expressive modalities that make use of sound as a mean of communication, i.e. speech and singing. Throughout the text we argue in favor of the idea that the vocal expression of emotions reflects physiological aspects associated to the emotion itself that is expressed; that there are many similarities between the expressive patterns found in speech and in singing; and that the singing is expressive bacause it has traces of expressive patterns of speech.
|
|
| 16. |
|
|
| 17. |
|
|
| 18. |
|
|
| 19. |
|
|
| 20. |
|
|
| 21. |
|
|
| 22. |
- Salomão, Gláucia Laís, et al.
(författare)
-
Perceptual relevance of voice source characteristics in male singers' modal and falsetto registers
- 2010
-
Konferensbidrag (refereegranskat)abstract
- It is commonly assumed that the voice source differs between modal and falsetto registers. However, singers often try to reduce the timbral differences between registers, some even doubting that they even exist. The purpose of this study was to investigate the relation between the perceived voice register and the voice source parameters in modal and in falsetto registers as analyzed by inverse filtering and electroglottography. A total of 52 falsetto register tones and 52 modal register tones, sung by 13 male more or less experienced choir singers, were classified by 16 expert listeners in a forced choice test. The listeners’ classifications mostly agreed with the registers intended by the singers. For some tones classification differed substantially, presumably because the singers had learnt to reduce the timbral contrasts between the registers. The number of votes for modal was compared to the following voice source parameters: duration of the closed phase and closed quotient (Qclosed), peak-to-peak airflow amplitude, maximum flow declination rate (MFDR), normalized amplitude quotient (NAQ, defined as the ratio between peak-to-peak airflow amplitude and MFDR multiplied by the fundamental frequency) and level difference between the two lowest source spectrum partials. The results showed that: (1) tones with higher values of Qclosed and of MFDR, and lower values of H1-H2 and NAQ were typically associated with higher number of votes to the modal register, and viceversa, (2) NAQ was the single voice source parameter that presented the strongest correlation with the register classification data, while (3) the combination of Qclosed and H1-H2 parameters was the strongest predictor of the voice source perceptual data.
|
|
| 23. |
|
|
| 24. |
- Salomão, Glaucia Lais, et al.
(författare)
-
Relation between perceived voice register and flow glottogram parameters in males
- 2008
-
Ingår i: Journal of the Acoustical Society of America. - : American Institute of Physics (AIP). - 0001-4966 .- 1520-8524. ; 124:1, s. 546-551
-
Tidskriftsartikel (refereegranskat)abstract
- The perception of modal and falsetto registers was analyzed in a material consisting of a total of 104 vowel sounds sung by 13 choir singers, 52 sung in modal register, and 52 in falsetto register. These vowel sounds were classified by 16 expert listeners in a forced choice test and the number of votes for modal was compared to the voice source parameters: (1) closed quotient (Q(closed)), (2) level difference between the two lowest source spectrum partials (H1-H2), (3) AC amplitude, (4) maximum flow declination rate (MFDR), and (5) normalized amplitude quotient (NAQ, AC amplitude/MFDR* fundamental frequency). Tones with a high value of Q(closed) and low values of H1-H2 and of NAQ were typically associated with high number of votes for modal register, and vice versa, Q(closed) showing the strongest correlation. Some singer subjects produced tones that could not be classified as either falsetto or modal register, suggesting that classification of registers is not always feasible.
|
|
| 25. |
|
|
| 26. |
- Salomão, Gláucia Laís, PhD
(författare)
-
Relationship between perceived vocal registers and glottal flow parameters : preliminary results
- 2008
-
Ingår i: Proceedings of the 4th International Conference on Speech Prosody. ; , s. 49-52
-
Konferensbidrag (refereegranskat)abstract
- The perception of modal and falsetto registers was analyzed in a material consisting of a total of 80 vowels sung by 10 choir singers, 40 sung in modal register and 40 in falsetto register. These vowels were classified by sixteen trained listeners in a force choice test and the number of votes for modal was compared with the voice-source parameters (1) Closed Quotient (Qclosed) and (2) level difference between the two lowest source spectrum partials (H1 - H2). Tones with a high value of Qclosed and low values of H1-H2 were typically associated with high number of votes for modal register, and vice versa, Qclosed showing the strongest correlation. Some singers produced tones that could not be classified as either falsetto or modal register, suggesting that categorical perception of registers is not always feasible.
|
|
| 27. |
- Salomão, Gláucia Laís
(författare)
-
Relationship between perceived vocal registers and glottal flow parameters: preliminary results
- 2008
-
Ingår i: Proceedings of the Speech Prosody Conference. - Campinas, Brazil.
-
Konferensbidrag (refereegranskat)abstract
- The perception of modal and falsetto registers was analyzedin a material consisting of a total of 80 vowel sounds sung by10 choir singers, 40 sung in modal register and 40 in falsettoregister. These vowel sounds were classified by sixteenexpert listeners in a force choice test and the number of votesfor modal was compared with the voice source parameters (1)Closed Quotient (Qclosed)and (2) level difference between thetwo lowest source spectrum partials (H1 – H2). Tones with ahigh value of Qclosed and low values of H1-H2 weretypically associated with high number of votes for modalregister, and vice versa, Qclosed showing the strongestcorrelation. Some singer subjects produced tones that couldnot be classified as either falsetto or modal register,suggesting that category perception of registers is not alwaysfeasible.
|
|
| 28. |
- Salomão, Gláucia Laís, PhD
(författare)
-
Relationships between glottal flow parameters and the perception of the voice quality
- 2013
-
Ingår i: 10th Pan-European Voice Conference, Prague, Czech Republic. - Prague, Czech Republic. ; , s. 342-
-
Konferensbidrag (refereegranskat)abstract
- A better understanding of the aerodynamic characteristics of the voice, such as the ones represented by glottal flowwaveform parameters, has been considered valuable to better assess voice quality. However, there is still uncertainty regarding which parameters would best reflect significant differences between perceived voice qualities. Thepurpose of this study is to investigate the relationship between glottal flow parameters and the perception of thevoice quality. Thirteen vocally healthy male choir singers, with various levels of experience, skill, and degree of singing training, were asked to sing ascending and descending chromatic scales of the vowel [a], in a comfortable pitchrange and vocal loudness. They were encouraged to sing the ascending scale in modal register, extending it as far aspossible, and the descending scale in falsetto, extending it as far as possible. Analyses of 104 glottograms of vowelswith the same pitch, extracted from the pitch range where both scales overlapped, were carried out regarding thefollowing parameters: period length (T0) and fundamental frequency (F0); duration of the closed phase (Tcl) andclosed quotient (Qclosed); peak-to-peak airflow amplitude (AC amplitude); maximum flow declination rate (MFDR);amplitude quotient (i.e. the ratio between the AC amplitude and MFDR) and its corresponding normalized amplitude quotient (NAQ); level difference between the two lowest partials in the spectrum (H1 – H2). A panel of 16 voiceexperts classified the voices as being produced in modal or in falsetto register. A correlation analysis was carriedout between the listening test classification and each of the flow glottogram parameters. Tones with a high valueof Qclosed and low values of H1−H2 and of NAQ were typically associated with a high number of voices perceivedas modal voices, and vice versa. NAQ showed the strongest correlation with the perceived voice quality (r=0.830).In addition, a stepwise multiple regression analysis was carried out of the relationships between the number ofvotes for modal voices and the various flow glottogram parameters. The results showed that the Qclosed was thestrongest predictor of the number of votes for modal voices, followed by H1−H2, MFDR and AC amplitude. Finally,a cluster analysis of the flow glottogram parameters showed five clusters in a continuum along the range of valuesfor each of the parameters. Voices were unanimously associated to one or the other voice categories when theircorresponding clusters of parameters were found at the extremes of this continuum, suggesting that: 1. differentglottal flow parameters can be varied continuously and combined differently; 2. specific combinations or clusters ofaerodynamics characteristics are likely to be associated with different perceived voice qualities; 3. a perceived voicequality seems to be easier to be classified the further apart the clusters appear on the continuum, and vice-versa.
|
|
| 29. |
|
|
| 30. |
|
|
| 31. |
|
|
| 32. |
- Salomão, Gláucia Laís, PhD, et al.
(författare)
-
What do male singers mean by modal and falsetto register? : An investigation of the glottal voice source
- 2009
-
Ingår i: Logopedics, Phoniatrics, Vocology. - : Taylor & Francis. - 1401-5439 .- 1651-2022. ; 34:2, s. 73-83
-
Tidskriftsartikel (refereegranskat)abstract
- The voice source differs between modal and falsetto registers, but singers often try to reduce the associated timbral differences, some even doubting that there are any. A total of 54 vowel sounds sung in falsetto and modal register by 13 male more or less experienced choir singers were analyzed by inverse filtering and electroglottography. Closed quotient, maximum flow declination rate, peak-to-peak airflow amplitude, normalized amplitude quotient, and level difference between the two lowest source spectrum partials were determined, and systematic differences were found in all singers, regardless of experience of singing. The observations seem compatible with previous observations of thicker vocal folds in modal register.
|
|
| 33. |
|
|
| 34. |
- Salomão, Gláucia Laís, PhD, et al.
(författare)
-
What does LTAS tell about the voice source?
- 2018
-
Ingår i: Proceedings of The Voice Foundation Annual 's 46<sup>th</sup> Annual Symposium.
-
Konferensbidrag (refereegranskat)
|
|
| 35. |
- Scherer, Klaus R., et al.
(författare)
-
Comparing the acoustic expression of emotion in the speaking and the singing voice
- 2015
-
Ingår i: Computer speech & language (Print). - : Elsevier. - 0885-2308 .- 1095-8363. ; 29:1, s. 218-235
-
Tidskriftsartikel (refereegranskat)abstract
- We examine the similarities and differences in the expression of emotion in the singing and the speaking voice. Three internationally renowned opera singers produced “vocalises” (using a schwa vowel) and short nonsense phrases in different interpretations for 10 emotions. Acoustic analyses of emotional expression in the singing samples show significant differences between the emotions. In addition to the obvious effects of loudness and tempo, spectral balance and perturbation make significant contributions (high effect sizes) to this differentiation. A comparison of the emotion-specific patterns produced by the singers in this study with published data for professional actors portraying different emotions in speech generally show a very high degree of similarity. However, singers tend to rely more than actors on the use of voice perturbation, specifically vibrato, in particular in the case of high arousal emotions. It is suggested that this may be due to by the restrictions and constraints imposed by the musical structure.
|
|
| 36. |
- Sundberg, Johan, et al.
(författare)
-
Analyzing Emotion Expression in Singing via Flow Glottograms, Long-Term-Average Spectra, and Expert Listener Evaluation
- 2021
-
Ingår i: Journal of Voice. - : Elsevier BV. - 0892-1997 .- 1873-4588. ; 35:1, s. 52-60
-
Tidskriftsartikel (refereegranskat)abstract
- Background: Acoustic aspects of emotional expressivity in speech have been analyzed extensively during recent decades. Emotional coloring is an important if not the most important property of sung performance, and therefore strictly controlled. Hence, emotional expressivity in singing may promote a deeper insight into vocal signaling of emotions. Furthermore, physiological voice source parameters can be assumed to facilitate the understanding of acoustical characteristics. Method: Three highly experienced professional male singers sang scales on the vowel /ae/ or /a/ in 10 emotional colors (Neutral, Sadness, Tender, Calm, Joy, Contempt, Fear, Pride, Love, Arousal, and Anger). Sixteen voice experts classified the scales in a forced-choice listening test, and the result was compared with long-term-average spectrum (LTAS) parameters and with voice source parameters, derived from flow glottograms (FLOGG) that were obtained from inverse filtering the audio signal. Results: On the basis of component analysis, the emotions could be grouped into four “families”, Anger-Contempt, Joy-Love-Pride, Calm-Tender-Neutral and Sad-Fear. Recognition of the intended emotion families by listeners reached accuracy levels far beyond chance level. For the LTAS and FLOGG parameters, vocal loudness had a paramount influence on all. Also after partialing out this factor, some significant correlations were found between FLOGG and LTAS parameters. These parameters could be sorted into groups that were associated with the emotion families. Conclusions: (i) Both LTAS and FLOGG parameters varied significantly with the enactment intentions of the singers. (ii) Some aspects of the voice source are reflected in LTAS parameters. (iii) LTAS parameters affect listener judgment of the enacted emotions and the accuracy of the intended emotional coloring.
|
|
| 37. |
- Sundberg, Johan, et al.
(författare)
-
Emotional expressivity in singing : Assessing physiological and acoustic indicators of two opera singers' voice characteristics
- 2024
-
Ingår i: Journal of the Acoustical Society of America. - : Acoustical Society of America. - 0001-4966 .- 1520-8524. ; 155:1, s. 18-28
-
Tidskriftsartikel (refereegranskat)abstract
- In an earlier study, we analyzed how audio signals obtained from three professional opera singers varied when they sang one octave wide eight-tone scales in ten different emotional colors. The results showed systematic variations in voice source and long-term-average spectrum (LTAS) parameters associated with major emotion “families”. For two of the singers, subglottal pressure (PSub) also was recorded, thus allowing analysis of an additional main physiological voice control parameter, glottal resistance (defined as the ratio between PSub and glottal flow), and related to glottal adduction. In the present study, we analyze voice source and LTAS parameters derived from the audio signal and their correlation with Psub and glottal resistance. The measured parameters showed a systematic relationship with the four emotion families observed in our previous study. They also varied systematically with values of the ten emotions along the valence, power, and arousal dimensions; valence showed a significant correlation with the ratio between acoustic voice source energy and subglottal pressure, while Power varied significantly with sound level and two measures related to the spectral dominance of the lowest spectrum partial. the fundamental.
|
|
| 38. |
|
|
| 39. |
- Sundberg, Johan, et al.
(författare)
-
What does LTAS tell about the voice source?
- 2018
-
Ingår i: 47th Annual Symposium: Care of the Professional Voice. ; , s. 15-15
-
Konferensbidrag (refereegranskat)abstract
- Objective: The long-term-average spectrum, or LTAS has been extensively used in voice research. It provides an overall measure of voice characteristics allowing to derive a large number of parameters. A minimalistic set of parameters has been identified which offers the most essential properties [Eyben et al., 2015; 2016; Scherer et al., 2017]. LTAS analysis is typically applied to audio signals of running speech or continuous singing. It reflects the combination of formant frequency and voice source characteristics. Often, e.g. in clinical settings, it is relevant to distinguish between these two sources Voice source analysis can be performed by means of inverse filtering. The aim of the present work was to analyse the relationships between LTAS and voice source properties.Method: Three internationally touring male singers sang scales in eleven different emotional colours. This material was analysed by inverse filtering as well as in terms of LTAS. The correlations between the averages across the scale tones of the flow glottogram parameters and minimalistic set of LTAS parameters were analysed.Results/Conclusions: A strong negative correlation was found between spectral slope and the flow glottogram’s maximum flow declination rate MFDR, and a strong positive correlation between proportion of spectral energy below 1000Hz and H1-H2. Somewhat surprisingly, a strong negative correlation was found between equivalent sound level and the normalized and un-normalized amplitude quotients (the ratio between AC peak-to-peak amplitude of the flow glottogram and MFDR). Thus, these LTAS parameters seem particularly informative with respect to voice source characteristics.
|
|
| 40. |
- Södersten, M., 1956-, et al.
(författare)
-
Natural Voice Use in Patients With Voice Disorders and Vocally Healthy Speakers Based on 2 Days Voice Accumulator Information From a Database
- 2015
-
Ingår i: Journal of Voice. - : Elsevier. - 0892-1997 .- 1873-4588. ; 29:5, s. 646.e1-646.e9
-
Tidskriftsartikel (refereegranskat)abstract
- Objectives and Study DesignInformation about how patients with voice disorders use their voices in natural communicative situations is scarce. Such long-term data have for the first time been uploaded to a central database from different hospitals in Sweden. The purpose was to investigate the potential use of a large set of long-term data for establishing reference values regarding voice use in natural situations.MethodsVoxLog (Sonvox AB, Umeå, Sweden) was tested for deployment in clinical practice by speech-language pathologists working at nine hospitals in Sweden. Files from 20 patients (16 females and 4 males) with functional, organic, or neurological voice disorders and 10 vocally healthy individuals (eight females and two males) were uploaded to a remote central database. All participants had vocally demanding occupations and had been mond for more than 2 days. The total recording time was 681 hours and 50 minutes. Data itoreon fundamental frequency (F0, Hz), phonation time (seconds and percentage), voice sound pressure level (SPL, dB), and background noise level (dB) were analyzed for each recorded day and compared between the 2 days. Variations across each day were measured using coefficients of variation.ResultsAverage F0, voice SPL, and especially the level of background noise varied considerably for all participants across each day. Average F0 and voice SPL were considerably higher than reference values from laboratory recordings.ConclusionsThe use of a remote central database and strict protocols can accelerate data collection from larger groups of participants and contribute to establishing reference values regarding voice use in natural situations and from patients with voice disorders. Information about activities and voice symptoms would supplement the objective data and is recommended in future studies.
|
|
| 41. |
|
|
