| 1. |
- Holsanova, Jana, et al.
(author)
-
Event segmentation in the audio description of films : A case study
- 2023
-
In: Journal of Audiovisual Translation. - 2617-9148. ; 6:1, s. 64-92
-
Journal article (peer-reviewed)abstract
- To make the content of moving images and audio-visual media available to a visually impaired audience, a sighted interpreter can provide audio description (AD). AD is a verbal description of visual events, aiming to increase the accessibility of visual information and to provide a visually impaired audience with a richer and more detailed understanding and experience of, for instance, films. To achieve this goal, the audio describer critically needs to select what to describe, when to describe it, and how to describe it, as well as to express the information aurally. The prosperity of this communication is thus critically dependent upon basic cognitive processes of how the sighted audio describer perceives and segments the film’s unfolding chain of events and how the visually impaired end users conceive the structure, content, and segmentation of such events in relation to the produced AD. While the way in which we as human cognitive beings perceive, segment, and remember chain of events has been the matter of much research, there is virtually no research on this interplay in relation to AD. In the present case study, we scrutinize live AD of a film from two trained audio describers, and examine how events are structured, segmented and construed in their AD. Results demonstrate that the event segmentation structure experienced from the film is indeed a fundamental part of how AD is structured and construed. It was found that AD at event boundaries was highly sensitive to different spatiotemporal circumstances and this relationship depends on semantic resources for expressing AD.
|
|
| 2. |
|
|
| 3. |
- Roll, Mikael, et al.
(author)
-
Atypical abstract associations in aphasia measured by a semantic space model
- 2010
-
In: The 20th Annual Rotman Research Institute Conference, The frontal lobes. - Toronto : Rotman Research Institute of Baycrest.
-
Conference paper (peer-reviewed)abstract
- Semantic similarity between concrete and abstract cue words and free association words was measured for aphasic subjects with left perisylvian lesions using a semantic space model. Aphasic participants showed more atypical associations the more abstract the cue words were. They also generally produced less abstract words than control subjects. The results support models assuming that the meanings of concrete words are represented in bi-hemispheric networks of semantic features in the brain, whereas the representation of abstract words is more dependent on the left perisylvian language network.
|
|
| 4. |
|
|
| 5. |
- Andersson, Annika, 1966-, et al.
(author)
-
The First Step to Study Neurophysiological Processing of Visual and Verbal Language in Children with Developmental Language Disorder
- 2019
-
In: The 40th Annual Symposium on Research in Child Language Disorders (SRCLD), June 6-8, 2019, Madison, Wisconsin. - : University of Wisconsin-Madison.
-
Conference paper (peer-reviewed)abstract
- We will compare processing of verbal and visual language in children with typical language development (TD) and with developmental language disorder (DLD). This will allow for a contribution to the discussion regarding whether the underlying nature of DLD is domain specific or domain general. The nature of visual language parallel that of verbal language in that it contains content and structure. In neurophysiological studies of adults it has been demonstrated that neural processing of visual narratives strongly resembles that of language processing in that semantic violations elicited an N400, while violations of structure elicited an anterior negativity followed by a P600.The study of visual-language processing in five TD-children (10;1-12;6) showed that violations of semantics and structure of the presented comic strip elicited ERP-effects that could be differentiated. By including this paradigm to the study of DLD-children we will enable a comparison between their neurophysiological processing of verbal language and visual language. We expect similar processing in both domains and that both differ from that of TD-children. These results could impact the understanding of DLD and the development of interventions.
|
|
| 6. |
- Blomberg, Frida
(author)
-
Concreteness, Specificity and Emotional Content in Swedish Nouns : Neurocognitive Studies of Word Meaning
- 2016
-
Doctoral thesis (other academic/artistic)abstract
- The present thesis investigated Swedish nouns differing in concreteness, specificity and emotional content using linguistic, psycholinguistic and neurolinguistic methods. The focus of Paper I was a semantic analysis of discourse produced by a person with a lesion in visual (left occipital) cortex. The results showed that the lesion site was related to with problems processing concrete nouns related to visual semantic features, as well as nouns with high semantic specificity. Paper II compared Swedish ratings of the cognitive psychological parameters imageability, age of acquisition and familiarity to English ratings, showing correlations indicating that ratings can be transferred between the two languages. Suggestions for constructing a Swedish psycholinguistic database were also outlined. In Paper III, four noun categories differing in specificity and emotional arousal (SPECIFIC, GENERAL, EMOTIONAL, ABSTRACT) were compared using a dichotic listening paradigm and a concrete/abstract categorisation task. EMOTIONAL nouns were shown to be processed faster than the other noun categories when presented in the left ear, possibly indicating more right hemisphere involvement. In Paper IV, PSEUDOWORDS as well as SPECIFIC, GENERAL, EMOTIONAL and ABSTRACT nouns were compared during lexical decision and imageability rating tasks using electroencephalography (EEG), targeting the event-related potentials (ERPs) N400 and N700, previously shown to be modulated by concreteness. On the assumption that abstract nouns have a larger number of lexical associates than more concrete nouns, N400 amplitudes were predicted to be smaller for abstract nouns than for concrete nouns. This prediction was supported by the results. Notably, even SPECIFIC and GENERAL nouns were observed to elicit different N400 amplitudes, in accordance with their hierarchical relationship in lexical semantic models. Bringing together theories and methods from linguistics, cognitive psychology and neuroscience, the present interdisciplinary thesis provides insights into word semantics as regards differences related to the cognitive dimension of concreteness and its relation to sensory and emotional meaning features.
|
|
| 7. |
- Blomberg, Frida, et al.
(author)
-
Emotional arousal and lexical specificity modulate response times differently depending on ear of presentation in a dichotic listening task
- 2015
-
In: The Mental Lexicon. - : John Benjamins Publishing Company. - 1871-1340 .- 1871-1375. ; 10:2, s. 221-246
-
Journal article (peer-reviewed)abstract
- We investigated possible hemispheric differences in the processing of four different lexical semantic categories: SPECIFIC (e.g. bird), GENERAL (e.g. animal), ABSTRACT (e.g. advice), and EMOTIONAL (e.g. love). These wordtypes were compared using a dichotic listening paradigm and a semantic category classification task. Response times (RTs) were measured when participants classified testwords as concrete or abstract. In line with previous findings, words were expected to be processed faster following right-ear presentation. However, lexical specificity and emotional arousal were predicted to modulate response times differently depending on the ear of presentation. For left-ear presentation, relatively faster RTs were predicted for SPECIFIC and EMOTIONAL words as opposed to GENERAL and ABSTRACT words. An interaction of ear and wordtype was found. For right-ear presentation, RTs increased as testwords’ imageability decreased along the span SPECIFIC–GENERAL–EMOTIONAL–ABSTRACT. In contrast, for left ear presentation, EMOTIONAL words were processed fastest, while SPECIFIC words gave rise to long RTs on par with those for ABSTRACT words. Thus, the prediction for EMOTIONAL words presented in the left ear was borne out, whereas the prediction for SPECIFIC words was not. This might be related to previously found differences in processing of stimuli at a global or local level.
|
|
| 8. |
|
|
| 9. |
- Blomberg, Frida, et al.
(author)
-
Lexical specificity, imageability and emotional arousal modulate the N400 and the N700
- 2016
-
In: 8th Annual Meeting of the Society for the Neurobiology of Language. SNL 2016. ; , s. 207-207
-
Conference paper (peer-reviewed)abstract
- Introduction: The event-related potential (ERP) componentN400 as well as a later effect, often labeled ‘N700’ haverepeatedly been shown to increase for concrete as compared to abstract words (Barber, Otten, Kousta, & Vigliocco, 2013; Gullick, Mitra, & Coch, 2013; Kounios & Holcomb, 1994; Nittono, Suehiro, & Hori, 2002; West & Holcomb, 2000). In addition, pseudowords elicit greater N400s than real words (Lau, Phillips, & Poeppel, 2008). Previous interpretations of the N400 as indexing contextual integration or alternatively, activation of semantic features in long-term memory, do notfully explain the combination of these differences. The present study compared ERPs in the N400 and N700 time-windows for PSEUDOWORDS (e.g. ‘danalod’) and four noun categories differing in specificity and imageability: (SPECIFIC, e.g. ‘squirrel’, GENERAL, e.g. ‘animal’, EMOTIONAL, e.g. ‘happiness’ and ABSTRACT, e.g. ‘tendency’).Methods: EEGwas recorded from 32 scalp electrodes and response times were measured while 35 healthy, right-handed native Swedish speakers (age 20-37) performed an imageability rating (IR) task and a lexical decision (LD) task. The stimuli were 160 written nouns, 40 each of the above-mentioned semantic categories, and 160 phonologically legal pseudowords. Statistical comparisons of ERPs in the N400 (300-500 ms post-stimulus onset) and N700 (500-800 ms post-stimulus onset) time-windows were carried out using within-subjects ANOVAs.Results: In the LD task, N400 amplitudes increasedin the order EMOTIONAL < ABSTRACT < GENERAL < SPECIFIC < PSEUDOWORD. A largely similar pattern wasfound in the IR task as well as in the N700 time-window ofboth tasks. N400 and N700 effects were found for SPECIFIC-GENERAL test words also when they were matched for imageability, indicating that something other than imageabilityper se was driving the effects.Conclusion: The pattern of ERPamplitudes seen in the present study could be explained by a model which assumes that words with larger numbers of associated words in the mental lexicon yield smaller N400s, for example abstract as compared to concrete words and real words as compared to pseudowords. The fact that N400 andN700 effects were found for SPECIFIC-GENERAL test wordseven when they were matched for imageability indicates that other factors, possibly related to hierarchical semantic relationsbetween concrete noun categories, drive the effect. In line withthe suggested model, this might be explained by superordinate GENERAL nouns having a larger number of lexical associates than SPECIFIC nouns.References:Barber, H. A., Otten, L. J., Kousta, S.-T., & Vigliocco, G. (2013). Brain and Language, 125(1), 47–53.Gullick, M. M., Mitra, P., & Coch, D. (2013). Psychophysiology, 50(5), 431–440.Kounios, J., & Holcomb, P. J. (1994). Journal of Experimental Psychology: Learning, Memory, and Cognition, 20(4), 804–823.Lau, E. F., Phillips, C., & Poeppel, D. (2008). Nature Reviews Neuroscience, 9(12), 920–933.Nittono, H., Suehiro, M., & Hori, T. (2002). International Journal of Psychophysiology, 1–11.West, W. C., & Holcomb, P. J. (2000). Journal of Cognitive Neuroscience, 12(6), 1024–1037.
|
|
| 10. |
|
|
