| 1. |
- Debreslioska, Sandra, et al.
(author)
-
Addressees are sensitive to the presence of gesture when tracking a single referent in discourse
- 2019
-
In: Frontiers in Psychology. - : Frontiers Media SA. - 1664-1078. ; 10:1775
-
Journal article (peer-reviewed)abstract
- Production studies show that anaphoric reference is bimodal. Speakers can introduce a referent in speech by also using a localizing gesture, assigning a specific locus in space to it. Referring back to that referent, speakers then often accompany a spoken anaphor with a localizing anaphoric gesture (i.e., indicating the same locus). Speakers thus create visual anaphoricity in parallel to the anaphoric process in speech. In the current perception study, we examine whether addressees are sensitive to localizing anaphoric gestures and specifically to the (mis)match between recurrent use of space and spoken anaphora. The results of two reaction time experiments show that, when a single referent is gesturally tracked, addressees are sensitive to the presence of localizing gestures, but not to their spatial congruence. Addressees thus seem to integrate gestural information when processing bimodal anaphora, but their use of locational information in gestures is not obligatory in every discourse context.
|
|
| 2. |
- Debreslioska, Sandra, et al.
(author)
-
Discourse reference is bimodal : How information status in speech interacts with presence and viewpoint of gestures
- 2019
-
In: Discourse Processes. - 0163-853X. ; 56:1, s. 41-60
-
Journal article (peer-reviewed)abstract
- Speakers use speech and gestures to represent referents in discourse. Depending on referents’ information status, in speech speakers will vary richness of expression (e.g., lexical noun phrase [NP]/pronoun), nominal definiteness (indefinite/definite), and grammatical role (subject/object). This study tested whether these three linguistic markers of information status interact with presence of gestures and gestural viewpoint (obser- ver/character). The results show that gestures are more frequent with less accessible referents expressed with richer spoken forms but that richness of expression does not interact with viewpoint. In contrast, nominal definite- ness and grammatical role interact with both presence and viewpoint of gestures. Gestures occur mainly with indefinite lexical NPs and objects. Character viewpoint gestures occur mainly with indefinite lexical NPs and objects plus predicates. The results shed light on when and how speakers use gestures in connected discourse and specifically highlight the discursive function of gestural viewpoint.
|
|
| 3. |
- Debreslioska, Sandra
(author)
-
Representing discourse referents in speech and gesture
- 2019
-
Doctoral thesis (other academic/artistic)abstract
- The thesis examines the way that speech and gestures are used together to represent referents in discourse. The starting point is the generally acknowledged observation that gestures are a constitutive part of language (Kendon, 2004; McNeill, 1992). Gestures are used in combination with speech in the production of language, and are integrated with speech in the perception of language. But while there is abundant linguistic research on the way that speech varies for the representation of referents as a function of discourse, much less is known about the role that gestures play. The thesis starts with a description of speech patterns. Linguistic research has shown that the way that speakers refer to discourse referents strongly relies on assumptions about the referents’ accessibility or information status (e.g., Ariel, 1988; Arnold, 1998; Chafe, 1994; Givón, 1983). Depending on whether speakers assume a referent to be new/less accessible or given/more accessible (for their addressees), they will vary different parameters on the level of the referential expression or the clause a referent is mentioned in. For instance, speakers will vary richness of expression (lexical NP vs. pronoun), nominal definiteness (indefinite vs. definite NP), the structure of the clause (focusing on the existence of a referent vs. focusing on an event the referent is mentioned in), and grammatical role assignment (subject vs. object). Importantly, gestures too can vary along different dimensions for the representation of discourse referents. They vary in terms of when they are produced, where they are produced, how they are produced, and in terms of what information they express. When gestures are produced refers to the incidence of gestures with some referential expressions used to represent referents but not with others. Where gestures are produced refers to the use of gesture space to create visual anaphoric linkages between different mentions of a referent. How gestures are produced refers to techniques of representation in gestures and is operationalized as gesture viewpoint (McNeill, 1992). And finally, what gestures express refers to whether gestures provide information about the entity itself or an action it is involved in when they accompany discourse referents.Three papers on bimodal discourse production show that there are intricate relationships between referent accessibility, discourse patterns in speech, and variations in gesture for the representation of referents. A fourth paper on bimodal discourse perception further shows that addressees are sensitive to the presence of gestures when they track referents in connected discourse. Together, the four studies contribute to a deeper understanding of the close relationship between speech and gestures on the discourse level, and highlight the multifunctionality of gestures. For language production, two main functions of gestures are identified, a parallel and a complementary function. For gesture perception, a facilitatory function is suggested. The thesis emphasizes the importance of considering gestures in linguistic studies of discourse, as well as considering discourse organizational principles in gesture studies.
|
|
