To see the other types of publications on this topic, follow the link: Gestural overlap.

Journal articles on the topic 'Gestural overlap'

Create a spot-on reference in APA, MLA, Chicago, Harvard, and other styles

Select a source type:

Consult the top 50 journal articles for your research on the topic 'Gestural overlap.'

Next to every source in the list of references, there is an 'Add to bibliography' button. Press on it, and we will generate automatically the bibliographic reference to the chosen work in the citation style you need: APA, MLA, Harvard, Chicago, Vancouver, etc.

You can also download the full text of the academic publication as pdf and read online its abstract whenever available in the metadata.

Browse journal articles on a wide variety of disciplines and organise your bibliography correctly.

1

Jun, Jongho. "Place assimilation is not the result of gestural overlap: evidence from Korean and English." Phonology 13, no. 3 (December 1996): 377–407. http://dx.doi.org/10.1017/s0952675700002682.

Full text
Abstract:
In the theory of articulatory phonology Browman & Goldstein (1986, 1990, 1992) claim that place assimilation is mainly the result of the overlap of gestures and the perception of these overlapping gestures as a single gesture. Ohala (1990) makes a similar claim. The present study provides interesting experimental evidence against this explanation of assimilation as a result of gestural overlap and resulting misperception, and for the importance of gestural reduction.
APA, Harvard, Vancouver, ISO, and other styles
2

Browman, Catherine P., and Louis Goldstein. "Articulatory gestures as phonological units." Phonology 6, no. 2 (August 1989): 201–51. http://dx.doi.org/10.1017/s0952675700001019.

Full text
Abstract:
We have argued that dynamically defined articulatory gestures are the appropriate units to serve as the atoms of phonological representation. Gestures are a natural unit, not only because they involve task-oriented movements of the articulators, but because they arguably emerge as prelinguistic discrete units of action in infants. The use of gestures, rather than constellations of gestures as in Root nodes, as basic units of description makes it possible to characterise a variety of language patterns in which gestural organisation varies. Such patterns range from the misorderings of disordered speech through phonological rules involving gestural overlap and deletion to historical changes in which the overlap of gestures provides a crucial explanatory element.Gestures can participate in language patterns involving overlap because they are spatiotemporal in nature and therefore have internal duration. In addition, gestures differ from current theories of feature geometry by including the constriction degree as an inherent part of the gesture. Since the gestural constrictions occur in the vocal tract, which can be charactensed in terms of tube geometry, all the levels of the vocal tract will be constricted, leading to a constriction degree hierarchy. The values of the constriction degree at each higher level node in the hierarchy can be predicted on the basis of the percolation principles and tube geometry. In this way, the use of gestures as atoms can be reconciled with the use of Constriction degree at various levels in the vocal tract (or feature geometry) hierarchy.The phonological notation developed for the gestural approach might usefully be incorporated, in whole or in part, into other phonologies. Five components of the notation were discussed, all derived from the basic premise that gestures are the primitive phonological unit, organised into gestural scores. These components include (1) constriction degree as a subordinate of the articulator node and (2) stiffness (duration) as a subordinate of the articulator node. That is, both CD and duration are inherent to the gesture. The gestures are arranged in gestural scores using (3) articulatory tiers, with (4) the relevant geometry (articulatory, tube or feature) indicated to the left of the score and (5) structural information above the score, if desired. Association lines can also be used to indicate how the gestures are combined into phonological units. Thus, gestures can serve both as characterisations of articulatory movement data and as the atoms of phonological representation.
APA, Harvard, Vancouver, ISO, and other styles
3

Iskarous, Khalil. "The acoustics of gestural overlap." Journal of the Acoustical Society of America 109, no. 5 (May 2001): 2294. http://dx.doi.org/10.1121/1.4744040.

Full text
APA, Harvard, Vancouver, ISO, and other styles
4

Valle, Chelsea La, Karen Chenausky, and Helen Tager-Flusberg. "How do minimally verbal children and adolescents with autism spectrum disorder use communicative gestures to complement their spoken language abilities?" Autism & Developmental Language Impairments 6 (January 2021): 239694152110350. http://dx.doi.org/10.1177/23969415211035065.

Full text
Abstract:
Background and aims Prior work has examined how children and adolescents with autism spectrum disorder who are minimally verbal use their spoken language abilities during interactions with others. However, social communication includes other aspects beyond speech. To our knowledge, no studies have examined how minimally verbal children and adolescents with autism spectrum disorder are using their gestural communication during social interactions. Such work can provide important insights into how gestures may complement their spoken language abilities. Methods Fifty minimally verbal children and adolescents with autism spectrum disorder participated ( Mage = 12.41 years; 38 males). Gestural communication was coded from the Autism Diagnostic Observation Schedule. Children ( n = 25) and adolescents ( n = 25) were compared on their production of gestures, gesture–speech combinations, and communicative functions. Communicative functions were also assessed by the type of communication modality: gesture, speech, and gesture–speech to examine the range of communicative functions across different modalities of communication. To explore the role gestures may play the relation between speech utterances and gestural production was investigated. Results Analyses revealed that (1) minimally verbal children and adolescents with autism spectrum disorder did not differ in their total number of gestures. The most frequently produced gesture across children and adolescents was a reach gesture, followed by a point gesture (deictic gesture), and then conventional gestures. However, adolescents produced more gesture–speech combinations (reinforcing gesture-speech combinations) and displayed a wider range of communicative functions. (2) Overlap was found in the types of communicative functions expressed across different communication modalities. However, requests were conveyed via gesture more frequently compared to speech or gesture–speech. In contrast, dis/agree/acknowledging and responding to a question posed by the conversational partner was expressed more frequently via speech compared to gesture or gesture–speech. (3) The total number of gestures was negatively associated with total speech utterances after controlling for chronological age, receptive communication ability, and nonverbal IQ. Conclusions Adolescents may be employing different communication strategies to maintain the conversational exchange and to further clarify the message they want to convey to the conversational partner. Although overlap occurred in communicative functions across gesture, speech, and gesture–speech, nuanced differences emerged in how often they were expressed across different modalities of communication. Given their speech production abilities, gestures may play a compensatory role for some individuals with autism spectrum disorder who are minimally verbal. Implications Findings underscore the importance of assessing multiple modalities of communication to provide a fuller picture of their social communication abilities. Our results identified specific communicative strengths and areas for growth that can be targeted and expanded upon within gesture and speech to optimize social communication development.
APA, Harvard, Vancouver, ISO, and other styles
5

Murillo, Eva, Carlota Ortega, Alicia Otones, Irene Rujas, and Marta Casla. "Changes in the Synchrony of Multimodal Communication in Early Language Development." Journal of Speech, Language, and Hearing Research 61, no. 9 (September 19, 2018): 2235–45. http://dx.doi.org/10.1044/2018_jslhr-l-17-0402.

Full text
Abstract:
Purpose The aim of this study is to analyze the changes in temporal synchrony between gesture and speech of multimodal communicative behaviors in the transition from babbling to two-word productions. Method Ten Spanish-speaking children were observed at 9, 12, 15, and 18 months of age in a semistructured play situation. We longitudinally analyzed the synchrony between gestures and vocal productions and between their prominent parts. We also explored the relationship between gestural–vocal synchrony and independent measures of language development. Results Results showed that multimodal communicative behaviors tend to be shorter with age, with an increasing overlap of its constituting elements. The same pattern is found when considering the synchrony between the prominent parts. The proportion of overlap between gestural and vocal elements at 15 months of age as well as the proportion of the stroke overlapped with vocalization appear to be related to lexical development 3 months later. Conclusions These results suggest that children produce gestures and vocalizations as coordinated elements of a single communication system before the transition to the two-word stage. This coordination is related to subsequent lexical development in this period. Supplemental Material https://doi.org/10.23641/asha.6912242
APA, Harvard, Vancouver, ISO, and other styles
6

Roberts, Anna Ilona, and Sam George Bradley Roberts. "Convergence and divergence in gesture repertoires as an adaptive mechanism for social bonding in primates." Royal Society Open Science 4, no. 11 (November 2017): 170181. http://dx.doi.org/10.1098/rsos.170181.

Full text
Abstract:
A key challenge for primates living in large, stable social groups is managing social relationships. Chimpanzee gestures may act as a time-efficient social bonding mechanism, and the presence (homogeneity) and absence (heterogeneity) of overlap in repertoires in particular may play an important role in social bonding. However, how homogeneity and heterogeneity in the gestural repertoire of primates relate to social interaction is poorly understood. We used social network analysis and generalized linear mixed modelling to examine this question in wild chimpanzees. The repertoire size of both homogeneous and heterogeneous visual, tactile and auditory gestures was associated with the duration of time spent in social bonding behaviour, centrality in the social bonding network and demography. The audience size of partners who displayed similar or different characteristics to the signaller (e.g. same or opposite age or sex category) also influenced the use of homogeneous and heterogeneous gestures. Homogeneous and heterogeneous gestures were differentially associated with the presence of emotional reactions in response to the gesture and the presence of a change in the recipient's behaviour. Homogeneity and heterogeneity of gestural communication play a key role in maintaining a differentiated set of strong and weak social relationships in complex, multilevel societies.
APA, Harvard, Vancouver, ISO, and other styles
7

Son, Minjung. "Gestural Overlap as a Function of Assimilation Contrast." Korean Journal of Linguistics 33, no. 4 (December 2008): 665–91. http://dx.doi.org/10.18855/lisoko.2008.33.4.005.

Full text
APA, Harvard, Vancouver, ISO, and other styles
8

Zsiga, Elizabeth C. "Acoustic evidence for gestural overlap in consonant sequences." Journal of Phonetics 22, no. 2 (April 1994): 121–40. http://dx.doi.org/10.1016/s0095-4470(19)30189-5.

Full text
APA, Harvard, Vancouver, ISO, and other styles
9

PIKA, SIMONE, ELENA NICOLADIS, and PAULA F. MARENTETTE. "A cross-cultural study on the use of gestures: Evidence for cross-linguistic transfer?" Bilingualism: Language and Cognition 9, no. 3 (October 20, 2006): 319–27. http://dx.doi.org/10.1017/s1366728906002665.

Full text
Abstract:
Anecdotal reports provide evidence of so called “hybrid” gesturer whose non-verbal behavior of one language/culture becomes visible in the other. The direction of this gestural transfer seems to occur from a high to a low frequency gesture language. The purpose of this study was therefore to test systematically 1) whether gestural transfer occurs from a high frequency gesture language to a low frequency gesture language, 2) if the frequency of production of some gesture types is more likely to be transferred than others, and 3) whether gestural transfer can also occur bi-directionally. To address these questions, we investigated the use of gestures of English–Spanish bilinguals, French–English bilinguals, and English monolinguals while retelling a cartoon. Our analysis focused on the rate of gestures and the frequency of production of gesture types. There was a significant difference in the overall rate of gestures: both bilingual groups gestured more than monolingual participants. This difference was particularly salient for iconic gestures. In addition, we found that French–English bilinguals used more deictic gestures in their L2. The results suggest that knowledge of a high frequency gesture language affects the gesture rate in a low-frequency gesture language.
APA, Harvard, Vancouver, ISO, and other styles
10

Tjaden, Kris, and Gary Weismer. "Evidence of gestural overlap across speaking rate: Acoustic data." Journal of the Acoustical Society of America 96, no. 5 (November 1994): 3326. http://dx.doi.org/10.1121/1.411344.

Full text
APA, Harvard, Vancouver, ISO, and other styles
11

Chitoran, Ioana, Dani Byrd, and Louis Goldstein. "Recoverability constraints on gestural overlap in Georgian stop sequences." Journal of the Acoustical Society of America 107, no. 5 (May 2000): 2804. http://dx.doi.org/10.1121/1.429033.

Full text
APA, Harvard, Vancouver, ISO, and other styles
12

Lee, Sook‐hyang. "Gestural overlap analysis of lenis stop reduction in Korean." Journal of the Acoustical Society of America 99, no. 4 (April 1996): 2551–74. http://dx.doi.org/10.1121/1.415176.

Full text
APA, Harvard, Vancouver, ISO, and other styles
13

Huinck, W. J., H. F. M. Peters, and W. Hulstijn. "The influence of gestural overlap during consonant transitions on stuttering." Journal of Fluency Disorders 25, no. 3 (September 2000): 174–75. http://dx.doi.org/10.1016/s0094-730x(00)80193-x.

Full text
APA, Harvard, Vancouver, ISO, and other styles
14

Davidson, Lisa. "Schwa Elision in Fast Speech: Segmental Deletion or Gestural Overlap?" Phonetica 63, no. 2-3 (2006): 79–112. http://dx.doi.org/10.1159/000095304.

Full text
APA, Harvard, Vancouver, ISO, and other styles
15

Luo, Shan. "Gestural overlap across word boundaries: Evidence from English and Mandarin speakers." Canadian Journal of Linguistics/Revue canadienne de linguistique 62, no. 1 (October 24, 2016): 56–83. http://dx.doi.org/10.1017/cnj.2016.37.

Full text
Abstract:
AbstractThis article examines how three factors determine the surface forms of English stop-stop coarticulation across word boundaries in both native and nonnative speech: place of articulation, frequency, and speech rate. The release percentage and closure duration ratio produced by English (L1) and Mandarin (L2) speakers were measured. The results showed that a place order effect was only partially supported in L1 speech but not shown at all in L2 speech. The results also confirmed a gradient lexical effect, finding a significant correlation between self-rated frequency and overlap. In addition, the results showed that increased speech rate did not induce increased overlap, given that speakers from both groups had either more or less overlap at the fast speech rate than at the slow rate.
APA, Harvard, Vancouver, ISO, and other styles
16

Luo, Shan. "Gestural overlap across word boundaries: Evidence from English and Mandarin speakers." Canadian Journal of Linguistics / La revue canadienne de linguistique 62, no. 1 (2017): 56–83. http://dx.doi.org/10.1353/cjl.2017.0003.

Full text
APA, Harvard, Vancouver, ISO, and other styles
17

Zhao, Sherry, and Kenneth N. Stevens. "Gestural overlap of stop‐consonant sequences: Evidence from analysis and synthesis." Journal of the Acoustical Society of America 113, no. 4 (April 2003): 2253. http://dx.doi.org/10.1121/1.1584149.

Full text
APA, Harvard, Vancouver, ISO, and other styles
18

Recasens, Daniel. "Typology of mixing articulatory gestures in phonetics and phonology." Loquens 6, no. 1 (February 27, 2019): 057. http://dx.doi.org/10.3989/loquens.2019.057.

Full text
Abstract:
The present paper analyzes the typology of cases of gestural blending in sequences of homorganic phonetic segments and indicates how gestural blending mechanisms differ from other processes of intersegmental adaptation commonly referred to as coarticulation and assimilation. The article establishes a distinction between three gestural blending types: by static intermediation, by dynamic intermediation, and by articulatory overlap. These mechanisms are analyzed with lingual configuration and linguopalatal contact data for sequences of lingual consonants from Catalan and other languages. An interpretation of gestural blending mechanisms is proposed which is based on notions such as the degree of articulatory adaptability of different lingual regions and the manner of articulation requirements for the consonants involved.
APA, Harvard, Vancouver, ISO, and other styles
19

손민정. "Articulatory properties of the allophonic variant [ɾ] in Korean /l/-flapping: Gestural reduction and the role of gestural overlap." Studies in Phonetics, Phonology, and Morphology 21, no. 3 (December 2015): 427–56. http://dx.doi.org/10.17959/sppm.2015.21.3.427.

Full text
APA, Harvard, Vancouver, ISO, and other styles
20

Choi, Susie, and Dani Byrd. "Evaluating gestural overlap as an influence on perception of fricative‐stop clusters." Journal of the Acoustical Society of America 118, no. 3 (September 2005): 2036–37. http://dx.doi.org/10.1121/1.4809105.

Full text
APA, Harvard, Vancouver, ISO, and other styles
21

Byun, Tara McAllister. "A gestural account of a child-specific neutralisation in strong position." Phonology 28, no. 3 (December 2011): 371–412. http://dx.doi.org/10.1017/s0952675711000297.

Full text
Abstract:
The child-specific phenomenon of preferential neutralisation in initial position, which reverses a positional bias attested across adult grammars, represents a long-standing problem for formal models of developmental phonology. In a phonetically based model of phonology, child-specific phonological patterns may emerge as the consequence of physical differences between child and adult speech. This paper presents new case-study data suggesting that a child-specific pattern of fricative neutralisation in initial position has its roots in children's articulatory limitations. Coarticulated fricative and vowel gestures are shown to require independent control of the tongue and jaw, known to be problematic for developing speakers. Substitution errors affecting fricatives are analysed as a phonologised reflex of this phonetic pressure to avoid overlapping vowel and fricative gestures. The positional asymmetry emerges as the consequence of the differing degrees of gestural overlap permitted in syllable-initialvs. syllable-final position, as encoded in the framework of Articulatory Phonology (Browman & Goldstein 1986).
APA, Harvard, Vancouver, ISO, and other styles
22

Stout, Dietrich, and Thierry Chaminade. "Stone tools, language and the brain in human evolution." Philosophical Transactions of the Royal Society B: Biological Sciences 367, no. 1585 (January 12, 2012): 75–87. http://dx.doi.org/10.1098/rstb.2011.0099.

Full text
Abstract:
Long-standing speculations and more recent hypotheses propose a variety of possible evolutionary connections between language, gesture and tool use. These arguments have received important new support from neuroscientific research on praxis, observational action understanding and vocal language demonstrating substantial functional/anatomical overlap between these behaviours. However, valid reasons for scepticism remain as well as substantial differences in detail between alternative evolutionary hypotheses. Here, we review the current status of alternative ‘gestural’ and ‘technological’ hypotheses of language origins, drawing on current evidence of the neural bases of speech and tool use generally, and on recent studies of the neural correlates of Palaeolithic technology specifically.
APA, Harvard, Vancouver, ISO, and other styles
23

권보영. "The Effects of Gestural Overlap on the Acquisition of English Word-final Obstruent Clusters." English Language and Linguistics ll, no. 25 (June 2008): 149–70. http://dx.doi.org/10.17960/ell.2008..25.008.

Full text
APA, Harvard, Vancouver, ISO, and other styles
24

Son, Minjung. "Normalized gestural overlap measures and spatial properties of lingual movements in Korean non-assimilating contexts*." Phonetics and Speech Sciences 11, no. 3 (September 2019): 31–38. http://dx.doi.org/10.13064/ksss.2019.11.3.031.

Full text
APA, Harvard, Vancouver, ISO, and other styles
25

Huinck, Wendy J., Pascal H. H. M. van Lieshout, Herman F. M. Peters, and Wouter Hulstijn. "Gestural overlap in consonant clusters: effects on the fluent speech of stuttering and non-stuttering subjects." Journal of Fluency Disorders 29, no. 1 (January 2004): 3–25. http://dx.doi.org/10.1016/j.jfludis.2003.09.001.

Full text
APA, Harvard, Vancouver, ISO, and other styles
26

PARRILL, FEY, BRITTANY LAVANTY, AUSTIN BENNETT, ALAYNA KLCO, and OZLEM ECE DEMIR-LIRA. "The relationship between character viewpoint gesture and narrative structure in children." Language and Cognition 10, no. 3 (July 12, 2018): 408–34. http://dx.doi.org/10.1017/langcog.2018.9.

Full text
Abstract:
abstractWhen children tell stories, they gesture; their gestures can predict how their narrative abilities will progress. Five-year-olds who gestured from the point of view of a character (CVPT gesture) when telling stories produced better-structured narratives at later ages (Demir, Levine, & Goldin-Meadow, 2014). But does gesture just predict narrative structure, or can asking children to gesture in a particular way change their narratives? To explore this question, we instructed children to produce CVPT gestures and measured their narrative structure. Forty-four kindergarteners were asked to tell stories after being trained to produce CVPT gestures, gestures from an observer’s viewpoint (OVPT gestures), or after no instruction in gesture. Gestures were coded as CVPT or OVPT, and stories were scored for narrative structure. Children trained to produce CVPT gestures produced more of these gestures, and also had higher narrative structure scores compared to those who received the OVPT training. Children returned for a follow-up session one week later and narrated the stories again. The training received in the first session did not impact narrative structure or recall for the events of the stories. Overall, these results suggest a brief gestural intervention has the potential to enhance narrative structure. Due to the fact that stronger narrative abilities have been correlated with greater success in developing writing and reading skills at later ages, this research has important implications for literacy and education.
APA, Harvard, Vancouver, ISO, and other styles
27

Torreira, Francisco. "Investigating the nature of aspirated stops in Western Andalusian Spanish." Journal of the International Phonetic Association 42, no. 1 (March 12, 2012): 49–63. http://dx.doi.org/10.1017/s0025100311000491.

Full text
Abstract:
In Western Andalusian Spanish (WAS), [h + voiceless stop] clusters are realized as long pre- and postaspirated stops. This study investigates if a new class of stops (realized as geminates with variable degrees of pre- and postaspiration) has emerged in this dialect, or if postaspiration in these clusters results from articulatory overlap. An experiment was carried out in which WAS speakers produced [h + voiceless stop] clusters under changes in speech rate and stress location. The duration of postaspiration, measured as voice onset, did not show systematic effects of any of the experimental variables. Moreover, trade-offs were observed between voice onset and preaspiration plus closure durations. These results indicate that postaspiration in WAS [h + voiceless stop] clusters is the consequence of extensive articulatory overlap. It is further hypothesized that the lengthening of closures in WAS stops preceded by [h] results from a different gestural mechanism affecting all [hC] clusters in this dialect. From a broader perspective, since extensive overlap and consonantal lengthening do not occur in the [hC] clusters of other Spanish varieties, these findings lend support to the idea that intergestural coordination patterns can be dialect-specific.
APA, Harvard, Vancouver, ISO, and other styles
28

Child, Simon, Anna Theakston, and Simone Pika. "How do modelled gestures influence preschool children’s spontaneous gesture production?" Gesture 14, no. 1 (December 31, 2014): 1–25. http://dx.doi.org/10.1075/gest.14.1.01chi.

Full text
Abstract:
Around the age of nine months, children start to communicate by using first words and gestures, during interactions with caregivers. The question remains as to how older preschool children utilise the gestures they observe into their own gestural representations of previously unseen objects. Two accounts of gesture production (the ‘gesture learning’, and ‘simulated representation’ accounts) offer different predictions for how preschool children use the gestures they observe when describing objects. To test these two competing accounts underlying gesture production, we showed 42 children (mean age: 45 months 14 days) four novel objects using speech only, or speech accompanied by either movement or physical feature gestures. Analyses revealed that (a) overall symbolic gesture production showed a high degree of individual variability, and (b) distinct observed gesture types influenced the children’s subsequent gesture use. Specifically, it was found that children preferred to match movement gestures in a subsequent communicative interaction including the same objects, but not physical feature gestures. We conclude that the observation of gestures (in particular gestures that depict movement) may act to change preschool children’s object representations, which in turn influences how they depict objects in space.
APA, Harvard, Vancouver, ISO, and other styles
29

Jurewicz, Katherina, and David M. Neyens. "Mapping 3D Gestural Inputs to Traditional Touchscreen Interface Designs within the Context of Anesthesiology." Proceedings of the Human Factors and Ergonomics Society Annual Meeting 61, no. 1 (September 2017): 696–700. http://dx.doi.org/10.1177/1541931213601660.

Full text
Abstract:
Gestures are a natural means of every day human-human communication, and with the advances in gestural input technology, there is an opportunity to investigate gestures as a means of communicating with computers and other devices. The primary benefit of gestural input technology is that it facilitates a touchless interaction, so the ideal market demand for this technology is an environment where touch needs to be minimized. The perfect example of an environment that discourages touch are sterile or clean environments, such as operating rooms (ORs). Healthcare-associated infections are a great burden to the healthcare system, and gestural input technology can decrease the number of surfaces, computers, and other devices that a healthcare provider comes in contact with, thus reducing the likelihood of bacterial contamination. The objective of this research was to map 3D gestural inputs to traditional touchscreen interface designs within the context of anesthesiology. An experimental study was conducted to elicit intuitive gestures from users and assess the cognitive complexity of ten typical functions of anesthesia providers. Intuitive gestures were observed in six out of the ten functions without any cognitive complexity concerns. Two functions, of the remaining four, demonstrated a higher-level gesture mapping with no cognitive complexity concerns. Overall, gestural input technology demonstrated promise for the ten functions of anesthesia providers in the operating room, and future research will continue investigating the application of gestural input technology for anesthesiology in the OR.
APA, Harvard, Vancouver, ISO, and other styles
30

Benga, Oana. "Intentional communication and the anterior cingulate cortex." Interaction Studies 6, no. 2 (September 30, 2005): 201–21. http://dx.doi.org/10.1075/is.6.2.04ben.

Full text
Abstract:
This paper presents arguments for considering the anterior cingulate cortex (ACC) as a critical structure in intentional communication. Different facets of intentionality are discussed in relationship to this neural structure. The macrostructural and microstructural characteristics of ACC are proposed to sustain the uniqueness of its architecture, as an overlap region of cognitive, affective and motor components. At the functional level, roles played by this region in communication include social bonding in mammals, control of vocalization in humans, semantic and syntactic processing, and initiation of speech. The involvement of the anterior cingulate cortex in social cognition is suggested where, for infants, joint attention skills are considered both prerequisites of social cognition and prelinguistic communication acts. Since the intentional dimension of gestural communication seems to be connected to a region previously equipped for vocalization, ACC might well be a starting point for linguistic communication.
APA, Harvard, Vancouver, ISO, and other styles
31

Sowińska, Agnieszka, and Monika Boruta-Żywiczyńska. "Gestures in patients’ presentation of medically unexplained symptoms (MUS)." Gesture 19, no. 1 (December 31, 2020): 97–127. http://dx.doi.org/10.1075/gest.17011.sow.

Full text
Abstract:
Abstract The aim of this paper is to explore speech-accompanying gesture use in presentation of medically unexplained symptoms (MUS). The data are 19 video-filmed semi-structured interviews with patients presenting MUS. Four patterns of gestural behaviors are established in symptom presentation: (1) No gesturing; (2) Overall low gesture rate; (3) Overall high gesture rate with low rate for symptoms; (4) Overall high gesture rate with high rate for symptoms. The patients with overall low gesture rate tend to perform deictic gestures, pointing to exact locations of the symptoms; those with overall high gesture rate and low symptom rate produce metaphorics, and those who gesticulate at high rates – mainly iconics and metaphorics. Although exact factors that lead to the four types of gesturing patterns are unclear, the findings encourage medical professionals to attend to the information in gesture use in order to obtain a better understanding of the patient’s experience of MUS.
APA, Harvard, Vancouver, ISO, and other styles
32

Arslan, Burcu, and Tilbe Göksun. "Ageing, working memory, and mental imagery: Understanding gestural communication in younger and older adults." Quarterly Journal of Experimental Psychology 74, no. 1 (August 4, 2020): 29–44. http://dx.doi.org/10.1177/1747021820944696.

Full text
Abstract:
Ageing has effects both on language and gestural communication skills. Although gesture use is similar between younger and older adults, the use of representational gestures (e.g., drawing a line with fingers on the air to indicate a road) decreases with age. This study investigates whether this change in the production of representational gestures is related to individuals’ working memory and/or mental imagery skills. We used three gesture tasks (daily activity description, story completion, and address description) to obtain spontaneous co-speech gestures from younger and older individuals ( N = 60). Participants also completed the Corsi working memory task and a mental imagery task. Results showed that although the two age groups’ overall gesture frequencies were similar across the three tasks, the younger adults used relatively higher proportions of representational gestures than the older adults only in the address description task. Regardless of age, the mental imagery but not working memory score was associated with the use of representational gestures only in this task. However, the use of spatial words in the address description task did not differ between the two age groups. The mental imagery or working memory scores did not associate with the spatial word use. These findings suggest that mental imagery can play a role in gesture production. Gesture and speech production might have separate timelines in terms of being affected by the ageing process, particularly for spatial content.
APA, Harvard, Vancouver, ISO, and other styles
33

Olthuis, Raimey, John van der Kamp, Koen Lemmink, and Simone Caljouw. "Touchscreen Pointing and Swiping: The Effect of Background Cues and Target Visibility." Motor Control 24, no. 3 (July 1, 2020): 422–34. http://dx.doi.org/10.1123/mc.2019-0096.

Full text
Abstract:
By assessing the precision of gestural interactions with touchscreen targets, the authors investigate how the type of gesture, target location, and scene visibility impact movement endpoints. Participants made visually and memory-guided pointing and swiping gestures with a stylus to targets located in a semicircle. Specific differences in aiming errors were identified between swiping and pointing. In particular, participants overshot the target more when swiping than when pointing and swiping endpoints showed a stronger bias toward the oblique than pointing gestures. As expected, the authors also found specific differences between conditions with and without delays. Overall, the authors observed an influence on movement execution from each of the three parameters studied and uncovered that the information used to guide movement appears to be gesture specific.
APA, Harvard, Vancouver, ISO, and other styles
34

Ruth-Hirrel, Laura, and Sherman Wilcox. "Speech-gesture constructions in cognitive grammar: The case of beats and points." Cognitive Linguistics 29, no. 3 (August 28, 2018): 453–93. http://dx.doi.org/10.1515/cog-2017-0116.

Full text
Abstract:
AbstractThe current study uses principles from Cognitive Grammar to better account for the symbolic integration of gesture and speech. Drawing on data collected from language use, we examine the use of two attention-directing strategies that are expressed through gesture, beats and pointing. It has been claimed that beats convey no semantic information. We propose that beat gestures are symbolic structures. It has also been noted that beats are often overlaid on other gestures. To date, however, no detailed explanation has been offered to account for the conceptual and phonological integration of beats with other co-expressed gestures. In this paper, we explore the integration of beats and pointing gestures as complex gestural expressions. We find that simple beat gestures, as well as beat gestures co-expressed with pointing gestures, are used to direct attention to meanings in speech that are associated with salient components of stancetaking acts. Our account further reveals a symbolic motivation for the apparent “superimposing” of beats onto pointing gestures. By closely examining actual usage events, we take an initial step toward demonstrating how the symbolic elements of both beats and points are integrated in multimodal constructions.
APA, Harvard, Vancouver, ISO, and other styles
35

Holler, Judith, and Geoffrey Beattie. "Pragmatic aspects of representational gestures." Gesture 3, no. 2 (December 31, 2003): 127–54. http://dx.doi.org/10.1075/gest.3.2.02hol.

Full text
Abstract:
Two studies are reported that investigate how speakers use gesture in association with verbal ambiguity in two communicational situations characteristic of everyday talk. The first study uses a design that mimics a speaker’s self-repair initiated by the listener, while the second study involves speakers producing longer stretches of speech involving lexical ambiguity, without the listener interacting verbally with the speaker. The findings of both studies show that speakers do use gesture to clarify verbal ambiguity. Moreover, they suggest that the speaker’s awareness of a potential communication problem, and the fact that this communication problem is associated with the speech itself, are crucial variables influencing speakers’ gestural behaviour. Differences in the complexity of the form of the gestures are also observed and the theoretical implications of this are discussed. Overall, these studies provide important insights into semantic and pragmatic aspects of representational hand gestures and speech-gesture interaction in everyday talk.
APA, Harvard, Vancouver, ISO, and other styles
36

Mattis, Steven. "All the Important Things You Wanted to Know About the Effects of Stroke: Location, Location, Location." Journal of the International Neuropsychological Society 14, no. 1 (December 14, 2007): 176–77. http://dx.doi.org/10.1017/s1355617708080235.

Full text
Abstract:
The Behavioral and Cognitive Neurology of Stroke. 2007. Olivier Godefroy and Julien Bogousslavsky (Eds.). Cambridge, UK: Cambridge University Press, 664 pp., $160.00 (HB)The Behavioral and Cognitive Neurology of Stroke is a very handy reference book for the bedside or brief office examination of the stroke patient. The initial chapter highlights the need for serial mental status exams during the critical initial post stroke period. The book is then organized by functional sections, each containing several chapters. The sections are organized by neuropsychological processes in the usual “walk around the brain” format. Thus, the reader is offered sections on motor and gestural disorders, aphasia and arthric disorders, hemineglect and right hemisphere syndromes, agnosia and Balint's syndrome, and executive and memory disorders. Of great significance is the inclusion of a section on behavioral and mood disorders, which reviews the clinical domains where the disciplines of psychiatry and neurology overlap. The final section, dementia and anatomical left/right syndromes, extends and integrates the previous sections.
APA, Harvard, Vancouver, ISO, and other styles
37

Parrill, Fey, and Kashmiri Stec. "Seeing first person changes gesture but saying first person does not." Gesture 17, no. 1 (October 19, 2018): 158–75. http://dx.doi.org/10.1075/gest.00014.par.

Full text
Abstract:
Abstract Events with a motor action component (e.g., handling an object) tend to evoke gestures from the point of view of a character (character viewpoint, or CVPT) while events with a path component (moving through space) tend to evoke gestures from the point of view of an observer (observer viewpoint, or OVPT). Events that combine both components (e.g., rowing a boat across a lake) seem to evoke both types of gesture, but it is unclear why narrators use one or the other. We carry out two manipulations to explore whether gestural viewpoint can be manipulated. Participants read a series of stories and retold them in two conditions. In the image condition, story sentences were presented with images from either the actor’s perspective (actor version) or the observer’s perspective (observer version). In the linguistic condition, the same sentences were presented in either the second person (you…) or the third person point of view (h/she…). The second person led participants to use the first person (I) in retelling. Gestures produced during retelling were coded as CVPT or OVPT. Participants produced significantly more CVPT gestures after seeing images from the point of view of an actor, but the linguistic manipulation did not affect viewpoint in gesture. Neither manipulation affected overall gesture rate, or co-occurring speech. We relate these findings to frameworks in which motor action and mental imagery are linked to viewpoint in gesture.
APA, Harvard, Vancouver, ISO, and other styles
38

SO, WING CHEE, and JIA YI LIM. "Point to a referent, and say, “what is this?” Gesture as a potential cue to identify referents in a discourse." Applied Psycholinguistics 33, no. 2 (June 1, 2011): 329–42. http://dx.doi.org/10.1017/s0142716411000373.

Full text
Abstract:
ABSTRACTThis study explored whether caregivers' gestures followed the discourse-pragmatic principle of information status of referents (given vs. new) and how their children responded to those gestures when identifying referents. Ten Chinese-speaking and eight English-speaking caregivers were videotaped while interacting spontaneously with their children. Their speech and gestures were coded for referential expressions. Our findings showed that the Chinese-speaking caregivers gestured more often than the English-speaking caregivers but both of the groups gestured more often when asking their children to identify the new referents than the given referents (e.g., pointed to a puzzle while asking “What is this”?). The children were also sensitive to the information status of referents and they relied on the gestures to identify the new referents (but not the given referents). Overall, gesture serves as a potential cue for referential identification in both the caregivers and their children.
APA, Harvard, Vancouver, ISO, and other styles
39

Janczyk, Markus, Aiping Xiong, and Robert W. Proctor. "Stimulus-Response and Response-Effect Compatibility With Touchless Gestures and Moving Action Effects." Human Factors: The Journal of the Human Factors and Ergonomics Society 61, no. 8 (March 7, 2019): 1297–314. http://dx.doi.org/10.1177/0018720819831814.

Full text
Abstract:
Objective: To determine whether response-effect (R-E) compatibility or stimulus-response (S-R) compatibility is more critical for touchless gesture responses. Background: Content on displays can be moved in the same direction (S-R incompatible but R-E compatible) or opposite direction (S-R compatible but R-E incompatible) as the touchless gesture that produces the movement. Previous studies suggested that it is easier to produce a button-press response when it is R-E compatible (and S-R incompatible). However, whether this R-E compatibility effect also occurs for touchless gesture responses is unknown. Method: Experiments 1 and 2 employed an R-E compatibility manipulation in which participants made responses with an upward or downward touchless gesture that resulted in the display content moving in the same (compatible) or opposite (incompatible) direction. Experiment 3 employed an S-R compatibility manipulation in which the stimulus occurred at the upper or lower location on the screen. Results: Overall, only negligible influences of R-E compatibility on performing the touchless gestures were observed (in contrast to button-press responses), whereas S-R compatibility heavily affected the gestural responses. Conclusion: The R-E compatibility obtained in many previous studies with various types of responses appears not to hold for touchless gestures as responses. Application: The results suggest that in the design of touchless interfaces, unique factors may contribute to determining which mappings of gesture and display movements are preferred by users.
APA, Harvard, Vancouver, ISO, and other styles
40

Çatak, Esra Nur, Alper Açık, and Tilbe Göksun. "The relationship between handedness and valence: A gesture study." Quarterly Journal of Experimental Psychology 71, no. 12 (January 22, 2018): 2615–26. http://dx.doi.org/10.1177/1747021817750110.

Full text
Abstract:
People with different hand preferences assign positive and negative emotions to different sides of their bodies and produce co-speech gestures with their dominant hand when the content is positive. In this study, we investigated this side preference by handedness in both gesture comprehension and production. Participants watched faceless gesture videos with negative and positive content on eye tracker and were asked to retell the stories after each video. Results indicated no difference in looking preferences regarding being right- or left-handed. Yet, an effect of emotional valence was observed. Participants spent more time looking to the right (actor’s left) when the information was positive and to the left (actor’s right) when the information was negative. Participants’ retelling of stories revealed a handedness effect only for different types of gestures (representational vs beat). Individuals used their dominant hands for beat gestures. For representational gestures, while the right-handers used their right hands more, the left-handers gestured using both hands equally. Overall, the lack of significant difference between handedness and emotional content in both comprehension and production levels suggests that body-specific mental representations may not extend to the conversational level.
APA, Harvard, Vancouver, ISO, and other styles
41

Oliveira, Miguel Filipe da Silva, and Sofia N. Wasterlain. "How zoo-housed chimpanzees (Pan troglodytes) target gestural communication within and between age groups." Antropologia Portuguesa, no. 37 (December 11, 2020): 7–28. http://dx.doi.org/10.14195/2182-7982_37_1.

Full text
Abstract:
Gestural communication among nonhuman primates evolved as a response to their complex social environment. In this scope, males and females, adults and non-adults employ different gestures, probably due to their distinct social roles. In this study, a within and between age group analysis of the gestures produced in different contexts was carried out. For this purpose, a community of 16 captive chimpanzees (Pan troglodytes) was observed during a 3-month period. Initially, data were collected through ad libitum sampling in order to identify their gestural repertoire. Subsequently, focal sampling was used to identify who gesticulated with whom and in what context. Overall, the results showed that juvenile chimpanzees tend to direct their gestures to different age groups according to the context; more specifically, juvenile chimpanzees frequently gesticulate within their age group in play contexts, and with older individuals in locomotion and affiliation contexts. Based on this, a certain degree of flexibility in juvenile chimpanzees gestural signalling is suggested, to the extent that they rather direct their gestural signs to chimpanzees of an apparently more adequate age group, with the aim of involving themselves in the activities’ context in which the gestural sign is produced.
APA, Harvard, Vancouver, ISO, and other styles
42

Beattie, Geoffrey, and Heather Shovelton. "When size really matters." Gesture 6, no. 1 (March 23, 2006): 63–84. http://dx.doi.org/10.1075/gest.6.1.04bea.

Full text
Abstract:
Although some studies have demonstrated that imagistic gestures do communicate significant amounts of information none have attempted to analyze the significance of that information for the linguistic account within which it is embedded. This study focuses on the semantic dimension size and in a corpus of narratives identifies every single instance of size information and identifies whether this size information is encoded in speech, in gesture, or in speech and gesture. Crucially, it considers the judged relative importance of each instance of size information. It was discovered that high importance size information was significantly more likely to be encoded in gesture rather than in speech, whereas low importance size information was more likely to be encoded in speech rather than in gesture. This suggests that speakers may vary what information is encoded gesturally, according to its salience for the overall meaning to be conveyed. This result has major implications for the conceptualization of how gesture and speech work together in everyday talk.
APA, Harvard, Vancouver, ISO, and other styles
43

Hupp, Julie M., and Mary C. Gingras. "The role of gesture meaningfulness in word learning." Gesture 15, no. 3 (November 28, 2016): 340–56. http://dx.doi.org/10.1075/gest.15.3.04hup.

Full text
Abstract:
Adults regularly use word-gesture combinations in communication, and meaningful gestures facilitate word learning. However, it is not clear if this benefit of gestures is due to the speaker’s movement increasing the listener’s attention or if it needs to be a meaningful gesture, if the difficulty of the task results in disparate reliance on gestures, and if word classes are differentially affected by gestures. In the present research, participants were measured on their novel word learning across four gesture conditions: meaningful gesture, beat gesture, nonsense gesture, and no gesture with extended training (Study 1, n = 139) and brief training (Study 2, n = 128). Overall, meaningful gestures and high frequency words led to the highest word learning accuracy. This effect of word frequency did not hold true for beat gestures after brief training suggesting that adding rhythmic information — if not adding semantic information — may detract from word learning. This research highlights the importance of considering task difficulty when analyzing the effects of gestures.
APA, Harvard, Vancouver, ISO, and other styles
44

Namy, Laura L., Rebecca Vallas, and Jennifer Knight-Schwarz. "Linking parent input and child receptivity to symbolic gestures." Gesture 8, no. 3 (December 12, 2008): 302–24. http://dx.doi.org/10.1075/gest.8.3.03nam.

Full text
Abstract:
This study explored the relation between parents’ production of gestures and symbolic play during free play and children’s production and comprehension of symbolic gestures. Thirty-one 16- to 22-month-olds and their parents participated in a free play session. Children also participated in a forced-choice novel gesture-learning task. Parents’ pretend play with objects in hand was predictive of children’s gesture production during play and gesture vocabulary according to parental report. No relationship was found between parent gesture and child performance on the forced-choice gesture-learning task, although children’s performance was negatively correlated with their verbal vocabulary size. These data suggest a strong link between parental input and the children’s use of gestures as symbols, although not a direct link from parent gesture to child gesture. The data also suggest that children’s overall expectations that gestures can be symbols is unaffected by parental input, and highlight the possibility that children play a role in transforming the symbolic play behaviors that they observe into communicative signals.
APA, Harvard, Vancouver, ISO, and other styles
45

de Beer, Carola, Marcella Carragher, Karin van Nispen, Katharina Hogrefe, Jan P. de Ruiter, and Miranda L. Rose. "How Much Information Do People With Aphasia Convey via Gesture?" American Journal of Speech-Language Pathology 26, no. 2 (May 17, 2017): 483–97. http://dx.doi.org/10.1044/2016_ajslp-15-0027.

Full text
Abstract:
Purpose People with aphasia (PWA) face significant challenges in verbally expressing their communicative intentions. Different types of gestures are produced spontaneously by PWA, and a potentially compensatory function of these gestures has been discussed. The current study aimed to investigate how much information PWA communicate through 3 types of gesture and the communicative effectiveness of such gestures. Method Listeners without language impairment rated the information content of short video clips taken from PWA in conversation. Listeners were asked to rate communication within a speech-only condition and a gesture + speech condition. Results The results revealed that the participants' interpretations of the communicative intentions expressed in the clips of PWA were significantly more accurate in the gesture + speech condition for all tested gesture types. Conclusion It was concluded that all 3 gesture types under investigation contributed to the expression of semantic meaning communicated by PWA. Gestures are an important communicative means for PWA and should be regarded as such by their interlocutors. Gestures have been shown to enhance listeners' interpretation of PWA's overall communication.
APA, Harvard, Vancouver, ISO, and other styles
46

Solé, Maria-Josep. "New Ways of Analyzing Sound Change." Sound Change 9 (January 1, 1994): 21–44. http://dx.doi.org/10.1075/bjl.9.03sol.

Full text
Abstract:
Abstract. Synchronic and diachronic sound change may involve (1) the phonologization of an effect of phonetic implementation, or (2) the lexicalization of phonetic or phonogical processes. This paper seeks to determine the phonologization and lexicalization of phonetic and phonological effects on the basis of their behaviour across different speaking rates. To illustrate the phonologization of phonetic effects, cross-linguistic data on aspiration and vowel nasalization across different speech rates are presented. The data show that phonological effects adjust to variations in speech rate, so as to keep a constant perceptual distance across rates, whereas phonetic effects, which originate at a lower level, remain constant across rates or present rate-correlated changes which can be accounted for by the general principles of speech motor control. Speech rate might also allow us to distinguish between phonetic effects which do not involve a change in the underlying representation, and effects which have been lexicalized. Connected speech processes, such as assimilation, are known to depend on factors such as speaking rate and speaking style. Consequently, low level assimilatory processes are expected to show continuous variation with changes in rate, as a result of increased gestural overlap. On the contrary, if assimilatory processes have been lexicalized as a distinct lexical representation or as an alternative style-dependent form, then the lexicalized form will exhibit a rate-invariant pattern. A variety of experimental data which provide support for this new way of analyzing sound change is presented. It is argued that part of the synchronic variation in present-day speakers is due to sound change, i.e. a discrete, categorical change in the speaker's grammar.
APA, Harvard, Vancouver, ISO, and other styles
47

Dingemanse, Mark. "Ideophones and gesture in everyday speech." Gesture 13, no. 2 (December 31, 2013): 143–65. http://dx.doi.org/10.1075/gest.13.2.02din.

Full text
Abstract:
This article examines the relation between ideophones and gestures in a corpus of everyday discourse in Siwu, a richly ideophonic language spoken in Ghana. The overall frequency of ideophone-gesture couplings in everyday speech is lower than previously suggested, but two findings shed new light on the relation between ideophones and gesture. First, discourse type makes a difference: ideophone-gesture couplings are more frequent in narrative contexts, a finding that explains earlier claims, which were based not on everyday language use but on elicited narratives. Second, there is a particularly strong coupling between ideophones and one type of gesture: iconic gestures. This coupling allows us to better understand iconicity in relation to the affordances of meaning and modality. Ultimately, the connection between ideophones and iconic gestures is explained by reference to the depictive nature of both. Ideophone and iconic gesture are two aspects of the process of depiction.
APA, Harvard, Vancouver, ISO, and other styles
48

Perepelytsia, Oleksandr O. "The Performance Gesture as a Theatrical Reflection of New Contexts of Genre and Style in Contemporary Piano Music." ICONI, no. 1 (2019): 116–24. http://dx.doi.org/10.33779/2658-4824.2019.1.116-124.

Full text
Abstract:
The article deals with the expressive role of gestures in the art of piano performance in relation to both classical and contemporary music. According to theoretical analysis, it is demonstrated that the issue of the performance gesture in contemporary music, in connection with the theatricalization of performance, as well as due to the fact that performance in many cases acquires the features of visual play-acting, stands out from the overall issue of artistry. The general provisions of the artistic gesture in contemporary piano music are complemented by multiple positions related to the art of playing the clusters, strings, pedals, using sound gestures, as well as theatricalization of the performed musical material. The article provides a detailed description of the categories of gestures adopted in the practice of modern music. They are: gestures related to performance of clusters; interspersed with verbal sounds in the process of playing the piano, the so-called verbal and sound gestures; related with playing on the strings by using fingers, sticks or other items; associated with playing pedals; theatricalized gestures. In conclusion: the expansion of the boundaries of musical language, and the emergence of performances and theatricalized compositions in performance practice has led to the expansion of the thesaurus of performance gestures’ and of its informative functions. In contemporary music gesture has become a bearer of meaning and forms one of the strata providing meaning to composition.
APA, Harvard, Vancouver, ISO, and other styles
49

Parrill, Fey, and Kashmiri Stec. "Gestures of the abstract." Pragmatics and Cognition 24, no. 1 (December 31, 2017): 33–61. http://dx.doi.org/10.1075/pc.17006.par.

Full text
Abstract:
Abstract Speakers perform manual gestures in the physical space nearest them, called gesture space. We used a controlled elicitation task to explore whether speakers use gesture space in a consistent way (assign spaces to ideas and use those spaces for those ideas) and whether they use space in a contrastive way (assign different spaces to different ideas when using contrastive speech) when talking about abstract referents. Participants answered two questions designed to elicit contrastive, abstract discourse. We investigated manual gesture behavior. Gesture hand, location on the horizontal axis, and referent in corresponding speech were coded. We also coded contrast in speech. Participants’ overall tendency to use the same hand (t(17) = 13.12, p = .001, 95% CI [.31, .43], d = 2.53) and same location (t(17) = 7.47, p = .001, 95% CI [.27, .47], d = 1.69) when referring to an entity was higher than expected frequency. When comparing pairs of gestures produced with contrastive speech to pairs of gestures produced with non-contrastive speech, we found a greater tendency to produce gestures with different hands for contrastive speech: (t(17) = 4.19, p = .001, 95% CI [.27, .82], d = 1.42). We did not find associations between dominant side and positive concepts or between left, center, and right space and past, present, and future, respectively, as predicted by previous studies. Taken together, our findings suggest that speakers do produce spatially consistent and contrastive gestures for abstract as well as concrete referents. They may be using spatial resources to assist with abstract thinking, and/or to help interlocutors with reference tracking. Our findings also highlight the complexity of predicting gesture hand and location, which appears to be the outcome of many competing variables.
APA, Harvard, Vancouver, ISO, and other styles
50

Obermeier, Christian, Henning Holle, and Thomas C. Gunter. "What Iconic Gesture Fragments Reveal about Gesture–Speech Integration: When Synchrony Is Lost, Memory Can Help." Journal of Cognitive Neuroscience 23, no. 7 (July 2011): 1648–63. http://dx.doi.org/10.1162/jocn.2010.21498.

Full text
Abstract:
The present series of experiments explores several issues related to gesture–speech integration and synchrony during sentence processing. To be able to more precisely manipulate gesture–speech synchrony, we used gesture fragments instead of complete gestures, thereby avoiding the usual long temporal overlap of gestures with their coexpressive speech. In a pretest, the minimal duration of an iconic gesture fragment needed to disambiguate a homonym (i.e., disambiguation point) was therefore identified. In three subsequent ERP experiments, we then investigated whether the gesture information available at the disambiguation point has immediate as well as delayed consequences on the processing of a temporarily ambiguous spoken sentence, and whether these gesture–speech integration processes are susceptible to temporal synchrony. Experiment 1, which used asynchronous stimuli as well as an explicit task, showed clear N400 effects at the homonym as well as at the target word presented further downstream, suggesting that asynchrony does not prevent integration under explicit task conditions. No such effects were found when asynchronous stimuli were presented using a more shallow task (Experiment 2). Finally, when gesture fragment and homonym were synchronous, similar results as in Experiment 1 were found, even under shallow task conditions (Experiment 3). We conclude that when iconic gesture fragments and speech are in synchrony, their interaction is more or less automatic. When they are not, more controlled, active memory processes are necessary to be able to combine the gesture fragment and speech context in such a way that the homonym is disambiguated correctly.
APA, Harvard, Vancouver, ISO, and other styles
We offer discounts on all premium plans for authors whose works are included in thematic literature selections. Contact us to get a unique promo code!

To the bibliography