Academic literature on the topic 'Gestural overlap'
Create a spot-on reference in APA, MLA, Chicago, Harvard, and other styles
Consult the lists of relevant articles, books, theses, conference reports, and other scholarly sources on the topic 'Gestural overlap.'
Next to every source in the list of references, there is an 'Add to bibliography' button. Press on it, and we will generate automatically the bibliographic reference to the chosen work in the citation style you need: APA, MLA, Harvard, Chicago, Vancouver, etc.
You can also download the full text of the academic publication as pdf and read online its abstract whenever available in the metadata.
Journal articles on the topic "Gestural overlap"
1
Jun, Jongho. "Place assimilation is not the result of gestural overlap: evidence from Korean and English." Phonology 13, no. 3 (December 1996): 377–407. http://dx.doi.org/10.1017/s0952675700002682.
Full textAbstract:
In the theory of articulatory phonology Browman & Goldstein (1986, 1990, 1992) claim that place assimilation is mainly the result of the overlap of gestures and the perception of these overlapping gestures as a single gesture. Ohala (1990) makes a similar claim. The present study provides interesting experimental evidence against this explanation of assimilation as a result of gestural overlap and resulting misperception, and for the importance of gestural reduction.
2
Browman, Catherine P., and Louis Goldstein. "Articulatory gestures as phonological units." Phonology 6, no. 2 (August 1989): 201–51. http://dx.doi.org/10.1017/s0952675700001019.
Full textAbstract:
We have argued that dynamically defined articulatory gestures are the appropriate units to serve as the atoms of phonological representation. Gestures are a natural unit, not only because they involve task-oriented movements of the articulators, but because they arguably emerge as prelinguistic discrete units of action in infants. The use of gestures, rather than constellations of gestures as in Root nodes, as basic units of description makes it possible to characterise a variety of language patterns in which gestural organisation varies. Such patterns range from the misorderings of disordered speech through phonological rules involving gestural overlap and deletion to historical changes in which the overlap of gestures provides a crucial explanatory element.Gestures can participate in language patterns involving overlap because they are spatiotemporal in nature and therefore have internal duration. In addition, gestures differ from current theories of feature geometry by including the constriction degree as an inherent part of the gesture. Since the gestural constrictions occur in the vocal tract, which can be charactensed in terms of tube geometry, all the levels of the vocal tract will be constricted, leading to a constriction degree hierarchy. The values of the constriction degree at each higher level node in the hierarchy can be predicted on the basis of the percolation principles and tube geometry. In this way, the use of gestures as atoms can be reconciled with the use of Constriction degree at various levels in the vocal tract (or feature geometry) hierarchy.The phonological notation developed for the gestural approach might usefully be incorporated, in whole or in part, into other phonologies. Five components of the notation were discussed, all derived from the basic premise that gestures are the primitive phonological unit, organised into gestural scores. These components include (1) constriction degree as a subordinate of the articulator node and (2) stiffness (duration) as a subordinate of the articulator node. That is, both CD and duration are inherent to the gesture. The gestures are arranged in gestural scores using (3) articulatory tiers, with (4) the relevant geometry (articulatory, tube or feature) indicated to the left of the score and (5) structural information above the score, if desired. Association lines can also be used to indicate how the gestures are combined into phonological units. Thus, gestures can serve both as characterisations of articulatory movement data and as the atoms of phonological representation.
3
Iskarous, Khalil. "The acoustics of gestural overlap." Journal of the Acoustical Society of America 109, no. 5 (May 2001): 2294. http://dx.doi.org/10.1121/1.4744040.
Full text
4
Valle, Chelsea La, Karen Chenausky, and Helen Tager-Flusberg. "How do minimally verbal children and adolescents with autism spectrum disorder use communicative gestures to complement their spoken language abilities?" Autism & Developmental Language Impairments 6 (January 2021): 239694152110350. http://dx.doi.org/10.1177/23969415211035065.
Full textAbstract:
Background and aims Prior work has examined how children and adolescents with autism spectrum disorder who are minimally verbal use their spoken language abilities during interactions with others. However, social communication includes other aspects beyond speech. To our knowledge, no studies have examined how minimally verbal children and adolescents with autism spectrum disorder are using their gestural communication during social interactions. Such work can provide important insights into how gestures may complement their spoken language abilities. Methods Fifty minimally verbal children and adolescents with autism spectrum disorder participated ( Mage = 12.41 years; 38 males). Gestural communication was coded from the Autism Diagnostic Observation Schedule. Children ( n = 25) and adolescents ( n = 25) were compared on their production of gestures, gesture–speech combinations, and communicative functions. Communicative functions were also assessed by the type of communication modality: gesture, speech, and gesture–speech to examine the range of communicative functions across different modalities of communication. To explore the role gestures may play the relation between speech utterances and gestural production was investigated. Results Analyses revealed that (1) minimally verbal children and adolescents with autism spectrum disorder did not differ in their total number of gestures. The most frequently produced gesture across children and adolescents was a reach gesture, followed by a point gesture (deictic gesture), and then conventional gestures. However, adolescents produced more gesture–speech combinations (reinforcing gesture-speech combinations) and displayed a wider range of communicative functions. (2) Overlap was found in the types of communicative functions expressed across different communication modalities. However, requests were conveyed via gesture more frequently compared to speech or gesture–speech. In contrast, dis/agree/acknowledging and responding to a question posed by the conversational partner was expressed more frequently via speech compared to gesture or gesture–speech. (3) The total number of gestures was negatively associated with total speech utterances after controlling for chronological age, receptive communication ability, and nonverbal IQ. Conclusions Adolescents may be employing different communication strategies to maintain the conversational exchange and to further clarify the message they want to convey to the conversational partner. Although overlap occurred in communicative functions across gesture, speech, and gesture–speech, nuanced differences emerged in how often they were expressed across different modalities of communication. Given their speech production abilities, gestures may play a compensatory role for some individuals with autism spectrum disorder who are minimally verbal. Implications Findings underscore the importance of assessing multiple modalities of communication to provide a fuller picture of their social communication abilities. Our results identified specific communicative strengths and areas for growth that can be targeted and expanded upon within gesture and speech to optimize social communication development.
5
Murillo, Eva, Carlota Ortega, Alicia Otones, Irene Rujas, and Marta Casla. "Changes in the Synchrony of Multimodal Communication in Early Language Development." Journal of Speech, Language, and Hearing Research 61, no. 9 (September 19, 2018): 2235–45. http://dx.doi.org/10.1044/2018_jslhr-l-17-0402.
Full textAbstract:
Purpose The aim of this study is to analyze the changes in temporal synchrony between gesture and speech of multimodal communicative behaviors in the transition from babbling to two-word productions. Method Ten Spanish-speaking children were observed at 9, 12, 15, and 18 months of age in a semistructured play situation. We longitudinally analyzed the synchrony between gestures and vocal productions and between their prominent parts. We also explored the relationship between gestural–vocal synchrony and independent measures of language development. Results Results showed that multimodal communicative behaviors tend to be shorter with age, with an increasing overlap of its constituting elements. The same pattern is found when considering the synchrony between the prominent parts. The proportion of overlap between gestural and vocal elements at 15 months of age as well as the proportion of the stroke overlapped with vocalization appear to be related to lexical development 3 months later. Conclusions These results suggest that children produce gestures and vocalizations as coordinated elements of a single communication system before the transition to the two-word stage. This coordination is related to subsequent lexical development in this period. Supplemental Material https://doi.org/10.23641/asha.6912242
6
Roberts, Anna Ilona, and Sam George Bradley Roberts. "Convergence and divergence in gesture repertoires as an adaptive mechanism for social bonding in primates." Royal Society Open Science 4, no. 11 (November 2017): 170181. http://dx.doi.org/10.1098/rsos.170181.
Full textAbstract:
A key challenge for primates living in large, stable social groups is managing social relationships. Chimpanzee gestures may act as a time-efficient social bonding mechanism, and the presence (homogeneity) and absence (heterogeneity) of overlap in repertoires in particular may play an important role in social bonding. However, how homogeneity and heterogeneity in the gestural repertoire of primates relate to social interaction is poorly understood. We used social network analysis and generalized linear mixed modelling to examine this question in wild chimpanzees. The repertoire size of both homogeneous and heterogeneous visual, tactile and auditory gestures was associated with the duration of time spent in social bonding behaviour, centrality in the social bonding network and demography. The audience size of partners who displayed similar or different characteristics to the signaller (e.g. same or opposite age or sex category) also influenced the use of homogeneous and heterogeneous gestures. Homogeneous and heterogeneous gestures were differentially associated with the presence of emotional reactions in response to the gesture and the presence of a change in the recipient's behaviour. Homogeneity and heterogeneity of gestural communication play a key role in maintaining a differentiated set of strong and weak social relationships in complex, multilevel societies.
7
Son, Minjung. "Gestural Overlap as a Function of Assimilation Contrast." Korean Journal of Linguistics 33, no. 4 (December 2008): 665–91. http://dx.doi.org/10.18855/lisoko.2008.33.4.005.
Full text
8
Zsiga, Elizabeth C. "Acoustic evidence for gestural overlap in consonant sequences." Journal of Phonetics 22, no. 2 (April 1994): 121–40. http://dx.doi.org/10.1016/s0095-4470(19)30189-5.
Full text
9
PIKA, SIMONE, ELENA NICOLADIS, and PAULA F. MARENTETTE. "A cross-cultural study on the use of gestures: Evidence for cross-linguistic transfer?" Bilingualism: Language and Cognition 9, no. 3 (October 20, 2006): 319–27. http://dx.doi.org/10.1017/s1366728906002665.
Full textAbstract:
Anecdotal reports provide evidence of so called “hybrid” gesturer whose non-verbal behavior of one language/culture becomes visible in the other. The direction of this gestural transfer seems to occur from a high to a low frequency gesture language. The purpose of this study was therefore to test systematically 1) whether gestural transfer occurs from a high frequency gesture language to a low frequency gesture language, 2) if the frequency of production of some gesture types is more likely to be transferred than others, and 3) whether gestural transfer can also occur bi-directionally. To address these questions, we investigated the use of gestures of English–Spanish bilinguals, French–English bilinguals, and English monolinguals while retelling a cartoon. Our analysis focused on the rate of gestures and the frequency of production of gesture types. There was a significant difference in the overall rate of gestures: both bilingual groups gestured more than monolingual participants. This difference was particularly salient for iconic gestures. In addition, we found that French–English bilinguals used more deictic gestures in their L2. The results suggest that knowledge of a high frequency gesture language affects the gesture rate in a low-frequency gesture language.
10
Tjaden, Kris, and Gary Weismer. "Evidence of gestural overlap across speaking rate: Acoustic data." Journal of the Acoustical Society of America 96, no. 5 (November 1994): 3326. http://dx.doi.org/10.1121/1.411344.
Full textDissertations / Theses on the topic "Gestural overlap"
1
Zhao, Sherry Yi 1980. "Gestural overlap of stop-consonant sequences." Thesis, Massachusetts Institute of Technology, 2003. http://hdl.handle.net/1721.1/29728.
Full textAbstract:
Thesis (M.Eng.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 2003.Includes bibliographical references (p. 79).
This study used an analysis-by-synthesis approach to discover possible principles governing the coordination of oral and laryngeal articulators in the production of English stop-consonant sequences. Recorded utterances containing stop-consonant sequences were analyzed acoustically, with focus on formant movements, closure durations, release bursts, and spectrum shape at low frequencies. The results of the acoustic analysis were translated into general gestural timing estimates. From these estimates, a set of possible principles was derived. Both the general gestural estimates and the derived principles were verified and refined through quasi-articulatory synthesis using HLsyn. Perception tests composed of synthetic sequences with varying degrees of overlap were administered. From acoustic analysis, synthesis verification, and perception testing, two principles emerged. First, V1Cl#C2V2 stop-consonant sequences with front-to-back order of place of articulation have more overlap of articulators than those with back-to-front order; this agrees with past research findings (Chitoran, Goldstein, and Byrd, 2002). The extent of the overlapping usually does not go beyond the obliteration of the Cl release burst. Second, gestural overlap involving laryngeal articulators exists but varies from individual to individual. The voicing of C1 usually affects the voicing of C2 in V1CI#C2V2 sequences.
by Sherry Yi Zhao.
M.Eng.
2
Yun, Gwan Hi. "The Interaction Between Palatalization and Coarticulation in Korean and English." Diss., The University of Arizona, 2006. http://hdl.handle.net/10150/195270.
Full textAbstract:
This study investigates phonetic and phonological factors which influence the degree of vowel-to-vowel coarticulation in Korean and English, especially around palatalization rules. Two phonetic factors and two phonological factors were examined in investigating the degree of anticipatory or carryover coarticulation in VCV sequences. The phonetic factors were the intervening consonants (alveolar stop vs. (alveo)palatals), and the second vowels (/i/ vs. /a/); the phonological factors were the effect of palatalization, and the lexical status of palatalization (lexical vs. postlexical palatalization). Ultrasound imaging techniques and F2 measurements are employed to see how much further front the articulation of V1 in V1CV2 sequences is due to influence of V2 across the consonants. Ultrasound images of vowels and their F2 values were quantified and statistically analyzed with ANOVA.First, it was found that V1 in V1CV2 sequences in Korean was articulated further front when intervening consonants were palatals than when they were alveolars, while there was no difference in frontness of V1 between two consonantal conditions in English. This indicates that Korean palatals are a stronger barrier to vowel-to-vowel coarticulation, while English alveopalatals are not. Next, V1 in both languages was articulated further front when V2 was /i/ than when V2 was /a/. Third, we had striking findings that palatalization rules caused stronger vowel-to-vowel coarticulation than in nonpalatalized words. Results showed that V1s were articulated further front across derived palatals than across underlying palatals in V1Ci sequences. Last, it was determined that V2 was articulated further front in words which underwent postlexical palatalization than in words which underwent lexical palatalization. Such findings indicate that postlexical palatalization causes greater gestural overlap than lexical palatalization, showing stronger degree of coarticulation.Based on the experimental results that phonetic details such as the degree of vowel-to-vowel coarticulation are highly conditioned by the lexical status of palatalization as well as the application of palatalization, I suggest a unified model of phonology and phonetics, using feature-and-gesture based OT frameworks. Second, I follow the proposal that abstract intergestural timing relations should be incorporated into phonological representations either in the input or output (Cho 1998, Gafos 2002, Yun 2005b).
3
Luo, Shan. "Gestural overlap across word boundaries: evidence from English and Mandarins speakers." Thesis, 2016. http://hdl.handle.net/1828/7050.
Full textAbstract:
This research examines how competing factors determine the articulation of English stop-stop sequences across word boundaries in both native (L1) and nonnative (L2) speech. The two general questions that drive this research are 1) how is consonantal coordination implemented across English words? And 2) is this implementation different in L1 versus L2 speech?
A group of 15 native English (NE) speakers and a group of 25 native Mandarin speakers (NM) who use English as a foreign language (ESL) participated in this study. The stimuli employed in this research were designed along four major parameters: 1) place of articulation, 2) lexical frequency, 3) stress, and 4) speech rate. The release percentages and closure duration ratios produced by English and Mandarin speakers were measured.
The results showed that place of articulation had different effects on English and Mandarin speakers in their English stop-stop coarticulation, especially in heterorganic clusters. Specifically, a place order effect (i.e., more releases and more overlap in front-back clusters than in back-front clusters; POE) was only partially supported in native speech but not shown at all in nonnative speech in the current research. The results also confirmed a gradient lexical frequency effect, finding a significant correlation between self-rated frequency and overlap. A group difference was observed in the interaction between the effects of place of articulation and categorical frequency (real words vs. nonwords). In addition, the results showed, unexpectedly, a stronger stress effect for the NM group rather than for the NE group. Further analyses showed that increased speech rate did not systematically induce increased temporal overlap, because speakers from both groups varied in their behavior, having either more or less overlap at the fast speech rate than at the slow rate. Lastly, the analyses found no correlation between closure duration ratio and perceived accent in L2 speech. This finding was not predicted, given that timing features had always been considered critical to foreign accent perception.Graduate
4
Hall, Nancy Elizabeth. "Gestures and segments: Vowel intrusion as overlap." 2003. https://scholarworks.umass.edu/dissertations/AAI3110499.
Full textAbstract:
This dissertation focuses on a phenomenon that I call vowel intrusion . There are cases where a vowel can be heard between two consonants, yet the phonology behaves as if no vowel is present. These “intrusive vowels” are non-syllabic, and native speakers are often unaware of their existence. I argue that intrusive vowels are a percept resulting from the organization of articulatory gestures. When two consonant gestures have little overlap with one another, there is an acoustic release between them; vowel gestures typically overlap neighboring consonants considerably, and it is possible for an overlapping vowel gesture to be heard in this period of release. Intrusive vowels are not segments. They behave unlike true epenthetic vowels. A topological survey reveals that vowel intrusion happens in consonant clusters that contain a sonorant or a guttural, and that it is always the vowel adjacent to the sonorant or guttural that is heard during the release. Intrusive vowels occur primarily in heterorganic clusters, especially next to geminates; they often disappear at fast speech rates, and in some languages, they occur only within or only between syllables. I argue that these characteristics are best explained in a theory that uses Articulatory Phonology representations (Browman & Goldstein 1986 et seq.). I develop a theory called Timing-Augmented Surface Phonology (TASP), cast within the framework of Optimality Theory. TASP contains constraints on the alignment of neighboring gestures (Gafos 2002) and on the permitted degree of overlap between different gestures. The theory requires a segmental representation as well as a gestural representation. Syllables organize segments rather than gestures, and that inter-segmental gestural alignment is universally non-contrastive. The same gestural framework describes both the short, schwa-like intrusive vowels often described as “excrescent”, and also a longer type found in Scots Gaelic and Hocank (Winnebago), in which the vowel is heard in two long parts on either side of the sonorant. In the latter cases the sonorant and vowel together behave like a bimoraic nucleus, and are adjoined in a structure similar to vocalic diphthongs. The theory also has implications for the analysis of Hocank accent.
Books on the topic "Gestural overlap"
1
Yang, Jingduan, and Daniel A. Monti. Physiology of the Internal Organs. Oxford University Press, 2017. http://dx.doi.org/10.1093/med/9780190210052.003.0004.
Full textAbstract:
This chapter provides a detailed description of the concepts of internal human organs from a Chinese medicine perspective, including two additional organs: Pericardium and San Jiao (cavities of chest, abdomen, and pelvic). It describes in detail the manifestation (Xiang) of physiological functions of solid organs (Zang) such as the Heart, Liver, Lungs, Spleen, Kidneys, and Pericardium, and hollow organs (Fu) such as Small Intestine, Larger Intestine, Gallbladder, Bladder, Stomach, and San Jiao. It teaches the functions that overlap largely with modern medical physiology as well as the additional functions due to the energetic connections of each internal organ with the rest of the body, including their specific impacts on sensory faculties, connective tissues, body gestures and movements, and body fluids. This chapter emphasizes that the internal organs in acupuncture and Chinese medicine should be perceived not only as structural and biochemical centers but also as energetic centers.
2
Bickford, Tyler. Schooling New Media. Oxford University Press, 2017. http://dx.doi.org/10.1093/acprof:oso/9780190654146.001.0001.
Full textAbstract:
Schooling New Media is an ethnography of children’s music and media consumption practices at a small elementary and middle school in Vermont. It examines how transformations in music technologies influence the way children, their peers, and adults relate to one another in school. Focusing especially on digital music devices—MP3 players—it reveals the key role of intimate, face-to-face relationships in structuring children’s uses of music technologies. It explores how headphones mediate face-to-face peer relationships, as children share earbuds and listen to music with friends while participating in their peer groups’ dense overlap of talk, touch, and gesture. It argues that kids treat MP3 players less like “technology” and more like “toys,” domesticating them within traditional childhood material cultures already characterized by playful physical interaction and portable objects such as toys, trading cards, and dolls that can be shared, manipulated, and held close. Kids use digital music devices to expand their repertoires of communicative practices—like passing notes or whispering—that allow them to maintain intimate connections with friends beyond the reach of adults. Kids position the connections afforded by digital music listening as a direct challenge to the overarching language and literacy goals of classroom education. Schooling New Media is unique in its intensive ethnographic attention to everyday sites of musical consumption and performance. And it is uniquely interdisciplinary, bringing together approaches from music education, ethnomusicology, technology studies, literacy studies, and linguistic anthropology to make integrative arguments about the relationship between consumer technologies, childhood identities, and educational institutions.
Book chapters on the topic "Gestural overlap"
1
Mondada, Lorenza, and Florence Oloff. "Chapter 24. Gestures in overlap." In Gesture Studies, 321–38. Amsterdam: John Benjamins Publishing Company, 2011. http://dx.doi.org/10.1075/gs.4.29mon.
Full text
2
Yamaguchi, Regiane, and Fernando Gualda. "(Re)Shaping Musical Gesture: Modelling Voice Balance and Overall Dynamics Contour." In From Sounds to Music and Emotions, 459–68. Berlin, Heidelberg: Springer Berlin Heidelberg, 2013. http://dx.doi.org/10.1007/978-3-642-41248-6_26.
Full text
3
de Andrade, Fernando Henrique Cruz, Flavio Garcia Pereira, Cassius Zanetti Resende, and Daniel Cruz Cavalieri. "Improving sEMG-Based Hand Gesture Recognition Using Maximal Overlap Discrete Wavelet Transform and an Autoencoder Neural Network." In XXVI Brazilian Congress on Biomedical Engineering, 271–79. Singapore: Springer Singapore, 2019. http://dx.doi.org/10.1007/978-981-13-2517-5_42.
Full text
4
"Gestural overlap and recoverability: Articulatory evidence from Georgian." In Laboratory Phonology 7, 419–48. De Gruyter Mouton, 2002. http://dx.doi.org/10.1515/9783110197105.2.419.
Full text
5
Browman, Catherine P. "Assimilation as gestural overlap: comments on Hoist and Nolan." In Phonology and Phonetic Evidence, 334–42. Cambridge University Press, 1995. http://dx.doi.org/10.1017/cbo9780511554315.023.
Full text
6
Schmelz, Peter J. "The Soviet Culture of Collage." In Sonic Overload, 29–46. Oxford University Press, 2021. http://dx.doi.org/10.1093/oso/9780197541258.003.0002.
Full textAbstract:
Chapter 1 discusses the precursors for polystylism in the film, visual arts, and musicking of the Soviet 1920s and 1930s. It begins by considering two compositions that encapsulate the initial motivations and method for polystylism: Schnittke’s Violin Sonata no. 2, “Quasi una Sonata,” from 1968, and Silvestrov’s Drama for violin, cello, and piano, composed between 1970 and 1971. Both works juxtapose different techniques and approaches, shifting, often quite radically, from extremely dissonant, sonoristic gestures to quotations or pastiche. This chapter also presents a genealogy of polystylism, looking first at polystylistic antecedents in the music of Dmitriy Shostakovich, Gavriil Popov, Boris Asafyev, and other composers, as well as the general trend toward collage and montage in the Russian visual arts and film from the teens to the 1930s. It concludes by exploring the collage works that took hold in the 1960s in the USSR, starting with Arvo Pärt’s Collage on the Theme B-A-C-H, before spreading more widely, ultimately providing the fuel for Schnittke’s early polystylistic compositions and his theorizing of polystylism by the end of the decade.
7
Korpipää, Panu, Jukka Linjama, Juha Kela, and Tapani Rantakokko. "Unobtrusive Movement Interaction for Mobile Devices." In Mobile Computing, 1029–46. IGI Global, 2009. http://dx.doi.org/10.4018/978-1-60566-054-7.ch084.
Full textAbstract:
Gesture control of mobile devices is an emerging user interaction modality. Large-scale deployment has been delayed by two main technical challenges: detecting gestures reliably and power consumption. There have also been user-experience- related challenges, such as indicating the start of a gesture, social acceptance, and feedback on the gesture detection status. This chapter evaluates a solution for the main challenges: an event-based movement interaction modality, tapping, that emphasizes minimal user effort in interacting with a mobile device. The technical feasibility of the interaction method is examined with a smartphone equipped with a sensor interaction cover, utilizing an enabling software framework. The reliability of detecting tapping is evaluated by analyzing a dataset collected with the smartphone prototype. Overall, the results suggest that detecting tapping is reliable enough for practical applications in mobile computing when the interaction is performed in a stationary situation.
8
Korpipää, Panu, Jukka Linjama, Juha Kela, and Tapani Rantakokko. "Unobtrusive Movement Interaction for Mobile Devices." In Handbook of Research on User Interface Design and Evaluation for Mobile Technology, 507–23. IGI Global, 2008. http://dx.doi.org/10.4018/978-1-59904-871-0.ch030.
Full textAbstract:
Gesture control of mobile devices is an emerging user interaction modality. Large-scale deployment has been delayed by two main technical challenges: detecting gestures reliably and power consumption. There have also been user-experience-related challenges, such as indicating the start of a gesture, social acceptance, and feedback on the gesture detection status. This chapter evaluates a solution for the main challenges: an event-based movement interaction modality, tapping, that emphasizes minimal user effort in interacting with a mobile device. The technical feasibility of the interaction method is examined with a smartphone equipped with a sensor interaction cover, utilizing an enabling software framework. The reliability of detecting tapping is evaluated by analyzing a dataset collected with the smartphone prototype. Overall, the results suggest that detecting tapping is reliable enough for practical applications in mobile computing when the interaction is performed in a stationary situation.
9
Turk, Alice, and Stefanie Shattuck-Hufnagel. "Articulatory Phonology/Task Dynamics." In Speech Timing, 8–48. Oxford University Press, 2020. http://dx.doi.org/10.1093/oso/9780198795421.003.0002.
Full textAbstract:
This chapter summarizes the basic mechanisms of the Articulatory Phonology model, currently the most thoroughly worked-out model in the literature, with a focus on its system-intrinsic mechanisms used to account for systematic variation in speech timing. Key features of the model are reviewed, and oscillator-based mechanisms are described for timing control for articulatory gestures, control of inter-gestural coordination, prosodic timing control, and the control of overall speech rate. Strengths of the AP/TD approach are discussed, which include facts that are well-accounted-for within this model, such as the predominance of CV syllables within the world’s languages, as well as characteristics of processing within the model that are assumed to be advantageous, such as the avoidance of the need to explicitly plan the details of articulatory movement when planning an utterance. This presentation forms the basis of the evaluation presented in subsequent chapters.
10
Denkowski, Marcin, and Łukasz Sadkowski. "Gesture-Driven System for Intelligent Building Control." In Handbook of Research on Advanced Intelligent Control Engineering and Automation, 390–405. IGI Global, 2015. http://dx.doi.org/10.4018/978-1-4666-7248-2.ch014.
Full textAbstract:
In recent years, intelligent building systems have become standard in residential buildings as well as commercial buildings. This chapter presents a novel system for controlling such buildings using natural user interfaces. Due to advanced logic, it is capable of identifying people occupying defined areas and recognizing their gestures. The system cooperates with a Domatiq System – Intelligent Building Management System, to provide an overall control of the building. This allows the user to control particular building components in a more natural way. Results shows that for the elderly or disabled people a more natural method of controlling some appliances is more convenient than, for example, by remote controllers. This system can also be used to control and monitor such people, giving them a sense of comfort and safety in their homes while respecting their privacy.
Conference papers on the topic "Gestural overlap"
1
Crouch, Caroline, Argyro Katsika, and Ioana Chitoran. "The role of sonority profile and order of place of articulation on gestural overlap in Georgian." In 10th International Conference on Speech Prosody 2020. ISCA: ISCA, 2020. http://dx.doi.org/10.21437/speechprosody.2020-42.
Full text
2
Chen, Jinfa, and Won-jong Kim. "Development of a Mobile Robot Providing a Natural Way to Interact With Electronic Devices." In ASME 2016 Dynamic Systems and Control Conference. American Society of Mechanical Engineers, 2016. http://dx.doi.org/10.1115/dscc2016-9751.
Full textAbstract:
This paper provides a natural, yet low-cost way for human to interact with electronic devices indoor: the development of a human-following mobile robot capable of controlling other electrical devices for the user based on the user’s gesture commands. The overall experimental setup consists of a skid-steered mobile robot, Kinect sensor, laptop, wide-angle camera and two lamps. The OpenNI middleware is used to process data from the Kinect sensor, and the OpenCV is used to process data from the wide-angle camera. A new human-following algorithm is proposed based on human motion estimation. The human-following control system consists of two feedback control loop for linear and rotational motions, respectively. A lead-lag and lead controller are developed for the linear and rotational motion control loop, respectively. Experimental results show that the tracking algorithm is robust and reduced the distance and angular error by 40% and 50%, respectively. There are small delays (0.5 s for linear motion and 1.5 s for rotational motion) and steady-state errors (0.1 m for linear motion and 1.5° for rotational motion) of the system’s response. However, the delays and errors are acceptable since they do not cause the tracking distance or angle out of the desirable range (±0.05m and ±10° of the reference input). There are four gestures designed for the user to control the robot, two switch-mode gestures, lamp-creation, lamp-selection and color change gesture. Success rates of gesture recognition are more than 90% within the detectable range of the Kinect sensor.
3
Hihn, Heinke, Sascha Meudt, and Friedhelm Schwenker. "Inferring mental overload based on postural behavior and gestures." In ICMI '16: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION. New York, NY, USA: ACM, 2016. http://dx.doi.org/10.1145/3009960.3009961.
Full text
4
Terao, Junichi, Lina Trejos, Zhe Zhang, and Goldie Nejat. "An Intelligent Socially Assistive Robot for Health Care." In ASME 2008 International Mechanical Engineering Congress and Exposition. ASMEDC, 2008. http://dx.doi.org/10.1115/imece2008-67678.
Full textAbstract:
The development of socially assistive robots for health care applications can provide measurable improvements in patient safety, quality of care, and operational efficiencies by playing an increasingly important role in patient care in the fast pace of crowded clinics, hospitals and nursing/veterans homes. However, there are a number of research issues that need to be addressed in order to design such robots. In this paper, we address two main limitations to the development of intelligent socially assistive robots: (i) identification of human body language via a non-contact sensory system and categorization of these gestures for determining the accessibility level of a person during human-robot interaction, and (ii) decision making control architecture design for determining the learning-based task-driven behavior of the robot during assistive interaction. Preliminary experiments presented show the potential of the integration of the aforementioned techniques into the overall design of such robots intended for assistive scenarios.
5
Nuriman, Harry, Nia Kurniasih, Setiawan Sabana, Intan R. Mutiaz, and Rikrik K. Andryanto. "From Verbal to Three-dimensional Digital Visual Texts: A Construction of a Javanese Prince." In GLOCAL Conference on Asian Linguistic Anthropology 2020. The GLOCAL Unit, SOAS University of London, 2020. http://dx.doi.org/10.47298/cala2020.13-2.
Full textAbstract:
Visualizations of the body of the famous Javanese Prince Diponegoro appears in various media, ranging across sketches, paintings, sculptures, banknotes and coins, shadow puppets, stamps, theatrical performances and electronic devices. All these visualizations mostly follow previous visualizations influenced by artist imaginations. This research seeks to present Prince Diponegoro in three-dimensional animated visualization using a motion capture technique. To complete this, the project draws from authentic manuscript research from the autobiography of Babad Diponegoro. Further, the project employs intertextuality as a method with which to interpolate the data, and hence to obtain a satisfactory overall visualization. The physical features, gestures and paralinguistic elements contained in the verbal text of Babad Diponegoro have been employed using motion capture data based on events written in the Babad Diponegoro. Many existing representations of the prince exist. However, this study attempts to rethink these existing visualizations, so as to produce a much more accurate, if not completely new, icon, thus differing to existing representations.
6
Nejat, Goldie, Brian Allison, Nadia Gomez, and Andrew Rosenfeld. "The Design of an Interactive Socially Assistive Robot for Patient Care." In ASME 2007 International Mechanical Engineering Congress and Exposition. ASMEDC, 2007. http://dx.doi.org/10.1115/imece2007-41811.
Full textAbstract:
It is anticipated that the use of assistive robots will be one of the most important service applications of robotic systems of the future. In this paper, a unique non-contact socially assistive robot consisting of a human-like demeanor is presented for utilization in hospital wards and veteran homes to study its role and impact on the well-being of patients, addressing patient’s needs and its overall effect on the quality of patient care. The robot will be an embodied entity that will participate in hands-off non-contact social interaction with a patient during the convalescence, rehabilitation or end-of-life care stage. The robot has been designed as a platform to incorporate the three design parameters of embodiment, emotion and non-verbal dialog to encourage natural interactions between the patient and itself. For perception, we describe the first application of utilizing varying intensity depth imaginary, via a 3D camera, for non-contact and non-restricting 3D gesture recognition and characterization.
7
Allison, Brian, and Goldie Nejat. "An Expressive Socially Assistive Robot for Health-Care Applications." In ASME 2008 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference. ASMEDC, 2008. http://dx.doi.org/10.1115/detc2008-50082.
Full textAbstract:
It is anticipated that the use of assistive robots will be one of the most important service applications of robotic systems of the future. In this paper, a unique non-contact socially assistive robot consisting of a human-like demeanor is presented for utilization in hospital wards and veteran homes to study its role and impact on the well-being of patients, addressing patient’s needs and its overall effect on the quality of patient care. The robot will be an embodied entity that will participate in hands-off non-contact social interaction with a patient during the convalescence, rehabilitation or end-of-life care stage. The robot has been designed as a platform to incorporate the three design parameters of embodiment, emotion and non-verbal communication to encourage natural interactions between a person and itself. In this paper, we present the mechanical design of the robot. The robot is able to communicate via: (i) a unique human-like face with artificial skin that utilizes the modeling of muscles of a human face to express facial expressions, (ii) a 3 degrees-of-freedom (DOF) neck capable of expressing head gestures, and (iii) an upper torso consisting of a 2 DOF waist and two 4 DOF arms designed to mimic human-like body language.
8
Opiyo, Eliab Z., and Imre Horva´th. "A Study on the Practicalities of Using Volumetric Three-Dimensional Imaging Devices in Design." In ASME 2006 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference. ASMEDC, 2006. http://dx.doi.org/10.1115/detc2006-99135.
Full textAbstract:
Standard two-dimensional (2D) computer displays are traditionally used in engineering design to display the three-dimensional (3D) images generated by computer-aided design and engineering (CAD/CAE) systems. These displays serve primarily as passive visualization tools. The interaction with the displayed images on these devices is only possible through archaic 2D peripheral input devices such as keyboards and mice; via the Windows, Icons, Menus and Pointing (WIMP) style graphical user interfaces. It is widely acknowledged in the design community that such visualization and interaction methods do not match the way the designers think and work. Overall, the emerging volumetric 3D displays are seen as the obvious replacement of flat displays in future. This paper explores the possibility of stepping beyond the present 2D desktop computer monitors, and investigate the practicalities of using the emerging volumetric 3D displays, coupled with non encumbering natural interaction means such as gestures, hand motions and haptics for designing in 3D space. We first explore the need for spatial visualization and interaction in design, and outline how the volumetric 3D imaging devices could be used in design. We then review the existing volumetric 3D display configurations, and investigate how they would assist designing in 3D space. Next, we present the study we conducted to seek views of the designers on what kind of volumetric 3D display configuration would more likely match their needs. We finally highlight what would be the consequences and benefits of using volumetric 3D displays instead of the canonical flat screen displays and 2D input devices in design. It has been established that the designers who participated as subjects in the above-mentioned preliminary field study feel that dome-shaped and aerial volumetric 3D imaging devices, which allow for both visualization and interaction with virtual objects, are the imaging options that would not only better suit their visualization and interaction needs, but would also satisfy most of the usability requirements. However, apart from dealing with the remaining basic technological gaps, the challenge is also on how to combine the prevailing proven CAD/CAE technologies and the emerging interaction technologies with the emerging volumetric 3D imaging technologies. As a result of turning to volumetric 3D imaging devices, there is also the challenge of putting in place a formal methodology for designing in 3D space by using these devices.
9
Das, Aditya N., Kris Doelling, Cody Lundberg, Hakki Erhan Sevil, and Frank Lewis. "A Mixed Reality Based Hybrid Swarm Control Architecture for Manned-Unmanned Teaming (MUM-T)." In ASME 2017 International Mechanical Engineering Congress and Exposition. American Society of Mechanical Engineers, 2017. http://dx.doi.org/10.1115/imece2017-72076.
Full textAbstract:
Recent advancements in robotics have established standard control and planning algorithms for robot localization, navigation, and manipulation, which extend the automation from skill-based to rule-based. Such automation approaches, however, are susceptible to environmental dynamics and the burden of corresponding event handling falls on the human operator. In multi-agent systems, any deviation from the otherwise inefficient one operator to one robot mapping can result in an exponential growth of system complexity, and, in the absence of some form of artificial intelligence supervisory control, the overall framework can quickly become unmanageable, counterproductive, and even hazardous. Therefore, for future manned-unmanned teaming, a knowledge-based cooperative control architecture is warranted that can process cognitive reasoning at the meta-level to autonomously carry out some or all tactical parts of the mission while maintaining constant connection with the human operator. Furthermore, in such a scenario, the human operator needs to be able to communicate with multiple robotic agents via natural language and gesture interface so that he/she can efficiently manage not just one robot but the entire swarm or at least a segment. This paper will discuss a hybrid swarm autonomy architecture to coordinate a diverse team of robots using an immersive and intuitive interface technology for cooperative control of unmanned platforms. This novel interactive interface will offer situational awareness and decision presentation capabilities. Implemented through a real time, networked, mixed reality environment, it will be designed to support rapid exploration and evaluation with the swarm as well as dynamic interaction among different human operators. One of the major objectives of this research is to reduce cognitive load on operators and enable trust among robots and humans. This paper will discuss the approach to design and evaluate a distributed trust control algorithm for high-throughput hybrid swarm autonomy, and implement it through a curated, controlled-access portal to integrate swarm algorithms and collective behavior. Major discussion points will include: customization of unmanned platforms for distributed control and sensor fusion, development and implementation of a mixed reality human robot interface portal, and incorporation of a neuro-cognitive dynamic trust controller for swarm autonomy. It is envisioned that through such interconnection between humans and robots the effectiveness of the swarm can be boosted to carry out the missions with unprecedented speed and accuracy at a fraction of the cost for complex systems. This paper presents experimental validation to the analytical models involving real and virtual platforms.