Log in

Relevant bibliographies by topics / Multimodal Knowledge Representation / Journal articles

To see the other types of publications on this topic, follow the link: Multimodal Knowledge Representation.

Journal articles on the topic 'Multimodal Knowledge Representation'

Author: Grafiati

Published: 10 March 2023

Create a spot-on reference in APA, MLA, Chicago, Harvard, and other styles

Select a source type:

Consult the top 50 journal articles for your research on the topic 'Multimodal Knowledge Representation.'

Next to every source in the list of references, there is an 'Add to bibliography' button. Press on it, and we will generate automatically the bibliographic reference to the chosen work in the citation style you need: APA, MLA, Harvard, Chicago, Vancouver, etc.

You can also download the full text of the academic publication as pdf and read online its abstract whenever available in the metadata.

Browse journal articles on a wide variety of disciplines and organise your bibliography correctly.

1

Azañón, Elena, Luigi Tamè, Angelo Maravita, et al. "Multimodal Contributions to Body Representation." Multisensory Research 29, no. 6-7 (2016): 635–61. http://dx.doi.org/10.1163/22134808-00002531.

Full text

Abstract:

Our body is a unique entity by which we interact with the external world. Consequently, the way we represent our body has profound implications in the way we process and locate sensations and in turn perform appropriate actions. The body can be the subject, but also the object of our experience, providing information from sensations on the body surface and viscera, but also knowledge of the body as a physical object. However, the extent to which different senses contribute to constructing the rich and unified body representations we all experience remains unclear. In this review, we aim to bri

APA, Harvard, Vancouver, ISO, and other styles

2

Coelho, Ana, Paulo Marques, Ricardo Magalhães, Nuno Sousa, José Neves, and Victor Alves. "A Knowledge Representation and Reasoning System for Multimodal Neuroimaging Studies." Inteligencia Artificial 20, no. 59 (2017): 42. http://dx.doi.org/10.4114/intartif.vol20iss59pp42-52.

Full text

Abstract:

Multimodal neuroimaging analyses are of major interest for both research and clinical practice, enabling the combined evaluation of the structure and function of the human brain. These analyses generate large volumes of data and consequently increase the amount of possibly useful information. Indeed, BrainArchive was developed in order to organize, maintain and share this complex array of neuroimaging data. It stores all the information available for each participant/patient, being dynamic by nature. Notably, the application of reasoning systems to this multimodal data has the potential to pro

APA, Harvard, Vancouver, ISO, and other styles

3

Bruni, E., N. K. Tran, and M. Baroni. "Multimodal Distributional Semantics." Journal of Artificial Intelligence Research 49 (January 23, 2014): 1–47. http://dx.doi.org/10.1613/jair.4135.

Full text

Abstract:

Distributional semantic models derive computational representations of word meaning from the patterns of co-occurrence of words in text. Such models have been a success story of computational linguistics, being able to provide reliable estimates of semantic relatedness for the many semantic tasks requiring them. However, distributional models extract meaning information exclusively from text, which is an extremely impoverished basis compared to the rich perceptual sources that ground human semantic knowledge. We address the lack of perceptual grounding of distributional models by exploiting co

APA, Harvard, Vancouver, ISO, and other styles

4

Toraldo, Maria Laura, Gazi Islam, and Gianluigi Mangia. "Modes of Knowing." Organizational Research Methods 21, no. 2 (2016): 438–65. http://dx.doi.org/10.1177/1094428116657394.

Full text

Abstract:

The current article argues that video-based methodologies offer unique potential for multimodal research applications. Multimodal research, further, can respond to the problem of “elusive knowledges,” that is, tacit, aesthetic, and embodied aspects of organizational life that are difficult to articulate in traditional methodological paradigms. We argue that the multimodal qualities of video, including but not limited to its visual properties, provide a scaffold for translating embodied, tacit, and aesthetic knowledge into discursive and textual forms, enabling the representation of organizatio

APA, Harvard, Vancouver, ISO, and other styles

5

Gül, Davut, and Bayram Costu. "To What Extent Do Teachers of Gifted Students Identify Inner and Intermodal Relations in Knowledge Representation?" Mimbar Sekolah Dasar 8, no. 1 (2021): 55–80. http://dx.doi.org/10.53400/mimbar-sd.v8i1.31333.

Full text

Abstract:

Gifted students get bored of reading authoritative and descriptive multimodal texts. They need coherent, explanatory, and interactive texts. Moreover, because of the pandemic, gifted students took courses online, and teachers had to conduct their lessons on digital online tools with multimodal representations. They posted supplementary teaching materials as multimodal texts to the students. Hence, teachers of gifted students should pay attention to inner and intermodal relations to meet the needs of gifted students and support their learning experience. The research aims at examining to what e

APA, Harvard, Vancouver, ISO, and other styles

6

Tomskaya, Maria, and Irina Zaytseva. "MULTIMEDIA REPRESENTATION OF KNOWLEDGE IN ACADEMIC DISCOURSE." Verbum 8, no. 8 (2018): 129. http://dx.doi.org/10.15388/verb.2017.8.11357.

Full text

Abstract:

The article focuses on academic presentations created with the help of multimedia programmes. The presentation is regarded as a special form of new academic knowledge representation. An academic presentation is explored as a multimodal phenomenon due to the fact that different channels or modes are activated during its perception. Data perception constitutes a part of the context which in itself is a semiotic event involving various components (an addresser, an addressee, the message itself, the channel of communication and the code). The choice of the code and the channel depends on different

APA, Harvard, Vancouver, ISO, and other styles

7

Cholewa, Wojciech, Marcin Amarowicz, Paweł Chrzanowski, and Tomasz Rogala. "Development Environment for Diagnostic Multimodal Statement Networks." Key Engineering Materials 588 (October 2013): 74–83. http://dx.doi.org/10.4028/www.scientific.net/kem.588.74.

Full text

Abstract:

Development of effective diagnostic systems for the recognition of technical conditions of complex objects or processes requires the use of knowledge from multiple sources. Gathering of diagnostic knowledge acquired from diagnostic experiments as well as independent experts in the form of an information system database is one of the most important stages in the process of designing diagnostic systems. The task can be supported through suitable modeling activities and diagnostic knowledge management. Briefly, this paper presents an example of an application of multimodal diagnostic statement ne

APA, Harvard, Vancouver, ISO, and other styles

8

Prieto-Velasco, Juan Antonio, and Clara I. López Rodríguez. "Managing graphic information in terminological knowledge bases." Terminology 15, no. 2 (2009): 179–213. http://dx.doi.org/10.1075/term.15.2.02pri.

Full text

Abstract:

The cognitive shift in Linguistics has affected the way linguists, lexicographers and terminologists understand and describe specialized language, and the way they represent scientific and technical concepts. The representation of terminological knowledge, as part of our encyclopaedic knowledge about the world, is crucial in multimedia terminological knowledge bases, where different media coexist to enhance the multidimensional character of knowledge representations. However, so far little attention has been paid in Terminology and Linguistics to graphic information, including visual resources

APA, Harvard, Vancouver, ISO, and other styles

9

Laenen, Katrien, and Marie-Francine Moens. "Learning Explainable Disentangled Representations of E-Commerce Data by Aligning Their Visual and Textual Attributes." Computers 11, no. 12 (2022): 182. http://dx.doi.org/10.3390/computers11120182.

Full text

Abstract:

Understanding multimedia content remains a challenging problem in e-commerce search and recommendation applications. It is difficult to obtain item representations that capture the relevant product attributes since these product attributes are fine-grained and scattered across product images with huge visual variations and product descriptions that are noisy and incomplete. In addition, the interpretability and explainability of item representations have become more important in order to make e-commerce applications more intelligible to humans. Multimodal disentangled representation learning,

APA, Harvard, Vancouver, ISO, and other styles

10

Li, Jinghua, Runze Liu, Dehui Kong, et al. "Attentive 3D-Ghost Module for Dynamic Hand Gesture Recognition with Positive Knowledge Transfer." Computational Intelligence and Neuroscience 2021 (November 18, 2021): 1–12. http://dx.doi.org/10.1155/2021/5044916.

Full text

Abstract:

Hand gesture recognition is a challenging topic in the field of computer vision. Multimodal hand gesture recognition based on RGB-D is with higher accuracy than that of only RGB or depth. It is not difficult to conclude that the gain originates from the complementary information existing in the two modalities. However, in reality, multimodal data are not always easy to acquire simultaneously, while unimodal RGB or depth hand gesture data are more general. Therefore, one hand gesture system is expected, in which only unimordal RGB or Depth data is supported for testing, while multimodal RGB-D d

APA, Harvard, Vancouver, ISO, and other styles

11

Hocaoǧlu, Cem, and Arthur C. Sanderson. "Multimodal Function Optimization Using Minimal Representation Size Clustering and Its Application to Planning Multipaths." Evolutionary Computation 5, no. 1 (1997): 81–104. http://dx.doi.org/10.1162/evco.1997.5.1.81.

Full text

Abstract:

A novel genetic algorithm (GA) using minimal representation size cluster (MRSC) analysis is designed and implemented for solving multimodal function optimization problems. The problem of multimodal function optimization is framed within a hypothesize-and-test paradigm using minimal representation size (minimal complexity) for species formation and a GA. A multiple-population GA is developed to identify different species. The number of populations, thus the number of different species, is determined by the minimal representation size criterion. Therefore, the proposed algorithm reveals the unkn

APA, Harvard, Vancouver, ISO, and other styles

12

Jaiswal, Mimansa, and Emily Mower Provost. "Privacy Enhanced Multimodal Neural Representations for Emotion Recognition." Proceedings of the AAAI Conference on Artificial Intelligence 34, no. 05 (2020): 7985–93. http://dx.doi.org/10.1609/aaai.v34i05.6307.

Full text

Abstract:

Many mobile applications and virtual conversational agents now aim to recognize and adapt to emotions. To enable this, data are transmitted from users' devices and stored on central servers. Yet, these data contain sensitive information that could be used by mobile applications without user's consent or, maliciously, by an eavesdropping adversary. In this work, we show how multimodal representations trained for a primary task, here emotion recognition, can unintentionally leak demographic information, which could override a selected opt-out option by the user. We analyze how this leakage diffe

APA, Harvard, Vancouver, ISO, and other styles

13

Chu, Hanlu, Haien Zeng, Hanjiang Lai, and Yong Tang. "Efficient modal-aware feature learning with application in multimodal hashing." Intelligent Data Analysis 26, no. 2 (2022): 345–60. http://dx.doi.org/10.3233/ida-215780.

Full text

Abstract:

Many retrieval applications can benefit from multiple modalities, for which how to represent multimodal data is the critical component. Most deep multimodal learning methods typically involve two steps to construct the joint representations: 1) learning of multiple intermediate features, with each intermediate feature corresponding to a modality, using separate and independent deep models; 2) merging the intermediate features into a joint representation using a fusion strategy. However, in the first step, these intermediate features do not have previous knowledge of each other and cannot fully

APA, Harvard, Vancouver, ISO, and other styles

14

He, Yang, Ling Tian, Lizong Zhang, and Xi Zeng. "Knowledge Graph Representation Fusion Framework for Fine-Grained Object Recognition in Smart Cities." Complexity 2021 (July 13, 2021): 1–9. http://dx.doi.org/10.1155/2021/8041029.

Full text

Abstract:

Autonomous object detection powered by cutting-edge artificial intelligent techniques has been an essential component for sustaining complex smart city systems. Fine-grained image classification focuses on recognizing subcategories of specific levels of images. As a result of the high similarity between images in the same category and the high dissimilarity in the same subcategories, it has always been a challenging problem in computer vision. Traditional approaches usually rely on exploring only the visual information in images. Therefore, this paper proposes a novel Knowledge Graph Represent

APA, Harvard, Vancouver, ISO, and other styles

15

Feng, Debing, and Xiangxiang Wu. "Coronavirus, Demons, and War: Visual and Multimodal Metaphor in Chinese Public Service Advertisements." SAGE Open 12, no. 1 (2022): 215824402210788. http://dx.doi.org/10.1177/21582440221078855.

Full text

Abstract:

Metaphors in public service advertisements, or PSAs, have played an important role in promoting the knowledge of COVID-19 and China’s anti-epidemic activities. Based primarily on Feng and O’Halloran’s visual representation of multimodal metaphor, this article examines visual and multimodal metaphors created in the online PSAs that were produced in early 2020 to publicize China’s epidemic prevention and control activities. It is found that those metaphors fall into three general groups, namely “coronavirus” metaphor, “anti-epidemic worker” metaphor, and “medical instrument” metaphor. Nearly all

APA, Harvard, Vancouver, ISO, and other styles

16

Zhong, Dong, Yi-An Zhu, Lanqing Wang, Junhua Duan, and Jiaxuan He. "A Cognition Knowledge Representation Model Based on Multidimensional Heterogeneous Data." Complexity 2020 (December 28, 2020): 1–17. http://dx.doi.org/10.1155/2020/8812459.

Full text

Abstract:

The information in the working environment of industrial Internet is characterized by diversity, semantics, hierarchy, and relevance. However, the existing representation methods of environmental information mostly emphasize the concepts and relationships in the environment and have an insufficient understanding of the items and relationships at the instance level. There are also some problems such as low visualization of knowledge representation, poor human-machine interaction ability, insufficient knowledge reasoning ability, and slow knowledge search speed, which cannot meet the needs of in

APA, Harvard, Vancouver, ISO, and other styles

17

Nguyen, Nhu Van, Alain Boucher, and Jean-Marc Ogier. "Keyword Visual Representation for Image Retrieval and Image Annotation." International Journal of Pattern Recognition and Artificial Intelligence 29, no. 06 (2015): 1555010. http://dx.doi.org/10.1142/s0218001415550101.

Full text

Abstract:

Keyword-based image retrieval is more comfortable for users than content-based image retrieval. Because of the lack of semantic description of images, image annotation is often used a priori by learning the association between the semantic concepts (keywords) and the images (or image regions). This association issue is particularly difficult but interesting because it can be used for annotating images but also for multimodal image retrieval. However, most of the association models are unidirectional, from image to keywords. In addition to that, existing models rely on a fixed image database an

APA, Harvard, Vancouver, ISO, and other styles

18

Höllerer, Markus A., Dennis Jancsary, and Maria Grafström. "‘A Picture is Worth a Thousand Words’: Multimodal Sensemaking of the Global Financial Crisis." Organization Studies 39, no. 5-6 (2018): 617–44. http://dx.doi.org/10.1177/0170840618765019.

Full text

Abstract:

Through its specific rhetorical potential that is distinct from verbal text, visual material facilitates and plays a pivotal role in linking novel phenomena to established and taken-for-granted social categories and discourses within the social stock of knowledge. Employing data from the worldwide news coverage of the global financial crisis in the Financial Times between 2008 and 2012, we analyse sensemaking and sensegiving efforts in the business media. We identify a set of specific multimodal compositions that construct and shape a limited number of narratives on the global financial crisis

APA, Harvard, Vancouver, ISO, and other styles

19

Li, Mimi, and Julie Dell-Jones. "The same topic, different products: Pre-/in-service teachers’ linguistic knowledge representation in a multimodal project." Computers and Composition 67 (March 2023): 102754. http://dx.doi.org/10.1016/j.compcom.2023.102754.

Full text

APA, Harvard, Vancouver, ISO, and other styles

20

Ahmad, Arinal Haqqiyah, Bukhari Daud, and Dohra Fitrisia. "The analysis of best-seller fantasy novel covers in 2019 through multimodal lens." English Education Journal 12, no. 1 (2021): 1–18. http://dx.doi.org/10.24815/eej.v12i1.19140.

Full text

Abstract:

The purpose of this research was to analyze ten covers of 2019 best-seller fantasy novels through multimodal. The research method used was qualitative research. The objects in this research were ten book covers of 2019 best-seller fantasy novels. The instruments used were documentation that aimed at obtaining data, including relevant books, study, activity reporting, relevant research data. Content analysis was used to obtain the data. This study used five phased cycles in analyzing the data; compiling, disassembling, reassembling, interpreting, and concluding. The result of analyzing the nove

APA, Harvard, Vancouver, ISO, and other styles

21

Masita, Ella. "The Representation of Indonesian National Identity in English Textbook." Indonesian Research Journal in Education |IRJE| 5, no. 1 (2021): 226–44. http://dx.doi.org/10.22437/irje.v5i1.10599.

Full text

Abstract:

This article interrogates the conceptualization of Indonesian national identity from the point of view of the Indonesian government. The data were taken from a mandatory English textbook for Grade XI. Through the lens of Representation theory, this research explores the key issues within the textbook. In analyzing the data, a multimodal discourse analysis is utilized, specifically through the verbal analysis and visual analysis of the texts within the textbook. The results of analysis reveal that there are four themes namely: spirituality and morality, personal attribute, nationalism, and know

APA, Harvard, Vancouver, ISO, and other styles

22

Zhang, Jing, Meng Chen, Jie Liu, et al. "A Knowledge-Graph-Based Multimodal Deep Learning Framework for Identifying Drug–Drug Interactions." Molecules 28, no. 3 (2023): 1490. http://dx.doi.org/10.3390/molecules28031490.

Full text

Abstract:

The identification of drug–drug interactions (DDIs) plays a crucial role in various areas of drug development. In this study, a deep learning framework (KGCN_NFM) is presented to recognize DDIs using coupling knowledge graph convolutional networks (KGCNs) with neural factorization machines (NFMs). A KGCN is used to learn the embedding representation containing high-order structural information and semantic information in the knowledge graph (KG). The embedding and the Morgan molecular fingerprint of drugs are then used as input of NFMs to predict DDIs. The performance and effectiveness of the

APA, Harvard, Vancouver, ISO, and other styles

23

Li, Ke, and Sang-Bing Tsai. "An Empirical Study on the Countermeasures of Implementing 5G Multimedia Network Technology in College Education." Mobile Information Systems 2021 (October 13, 2021): 1–14. http://dx.doi.org/10.1155/2021/2547648.

Full text

Abstract:

Aiming at the problem of 5G multimedia heterogeneous multimodal network representation learning, this paper proposes a collaborative multimodal heterogeneous network representation learning method based on attention mechanism. This method learns different representations for nodes based on heterogeneous network structure information and multimodal content and designs an attention mechanism to learn weights for different representations to fuse them to obtain robust node representations. Combining the general process of exploring the college physical education model and the characteristics of t

APA, Harvard, Vancouver, ISO, and other styles

24

Hurdley, Rachel, and Bella Dicks. "In-between practice: working in the ‘thirdspace’ of sensory and multimodal methodology." Qualitative Research 11, no. 3 (2011): 277–92. http://dx.doi.org/10.1177/1468794111399837.

Full text

Abstract:

This article discusses how emergent sensory and multimodal methodologies can work in interaction to produce innovative social enquiry. A juxtaposition of two research projects — an ethnography of corridors and a mixed methods study of multimodal authoring and ‘reading’ practices — opened up this encounter. Sensory ethnography within social research methods aims to create empathetic, experiential ways of knowing participants’ and researchers’ worlds. The linguistic field of multimodality offers a rather different framework for research attending to the visual, material and acoustic textures of

APA, Harvard, Vancouver, ISO, and other styles

25

Reyes-Torres, Agustín, Matilde Portalés-Raga, and Clara Torres-Mañá. "The potential of sound picturebooks as multimodal narratives." AILA Review 34, no. 2 (2021): 300–324. http://dx.doi.org/10.1075/aila.21006.rey.

Full text

Abstract:

Abstract In this article, we study how Sound Picturebooks constitute a multimodal narrative that enables students to develop their literacy, not only in terms of basic reading and writing skills, but also as a multidimensional interaction with other forms of representation such as images, sounds and actions. In line with the aims of the Pedagogy of Multiliteracies (New London Group 1996), we select and analyze fifteen Sound Picturebooks whose features allows us to implement the Learning by Design tenets and the four pedagogical components of the Knowledge Processes Framework: experiencing, con

APA, Harvard, Vancouver, ISO, and other styles

26

Korolainen, Kari Tapio. "The Handwork of Folkloristic-Ethnological Knowledge." Ethnologia Fennica 44 (December 31, 2017): 35–51. http://dx.doi.org/10.23991/ef.v44i0.59693.

Full text

Abstract:

Drawing is discussed here, both from the historical and from the contemporary folklore and material culture stance. Folklore collector Samuli Paulaharju’s (1875–1944) drawings serve as a point of departure; again, cultural studies constitute the background, as the notion of representation and the construction of folkloristic-ethnologic knowledge are stressed. Material and visual culture comprises yet other central viewpoints. The research material consists of Paulaharju’s folkloristic descriptions (at the SKS) of the interlacements, as knots and lattices. The materials are discussed in the con

APA, Harvard, Vancouver, ISO, and other styles

27

Ellis, Elizabeth Marrkilyi, Jennifer Green, and Inge Kral. "Family in mind." Research on Children and Social Interaction 1, no. 2 (2017): 164–98. http://dx.doi.org/10.1558/rcsi.28442.

Full text

Abstract:

In the Ngaanyatjarra Lands in remote Western Australia children play a guessing game called mama mama ngunytju ngunytju ‘father father mother mother’. It is mainly girls who play the game, along with other members of their social network, including age-mates, older kin and adults. They offer clues about target referents and establish mutual understandings through multimodal forms of representation that include semi-conventionalized drawings on the sand. In this paper we show how speech, gesture, and graphic schemata are negotiated and identify several recurrent themes, particularly focusing on

APA, Harvard, Vancouver, ISO, and other styles

28

Rayón Rumayor, Laura, Ana María De las Heras Cuenca, and José Hernández Ortega. "Didáctica universitaria híbrida: identidad digital creativa y multimodalidad." Altre Modernità, no. 27 (May 30, 2022): 48–64. http://dx.doi.org/10.54103/2035-7680/17876.

Full text

Abstract:

The incipient interest in hybrid and collaborative didactics in times of COVID-19 highlights the fundamental role of digital hybrids in the training of university students. New mobile devices allow the ubiquity of teaching-learning processes. But they not only allow the possibility of sharing and communicating at any time and place. In these devices, different tools that integrate different representation systems converge, and offer new forms of construction, representation and communication of knowledge. From the questioning of the hegemonic technological culture, and from a didactic approach

APA, Harvard, Vancouver, ISO, and other styles

29

Kirova, Anna, Christine Massing, Larry Prochner, and Ailie Cleghorn. "Shaping the “Habits of mind” of diverse learners in early childhood teacher education programs through powerpoint: An illustrative case." Journal of Pedagogy 7, no. 1 (2016): 59–78. http://dx.doi.org/10.1515/jped-2016-0004.

Full text

Abstract:

Abstract This study examines the use of PowerPoint as a teaching tool in a workplace- embedded program aimed at bridging immigrant/refugee early childhood educators into post-secondary studies, and how, in the process, it shapes students’ “habits of mind” (Turkle, 2004). The premise of the study is that it is not only the bodies of knowledge shaping teacher education programs which must be interrogated, but also the ways in which instructors and programs choose to represent and impart these understandings to students. The use of PowerPoint to advance an authoritative western, linear, rule-gove

APA, Harvard, Vancouver, ISO, and other styles

30

Liao, Danlu. "Construction of Knowledge Graph English Online Homework Evaluation System Based on Multimodal Neural Network Feature Extraction." Computational Intelligence and Neuroscience 2022 (May 13, 2022): 1–12. http://dx.doi.org/10.1155/2022/7941414.

Full text

Abstract:

This paper defines the data schema of the multimodal knowledge graph, that is, the definition of entity types and relationships between entities. The knowledge point entities are defined as three types of structures, algorithms, and related terms, speech is also defined as one type of entities, and six semantic relationships are defined between entities. This paper adopts a named entity recognition model that combines bidirectional long short-term memory network and convolutional neural network, combines local information and global information of text, uses conditional random field algorithm

APA, Harvard, Vancouver, ISO, and other styles

31

Dourlens, Sébastien, and Amar Ramdane-Cherif. "Cognitive Memory for Semantic Agents Architecture in Robotic Interaction." International Journal of Cognitive Informatics and Natural Intelligence 5, no. 1 (2011): 43–58. http://dx.doi.org/10.4018/jcini.2011010103.

Full text

Abstract:

Since 1960, AI researchers have worked on intelligent and reactive architectures capable of managing multiple events and acts in the environment. This issue is part of the Robotics domain. An extraction of meaning at different levels of abstraction and the decision process must be implemented in the robot brain to accomplish the multimodal interaction with humans in a human environment. This paper presents a semantic agents architecture giving the robot the ability to understand what is happening and thus provide more robust responses. Intelligence and knowledge about objects like behaviours i

APA, Harvard, Vancouver, ISO, and other styles

32

Sun, Guofei, Yongkang Wong, Mohan S. Kankanhalli, Xiangdong Li, and Weidong Geng. "Enhanced 3D Shape Reconstruction With Knowledge Graph of Category Concept." ACM Transactions on Multimedia Computing, Communications, and Applications 18, no. 3 (2022): 1–20. http://dx.doi.org/10.1145/3491224.

Full text

Abstract:

Reconstructing three-dimensional (3D) objects from images has attracted increasing attention due to its wide applications in computer vision and robotic tasks. Despite the promising progress of recent deep learning–based approaches, which directly reconstruct the full 3D shape without considering the conceptual knowledge of the object categories, existing models have limited usage and usually create unrealistic shapes. 3D objects have multiple forms of representation, such as 3D volume, conceptual knowledge, and so on. In this work, we show that the conceptual knowledge for a category of objec

APA, Harvard, Vancouver, ISO, and other styles

33

Davis, Brian. "Instrumentalizing the book: Anne Carson’s Nox and books as archives." Frontiers of Narrative Studies 7, no. 1 (2021): 84–109. http://dx.doi.org/10.1515/fns-2021-0005.

Full text

Abstract:

Abstract This article introduces an experimental mode of contemporary writing and bookmaking that I call multimodal book-archives, an emergent mode of contemporary literature that constructs narratives and textual sequences through the collection and representation of reproduced texts and other artifacts. In multimodal book-archives the book-object is presented as a container designed to preserve and transmit textual artifacts. In this article, I examine Anne Carson’s Nox (2010) as a case study in archival poetics, exemplifying the “archival turn” in contemporary literature. My analysis draws

APA, Harvard, Vancouver, ISO, and other styles

34

BOURBAKIS, NIKOLAOS, and MICHAEL MILLS. "CONVERTING NATURAL LANGUAGE TEXT SENTENCES INTO SPN REPRESENTATIONS FOR ASSOCIATING EVENTS." International Journal of Semantic Computing 06, no. 03 (2012): 353–70. http://dx.doi.org/10.1142/s1793351x12500067.

Full text

Abstract:

A better understanding of events many times requires the association and the efficient representation of multi-modal information. A good approach to this important issue is the development of a common platform for converting different modalities (such as images, text, etc.) into the same medium and associating them for efficient processing and understanding. In a previous paper we have presented a Local-Global graph model for the conversion of images into graphs with attributes and then into natural language (NL) text sentences [25]. Here, in this paper we propose the conversion of NL text sen

APA, Harvard, Vancouver, ISO, and other styles

35

Sugiura, Motoaki, Yuko Sassa, Jobu Watanabe, et al. "Anatomical Segregation of Representations of Personally Familiar and Famous People in the Temporal and Parietal Cortices." Journal of Cognitive Neuroscience 21, no. 10 (2009): 1855–68. http://dx.doi.org/10.1162/jocn.2008.21150.

Full text

Abstract:

Person recognition has been assumed to entail many types of person-specific cognitive responses, including retrieval of knowledge, episodic recollection, and emotional responses. To demonstrate the cortical correlates of this modular structure of multimodal person representation, we investigated neural responses preferential to personally familiar people and responses dependent on familiarity with famous people in the temporal and parietal cortices. During functional magnetic resonance imaging (fMRI) measurements, normal subjects recognized personally familiar names (personal) or famous names

APA, Harvard, Vancouver, ISO, and other styles

36

Kalantzis, Mary, and Bill Cope. "From Gutenberg to the Internet: How Digitisation Transforms Culture and Knowledge." Logos 21, no. 1-2 (2010): 12–39. http://dx.doi.org/10.1163/095796510x546887.

Full text

Abstract:

AbstractIn this paper, we explore the changes wrought by digitisation upon the domains of culture and knowledge. Half a century into the process of the digitisation of text, we argue that only now are we on the cusp of a series of paradigm shifts in the processes of writing, and concomitantly, our modes of cultural expression and our social processes of knowing. We describe the transition underway in the fundamental mechanics of rendering, the new navigational order which is associated with this transition, the demise of isolated written text that accompanies the rise of multimodality, the ubi

APA, Harvard, Vancouver, ISO, and other styles

37

Kryssanov, Victor V., Shizuka Kumokawa, Igor Goncharenko, and Hitoshi Ogawa. "Perceiving the Social." International Journal of Software Science and Computational Intelligence 2, no. 1 (2010): 24–37. http://dx.doi.org/10.4018/jssci.2010101902.

Full text

Abstract:

This article describes a system developed to help people explore local communities by providing navigation services in social spaces created by the community members via communication and knowledge sharing. The proposed system utilizes data of a community’s social network to reconstruct the social space, which is otherwise not physically perceptible but imaginary, experiential, yet learnable. The social space is modeled with an agent network, where each agent stands for a member of the community and has knowledge about expertise and personal characteristics of some other members. An agent can

APA, Harvard, Vancouver, ISO, and other styles

38

Prado, Jan Alyne Barbosa. "Formal and Multimodal Approach to Hard News as Genre, Structure and Metalanguage in Social and Digital Media Contexts. The Example of Twitter." Bakhtiniana: Revista de Estudos do Discurso 17, no. 4 (2022): 163–93. http://dx.doi.org/10.1590/2176-4573e57554.

Full text

Abstract:

ABSTRACT The goal of this paper is to improve heuristics for hard news discourse by proposing a cognitive model of abstraction, regarding social media contexts. To this end, hard news is discussed as a genre, structure and metalanguage, under the formal definition of a semiotic mode. Annotation is a successful technology to control the effects of genre operations, reveal relations, and to inquire about data and documents. It proceeds to characterize Twitter’s interface, in terms of formal and material regularities, employed recursively. It further demonstrates the formalization of a semantics

APA, Harvard, Vancouver, ISO, and other styles

39

Yuan, Hui, Yuanyuan Tang, Wei Xu, and Raymond Yiu Keung Lau. "Exploring the influence of multimodal social media data on stock performance: an empirical perspective and analysis." Internet Research 31, no. 3 (2021): 871–91. http://dx.doi.org/10.1108/intr-11-2019-0461.

Full text

Abstract:

PurposeDespite the extensive academic interest in social media sentiment for financial fields, multimodal data in the stock market has been neglected. The purpose of this paper is to explore the influence of multimodal social media data on stock performance, and investigate the underlying mechanism of two forms of social media data, i.e. text and pictures.Design/methodology/approachThis research employs panel vector autoregressive models to quantify the effect of the sentiment derived from two modalities in social media, i.e. text information and picture information. Through the models, the au

APA, Harvard, Vancouver, ISO, and other styles

40

Kotis, Konstantinos, Sotiris Angelis, Efthymia Moraitou, et al. "A KG-Based Integrated UAV Approach for Engineering Semantic Trajectories in the Cultural Heritage Documentation Domain." Remote Sensing 15, no. 3 (2023): 821. http://dx.doi.org/10.3390/rs15030821.

Full text

Abstract:

Data recordings of the movement of vehicles can be enriched with heterogeneous and multimodal data beyond latitude, longitude, and timestamp and enhanced with complementary segmentations, constituting a semantic trajectory. Semantic Web (SW) technologies have been extensively used for the semantic integration of heterogeneous and multimodal movement-related data, and for the effective modeling of semantic trajectories, in several domains. In this paper, we present an integrated solution for the engineering of cultural heritage semantic trajectories generated from unmanned aerial vehicles (UAVs

APA, Harvard, Vancouver, ISO, and other styles

41

Arend, Johannes M., Melissa Ramírez, Heinrich R. Liesefeld, and Christoph Pӧrschmann. "Do near-field cues enhance the plausibility of non-individual binaural rendering in a dynamic multimodal virtual acoustic scene?" Acta Acustica 5 (2021): 55. http://dx.doi.org/10.1051/aacus/2021048.

Full text

Abstract:

It is commonly believed that near-field head-related transfer functions (HRTFs) provide perceptual benefits over far-field HRTFs that enhance the plausibility of binaural rendering of nearby sound sources. However, to the best of our knowledge, no study has systematically investigated whether using near-field HRTFs actually provides a perceptually more plausible virtual acoustic environment. To assess this question, we conducted two experiments in a six-degrees-of-freedom multimodal augmented reality experience where participants had to compare non-individual anechoic binaural renderings based

APA, Harvard, Vancouver, ISO, and other styles

42

Pazzaglia, Mariella, and Marta Zantedeschi. "Plasticity and Awareness of Bodily Distortion." Neural Plasticity 2016 (2016): 1–7. http://dx.doi.org/10.1155/2016/9834340.

Full text

Abstract:

Knowledge of the body is filtered by perceptual information, recalibrated through predominantly innate stored information, and neurally mediated by direct sensory motor information. Despite multiple sources, the immediate prediction, construction, and evaluation of one’s body are distorted. The origins of such distortions are unclear. In this review, we consider three possible sources of awareness that inform body distortion. First, the precision in the body metric may be based on the sight and positioning sense of a particular body segment. This view provides information on the dual nature of

APA, Harvard, Vancouver, ISO, and other styles

43

Sunkara, Adhira, Gregory C. DeAngelis, and Dora E. Angelaki. "Joint representation of translational and rotational components of optic flow in parietal cortex." Proceedings of the National Academy of Sciences 113, no. 18 (2016): 5077–82. http://dx.doi.org/10.1073/pnas.1604818113.

Full text

Abstract:

Terrestrial navigation naturally involves translations within the horizontal plane and eye rotations about a vertical (yaw) axis to track and fixate targets of interest. Neurons in the macaque ventral intraparietal (VIP) area are known to represent heading (the direction of self-translation) from optic flow in a manner that is tolerant to rotational visual cues generated during pursuit eye movements. Previous studies have also reported that eye rotations modulate the response gain of heading tuning curves in VIP neurons. We tested the hypothesis that VIP neurons simultaneously represent both h

APA, Harvard, Vancouver, ISO, and other styles

44

Hnini, Ghizlane, Jamal Riffi, Mohamed Adnane Mahraz, Ali Yahyaouy, and Hamid Tairi. "MMPC-RF: A Deep Multimodal Feature-Level Fusion Architecture for Hybrid Spam E-mail Detection." Applied Sciences 11, no. 24 (2021): 11968. http://dx.doi.org/10.3390/app112411968.

Full text

Abstract:

Hybrid spam is an undesirable e-mail (electronic mail) that contains both image and text parts. It is more harmful and complex as compared to image-based and text-based spam e-mail. Thus, an efficient and intelligent approach is required to distinguish between spam and ham. To our knowledge, a small number of studies have been aimed at detecting hybrid spam e-mails. Most of these multimodal architectures adopted the decision-level fusion method, whereby the classification scores of each modality were concatenated and fed to another classification model to make a final decision. Unfortunately,

APA, Harvard, Vancouver, ISO, and other styles

45

Kendrick, Maureen, Elizabeth Namazzi, Ava Becker-Zayas, and Esther Nancy Tibwamulala. "Closing the HIV and AIDS “Information Gap” Between Children and Parents: An Exploration of Makerspaces in a Ugandan Primary School." Education Sciences 10, no. 8 (2020): 193. http://dx.doi.org/10.3390/educsci10080193.

Full text

Abstract:

In this study, we address the research question: “How might child-created billboards about HIV and AIDS help facilitate more open discussions between parents and children?" The premise of our study is that there may be considerable potential for using multimodal forms of representation in makerspaces with young children to create more open dialogue with parents about culturally sensitive information. Drawing on multimodal literacies and visual methodologies, we designed a makerspace in a grade 5 classroom (with students aged 9–10) in a Ugandan residential primary school. Our makerspace include

APA, Harvard, Vancouver, ISO, and other styles

46

Miao, Haotian, Yifei Zhang, Daling Wang, and Shi Feng. "Multi-Output Learning Based on Multimodal GCN and Co-Attention for Image Aesthetics and Emotion Analysis." Mathematics 9, no. 12 (2021): 1437. http://dx.doi.org/10.3390/math9121437.

Full text

Abstract:

With the development of social networks and intelligent terminals, it is becoming more convenient to share and acquire images. The massive growth of the number of social images makes people have higher demands for automatic image processing, especially in the aesthetic and emotional perspective. Both aesthetics assessment and emotion recognition require a higher ability for the computer to simulate high-level visual perception understanding, which belongs to the field of image processing and pattern recognition. However, existing methods often ignore the prior knowledge of images and intrinsic

APA, Harvard, Vancouver, ISO, and other styles

47

De Paepe, Annick, Valéry Legrain, and Geert Crombez. "Visual stimuli within peripersonal space prioritize pain." Seeing and Perceiving 25 (2012): 88. http://dx.doi.org/10.1163/187847612x647072.

Full text

Abstract:

Localizing pain not only requires a simple somatotopic representation of the body, but also knowledge about the limb position (i.e., proprioception), and a visual localization of the pain source in external space. Therefore, nociceptive events are remapped into a multimodal representation of the body and the space nearby (i.e., a peripersonal schema of the body). We investigated the influence of visual cues presented either in peripersonal, or in extrapersonal space on the localization of nociceptive stimuli in a temporal order judgement (TOJ) task. 24 psychology students made TOJs concerning

APA, Harvard, Vancouver, ISO, and other styles

48

Bălan, Oana, Alin Moldoveanu, Florica Moldoveanu, Hunor Nagy, György Wersényi, and Rúnar Unnórsson. "Improving the Audio Game–Playing Performances of People with Visual Impairments through Multimodal Training." Journal of Visual Impairment & Blindness 111, no. 2 (2017): 148–64. http://dx.doi.org/10.1177/0145482x1711100206.

Full text

Abstract:

Introduction As the number of people with visual impairments (that is, those who are blind or have low vision) is continuously increasing, rehabilitation and engineering researchers have identified the need to design sensory-substitution devices that would offer assistance and guidance to these people for performing navigational tasks. Auditory and haptic cues have been shown to be an effective approach towards creating a rich spatial representation of the environment, so they are considered for inclusion in the development of assistive tools that would enable people with visual impairments to

APA, Harvard, Vancouver, ISO, and other styles

49

Vasiliu, Laurentiu, Keith Cortis, Ross McDermott, et al. "CASIE – Computing affect and social intelligence for healthcare in an ethical and trustworthy manner." Paladyn, Journal of Behavioral Robotics 12, no. 1 (2021): 437–53. http://dx.doi.org/10.1515/pjbr-2021-0026.

Full text

Abstract:

Abstract This article explores the rapidly advancing innovation to endow robots with social intelligence capabilities in the form of multilingual and multimodal emotion recognition, and emotion-aware decision-making capabilities, for contextually appropriate robot behaviours and cooperative social human–robot interaction for the healthcare domain. The objective is to enable robots to become trustworthy and versatile social robots capable of having human-friendly and human assistive interactions, utilised to better assist human users’ needs by enabling the robot to sense, adapt, and respond app

APA, Harvard, Vancouver, ISO, and other styles

50

Kearney, Matthew, Marta Bornstein, Marieme Fall, Roch Nianogo, Deborah Glik, and Philip Massey. "Cross-sectional study of COVID-19 knowledge, beliefs and prevention behaviours among adults in Senegal." BMJ Open 12, no. 5 (2022): e057914. http://dx.doi.org/10.1136/bmjopen-2021-057914.

Full text

Abstract:

ObjectivesThe aim of the study was to explore COVID-19 beliefs and prevention behaviours in a francophone West African nation, Senegal.DesignThis was a cross-sectional analysis of survey data collected via a multimodal observational study.ParticipantsSenegalese adults aged 18 years or older (n=1452).Primary and secondary outcome measuresPrimary outcome measures were COVID-19 prevention behaviours. Secondary outcome measures included COVID-19 knowledge and beliefs. Univariate, bivariate and multivariate statistics were generated to describe the sample and explore potential correlations.SettingP

APA, Harvard, Vancouver, ISO, and other styles

We offer discounts on all premium plans for authors whose works are included in thematic literature selections. Contact us to get a unique promo code!