Sentic blending: Scalable multimodal fusion for the continuous interpretation of semantics and sentics

Erik Cambria, Newton Howard, Jane Hsu, Amir Hussain

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

85 Scopus citations

Abstract

The capability of interpreting the conceptual and affective information associated with natural language through different modalities is a key issue for the enhancement of human-agent interaction. The proposed methodology, termed sentic blending, enables the continuous interpretation of semantics and sentics (i.e., the conceptual and affective information associated with natural language) based on the integration of an affective common-sense knowledge base with any multimodal signal-processing module. In this work, in particular, sentic blending is interfaced with a facial emotional classifier and an opinion mining engine. One of the main distinguishing features of the proposed technique is that it does not simply perform cognitive and affective classification in terms of discrete labels, but it operates in a multidimensional space that enables the generation of a continuous stream characterising user's semantic and sentic progress over time, despite the outputs of the unimodal categorical modules have very different time-scales and output labels.

Original languageEnglish
Title of host publicationProceedings of the 2013 IEEE Symposium on Computational Intelligence for Human-Like Intelligence, CIHLI 2013 - 2013 IEEE Symposium Series on Computational Intelligence, SSCI 2013
Pages108-117
Number of pages10
DOIs
StatePublished - 2013
Externally publishedYes
Event2013 IEEE Symposium on Computational Intelligence for Human-Like Intelligence, CIHLI 2013 - 2013 IEEE Symposium Series on Computational Intelligence, SSCI 2013 - Singapore, Singapore
Duration: 16 04 201319 04 2013

Publication series

NameProceedings of the 2013 IEEE Symposium on Computational Intelligence for Human-Like Intelligence, CIHLI 2013 - 2013 IEEE Symposium Series on Computational Intelligence, SSCI 2013

Conference

Conference2013 IEEE Symposium on Computational Intelligence for Human-Like Intelligence, CIHLI 2013 - 2013 IEEE Symposium Series on Computational Intelligence, SSCI 2013
Country/TerritorySingapore
CitySingapore
Period16/04/1319/04/13

Keywords

  • Affective common-sense
  • Emotion recognition
  • Facial expression analysis
  • Multimodal fusion
  • SenticNet

Fingerprint

Dive into the research topics of 'Sentic blending: Scalable multimodal fusion for the continuous interpretation of semantics and sentics'. Together they form a unique fingerprint.

Cite this