Open Access Open Access  Restricted Access Subscription or Fee Access

A framework for the development of context-aware multimodal dialog systems

David Griol, Jesús Garcíıa-Herrero, José Manue Molina


Context-aware dialog systems must be able to process very heterogeneous information sources and user input modes. This paper is focused on the multimodal input, providing a proposal for the fusion of multiple input modalities in the dialog manager of the system, so that a single combined input is used to select the next system action. We describe a framework to build context-aware multimodal dialog systems that process user’s spoken utterances, tactile and keyboard inputs, and information related to the context of the interaction. Context information is divided in our proposal into external and internal context, user’s internal, represented in our contribution by the detection of their intention during the dialog and their emotional state. We describe a practical application of our technique to build a multimodal dialog system providing context-aware academic information.


Multimodal Systems, Conversational Agents, Fusion Techniques, Dialog management, User Modeling.

Full Text:


Disclaimer/Regarding indexing issue:

We have provided the online access of all issues and papers to the indexing agencies (as given on journal web site). It’s depend on indexing agencies when, how and what manner they can index or not. Hence, we like to inform that on the basis of earlier indexing, we can’t predict the today or future indexing policy of third party (i.e. indexing agencies) as they have right to discontinue any journal at any time without prior information to the journal. So, please neither sends any question nor expects any answer from us on the behalf of third party i.e. indexing agencies.Hence, we will not issue any certificate or letter for indexing issue. Our role is just to provide the online access to them. So we do properly this and one can visit indexing agencies website to get the authentic information.