Multimodal User Interfaces : From Signals to Interaction

The book presents a common theoretical framework for fusion and fission of multimodal information using the most advanced signal processing algorithms constrained by HCI rules, described in detail and integrated in the context of a common distributed software platform for easy and efficient development and usability assessment of multimodal tools. The book also demonstrates the use of the multimodal framework for the development of a set of applications in the areas of edutainment, interfaces for disabled people and interfaces for medical applications.