This lecture gives an introduction into Cognitive User Interfaces (CUIs). CUIs mimic or reproduce human behavior in order to enable more natural and robust interaction between man and machine.
The lecture covers underlying algorithms, design questions, possible applications, and evaluation methods for CUIs. The focus lies on speech- and multimodal interfaces.  Training and adaptation methods for hidden-Markov-models are discussed as a main modeling paradigm for CUIs.
The student gets an overview of typical CUIs and their application field and should be able to understand the basic algorithms and designs.

• Introduction to CUIs
• Human cognition and perception models for CUIs
• Hidden-Markov-models (Training, Adaptation, Recognition, Synthesis)
• Acoustic speech synthesis
• Acoustic speech recognition
• Visual speech synthesis
• Speaker recognition
• Silent speech interfaces
• Gesture recognition
• Multimodal and spoken dialog systems
• Socially and culturally aware evaluation of CUIs

Didactics:

During the lecture exercises are given that can be solved on the basis of the discussed topics.  The student’s solutions to the exercises are then discussed in the subsequent lecture.

Written exam. In case you cannot participate in the exam, please contact me for an individual exam (pucher@ftw.at).