Automatic Classification and Shift Detection of Facial Expressions in Event-Aware Smart Environments

Bernin, Arne, Müller, Larissa, Ghose, Sobin, Grecos, Christos, Wang, Qi, Jettke, Ralf, von Luck, Kai and Vogt, Florian (2018) Automatic Classification and Shift Detection of Facial Expressions in Event-Aware Smart Environments. In: Proceedings of the 11th PErvasive Technologies Related to Assistive Environments Conference. ACM, New York, NY, USA, pp. 194-201. ISBN 9781450363907

Full text not available from this repository.

Abstract

Affective application developers often face a challenge in integrating the output of facial expression recognition (FER) software in interactive systems: although many algorithms have been proposed for FER, integrating the results of these algorithms into applications remains difficult. Due to inter-and within-subject variations further post-processing is needed. Our work addresses this problem by introducing and comparing three post-processing classification algorithms for FER output applied to an event-based interaction scheme to pinpoint the affective context within a time window. Our comparison is based on earlier published experiments with an interactive cycling simulation in which participants were provoked with game elements and their facial expression responses were analysed by all three algorithms with a human observer as reference. The three post-processing algorithms we investigate are mean fixed-window, matched filter, and Bayesian changepoint detection. In addition, we introduce a novel method for detecting fast transition of facial expressions, which we call emotional shift. The proposed detection pattern is suitable for affective applications especially in smart environments, wherever users' reactions can be tied to events.

Item Type:	Book Section
Subjects:	Q Science > QA Mathematics > Electronic computers. Computer science T Technology > T Technology (General) > Information Technology > Electronic computers. Computer science Q Science > QA Mathematics > Computer software T Technology > T Technology (General) > Information Technology > Computer software
Divisions:	School of Computing > Staff Research and Publications
Depositing User:	Caoimhe Ní Mhaicín
Date Deposited:	27 Feb 2019 09:27
Last Modified:	27 Feb 2019 09:27
URI:	https://norma.ncirl.ie/id/eprint/3585

Actions (login required)

View Item