NORMA eResearch @NCI Library

Machine Learning Framework for predicting Empathy using Eye tracking and Pupil Dilation

Sayar, Akshay Dilip (2022) Machine Learning Framework for predicting Empathy using Eye tracking and Pupil Dilation. Masters thesis, Dublin, National College of Ireland.

[thumbnail of Master of Science]
PDF (Master of Science)
Download (1MB) | Preview
[thumbnail of Configuration manual]
PDF (Configuration manual)
Download (1MB) | Preview


Empathy is understanding or sensing other persons’ emotions. Finding highly empathetic person can help find the right candidate for jobs like nurses, psychology counsellors or team leaders, which require highly empathetic people. Empathy can be measured based on questionnaires. However, this has drawbacks as answers may be incorrect (on-purpose or not) and results can be manipulated. This research proposes a machine learning framework that combines psychological analysis, empathy questionnaire, point-of-gaze using eye-tracking device, and various deep learning frameworks to measure empathy. The point-of-gaze, and pupil of 53 participants were recorded while they watched videos that contained six sad stories which were narrated by actors. Different features like point of gaze based heat map, pupil dilation features, blink percent, saccade percent, blink standard deviation, saccade standard deviation, blink mean, saccade mean and self report parameters like memory questionnaire, age, gender, average distance of point of gaze from left and right eye of actor were extracted from the experiments. Models were trained on parameters from these different experiment individually and combined with target variable generated from the empathy questionnaire. Logistic regression model on all the parameters combined showed the best accuracy of 89%. The result also showed that pupil dilation features contributed the most in prediction followed by eye tracking features.

Item Type: Thesis (Masters)
Subjects: Q Science > QA Mathematics > Electronic computers. Computer science
T Technology > T Technology (General) > Information Technology > Electronic computers. Computer science
B Philosophy. Psychology. Religion > Psychology > Emotions
R Medicine > Healthcare Industry
Q Science > Q Science (General) > Self-organizing systems. Conscious automata > Machine learning
Divisions: School of Computing > Master of Science in Data Analytics
Depositing User: Tamara Malone
Date Deposited: 10 Mar 2023 17:34
Last Modified: 10 Mar 2023 17:34

Actions (login required)

View Item View Item