Emotion recognition through physiological wearable sensors for social robotics applications using machine learning techniques

Research output: ThesisMaster's Thesis

Abstract

Nowadays, social robotics is a very recent topic of research. Aiming for futuristic scenarios, its objective is to introduce robots in the everyday life and making them interact with people in a way that resembles that one a normal human would perform. In this context, ability for robots to perceive human emotions and be consequently affected by them surely constitutes a crucial element in the building of human-robot interactions.< br> This work aims to assess the possibility for robots to recognize user’s emotions in social environments by means of physiological signals. Specifically, brain, cardiac and electrodermal activities were investigated through three different sensors, supported by video acquisition. To control all of them at the same time, a customized interface was implemented in Microsoft Visual Studio™ 2017 (Microsoft®, Washington, USA).< br> Secondly, an experimental methodology to elicit three emotional states by means of social interactions was designed. Paradoxically, this is the least explored among mood induction procedures, although it is one of the most natural and immediate stimuli to elicit emotions. 21 subjects were examined. The experiment succeeded in arousing desired emotional responses.< br> After the experiment, acquired signals were processed, and features were extracted and selected by means of correlation and significance analysis in Matlab™ 2017 (Mathworks®, Massachusetts, USA). Finally, the obtained dataset was analyzed by different classifiers in WEKA™ 3.8 (University of Waikato, Waikato, New Zealand) framework, achieving 89.70% accuracy in discerning among a positive, negative and relaxed mood.
Original languageEnglish
QualificationMaster of Science
Awarding Institution
  • Universita di Pisa
  • Scuola Superiore Sant'Anna The BioRobotics Institute
Supervisors/Advisors
  • Cavallo, Filippo, Supervisor, External person
  • Fiorini, Laura, Supervisor, External person
Award date3 May 2018
Publisher
Publication statusPublished - 3 May 2018
Externally publishedYes

Keywords

  • Affective computing
  • System integration
  • Mood induction procedure
  • Sensor fusion
  • Supervised learning

Fingerprint

Dive into the research topics of 'Emotion recognition through physiological wearable sensors for social robotics applications using machine learning techniques'. Together they form a unique fingerprint.

Cite this