Recognition of emotions by the emotional feedback through behavioral human poses
The sensory perceptions from humans are intertwined channels, which assemble diverse data in order to decrypt emotional information. Just by associations, humans can mix emotional information, i.e. emotion detection through facial expressions criteria, emotional speech, and the challenging field of emotional body language over the body poses and motion. In this work, we present an approach that can predict six basic universal emotions collected by responses linked to human body poses, from a computational perspective. The emotional outputs could be fed as inputs to a synthetic socially skilled agent capable of interaction, in the context of socially intelligent systems. The methodology uses a classification technique of information from six images extracted from a video, entirely developed using the motion sensing input device of Xbox 360 by Microsoft. We are taking into account that the emotional body language contains advantageous information about the emotional state of humans, especially when bodily reaction brings about conscious emotional experiences. The body parts are windows that show emotions and they would be particularly suitable to decoding affective states. The group of extracted images is merged in one image with all the relevant information. The recovered image will serve as input to the classifiers. The analysis of images from human body poses makes it possible to obtain relevant information through the combination of proper data in the same image. It is shown by experimental results that the SVM can detect emotion with good accuracy compared to other classifiers.
Keywords: Detection of Emotional Information, Affective Computing, Body Gesture Analysis, Robotics, Classification, Machine Learning.
Download Full-Text
ABOUT THE AUTHORS
Javier Francisco Guerrero Razuri
is currently a researcher at the Department of Computer and System Sciences, Stockholm University. He was a researcher and Phd student of Department of Statistics and Operations Research at Universidad Rey Juan Carlos and Acting developer of the Affective computing department in AISoy Robotics. In 1995, he received with honors the Bachelor of electronic engineering degree at Peruvian University of Applied Sciences (UPC) in Perú. In 2007, he received a Master's Degree in Business Management at IEDE - Business School of European University of Madrid. In 2008, he received a Master's Degree in Decision Systems Engineering at Universidad Rey Juan Carlos. From 2008, he was a researcher in several projects financed for the university and the European Union focused on Robotics and decision-making related to EU higher education. His research interests are related with, Affective computing, emotional decision making, Human-machine interaction, Robotics, Human Robotics, Robotics and Autonomous Systems, Neuroscience, Sentiment analysis, in order to reproducing behavior patterns similar to human and provide to the agents a type of emotional intelligence and improve the interaction experience making more close the loop human-robot emotional interaction.
Aron Larsson
has his PhD degree in Computer and Systems Sciences and is currently a researcher at the Department of Information and Media, Mid Sweden University as well as the Department of Computer and System Sciences, Stockholm University. His main research interest is the use of computer-based decision analysis and process models in complex decision making in which risks, uncertainties and trade-offs exist. Aron is the coordinator for the DECIDE Research Group at Stockholm University and leads the research RDALAB at Mid Sweden University. He has developed and applied risk and decision analytical methods for the paper industry, municipal decision-making problems, international mine clearance efforts and disaster preparedness. Aron is also active in the spin-off company Preference AB, which maintains the decision analysis software DecideIT.
Rahim Rahmani
Rahim Rahmani received his MSc in Electrical Engineering, wireless communication from Mid Sweden University in 1997. He worked as junior lecturer at Mid Sweden University and from 2007 he received 50% time for his study toward to PhD, he earned a technical doctorate in computer science from Mid Sweden University in March 2010. He is currently a researcher at the Department of Computer and System Sciences, Stockholm University.
David Sundgren
David Sundgren received his Doctoral degree in Computer and Systems Sciences from Stockholm University in 2011. He worked as lecturer at University of Gavle. He defended the thesis on "Apparent Arbitrariness of Second-Order Probability Distributions", dealing with uncertain probabilities. He is currently a researcher at the Department of Computer and System Sciences, Stockholm University.
Isis Bonet
received the B.Sc. degree in Computer Science from the Universidad Central “Marta Abreu” de Las Villas (UCLV), Santa Clara, Cuba, in 2001, her M.Sc. degree in Computer Science at UCLV in 2005 and her Ph.D. in Technical Sciences at UCLV in 2009. She is currently a researcher at Antioquia School of Engineering (EIA), Envigado, Colombia. She has authored/coauthored for some 42 papers in conference proceedings and scientific journals and earned several awards including the Cuban Academy of Sciences Award in 2011. Her research interests include Artificial Intelligence, Neural Networks, Classification Problems, Bioinformatics and Business Intelligence
Antonio Moran Cardenas
Antonio Moran Cardenas has his PhD degree in Engineering from Tokyo University of Agric. and Technology, Japan. His research interests include intelligent systems design based on the integration of neural networks, fuzzy logic and genetic algorithms applied to autonomous control engineering, bio-engineering, robotics, systems modeling, optimization and other applications.
Javier Francisco Guerrero Razuri
is currently a researcher at the Department of Computer and System Sciences, Stockholm University. He was a researcher and Phd student of Department of Statistics and Operations Research at Universidad Rey Juan Carlos and Acting developer of the Affective computing department in AISoy Robotics. In 1995, he received with honors the Bachelor of electronic engineering degree at Peruvian University of Applied Sciences (UPC) in Perú. In 2007, he received a Master's Degree in Business Management at IEDE - Business School of European University of Madrid. In 2008, he received a Master's Degree in Decision Systems Engineering at Universidad Rey Juan Carlos. From 2008, he was a researcher in several projects financed for the university and the European Union focused on Robotics and decision-making related to EU higher education. His research interests are related with, Affective computing, emotional decision making, Human-machine interaction, Robotics, Human Robotics, Robotics and Autonomous Systems, Neuroscience, Sentiment analysis, in order to reproducing behavior patterns similar to human and provide to the agents a type of emotional intelligence and improve the interaction experience making more close the loop human-robot emotional interaction.
Aron Larsson
has his PhD degree in Computer and Systems Sciences and is currently a researcher at the Department of Information and Media, Mid Sweden University as well as the Department of Computer and System Sciences, Stockholm University. His main research interest is the use of computer-based decision analysis and process models in complex decision making in which risks, uncertainties and trade-offs exist. Aron is the coordinator for the DECIDE Research Group at Stockholm University and leads the research RDALAB at Mid Sweden University. He has developed and applied risk and decision analytical methods for the paper industry, municipal decision-making problems, international mine clearance efforts and disaster preparedness. Aron is also active in the spin-off company Preference AB, which maintains the decision analysis software DecideIT.
Rahim Rahmani
Rahim Rahmani received his MSc in Electrical Engineering, wireless communication from Mid Sweden University in 1997. He worked as junior lecturer at Mid Sweden University and from 2007 he received 50% time for his study toward to PhD, he earned a technical doctorate in computer science from Mid Sweden University in March 2010. He is currently a researcher at the Department of Computer and System Sciences, Stockholm University.
David Sundgren
David Sundgren received his Doctoral degree in Computer and Systems Sciences from Stockholm University in 2011. He worked as lecturer at University of Gavle. He defended the thesis on "Apparent Arbitrariness of Second-Order Probability Distributions", dealing with uncertain probabilities. He is currently a researcher at the Department of Computer and System Sciences, Stockholm University.
Isis Bonet
received the B.Sc. degree in Computer Science from the Universidad Central “Marta Abreu” de Las Villas (UCLV), Santa Clara, Cuba, in 2001, her M.Sc. degree in Computer Science at UCLV in 2005 and her Ph.D. in Technical Sciences at UCLV in 2009. She is currently a researcher at Antioquia School of Engineering (EIA), Envigado, Colombia. She has authored/coauthored for some 42 papers in conference proceedings and scientific journals and earned several awards including the Cuban Academy of Sciences Award in 2011. Her research interests include Artificial Intelligence, Neural Networks, Classification Problems, Bioinformatics and Business Intelligence
Antonio Moran Cardenas
Antonio Moran Cardenas has his PhD degree in Engineering from Tokyo University of Agric. and Technology, Japan. His research interests include intelligent systems design based on the integration of neural networks, fuzzy logic and genetic algorithms applied to autonomous control engineering, bio-engineering, robotics, systems modeling, optimization and other applications.
