Contextual Query Perfection by Affective Features Based Implicit Contextual Semantic Relevance Feedback in Multimedia Information Retrieval
Multimedia Information may have multiple semantics depending on context, a temporal interest and user preferences. Hence we are exploiting the plausibility of context associated with semantic concept in retrieving relevance information. We are proposing an Affective Feature Based Implicit Contextual Semantic Relevance Feedback (AICSRF) to investigate whether audio and speech along with visual could determine the current context in which user wants to retrieve the information and to further investigate whether we could employ Affective Feedback as an implicit source of evidence in CSRF cycle to increase the systems contextual semantic understanding. We introduce an Emotion Recognition Unit (ERU) that comprises of spatiotemporal Gabor filter to capture spontaneous facial expression and emotional word recognition system that uses phonemes to recognize the spoken emotional words. We propose Contextual Query Perfection Scheme (CQPS) to learn, refine the current context that could be used in query perfection in RF cycle to understand the semantic of query on the basis of relevance judgment taken by ERU. Observations suggest that CQPS in AICSRF incorporating such affective features reduce the search space hence retrieval time and increase the systems contextual semantic understanding.
Keywords: Contextual semantic relevance feedback, spoken emotional words, affective feedback, facial expression, Multimedia Information Retrieval, video retrieval
Download Full-Text
ABOUT THE AUTHORS
Karm Veer Singh
Mr. KARM VEER SINGH received his B.E. degree in Computer Engineering from Madan Mohan Malviya Engineering College, Gorakhpur, India in 1990, and the M.S. degree in Software Systems from Birla Institute of Technology (BITS), Pilani, Rajasthan, India in 2003. He worked as programmer in VBS Purvanchal University, Jaunpur, India from 1999 to 2011. He has joined at the post of System Engineer in Computer Centre, Banaras Hindu University in 2011. He is currently persuing Ph.D. in Computer Engineering from the Department of Computer Engineering, Indian Institute of Technology, Banaras Hindu University,Varanasi, India. His current interests are in the area of Pattern Recognition, Content-based Multimedia Information retrieval, Search Engines, Artificial Intelligence, Statistical Learning and parallel/distributed computing.
Anil K. Tripathi
Dr. ANIL K. TRIPATHI received his M.Sc. Engineering (Computers) from Oddesa National Polytech University, Ukraine in 1984, and Ph.D. in Computer Engineering from Institute of Technology, Banaras Hindu University, Varanasi, India in1992. Dr. Tripathi a Professor in Computer Engineering Department, Indian Institute of Technology, Banaras Hindu University, Varanasi, India has been engaged in teaching and research for last 26 years in areas of Software Engineering and Parallel/Distributing computing. One research monograph on “Scheduling in Distributed Computing Systems-Analysis, Design and Models” has been published by Springer USA in 2009. Two book chapters have been published from John Wiley (USA) and Springer (USA). He has more than fifty research papers in Journals and conference proceedings. Twelve scholars have been awarded PhD degrees under his supervision in fields of software engineering and parallel/distributed computing.
Karm Veer Singh
Mr. KARM VEER SINGH received his B.E. degree in Computer Engineering from Madan Mohan Malviya Engineering College, Gorakhpur, India in 1990, and the M.S. degree in Software Systems from Birla Institute of Technology (BITS), Pilani, Rajasthan, India in 2003. He worked as programmer in VBS Purvanchal University, Jaunpur, India from 1999 to 2011. He has joined at the post of System Engineer in Computer Centre, Banaras Hindu University in 2011. He is currently persuing Ph.D. in Computer Engineering from the Department of Computer Engineering, Indian Institute of Technology, Banaras Hindu University,Varanasi, India. His current interests are in the area of Pattern Recognition, Content-based Multimedia Information retrieval, Search Engines, Artificial Intelligence, Statistical Learning and parallel/distributed computing.
Anil K. Tripathi
Dr. ANIL K. TRIPATHI received his M.Sc. Engineering (Computers) from Oddesa National Polytech University, Ukraine in 1984, and Ph.D. in Computer Engineering from Institute of Technology, Banaras Hindu University, Varanasi, India in1992. Dr. Tripathi a Professor in Computer Engineering Department, Indian Institute of Technology, Banaras Hindu University, Varanasi, India has been engaged in teaching and research for last 26 years in areas of Software Engineering and Parallel/Distributing computing. One research monograph on “Scheduling in Distributed Computing Systems-Analysis, Design and Models” has been published by Springer USA in 2009. Two book chapters have been published from John Wiley (USA) and Springer (USA). He has more than fifty research papers in Journals and conference proceedings. Twelve scholars have been awarded PhD degrees under his supervision in fields of software engineering and parallel/distributed computing.
