AMIBO: intelligent social conversational agent using artificial intelligence

ABSTRACT

In today’s time, the research mainly focuses on designing a Chat-bot which responds to a user’s query in the most efficient manner. However, state-of-the-art works on chat-bot design are unable to emotionally connect with the user and follow-up to a conversation. In this paper, a socially and emotionally active intelligent assistant, AMIBO is proposed. It detects and recognizes the face, perceives emotion via speech and vision capabilities, provides empathetic and intelligent responses. In order to enhance the experience of AMIBO, navigation and information delivery system have been integrated in the bot. The analysis of the feature vector (on 450 subjects) is done for all the initially taken 75 distances and 15 angles reduced to 26 distances and 11 angles feature vector. An encouraging accuracy of 99% was achieved on CK+ dataset and 97% on KDEF dataset.

KEYWORDS:

• Chatbot
• Artificial Intelligence
• emotion recognition
• conversational agent
• Human-Computer Interaction
• socially active bot
• facial feature vector
• emotion

Disclosure statement

No potential conflict of interest was reported by the author(s).

Additional information

Notes on contributors

Deepali Virmani

Prof. Deepali Virmani is HOD of B.Tech Programmes at Vivekananda Institute of Professional Studies-Technical Campus College of Engineering, affiliated to GGSIPU, New Delhi. She is a doctorate from the Delhi University, India with specialization in Computer Science. She has an innovative work experience of more than 21 years in both research and academics. She has published more than 100 research papers.

Charu Gupta

Dr. Charu Gupta received her Doctoral degree from the Department of Computer Science, Banasthali Vidyapith, Rajasthan, India. Presently serving in at Bhagwan Parshuram Institute of Technology (Affiliated to GGSIPU, Dwarka), Delhi with a teaching experience of 10+ years. She has to her credit research publications in various National and International Journals/Conferences of repute (SCIE/ESCI/SCOPUS). She is a reviewer, section editor and editorial member of many international journals/conferences. Her areas of interest are Natural Language Processing, Neutrosophic logic and its applications, Time Series Analysis and Forecasting, Evolutionary Computation.