Datasets
Standard Dataset
Performance evaluation of AI Bot responses
- Citation Author(s):
- Submitted by:
- Hitesh Mohapatra
- Last updated:
- Fri, 07/07/2023 - 02:56
- DOI:
- 10.21227/w3ve-rf60
- Data Format:
- Research Article Link:
- Links:
- License:
0 ratings - Please login to submit your rating.
Abstract
Performance evaluation of AI Bot responses based on various sectors of society is a crucial aspect in determining the effectiveness and reliability of AI-based Chatbots. In order to evaluate their performance, several explicit parameters are taken into account, ensuring a comprehensive assessment. These parameters encompass a range of factors, such as accuracy, relevance, coherence, clarity, and contextual understanding. By analyzing these aspects, we can gauge the AI Bot's ability to comprehend user queries and generate appropriate and helpful responses. However, evaluating AI Bot performance doesn't solely rely on predefined criteria. It is essential to compare the responses of AI Bots against the insights and opinions of human experts from diverse fields. These experts possess invaluable knowledge and expertise, allowing for a more nuanced evaluation process. By juxtaposing AI Bot responses with those of human experts, we can establish a benchmark to measure the quality of AI-generated answers. This comparison enables us to calculate a quality percentage, representing the extent to which the AI Bot's responses align with the considered expert opinions. Through this meticulous evaluation methodology, we aim to continuously refine and enhance the performance of AI-based Chatbots, ensuring they provide accurate and valuable information to users across various sectors of society.
Instructions:
The responses from AI chatbot has been compared against the experts of various sectors based on few explicit parametrs such as
AccuracyRelevanceCoherenceGrammaticalityFluency