Skip to Content

AI-900: How to Evaluate Conversational Language Understanding with Azure AI?

Learn how to calculate recall for Azure AI-900 certification. Understand chatbot performance metrics like recall with a detailed explanation and example.

Table of Contents

Question

You are evaluating the performance of your customer service chatbot developed with Azure Al’s Conversational Language Understanding.
In a recent test, the chatbot correctly identified 90 refund-related queries out of 100 total refund-related queries.
Which of the following correctly represents the recall of the chatbot for refund-related queries?

A. 85%
B. 95%
C. 80%
D. 90%

Answer

D. 90%

Explanation

Recall is a key performance metric used to evaluate the effectiveness of machine learning models, particularly in classification tasks. It measures the ability of a model to correctly identify all relevant instances within a dataset. For this question, the chatbot’s recall is calculated using the formula:

Recall = (Correctly Identified Relevant Instances / Total Relevant Instances) × 100

Here:

  • Correctly identified refund-related queries = 90
  • Total refund-related queries = 100
  • Substituting these values into the formula:

Recall = (90 / 100)× 100 = 90%

This means the chatbot successfully identified 90% of all refund-related queries, making D. 90% the correct answer.

How to Evaluate Conversational Language Understanding with Azure AI?

Microsoft Azure AI Fundamentals AI-900 certification exam practice question and answer (Q&A) dump with detail explanation and reference available free, helpful to pass the Microsoft Azure AI Fundamentals AI-900 exam and earn Microsoft Azure AI Fundamentals AI-900 certification.