title | titleSuffix | description | author | manager | ms.service | ms.topic | ms.date | ms.author | ms.custom |
---|---|---|---|---|---|---|---|---|---|
View a custom text classification model evaluation - Azure AI services |
Azure AI services |
Learn how to view the evaluation scores for a custom text classification model |
jboback |
nitinme |
azure-ai-language |
how-to |
12/19/2023 |
jboback |
language-service-custom-classification |
After your model has finished training, you can view the model performance and see the predicted classes for the documents in the test set.
Note
Using the Automatically split the testing set from training data option may result in different model evaluation result every time you train a new model, as the test set is selected randomly from the data. To make sure that the evaluation is calculated on the same test set every time you train a model, make sure to use the Use a manual split of training and testing data option when starting a training job and define your Test documents when labeling data.
Before viewing model evaluation you need:
- A custom text classification project with a configured Azure blob storage account.
- Text data that has been uploaded to your storage account.
- Labeled data
- A successfully trained model
See the project development lifecycle for more information.
[!INCLUDE View model details]
[!INCLUDE Model evaluation]
[!INCLUDE Model evaluation]
[!INCLUDE Load export model]
[!INCLUDE Load export model]
[!INCLUDE Delete model]
[!INCLUDE Delete model]
As you review your how your model performs, learn about the evaluation metrics that are used. Once you know whether your model performance needs to improve, you can begin improving the model.