Information-Gain

The information gain measures the amount of "information" that provides us with an advantage for the semester, that is, when you use a node in the decision tree to divide the sample into smaller subgroups, the entropy changes and the information gain is a measure of this change, i.e. the scale of attrition with the value of entropy the information gain is calculated The difference between entropy before division and intermediate entropy after dividing the data set based on the values of the attributes given