Which Attribute Is the Best Classifier?

• The central choice in the ID3 algorithm is selecting which attribute to test at each node in the tree.
• A statistical property called information gain that measures how well a given attribute separates the training examples according to their target classification.
• ID3 uses information gain measure to select among the candidate attributes at each step while growing the tree.