- The recursive partitioning method in tree construction often produces a complex tree that overfits the data
- If a lower predicted error rate is produced when a subtree is replaced with a leaf, the subtree is pruned
- Typical pruning methods
- Cost-complexity
- Pessimistic