Maximum entropy reduction

[Emma K]

What happens if two splits of the tree have the exact same entropy reduction? Would you just randomly pick one?

[Simon]

You could just pick one at random. Or, you might have some secondary criterion such as choosing the one with the most balanced split (i.e., the one closest to a 50/50 split) on the grounds that small partitions are a bad thing.

Why is a small partition a bad thing? What consequences might it have when we try to split it?

[Author]

Posts