Phonetic Decision Trees

[Paul C]

If multiple models end up at a single leaf of a phonetic decision tree, and we want to combine them into a single model with shared parameters, does the single model have parameters that are the average of the parameter values of all the models at the leaf?

[Simon]

Yes, that’s the correct idea.

In fact we don’t actually average the model parameters, but instead we pool all the training data associated with those models and use that to train a new, single model. Averaging the model parameters would be incorrect because it wouldn’t account for the fact that each was trained on a different amount of data.

[Author]

Posts