Out-of-dictionary words

[Iain W]

I have been running Festival’s script to check for out-of-dictionary words in the corpus I chose. It is still running after about six hours and seems to have found hundreds of out-of-dictionary words.

What should I do in this situation? Should I still use this corpus or try to find another one?

[Simon]

How large is your corpus?

What is the goal of finding the out-of-dictionary words?

If you wish to exclude all sentences that contain such a word, then you’ll have to find them all – you could do this using the provided Festival script (which might be slow for a very large corpus) or some other way (by writing your own code).

But if your aim is to identify all the words you might need to add to the dictionary, then you are not expected to do that for the large source corpus. You might need to rely on letter-to-sound to provide pronunciations during the text selection phase.

You should only manually write pronunciations for a modest number of words appearing in your (much smaller) recording script.

[Author]

Posts