Harder Intelligibility Test Design

[James B]

Various means are discussed (semantic unpredictability, confusable words, noise, simultaneous tasks etc.) of making intelligibility tests harder, for greater discrimination between high-performing systems. For the purposes of test design (before test data is available), how does one decide how hard the tests need to be? These hard tests may penalise systems which will perform acceptably in real-world situations, if their intended use will never cause them to encounter these difficulties.

[Simon]

We will look at how to calibrate the materials, in the lecture.

[Author]

Posts