next up previous contents index
Next: Scoring method Up: Experimental design of large Previous: Test material selection

Evaluation protocol

If one organises a competitive benchmarking  evaluation among several speech recognition laboratories, an evaluation test protocol should be kept. In this protocol, the coordinator should specify all details concerning the test. This is necessary, because for such an evaluation the recognition is not performed at the location of the organising institution, but at the sites of the laboratories themselves. Items that should certainly be defined in such a protocol are:

EAGLES SWLG SoftEdition, May 1997. Get the book...