6.3.5 N-grams: Scoring
The details of scoring are discussed in
Section 4.3.1.
Monophones
To produce a scoring report for the previous two n-gram decoding experiments,
go to the directory:
isip_extract_hypo -level word -format NIST_TRN -list $ISIP_TUTORIAL/research/isip/databases/lists/identifiers_test.sof -output ngram_phone.score -transdb ./ngram_phone.sof -exclude_symbols exclude_symbols.sof
This command extracts the hypotheses from the database produced by the decoding
experiment. The resulting file is in NIST_TRN format and will be used in the
next step.
From the same directory, run the command
isip_eval score ngram_sp.score reference.score ngram_sp
This will produce the file
ngram_phone.report
which contains detailed scoring results of your experiment.
State-Tied Cross-Word Context-Dependent Triphones
isip_extract_hypo -level word -format NIST_TRN -list $ISIP_TUTORIAL/research/isip/databases/lists/identifiers_test.sof -output ngram_xword.score -transdb ./ngram_xword.sof -exclude_symbols exclude_symbols.sof
From the same directory, run the command
isip_eval score ngram_xword.score reference.score ngram_xword
This will produce the file
ngram_xword.report
which contains detailed scoring results of your experiment.
|
