Return to Main
Introduction:
Abstract
Outline
Motivation:
Uncertainties
Definitions:
Entropy
Relative Entropy
Mutual Information
Relationship
Cross Entropy 1
Cross Entropy 2
Entropy of Sequences
Language models:
N-Gram
LM Toolkits
Applications:
LM Evaluation
Example
Conclusions:
Summary
References