Return to Main

Introduction:
  Abstract
  Outline

Motivation:
  Uncertainties

Definitions:
  Entropy
  Relative Entropy
  Mutual Information
  Relationship
  Cross Entropy 1
  Cross Entropy 2
  Entropy of Sequences

Language models:
  N-Gram
  LM Toolkits

Applications:
  LM Evaluation
  Example

Conclusions:
  Summary
  References