• introduction to entropy and its properties
  • motivation to optimize in general and entropy-based optimization in particular
  • principle of maximum entropy, maximum entropy distributions and their estimation
  • application of maximum entropy framework to estimation of bigram language model probabilities. implementation issues
  • applications to other areas of speech processing. summary of the talk