13 - Information theory, statistics, and decision trees
April 6th, 2010
Slides
Scribe Notes
Summary
- Basic information theory.
- Decision trees.
- Information theory and statistics.
Readings
- (optional) Chris Bishop: Information Theory. Pattern Recognition and Machine Learning, section 1.6, pages 48-58.
- (optional) Andrew Moore: Decision Trees. Tutorial slides.
Books
- David MacKay: Information Theory, Inference, and Learning Algorithms. Cambridge University Press, 2003