Information Theory, Coding and Inference (Jan-May 2024)

This course will serve as an introduction to information theory and will highlight its connections to statistics and coding via the following problems: binary hypothesis testing, data compression, and coding for noisy channels.

The primary references for this course are

  • Thomas Cover and Joy Thomas, Elements of Information Theory, Second Edition, Wiley-Interscience
  • Yury Polyanskiy and Yihong Wu, Information Theory: From Coding to Learning, draft available at Yury Polyanskiy’s page.

Recent Courses

Matrix Theory (Aug-Dec 2023).