Information Theory

Instructor: Prof. Heung-No Lee

e-mail: heungno@gist.ac.kr

1 Introduction to information Theory, Entropy
2 Entropy, Relative Entropy and Mutual Information
3 Entropy, Relative Entropy and Mutual Information
4 Asymptotic Equipartition Property
5 Asymptotic Equipartition Property / Entropy Rates of a Stochastic Process
6 Entropy rates of Markove Chain
7 Data compression
8 Channel capacity Midterm 1
9 Channel capacity theorems / forward / reverse
10 Differential entropy
11 Gaussian channel capacity
12 MIMO channel capacity theorem
13 Multiple Access channel capacity theorem
14 Slepian Wolf
15 Overview
16 Final Exam