After successful completion of the course, students are able to understand important concepts and fundamental relations of information theory as well as their application to source coding and channel coding. A further outcome is an improvement of English language skills.
* Fundamentals of information theory: Entropy, mutual information, typical sequences, fundamental relations and inequalities, interpretations
* Lossless source coding: Optimal codes, Huffman code, significance of entropy, universal codes, Lempel-Ziv code
* Lossy source coding: Rate-distortion theory, quantization, rate-distortion function, Shannon's rate-distortion theorem
* Channel coding: Channel capacity, Shannon's channel coding theorem, Gaussian channel, parallel Gaussian channels, feedback channels, separability of source coding and channel coding
The prof (Hlawatsch) verbally presents the class material, discusses the material with his students, and answers the students' questions. For this, he uses a blackboard, on which he writes certain characters and draws simple figures with a piece of chalk (also using different colors if helpful). He also uses a tablecloth to erase the board every now and then. Finally, he uses an overhead projector to project more complicated figures and tables on a screen. The prof's presentation is supported by detailed lecture notes.
!!! This course will NOT be taught in the acadamic year 2021/2022 !!!
First class: Thursday, --- 3.15 p.m., in Seminar Room 389 (formerly 118) of the Institute of Telecommunications
Because of the limited capacity of the classroom, the first class (on ---) will be additionally offered in distance mode. The subsequent classes will be held only in presence mode (if possible).
This course is an optional part of the "Wahlmodul Advanced Digital Communications."
Lecture notes for this course are available at the "Grafisches Zentrum" of TU Wien, Wiedner Hauptstraße 8-10, 1040 Wien.
