389.032 Information theory for communications engineers
This course is in all assigned curricula part of the STEOP.
This course is in at least 1 assigned curriculum part of the STEOP.

2014W, VO, 2.0h, 3.0EC


  • Semester hours: 2.0
  • Credits: 3.0
  • Type: VO Lecture

Aim of course

Understanding important concepts and fundamental relations of information theory as well as their application to source coding and channel coding. Improvement of English language skills.

Subject of course

* Fundamentals of information theory:  Entropy, mutual information, typical sequences, fundamental relations and inequalities, interpretations

* Lossless source coding:  Optimal codes, Huffman code, significance of entropy, universal codes, Lempel-Ziv code

* Lossy source coding:  Rate-distortion theory, quantization, rate-distortion function, Shannon's rate-distortion theorem

* Channel coding:  Channel capacity, Shannon's channel coding theorem, Gaussian channel, parallel Gaussian channels, feedback channels, separability of source coding and channel coding

Additional information

First class: Thursday, October 9, 2014, 3:15 p.m., in Seminar Room 389 (formerly 118) of the Institute of Telecommunications

This course is an optional part of the "Wahlmodul Advanced Digital Communications."



Examination modalities

Written exam

Course registration

Registration modalities:

Bei der ersten Vorlesung



Lecture notes for this course are available at the "Graphischen Zentrum an der TU Wien", Wiedner Hauptstraße 8 - 10, 1040 Wien (EG, roter Bereich).

Previous knowledge

Working knowledge of probability theory and random variables