389.032 Information theory for communications engineers
This course is in all assigned curricula part of the STEOP.
This course is in at least 1 assigned curriculum part of the STEOP.

2021W, VO, 2.0h, 3.0EC

Properties

  • Semester hours: 2.0
  • Credits: 3.0
  • Type: VO Lecture
  • Format: Presence

Learning outcomes

After successful completion of the course, students are able to understand important concepts and fundamental relations of information theory as well as their application to source coding and channel coding. A further outcome is an improvement of English language skills.

Subject of course

* Fundamentals of information theory:  Entropy, mutual information, typical sequences, fundamental relations and inequalities, interpretations

* Lossless source coding:  Optimal codes, Huffman code, significance of entropy, universal codes, Lempel-Ziv code

* Lossy source coding:  Rate-distortion theory, quantization, rate-distortion function, Shannon's rate-distortion theorem

* Channel coding:  Channel capacity, Shannon's channel coding theorem, Gaussian channel, parallel Gaussian channels, feedback channels, separability of source coding and channel coding

Teaching methods

The prof (Hlawatsch) verbally presents the class material, discusses the material with his students, and answers the students' questions. For this, he uses a blackboard, on which he writes certain characters and draws simple figures with a piece of chalk (also using different colors if helpful). He also uses a tablecloth to erase the board every now and then. Finally, he uses an overhead projector to project more complicated figures and tables on a screen. The prof's presentation is supported by detailed lecture notes.

Mode of examination

Oral

Additional information


!!! This course will NOT be taught in the acadamic year 2021/2022 !!!


First class: Thursday, --- 3.15 p.m., in Seminar Room 389 (formerly 118) of the Institute of Telecommunications

Because of the limited capacity of the classroom, the first class (on ---) will be additionally offered in distance mode. The subsequent classes will be held only in presence mode (if possible).

This course is an optional part of the "Wahlmodul Advanced Digital Communications."

Lecturers

Institute

Course dates

DayTimeDateLocationDescription
Thu15:15 - 17:0014.10.2021 - 27.01.2022Sem 389 Information theory for communications engineers
Information theory for communications engineers - Single appointments
DayDateTimeLocationDescription
Thu14.10.202115:15 - 17:00Sem 389 Information theory for communications engineers
Thu21.10.202115:15 - 17:00Sem 389 Information theory for communications engineers
Thu28.10.202115:15 - 17:00Sem 389 Information theory for communications engineers
Thu04.11.202115:15 - 17:00Sem 389 Information theory for communications engineers
Thu11.11.202115:15 - 17:00Sem 389 Information theory for communications engineers
Thu18.11.202115:15 - 17:00Sem 389 Information theory for communications engineers
Thu25.11.202115:15 - 17:00Sem 389 Information theory for communications engineers
Thu02.12.202115:15 - 17:00Sem 389 Information theory for communications engineers
Thu09.12.202115:15 - 17:00Sem 389 Information theory for communications engineers
Thu16.12.202115:15 - 17:00Sem 389 Information theory for communications engineers
Thu13.01.202215:15 - 17:00Sem 389 Information theory for communications engineers
Thu20.01.202215:15 - 17:00Sem 389 Information theory for communications engineers
Thu27.01.202215:15 - 17:00Sem 389 Information theory for communications engineers

Examination modalities

Oral exam

Course registration

Registration modalities

Bei der ersten Vorlesung

Curricula

Literature

Lecture notes for this course are available at the "Grafisches Zentrum" of TU Wien, Wiedner Hauptstraße 8-10, 1040 Wien.

Previous knowledge

Working knowledge of probability theory and random variables

Language

English