# 389.032 Information theory for communications engineers This course is in all assigned curricula part of the STEOP.\$(function(){PrimeFaces.cw("Tooltip","widget_j_id_20",{id:"j_id_20",showEffect:"fade",hideEffect:"fade",target:"isAllSteop"});});This course is in at least 1 assigned curriculum part of the STEOP.\$(function(){PrimeFaces.cw("Tooltip","widget_j_id_22",{id:"j_id_22",showEffect:"fade",hideEffect:"fade",target:"isAnySteop"});}); 2021W 2020W 2019W 2018W 2017W 2016W 2015W 2014W 2013W 2012W 2011W 2010W 2009W 2008W 2008S 2007S 2004W 2003W 2002W 2001W 2000W

2021W, VO, 2.0h, 3.0EC

## Properties

• Semester hours: 2.0
• Credits: 3.0
• Type: VO Lecture
• Format: Presence

## Learning outcomes

After successful completion of the course, students are able to understand important concepts and fundamental relations of information theory as well as their application to source coding and channel coding. A further outcome is an improvement of English language skills.

## Subject of course

* Fundamentals of information theory:  Entropy, mutual information, typical sequences, fundamental relations and inequalities, interpretations

* Lossless source coding:  Optimal codes, Huffman code, significance of entropy, universal codes, Lempel-Ziv code

* Lossy source coding:  Rate-distortion theory, quantization, rate-distortion function, Shannon's rate-distortion theorem

* Channel coding:  Channel capacity, Shannon's channel coding theorem, Gaussian channel, parallel Gaussian channels, feedback channels, separability of source coding and channel coding

## Teaching methods

The prof (Hlawatsch) verbally presents the class material, discusses the material with his students, and answers the students' questions. For this, he uses a blackboard, on which he writes certain characters and draws simple figures with a piece of chalk (also using different colors if helpful). He also uses a tablecloth to erase the board every now and then. Finally, he uses an overhead projector to project more complicated figures and tables on a screen. The prof's presentation is supported by detailed lecture notes.

Oral

# !!! This course will NOT be taught in the acadamic year 2021/2022 !!!

First class: Thursday, --- 3.15 p.m., in Seminar Room 389 (formerly 118) of the Institute of Telecommunications

Because of the limited capacity of the classroom, the first class (on ---) will be additionally offered in distance mode. The subsequent classes will be held only in presence mode (if possible).

This course is an optional part of the "Wahlmodul Advanced Digital Communications."

## Course dates

DayTimeDateLocationDescription
Thu15:15 - 17:0014.10.2021 - 27.01.2022Sem 389 Information theory for communications engineers
Information theory for communications engineers - Single appointments
DayDateTimeLocationDescription
Thu14.10.202115:15 - 17:00Sem 389 Information theory for communications engineers
Thu21.10.202115:15 - 17:00Sem 389 Information theory for communications engineers
Thu28.10.202115:15 - 17:00Sem 389 Information theory for communications engineers
Thu04.11.202115:15 - 17:00Sem 389 Information theory for communications engineers
Thu11.11.202115:15 - 17:00Sem 389 Information theory for communications engineers
Thu18.11.202115:15 - 17:00Sem 389 Information theory for communications engineers
Thu25.11.202115:15 - 17:00Sem 389 Information theory for communications engineers
Thu02.12.202115:15 - 17:00Sem 389 Information theory for communications engineers
Thu09.12.202115:15 - 17:00Sem 389 Information theory for communications engineers
Thu16.12.202115:15 - 17:00Sem 389 Information theory for communications engineers
Thu13.01.202215:15 - 17:00Sem 389 Information theory for communications engineers
Thu20.01.202215:15 - 17:00Sem 389 Information theory for communications engineers
Thu27.01.202215:15 - 17:00Sem 389 Information theory for communications engineers

Oral exam

## Course registration

### Registration modalities

Bei der ersten Vorlesung

## Literature

Lecture notes for this course are available at the "Grafisches Zentrum" of TU Wien, Wiedner Hauptstraße 8-10, 1040 Wien.

## Previous knowledge

Working knowledge of probability theory and random variables

English