389.101 Information Theory and Coding
This course is in all assigned curricula part of the STEOP.
This course is in at least 1 assigned curriculum part of the STEOP.

2012W, VU, 3.0h, 4.5EC

Properties

  • Semester hours: 3.0
  • Credits: 4.5
  • Type: VU Lecture and Exercise

Aim of course

Knowledge of the most important classic techniques for channel coding; understanding of the information-theoretic background

Subject of course

1. Channel capacity:  Basic example, capacity of the AWGN channel, the promise of channel capacity, basic facts of channel coding (threshold SNR, coding gain, bandwidth expansion), problems

2. Block-based coded transmission:  HISO channel, Gaussian memoryless channel, HIHO channel, discrete memoryless channel, binary symmetric channel, optimum soft-input and hard-input block decoding (MAP, ML), optimum block decoding for the Gaussian memoryless channel and the discrete memoryless channel, problems

3. Fundamentals of block codes: Galois fields, Hamming weight and distance, Hamming spheres, repetition code, single parity check code, elementary modifications of block codes, minimum distance and bounded minimum distance decoding, error detection, erasure filling, burst errors, performance bounds (Singleton bound, Hamming bound, asymptotic performance bounds, capacity of the binary symmetric channel), problems

4. Linear block codes:  Standard array, weight distribution and weight enumerator, error probability of the ML decoder, matrix description, dual code, syndrome, syndrome decoding, repetition code, single parity check code, Hamming codes, modifications and compositions of linear block codes (permutation, length and rate modifications, subfield-subcodes, product codes, interleaved codes, concatenated codes, turbo codes), problems

5. Fundamentals of cyclic block codes: Polynomials over GF(q), polynomial description, dual code, syndrome decoding, matrix description, shift-register circuits for encoding and decoding, problems

6. Primitive cyclic codes:  Primitive elements and exponential representation, extension fields and splitting fields, primitive polynomials, defining set, cyclic redundancy check (CRC) codes, frequency-domain description, Reed-Solomon codes, BCH codes, problems

7. Convolutional codes:  Elementary encoders, distance profile and free distance, weight distribution and weight enumerator, error probability of the ML decoder, truncation and termination, matrix description, syndrome, syndrome decoding, polynomial description, noncatastrophic encoders, trellis description, graph-searching decoders, Viterbi algorithm for hard-input and soft-input ML decoding, sequential decoding, trellis-coded modulation, problems

Additional information

Winter term 2012:  No class on October 1, 2012

Lecturers

Institute

Course dates

DayTimeDateLocationDescription
Wed10:45 - 12:1503.10.2012EI 6 Eckert HS 389.101 Informationstheorie und Codierung
Mon10:45 - 12:1508.10.2012 - 21.01.2013EI 6 Eckert HS HLAWATSCH
Wed10:45 - 12:1510.10.2012 - 23.01.2013EI 6 Eckert HS HLAWATSCH
Mon10:45 - 12:1528.01.2013EI 6 Eckert HS 389.101 Informationstheorie und Codierung
Wed10:45 - 12:1530.01.2013EI 6 Eckert HS 389.101 Informationstheorie und Codierung
Information Theory and Coding - Single appointments
DayDateTimeLocationDescription
Wed03.10.201210:45 - 12:15EI 6 Eckert HS 389.101 Informationstheorie und Codierung
Mon08.10.201210:45 - 12:15EI 6 Eckert HS HLAWATSCH
Wed10.10.201210:45 - 12:15EI 6 Eckert HS HLAWATSCH
Mon15.10.201210:45 - 12:15EI 6 Eckert HS HLAWATSCH
Wed17.10.201210:45 - 12:15EI 6 Eckert HS HLAWATSCH
Mon22.10.201210:45 - 12:15EI 6 Eckert HS HLAWATSCH
Wed24.10.201210:45 - 12:15EI 6 Eckert HS HLAWATSCH
Mon29.10.201210:45 - 12:15EI 6 Eckert HS HLAWATSCH
Wed31.10.201210:45 - 12:15EI 6 Eckert HS HLAWATSCH
Mon05.11.201210:45 - 12:15EI 6 Eckert HS HLAWATSCH
Wed07.11.201210:45 - 12:15EI 6 Eckert HS HLAWATSCH
Mon12.11.201210:45 - 12:15EI 6 Eckert HS HLAWATSCH
Wed14.11.201210:45 - 12:15EI 6 Eckert HS HLAWATSCH
Mon19.11.201210:45 - 12:15EI 6 Eckert HS HLAWATSCH
Wed21.11.201210:45 - 12:15EI 6 Eckert HS HLAWATSCH
Mon26.11.201210:45 - 12:15EI 6 Eckert HS HLAWATSCH
Wed28.11.201210:45 - 12:15EI 6 Eckert HS HLAWATSCH
Mon03.12.201210:45 - 12:15EI 6 Eckert HS HLAWATSCH
Wed05.12.201210:45 - 12:15EI 6 Eckert HS HLAWATSCH
Mon10.12.201210:45 - 12:15EI 6 Eckert HS HLAWATSCH

Examination modalities

Exam consists of written and oral parts. Active participation in the Exercise section is required. Grading mode and previous exam problems: see http://www.nt.tuwien.ac.at/teaching/courses/winter-term/389101/

Course registration

Not necessary

Curricula

Study CodeObligationSemesterPrecon.Info
066 437 Telecommunications Not specified3. Semester
066 938 Computer Engineering Mandatory elective

Literature

Lecture notes for this course are available at the "Graphischen Zentrum an der TU Wien", Wiedner Hauptstraße 8 - 10, 1040 Wien (EG, roter Bereich).

Shu Lin and D. J. Costello, Jr., Error Control Coding - Fundamentals and Applications. Pearson Prentice Hall, Upper Saddle River, NJ, 2004 R. E. Blahut, Algebraic Codes for Data Transmission. Cambridge University Press, Cambridge, UK, 2003 T. M. Cover and J. A. Thomas, Elements of Information Theory. Wiley, New York, 1991 R. G. Gallager, Information Theory and Reliable Communication. Wiley, New York, 1968

Previous knowledge

A sound knowledge of random variables and random vectors is an absolute prerequisite

Miscellaneous

Language

English