Aller au menu Aller au contenu
Our engineering & Master degrees


School of engineering in Physics, Applied Physics, Electronics & Materials
Science

Our engineering & Master degrees
Our engineering & Master degrees

> Studies

Information Theory - 4PMSTHI9

A+Augmenter la taille du texteA-Réduire la taille du texteImprimer le documentEnvoyer cette page par mail Partagez cet article Facebook Twitter Linked In Google+ Viadeo
  • Number of hours

    • Lectures : 12.0
    • Tutorials : 6.0
    • Laboratory works : 0
    • Projects : 0
    • Internship : 0
    ECTS : 1.5

Goals

Introduction to Information Theory set by Claude Shannon in a communication context.
Application to give achievable bounds in terms of data compression (source coding)
and reliable transmission over noisy channel (channel capacity).

Contact Laurent ROS

Content

1 - General tool for Information Theory : measure of information, entropy, mutual information, Kullback-Leibler divergence, information rate, introduction to
sources with memory and to Markov sources

2 - Source coding : properties, Kraft inequality, first Shannon Theorem, Shannon-Fano and Huffman coding techniques

3 - Capacity and channel coding : capacity, redundancy, second Shannon (fundamental) Theorem, introduction to channel coding.

4 - Information Theory for continuous random variables, channel capacity for Additive White Gaussian Noise channel



Prerequisites

Tests

Final written examination - 2 hours



Additional Information

Curriculum->Master TSI SIGMA->Semester 7
Curriculum->SICOM->Semester 7
Curriculum->Master->Semester 7

Bibliography

T.M. Cover, J.A. Thomas, Elements of Information Theory, Wiley & Sons, 2nd edition, 2006.
G. Battail, « Théorie de l'information : application aux techniques de communication », col. pédagogique de Télécommunication, MASSON, 1997
F. Auger, « Introduction à la théorie du signal et de l'information , cours et exercices », Ed. Technip, 1999

A+Augmenter la taille du texteA-Réduire la taille du texteImprimer le documentEnvoyer cette page par mail Partagez cet article Facebook Twitter Linked In Google+ Viadeo

Date of update March 18, 2019

Grenoble INP Institut d'ingénierie Univ. Grenoble Alpes