Lecture type	Total
Lectures	45
Laboratory exercises	15

* Load is given in academic hour (1 academic hour = 45 minutes)

Introduction to the quantitative Shannon?s theory of information and its applications, especially to information coding. Mathematical definition and properties of information. Source coding theorem, lossless data compression and optimal lossless coding. Structural properties of natural languages. Information characteristics of images. Cryptography, data encryption. Noisy communication channels, channel coding theorem, multiple access channels. Error detection and error correction. Cyclic, binary block and convolutional codes, capacity-approaching codes. Gaussian noise, time-varying channels. Unified theory of information with applications to other sciences.

1. Uvod u teoriju informacije i kodiranje, 2. izd.; I.S. Pandžić, A. Bažant, Ž. Ilić, Z. Vrdoljak, M. Kos, V. Sinković; Element, Zagreb; 2009; ISBN: 978-953-197-605-3
2. Informacija, simbolika i semantika; V. Sinković; Školska knjiga; 1997; ISBN: 993-0-30739-X
3. Coding and Information Theory. 2nd ed.; R.E. Hamming; Prentice-Hall. Englewood Cliffs, New Jersey; 1986; ISBN: 0-13-139072-4
4. Fundamentals of Information Theory and Coding Design; R. Togneri, C.J.S. deSilva; Cjapman & Hall/CRC; 2003; ISBN: 978-1-58488-310-4
5. An Introduction to Information Theory; F.M. Reza; Dover, New York; 1994; ISBN: 0-486-68210-2
6. Pandžić, I. S. Bažant, A. Ilić, Ž. Vrdoljak, Z. Kos, M. Sinković, V. Uvod u teoriju informacije i kodiranje. Element, 2007.

Enrollment:
Passed: Probability and Statistics

Mandatory - module Computer Engineering
Mandatory - module Computer Science
Mandatory - module Control Engineering and Automation
Mandatory - module Electrical Power Engineering
Mandatory - module Electronic and Computer Engineering
Mandatory - module Electronics
Mandatory - module Information Processing
Mandatory - module Software Engineering and Information Systems
Mandatory - module Telecommunication and Informatics
Mandatory - module Wireless Technologies