Multimedia Technologies

Course Description

Multimedia technologies and systems; architecture and applications. Multimedia signal sources. Fundamentals of compression and coding. Speech signal, modeling and analysis. Parametric models; speech coding standards. Speech synthesis and recognition. Audio signal. Psychoacoustic model, audio coding principles and standards. Human visual perception model. Image formats, coding, and standards. Video signal and its properties. Spatial, time and subjective redundancy. Video compression standards. Storage, processing and transmission of multimedia content. Hardware and software implementations. Integration of multimedia content; synchronization. Multimedia systems and tools.

General Competencies

The purpose of the course is to give students fundamental knowledge on multimedia signals and technologies for their representation, processing, transmission and presentation. Students will learn to use computer-based tools for multimedia signal processing and composition and will be able to choose and implement suitable algorithms for voice, image, audio and video processing to meet given demands in different multimedia applications.

Learning Outcomes

  1. define media signals, their representation, processing and applications
  2. distinguish source coding and entropy coding and various algorithms for media compression
  3. apply and analyze methods for predictive and transform coding of media signals
  4. describe human visual perception model and explain properties of video signal
  5. explain differences between analog and digital video signal representation
  6. employ methods for image and video signal compression

Forms of Teaching

Lectures

--

Exercises

--

Laboratory Work

--

Experimental Exercises

--

Internship visits

--

Grading Method

Continuous Assessment Exam
Type Threshold Percent of Grade Comment: Percent of Grade
Laboratory Exercises 0 % 12 % 0 % 12 %
Homeworks 0 % 3 % 0 % 3 %
Attendance 0 % 5 % 0 % 5 %
Mid Term Exam: Written 0 % 30 % 0 %
Final Exam: Written 0 % 40 %
Final Exam: Oral 10 %
Exam: Written 0 % 60 %
Exam: Oral 20 %
Comment:

Necessary requirements to pass the course exam through continuing education are the following: student must attain at least 50% of total points from categories: laboratory exercises, homework and class attendance and at least 50% of total points from midterm exam and written part of the final exam. Student who doesn't fulfill these requirements can not approach the oral part of the final exam. The requirement to pass the course through end of semester course exam is also 50% of total points from categories: laboratory exercises, homework and class attendance

Week by Week Schedule

  1. Introduction to multimedia technologies. Architecture of multimedia system. Business aspects of multimedia systems and their applications. Multimedia signals and sources, requirements for their processing and transmission in multimedia systems.
  2. Principles of coding and compression. Classification of methods. Lossless and lossy compression.
  3. Entropy coding. Huffman coder, Arithmetic coder. Entropy constrained scalar quantization. High rate analysis of entropy constrained scalar quantization.
  4. Predictive, transform and sub-band coding. Speech signal. Modeling and analysis. Parametric model and speech coding.
  5. Coding standards and their properties. Demonstration of basic properties of different audio coding algorithms. Principles of speech synthesis and recognition.
  6. Human visual perception model. Eye-brain mechanism, human perception of color. Light sources, equal-energy white, subjective effects of color sensation. Standard observer and luminosity curve. Additive color mixing, CIE and EBU primary colors.
  7. Color matching, unity equation, chromaticity coordinates, color matching functions. Vector representation of color, primary-color triangle, chromaticity diagram, color temperature, hue and saturation in chromaticity diagram.
  8. Mid-term exam.
  9. Video signal, formats and properties. Progressive and interlaced scanning. Number of lines and number of frame per second. Video bandwidth. Horizontal and vertical resolution. SDTV and HDTV formats. Analog to digital conversion. Chroma subsampling. Bit rate.
  10. Principles of image and compression. Spatial, time and subjective redundancy in video signal. Transform coding. Common image formats and compression standards, their fundamental properties and applications. Video coding standards and their applications.
  11. Storage, processing, transmission and presentation of multimedia sources.
  12. Hardware and software implementations of multimedia processing algorithms.
  13. Integration of multimedia content. Synchronization.
  14. Survey of multimedia systems and their applications. Multimedia software tools. Examples.
  15. Visit to Croatian Radiotelevsion.

Study Programmes

Electronic and Computer Engineering -> Electrical Engineering and Information Technology (Module)

Wireless Technologies -> Electrical Engineering and Information Technology (Module)

Information Processing -> Computing (Module)

Computer Engineering -> Computing (Module)

Literature

Z. N. Li, M. S. Drew (2004.), Fundamentals of Multimedia, Prentice Hall
R. Steinmetz, K. Nahrstedt (2002.), Multimedia Fundamentals, Volume I: Media Coding and Content Processing, Prentice Hall
Y. Q. Shi, H. Sun (2008.), Image and Video Compression for Multimedia Engineering: Fundamentals, Algorithms, and Standards, CRC Press

Grading System

4 ECTS
L0 English Level
L1 e-Learning
40 Lecturers
5 Exercises
15 Laboratory exercises

Grading

90 Excellent
78 Very Good
62 Good
50 Acceptable