The purpose of the course is to give students fundamental knowledge on multimedia signals and technologies for their representation, processing, transmission and presentation. Students will learn to use computer-based tools for multimedia signal processing and composition and will be able to choose and implement suitable algorithms for voice, image, audio and video processing to meet given demands in different multimedia applications.
- define media signals, their representation, processing and applications
- distinguish source coding and entropy coding and various algorithms for media compression
- apply and analyze methods for predictive and transform coding of media signals
- describe human visual perception model and explain properties of video signal
- explain differences between analog and digital video signal representation
- employ methods for image and video signal compression
Forms of Teaching
|Type||Threshold||Percent of Grade||Threshold||Percent of Grade|
|Laboratory Exercises||0 %||12 %||0 %||12 %|
|Homeworks||0 %||3 %||0 %||3 %|
|Attendance||0 %||5 %||0 %||5 %|
|Mid Term Exam: Written||0 %||30 %||0 %|
|Final Exam: Written||0 %||40 %|
|Final Exam: Oral||10 %|
|Exam: Written||50 %||60 %|
|Exam: Oral||20 %|
Necessary requirements to pass the course exam through continuing education are the following: student must attain at least 50% of total points from categories: laboratory exercises, homework and class attendance and at least 50% of total points from midterm exam and written part of the final exam. Student who doesn't fulfill these requirements can not approach the oral part of the final exam. The requirement to pass the course through end of semester course exam is also 50% of total points from categories: laboratory exercises, homework and class attendance
Week by Week Schedule
- Introduction to multimedia technologies. Architecture of multimedia system. Business aspects of multimedia systems and their applications. Multimedia signals and sources, requirements for their processing and transmission in multimedia systems.
- Principles of coding and compression. Classification of methods. Lossless and lossy compression.
- Entropy coding. Huffman coder, Arithmetic coder. Entropy constrained scalar quantization. High rate analysis of entropy constrained scalar quantization.
- Predictive, transform and sub-band coding. Speech signal. Modeling and analysis. Parametric model and speech coding.
- Coding standards and their properties. Demonstration of basic properties of different audio coding algorithms. Principles of speech synthesis and recognition.
- Human visual perception model. Eye-brain mechanism, human perception of color. Light sources, equal-energy white, subjective effects of color sensation. Standard observer and luminosity curve. Additive color mixing, CIE and EBU primary colors.
- Color matching, unity equation, chromaticity coordinates, color matching functions. Vector representation of color, primary-color triangle, chromaticity diagram, color temperature, hue and saturation in chromaticity diagram.
- Mid-term exam.
- Video signal, formats and properties. Progressive and interlaced scanning. Number of lines and number of frame per second. Video bandwidth. Horizontal and vertical resolution. SDTV and HDTV formats. Analog to digital conversion. Chroma subsampling. Bit rate.
- Principles of image and compression. Spatial, time and subjective redundancy in video signal. Transform coding. Common image formats and compression standards, their fundamental properties and applications. Video coding standards and their applications.
- Storage, processing, transmission and presentation of multimedia sources.
- Hardware and software implementations of multimedia processing algorithms.
- Integration of multimedia content. Synchronization.
- Survey of multimedia systems and their applications. Multimedia software tools. Examples.
- Visit to Croatian Radiotelevsion.