Courses / DescriptionsEECS 421: Multimedia Signal Processing
Quarter OfferedWinter : 9:30-10:50 TuTh ; Pappas
PrerequisitesEECS 359 or equivalent, or permission of the instructor
Fundamentals of processing multimedia signals: text, graphics, speech, audio, image, video; standards for multimedia coding, processing and compression. Related products and services will be discussed.
REQUIRED TEXTS: Khalid Sayood, Introduction to Data Compression , Morgan Kaufmann, 4th edition (2012)
COURSE INSTRUCTOR: Prof. Thrasyvoulos N. Pappas
COURSE DIRECTOR: Prof. Aggelos Katsaggelos
COURSE GOALS: To provide an introduction to the fundamental principles and techniques in multimedia signal processing and compression, an overview of the current multimedia standards and technologies, and a brief description of future technologies.
PREREQUISITES BY COURSES: EECS 359 or equivalent, or permission of the instructor
DETAILED COURSE TOPICS:
- Digital Processing Basics
- Multimedia Processing and Communications
- Compression and Networking as Cornerstones
- Information Theory Basics
- Lossless Source Coding
- Huffman/arithmetic Codes, LZW
- Text/graphics Compression
- Fax Standards (Group 3, Group 4, JBIG)
- Quantization (scalar/vector)
- Waveform, Transform, Model-based Coding
- Performance Criteria, Perception
- Human Visual System Models
- Still Image Compression
- JPEG, JPEG2000
- Perceptually-based Coders
- 2 nd Generation Image Coding
- Speech Production
- Speech Compression
- LPC, CELP, MELP
- Audio Compression
- The G.72X Standars
- Fundamentals of Perceptual Coders
- MPEG-1/2, Dolby AC-2 and AC-3
- Compression of Stereo and Surround Sound
- Video Compression Basics
- Motion Estimation and Compensation
- Rate-Distortion based Optimal Encoding
- Overview of Multimedia Communication Standards H.323 and H.324
- Video Compression Standards H.261, H.263
- Video Compression Standards MPEG-1, MPEG-2, and HDTV
- Applications/Consumer Electronic Products
- “Modern” Coding Techniques
- Coding of Audio Objects (natural, synthetic)
- Coding of Visual Objects (boundary encoding)
- Sprites, Facial Animation
- Multimedia Transmission
- Error Resilience and Concealment
- Multimedia over IP
- Multimodal Signal Processing
- Speech-assisted Video Coding
- Multimodal Speech Recognition
COMPUTER USAGE: None.
PROJECT: A bibliographical search or computer type project is required. The purpose of this project is to enhance the understanding of a topic covered in class or to investigate a topic not covered in class. A final report and a presentation are required.
Homework Assignments – 60%
Project – 40%
COURSE OBJECTIVES: When a student completes this course, s/he should be able to:
• Understand the fundamentals behind multimedia signal processing.
• Understand the fundamentals behind multimedia compression.
• Understand the basic principles behind existing multimedia compression and communication standards.
• Understand future multimedia technologies.
• Apply the acquired knowledge to specific multimedia related problems and projects at work.
• Take advanced courses in this area.