CS5262 Multimedia Networking and Systems, Fall 2020
- Instructor: Cheng-Hsin Hsu (chsu@cs.nthu.edu.tw)
- Time: Wednesdays 11:10 a.m.-12:00 p.m.; Fridays 10:10 a.m. – 12:00 p.m.
- Location: Delta 106
- Office Hour: Tuesdays 2:00 p.m.-4:00 p.m.
- TA: Tse-Hou Hung (tsehou.nthu@gmail.com) and Cheng-Hao Wu (chenghao.nthu@gmail.com)
- TA Office: Delta 713
- TA Office Hour: Mondays 11:00 a.m.-12:00 p.m. (Cheng-Hao Wu) and Wednesdays 4:00 p.m.-5:00 p.m. (Tse-Hou Hung)
Summary:
This course covers two types of topics. First, we will review the key concepts of the broad area of multimedia and networks, which will prepare the students to get ready for more advanced topics. Second, we will study the cutting-edge multimedia networking systems, such as 360-degree video streaming to head-mounted displays, decentralized social media, and P4 based media-aware network elements. The goal of the course is to have each student finish a term project by the end of the semester.
Course Description:
This course covers the latest research in the areas of networking and multimedia systems. Despite the basic concepts of multimedia networking will be reviewed, the course is a graduate-level course and requires each student to work on an intensive term project. Students are expected to regularly present their project progress and turn in publishable technical reports at the end of the semester, in order to pass the course.
The lectures will be given in English. All the reports must be written in English.
Textbooks:
- Students will search, print, read, and present the latest search papers under the guidance of the instructor.
- Möller and Raake, Quality of Experience: Advanced Concepts, Applications and Methods, Springer, 2014.
- Jerald, The VR Book, ACM and Morgan & Claypool Publisher, 2016.
References:
- Kurose and Rose, Computer Networking: A top-down Approach Featuring the Internet, Addison Wesley, 2016.
- Burg, The Science of Digital Media, Pearson Prentice Hall, Inc., 2010 (available online).
- Li, Drew, and Liu, Fundamentals of Multimedia, 2nd Ed., Springer, 2014 (available online on campus).
Teaching Methods:
Each student will propose and carry out a research project. The expectation for each graduate student is to generate a research paper at the end of the semester. The expectation for each undergraduate student is to generate a report for a well-known multimedia grand-challenge problem; or to produce a good system demo with demo abstract at the end of the semester. Students who do not deliver publishable reports at the end of the semester will receive failing grades.
Syllabus:
The following tentative topics will be presented by the instructor if not all students are familiar with them already.
- Internet Architecture and Services
- Audio/Video Coding Overview
- Scalable Video Coding
- Adaptive Multimedia Streaming
- Stream Synchronization
- Streaming to Wireless and Mobile Devices
- Content-aware Multimedia Streaming and Storage
- 3D Mobile Video
Term Project Topics:
The following is not an exhausted list of the latest research topics in multimedia networking:
- 360-degree Videos to Head-Mounted Displays
- Point Cloud Compression and Streaming
- 6-DoF Video Streaming
- 3D Scene Reconstructions
- Multimedia Internet-of-Things
- Media-Aware Network Elements
- Virtual Reality and Augmented Reality
- Multimodal Speaker Recognition in Video Conferences
- Decentralized Social Media
Evaluations:
- Quizzes (5 times): 20%
- Paper presentations: 20%
- Term paper: 60%
Note that students who do not deliver publishable reports at the end of the semester will receive failed grades.