Graduate Institute of Networking and Multimedia
College of Electrical Engineering and Computer Science
National Taiwan University
Ⅰ. Brief Introduction
• Communications and Multimedia Lab. (CMLab.) was founded in Feb.1991 at
Department of Computer Science and Information Engineering (CSIE)
National Taiwan University – the first and the largest academic Lab., which
focused on, Multimedia and Networking researches in Taiwan. (Currently,
CMLab. has 7 faculty members, 3 post Ph.D.s, 80 M.S./Ph.D. students, and 3
• CSIE department transferred from College of Engineering to College of
Electrical Engineering and Computer Science (EECS) in Aug. 2000.(CSIE is
the first choice of high-school students who attended the Joint Collegiate
Entrance Examination in the category of Computer Science and Engineering)
• Ministry of Education approved GINM to offer M.S. and Ph.D. programs
starting at August 2004.
One Undergraduate Department and Multiple Graduate Institutes Structure
Graduate Institute of Networking
and Multimedia. (GINM)
CSIE Department & Graduate
Graduate Institute of Biomedical
Electronics and Bioinformatics.
Graduate Institute of Electronics
Graduate Institute of
Communication Engineering. (GICE)
Graduate Institute of Electro-Optical
EE Department & Graduate
Nurturing first-class information technology
Education professionals, specifically, in the area of
Networking and Multimedia.
Multiple-discipline researches among the
faculties within the NTU or with other
Research universities (Taiwan and other Nations) are
encouraged to foster innovative, high-quality
and advanced research.
The curriculum has been designed to minimize the
gap between the industry and academia.
University- Specifically, academic-industrial collective research
Industry projects are strongly encouraged.
Collaboration GINM encourages the interaction with industries
and the technology transfer to industries in hopes of
advancing the research capability of industries. 4
Full-time: 44 (joint with GINM(9), CSIE(21), BEBI(2), EE(3), GICE(6), GIEE(2),
Ph.D. Degree: 47
Life-time Distinguished Professor
Ph.D., Ta-Tung Institute of Technology, Taiwan
Address: No.1, Sec 4, Roosevelt Rd., Taipei, Taiwan 106
GINM comprises 44 full-time faculties (including 21 faculties from Department of CSIE, 2
faculties from Graduate Institute of Biomedical Electronics and Bioinformatics, 3 faculties
from Graduate Institute of Electrical Engineering, 6 faculties from Graduate Institute of
Communication Engineering ,2 faculties from Graduate Institute of Electronics
Engineering and 1 faculty from the Department of Information Management), 9 of them
are dedicated to GINM. All the GINM faculties hold Ph.D. degrees.
Full-Time Dedicated Faculty members:
Ja-Ling Wu Ph.D., Ta-Tung Institute of Technology
Ming Ouhyoung Ph.D., University of North Carolina, Chapel Hill
Yi-Ping Hung Ph.D., Brown University
Ai-Chun Pang Ph.D., National Chiao-Tung University
Chi-Sheng Shih Ph.D., University of Illinois at Urbana-Champaign
Chih-Wen Hsueh Ph.D., University of California, Irvine.
Shou-De Lin Ph.D., University of Southern California
Ming-Sui Lee Ph.D., University of Southern California
Winston H. Hsu Ph.D., University of Columbia
Three adjunct faculties have joined GINM since August 2005.
The GINM maintains an array of powerful computers and software for
instruction, as well as research laboratories maintained by individual faculty.
The facilities are available to all students and faculties. They include SGI
workstations, laptop computers, desktop computers, network traffic analyzers,
V8 and Hi8 video recorders, digital cameras, digital video camcorders,
scanners, 3D scanners, VHS/LD/DVD video player/recorders, video editors,
audio mixers, VCD/MP3 testing platforms, and Sony PSII. In the coming years,
GINM will continue expanding its facilities to serve its educational and research
mission. The faculties in GINM lead six laboratories:
Communications and Multimedia Laboratory, Embedded Systems and Wireless
Networking Laboratory, Image and Vision Laboratory, Network Security
Laboratory, Architecture and Complier Technology Laboratory and Computer
Graphics Laboratory (Department of IM).
C. Programs Requirements and Courses
GINM offers graduate programs leading to the degrees of Master of Science (MS) and
the Doctor of Philosophy (PhD). Students must complete course work or proficiency
courses. All the courses in the GINM are divided into three categories: multi-media
technology category, networking technology category, and systems and application
The MS requires 24 units of course work (one unit equals one
Master degree semester hour) excluding seminar, individual study, and thesis.
The PhD program requires 30 of semester hour units and the
completion of a doctoral thesis under the direction of an approved
thesis advisor and with the guidance of a doctoral committee.
Students must complete at least 18 units of course work and the
remainder are thesis research. PhD candidates must also satisfy a
core course requirement, pass the qualifying and preliminary
Ph.D. degree examinations and must successfully defend the doctoral thesis at
the final examination. Candidates who do not complete an Master of
Science in computer science as part of their graduate program or
enter the GINM doctoral program without an approved MS in
computer science or related area, are required to complete 12
additional units (42 units in total). 8
BASIC KERNEL ADVANCE SEMINAR
Introduction To Virtual Reality Geometric
Computer Graphics Modeling, Image-
Digital Signal Patten Analysis and Classification
Processing Computer Vision and Rendering,
Processing Digital Visual Effects
Communications and Information Theory Video Signal Processing
Computing and Coding Digital Speech Processing
Techniques Digital Audio Processing
Complexity-based Cryptography Wireless Multimedia
Network Data Security System Research,
Advanced Computer Network Data
Computer Networks Cryptography and Network Security
Personal Communications Services Performance
Internet Telephony Modeling, ….
Network System Management
Systems & Applications
Compilers for Embedded Systems Hardware Software
Advanced Operating Networked SoC Embedded Software Codesign,
Operating Systems Design Multiagent
Real-times Systems Systems,….
Database Systems Information Data Mining and Machine Learning Net arts,
Retrieval and Bioinformatics
Year M.S. Program Ph.D. Program MS Program (joint
with Depart. CSIE
2004 22 9 8
2005 33 10 6
2006 37 9 15
2007 39 13 -
• Prof. Ja-Ling Wu: Best Technical Full Paper Award, ACM Multimedia Conference, 2006.
• Prof. Su-Chu Hsu: The Second and Third Winners, 1st Digital Art Festival Taipei, 2006.
• Prof. Ja-Ling Wu: Excellent Award, Longterm Smile Competition, 2006.
• Prof. Ai-Chun Pang: Investigation Award, Pan Wen Yuan Foundation, 2006.
• Prof. Su-Chu Hsu: Technology Creating Award, 1st K.T. Originality Competition, 2006.
• Prof. Ai-Chun Pang: Excellent Teaching Award, National Taiwan University, 2005.
• Prof. Chi-Sheng Shih: Best Paper Award, IEEE Inte’l conf. on Embedded and Real Time
Systems and Applications, 2005.
• Prof. Yi-Ping Hung: Best Paper Award, CVGIP-Academic Society Taiwan, 2005.
• Prof.Ja-Ling Wu and Prof. Ming Ouhyoung: Fu Ssu-nien Award (for contributions to Industry-
University Cooperative Research), National Taiwan University, 2005.
• Prof. Ja-Ling Wu: Outstanding Faculty Award of Electrical Engineering, 2005.
• Prof. Chih-Wen Hsueh: Best Paper Award, IEEE Inte’l conf. on Embedded and Real Time
Systems and Applications, 2005.
Ⅳ.Research and Services
1. Research Areas
2. Related Research Labs.
Communications and Multimedia Lab.
(Profs. Ja-Ling Wu & Ming Ouhyoung & Winston H.Hsu)
Image and Vision Lab.
(Profs. Yi-Ping Hung)
Embedded Systems and Wireless Networking Lab.
(Profs. Ai-Chun Pang & Chi-Sheng Shih & Chih-Wen Hsueh)
Machine Discovery and Social Network Mining Lab.
(Prof. Shou-De Lin)
3. Large Scale Projects
Program for Promoting Academic Excellence of
University (Phase Ⅱ)-Content Science for a Media-Rich
NTU Center for Information and Electronics
The National Science & Technology Program for
Telecommunications (NTP)電信國家型計畫-數位家庭: 網
路, 平台, 與應用
Intimate Media Agent: Enabling Affective Content
Experience from Media Context. 產學合作計畫-感人媒體
4. Selected Research Results:
Image and Vision Lab (Prof. Yi-Ping Hung)
Multi-Resolution Displays Virtual Exhibition
Visual Surveillance Computer-Human Interaction
Embedded Systems and Wireless Networking Lab
(Prof. Chi-Sheng Shih)
Nth Dwell (N+1)th Dwell Real-Time
Systems and QoS
Embedded Systems and Wireless Networking Lab
(Prof. Ai-Chun Pang)
Embedded Systems and Wireless Networking Lab.
(Prof. Chih-Wen Hsueh)
User SOCOS on SOA
Kernel Device Space
Services Drivers Kernel
Ubiquitous Message Passing
NIC DMA GPU CPU UniCore DualCore MultiCore
2 1 3 4
1 2 3 4 5 6 7 8 Time
• A kind of new media that provides user elaborate photo browsing experience.
• Photo filtering & organization
• Music beat analysis
• Spatial and temporal composition issues
J.-C. Chen, W.-T. Chu, J.-H. Kuo, C.-Y. Weng, and J.-L. Wu, “Tiling Slideshow,” Proceedings
of ACM Multimedia Conference, pp. 25-34, 2006. (Best technical full paper award)
Visual Region-of-Interest Determination
• Video segmentation
• Visual attention modeling
• Camera motion registration
• Media aesthetics theory
• Feature fusion issues
W.-H. Cheng, W.-T. Chu, and J.-L. Wu, “A Visual Attention Based Region-of-interest
Determination Framework for Video Sequences,” IEICE Transactions on Information and20
Systems Journal, vol. E-88D, no. 7, pp. 1578-1586, July 2005.
Cubical Marching Squares: Adaptive Surface Extraction from
Volume Data with Sharp Features and Better Topology
Comparison of methods
• Resolving topology ambiguity with sharp features and eliminating inter-cell
dependency by sampling face sharp features. Best one for sculpting etc.
• Chien-Chang Ho, Pei-Lun Lee, Yung-Yu Chuang, Bing-Yu Chen, Ming Ouhyoung,
Eurographics 2005, Computer Graphics Forum, Vol. 24, No. 4, pp. 537-545, 2005 ,
Ireland, August, 2005. (Best Student Paper Award)
Hand Shadow Illusions and 3D DDR Based on Efficient
• Real-time installation art
• First one from Taiwan
• Got most discussion in Internet,
and attracted hundreds of
participants for personal trial.
• J.S. Yeh, J.Y Chiang, T.H. Huan, L.F. Lin, Y.C Tsai, L.K Wang, D.Y.Chen, Y.Y
Chuang, B.Y. Chen, M. Ouhyoung, "", Emerging Technology, SIGGRAPH2006,
Boston, USA, July 2006.
We explore the problem of enhancing still
pictures with subtly animated motions. The
result is a looping video texture created from
a single still image. We demonstrate the
technique on a variety of photographs and
Yung-Yu Chuang et. Al. Animating Pictures with Stochastic Motion Textures. In ACM 23
Transactions on Graphics (Proceedings of ACM SIGGRAPH 2005), 24(3), Los Angeles, 2005.
Real-Time Triple Product on GPU
We implemented triple product on
GPUs so that it can render the effects
of bump mapping, SBRDF, anisotropic
BRDF, soft shadows and glossy
materials in real time.
Wan-Chun Ma et. al. Real-Time Triple Product Relighting Using Spherical Local-Frame 24
Parameterization. In The Visual Computer (Proceedings of Pacific Graphics 2006), 22(9),, Taipei,
Communications & Multimedia Lab.
Large-Scale Video Structuring,
(Prof. Winston Hsu) Threading, and Retrieval
Feature fusion and selection from heterogeneous modalities
Automatic discovery of semantic mid-level features
Semantic threading across video sources
Video search reranking through recurrent patterns topic
feature models &
video selection classifiers video unit
Communications & Multimedia Lab.
(Prof. Winston Hsu)
TREC Video Retrieval Evaluation
Goal – to promote progress in content-based video retrieval via open
metric-based evaluation, supported by NIST, USA
Tasks including video story segmentation, high-level concept detection,
rushes exploitation, and automatic video search
Achieving one of the best systems since 2003
Affiliating with Columbia University and IBM TJ Watson
TRECVID 38 65
TRECVID 2002 Participants Participants
2001 17 Participants
73 Hours of 133 Hours of
11 Hours of 1998 ABC, 173 Hours of 220 Hours of
NIST video CNN news 1998 ABC, ARB, ENG,
& C-SPAN CNN news & CHN news,
& C-SPAN BBC
*courtesy of John Smith, IBM TJW
Communications & Multimedia Lab.Augmenting Image/Video Search with
(Prof. Winston Hsu) Multimodal Recurrences
Improving text-based image/video search with multimodal similarities between
documents across sources and domains
Formulating the solution as a random-walk framework
Requiring no query expansion, search examples, or pre-trained models
First work to consider recurrent patterns – improving text-based search up to 40%
Arabic English Chinese
Examples of topic “Pope sorry for his remarks on Muslim” in three languages, collected on 09/17/2006
(Prof. Shou-De Lin) Intelligent Information Process
5: Information Retrieval 1. Electronic Holmes
6: Ancient Script
and Information (Knowledge discovery in
Extraction complex networks)
Natural 3 Discovery
Language and Data
4: Semantic Analysis 2. Interesting Instance
(how machine can
understand human 3: Explanation-based interesting things from
language) Knowledge Discovery 28
(Prof. Ming-Sui Lee) Image Mosaic and Super Resolution
MPEG Enc Temporal synchronization
Focal length compensation
SD level (720x480) MPEG-2, MPEG-4 MPEG-2, MPEG-4
HD level (1280x720) HD level
High Visual Quality
Prof. Ja-Ling Wu
• IEEE Consumer Electronic Society – Taipei Section: Chairman, 2004-2006.
• IEEE International Conference on Consumer Electronics (ICCE) 2005, 2006, Technical Program
Committee: Chinese Representative.
• IEEE International Conference on Multimedia & Exposition (ICME) 2004, Organizing
Committee: Demonstration Chair.
• International Workshop on Inter-media Semantic Extraction and Reasoning (ISERE) 2005:
• International Journal of Fuzzy Mathematics: Advisory Editor
• Journal of Visual Communications & Image Representation: Editor, Since 2004.
• Journal of Information Science and Engineering: Editor, since 2003.
• Reviewers for (1987 ~ present):
IEEE Transactions on Signal Processing, IEEE Transactions on Image Processing, IEEE
Transactions on Multimedia, IEEE Transactions on Circuits and System for Video Technology,
IEEE Transactions on Information Theory, IEEE Transactions on Communications, IEEE Journal
on Selected Area on Communications, IEEE Signal Processing Letters, IEEE Conferences: ICIP,
ISCAS, ICASSP, ICME, ICCE, and ISCE, IEE Proceedings part-I, IEE Proceedings part-F, IEE
Electronics Letters, International Journal of Signal Processing, Signal Processing: Image
Communications, Optical Engineering, Multimedia Systems, EURASIP Journal on Applied 30
Prof. Ming Ouhyoung
• Special Issue on Search and retrieval of 3D content and associated knowledge
extraction and propagation ,2006. EURASIP Journal on Applied Signal Processing
• 2006 PacificGraphics Conference (PG2006),
Program Committee Member
• ACM Symposium on Interactive Computer Graphics and Games 2007
• ACM Virtual Reality Software and Technology (VRST), 2002, 2003, 2004
• PacificGraphics, 2000-2006.
• ChinaGraph, 2000-2006
• International Conference on Artificial Reality and Tele-existence (ICAT), 2000-
• International Conference on Computer Graphics and Imaging (CGIM), 2003-
Prof. Yi-Ping Hung
• Editorial Board Member, International Journal of Computer Vision (IJCV), Kluwer
Academic Publishers, 2004 – present
• Program Co-Chair, Multimedia Track, Third Taiwanese-French Conference on Information
Technology (TFIT), Nancy, France, March 28-30, 2006
• Area Chair, Seventh Asian Conference on Computer Vision (ACCV’06), Hyderabad, India,
January 22-25, 2006.
• Workshop Co-Chair, International Workshop on Task-Relevant Ubiquitous Media Access
(TRUMA’05), Taipei, Dec. 19-20, 2005.
• Workshop Co-Chair, Second IEEE Workshop on Image and Video Registration (IVR’04),
Washington DC, July 2, 2004.
• Workshop Co-Chair, International Conference on Computer Vision (ICCV’03), Nice,
October 13-16, 2003.
• Registration Chair, International Conference on Robotics and Automation (ICRA’03), Taipei,
September 14-19, 2003.
• Advisory Committee Member, Asian Conference on Computer Vision (ACCV’02), Melborne,
• Program Committee Member: ICPR’06, ICCV’05, MVA’04, ICMI’04, ICPR’04, ACCV’04,
ICCV’03, ICRA’03, ICPR’02, MVA’02, ICCV’01, ICDAR’01, MVA’00. ICPR’00, etc.
• Directorate, the Chinese Image Processing and Pattern Recognition Society, 1997 – present
Prof. Ai-Chun Pang
• Guest Editor: IEEE Wireless Communications Special Issue on Voice over
Wireless Local Area Network
• Conference Committee:
• IEEE Wireless Communications and Networking Conference (WCNC) 2007
• International Conference on Mobile Computing, Communications, and
Applications (ICMOCCA) 2006
• IEEE International Conference on Sensor Networks Ubiquitous and
Trustworthy Computing (SUTC) 2006
• International Conference on Communications, Circuits and Systems
• The 11th International Conference on Parallel and Distributed Systems
• IADIS Web Applications and Research (WARC2005) Conference
• The Third IASTED International Conference on COMMUNICATIONS
AND COMPUTER NETWORKS(CCN 2005)
• Mobile Computing Workshop 2004 and 2005
• Workshop Chair: The IEEE International Workshop on Mobility, Agents, and
Prof. Chi-Sheng Shih
•Publicity chair for RTAS 2005.
•Advisory committee of OSSF.
•Member of the Program Committee of ICPADS 2007.
•Member of the Program Committee of TFIT 2007.
•Member of the Program Committee of ICESS 2007.
•Workshop Program Co-Chair of EUC 2007.
•Member of the Program Committee of ATC 2006, 2007.
•Member of the Program Committee of TENCON 2006.
•Member of the Program Committee of WESE 2006.
•Member of the Program Committee of RTCSA 2004 - 2007.
•Member of the Program Committee of ICPADS 2005.
Prof. Chih-Wen Hsueh
•Program Committee member: RTCSA 2000, 2003, 2004, 2005, EEE04, 05, ADSN
•Publication Chair: EEE04
•Registration Coordinator: RTAS 2001
•Program Co-chair: RTCSA 2006 34
The curriculum of GINM should be evolutionary enhanced so that
the students graduate with most needed Networking and
Education Multimedia technology skills, cultivated skills and hands-on
GINM seeks the cooperation with research
institutes/universities in the country and all over the world.
GINM also accepts the admission from foreign countries and
Research welcomes the faculty member from foreign countries.
GINM should be recognized throughout the world as a leader in
the research of networking and multimedia in the near future.
For cooperation with research institutes and industry in the country,
GINM pursues the cooperation with other departments/institutes
Industrial-academics within NTU to promote the research results to the industry. Through
collaboration the interaction with the industry, the research agenda in GINM will
be highly related to the research and design needs of the industry
so as to advance the technology development.