introduction_ginm2007.ppt by wuyunyi


									Graduate Institute of Networking and Multimedia
 College of Electrical Engineering and Computer Science
               National Taiwan University

Ⅰ. Brief Introduction
•   Communications and Multimedia Lab. (CMLab.) was founded in Feb.1991 at
    Department of Computer Science and Information Engineering (CSIE)
    National Taiwan University – the first and the largest academic Lab., which
    focused on, Multimedia and Networking researches in Taiwan. (Currently,
    CMLab. has 7 faculty members, 3 post Ph.D.s, 80 M.S./Ph.D. students, and 3
•   CSIE department transferred from College of Engineering to College of
    Electrical Engineering and Computer Science (EECS) in Aug. 2000.(CSIE is
    the first choice of high-school students who attended the Joint Collegiate
    Entrance Examination in the category of Computer Science and Engineering)
•   Ministry of Education approved GINM to offer M.S. and Ph.D. programs
    starting at August 2004.

                                                                         One Undergraduate Department and Multiple Graduate Institutes Structure

               CS Division

                             Graduate Institute of Networking
                             and Multimedia. (GINM)
                             CSIE Department & Graduate
EECS College

                             Graduate Institute of Biomedical
                             Electronics and Bioinformatics.
                             Graduate Institute of Electronics
                             Engineering. (GIEE)
                             Graduate Institute of
               EE Division

                             Communication Engineering. (GICE)
                             Graduate Institute of Electro-Optical
                             Engineering. (GIEOE)
                             EE Department & Graduate
                  Nurturing first-class information technology
    Education     professionals, specifically, in the area of
                  Networking and Multimedia.

                  Multiple-discipline researches among the
                  faculties within the NTU or with other
    Research      universities (Taiwan and other Nations) are
                  encouraged to foster innovative, high-quality
                  and advanced research.
                  The curriculum has been designed to minimize the
                  gap between the industry and academia.
   University-    Specifically, academic-industrial collective research
    Industry      projects are strongly encouraged.
  Collaboration   GINM encourages the interaction with industries
                  and the technology transfer to industries in hopes of
                  advancing the research capability of industries.      4
Ⅲ.Current Status
 A. Faculty
 Full-time: 44 (joint with GINM(9), CSIE(21), BEBI(2), EE(3), GICE(6), GIEE(2),
        Depart IM(1))
 Adjunct: 3
 Ph.D. Degree: 47
 TEL: +886-2-33664899
 FAX: +886-2-33664898
                    Ja-Ling Wu
                    Life-time Distinguished Professor
                    Ph.D., Ta-Tung Institute of Technology, Taiwan
                    Address: No.1, Sec 4, Roosevelt Rd., Taipei, Taiwan 106
GINM comprises 44 full-time faculties (including 21 faculties from Department of CSIE, 2
faculties from Graduate Institute of Biomedical Electronics and Bioinformatics, 3 faculties
from Graduate Institute of Electrical Engineering, 6 faculties from Graduate Institute of
Communication Engineering ,2 faculties from Graduate Institute of Electronics
Engineering and 1 faculty from the Department of Information Management), 9 of them
are dedicated to GINM. All the GINM faculties hold Ph.D. degrees.
Full-Time Dedicated Faculty members:
             Ja-Ling Wu            Ph.D., Ta-Tung Institute of Technology
             Ming Ouhyoung         Ph.D., University of North Carolina, Chapel Hill
             Yi-Ping Hung          Ph.D., Brown University
             Associate Professor
             Ai-Chun Pang          Ph.D., National Chiao-Tung University
             Assistant Professors
             Chi-Sheng Shih        Ph.D., University of Illinois at Urbana-Champaign
             Chih-Wen Hsueh        Ph.D., University of California, Irvine.
             Shou-De Lin           Ph.D., University of Southern California
             Ming-Sui Lee          Ph.D., University of Southern California
             Winston H. Hsu        Ph.D., University of Columbia
Three adjunct faculties have joined GINM since August 2005.
B. Facilities

The GINM maintains an array of powerful computers and software for
instruction, as well as research laboratories maintained by individual faculty.
The facilities are available to all students and faculties. They include SGI
workstations, laptop computers, desktop computers, network traffic analyzers,
V8 and Hi8 video recorders, digital cameras, digital video camcorders,
scanners, 3D scanners, VHS/LD/DVD video player/recorders, video editors,
audio mixers, VCD/MP3 testing platforms, and Sony PSII. In the coming years,
GINM will continue expanding its facilities to serve its educational and research
mission. The faculties in GINM lead six laboratories:
Communications and Multimedia Laboratory, Embedded Systems and Wireless
Networking Laboratory, Image and Vision Laboratory, Network Security
Laboratory, Architecture and Complier Technology Laboratory and Computer
Graphics Laboratory (Department of IM).

C. Programs Requirements and Courses
   GINM offers graduate programs leading to the degrees of Master of Science (MS) and
the Doctor of Philosophy (PhD). Students must complete course work or proficiency
courses. All the courses in the GINM are divided into three categories: multi-media
technology category, networking technology category, and systems and application

                   The MS requires 24 units of course work (one unit equals one
 Master degree     semester hour) excluding seminar, individual study, and thesis.

                    The PhD program requires 30 of semester hour units and the
                    completion of a doctoral thesis under the direction of an approved
                    thesis advisor and with the guidance of a doctoral committee.
                    Students must complete at least 18 units of course work and the
                    remainder are thesis research. PhD candidates must also satisfy a
                    core course requirement, pass the qualifying and preliminary
  Ph.D. degree      examinations and must successfully defend the doctoral thesis at
                    the final examination. Candidates who do not complete an Master of
                    Science in computer science as part of their graduate program or
                    enter the GINM doctoral program without an approved MS in
                    computer science or related area, are required to complete 12
                    additional units (42 units in total).                              8
                                                             Course Flow
                                  BASIC                KERNEL                            ADVANCE               SEMINAR
                              Introduction To                          Virtual Reality                      Geometric
                                                  Computer Graphics                                         Modeling, Image-
                              Digital Signal                           Patten Analysis and Classification
                                                                                                            based Modeling

                              Processing                               Computer Vision                      and Rendering,
                                                     Digital Image
                                                                                                            Digital Image
                                                     Processing        Digital Visual Effects
                                                                                                            Synthesis, …
                            Communications and    Information Theory Video Signal Processing
                            Computing             and Coding         Digital Speech Processing
                                                  Techniques         Digital Audio Processing
                                                                    Channel Coding

                                                                    Complexity-based Cryptography           Wireless Multimedia
                                                                    Network Data Security                   System Research,
                                                  Advanced Computer                                         Network Data
                            Computer Networks                       Cryptography and Network Security
                                                                    Personal Communications Services        Performance
                                                                    Internet Telephony                      Modeling, ….
                                                                    Network System Management
   Systems & Applications

                                                                    Compilers for Embedded Systems          Hardware Software
                                                 Advanced Operating Networked SoC Embedded Software         Codesign,
                            Operating Systems                       Design                                  Multiagent
                                                                    Real-times Systems                      Systems,….
                             Database Systems     Information          Data Mining and Machine Learning     Net arts,
                                                  Retrieval and                                             Bioinformatics
                                                                                                            Algorithms,….      9
D. Students
   Year       M.S. Program   Ph.D. Program   MS Program (joint
                                             with Depart. CSIE

    2004          22              9                 8

    2005          33              10                6

    2006          37              9                 15

    2007          39              13                 -
    E. Awards
•   Prof. Ja-Ling Wu: Best Technical Full Paper Award, ACM Multimedia Conference, 2006.
•   Prof. Su-Chu Hsu: The Second and Third Winners, 1st Digital Art Festival Taipei, 2006.
•   Prof. Ja-Ling Wu: Excellent Award, Longterm Smile Competition, 2006.
•   Prof. Ai-Chun Pang: Investigation Award, Pan Wen Yuan Foundation, 2006.
•   Prof. Su-Chu Hsu: Technology Creating Award, 1st K.T. Originality Competition, 2006.
•   Prof. Ai-Chun Pang: Excellent Teaching Award, National Taiwan University, 2005.
•   Prof. Chi-Sheng Shih: Best Paper Award, IEEE Inte’l conf. on Embedded and Real Time
    Systems and Applications, 2005.
•   Prof. Yi-Ping Hung: Best Paper Award, CVGIP-Academic Society Taiwan, 2005.
•   Prof.Ja-Ling Wu and Prof. Ming Ouhyoung: Fu Ssu-nien Award (for contributions to Industry-
    University Cooperative Research), National Taiwan University, 2005.
•   Prof. Ja-Ling Wu: Outstanding Faculty Award of Electrical Engineering, 2005.
•   Prof. Chih-Wen Hsueh: Best Paper Award, IEEE Inte’l conf. on Embedded and Real Time
    Systems and Applications, 2005.

Ⅳ.Research and Services
A. Research
 1. Research Areas

2. Related Research Labs.
  Communications and Multimedia Lab.
  (Profs. Ja-Ling Wu & Ming Ouhyoung & Winston H.Hsu)
  Image and Vision Lab.
 (Profs. Yi-Ping Hung)
  Embedded Systems and Wireless Networking Lab.
 (Profs. Ai-Chun Pang & Chi-Sheng Shih & Chih-Wen Hsueh)
  Machine Discovery and Social Network Mining Lab.
 (Prof. Shou-De Lin)

3. Large Scale Projects
   Program for Promoting Academic Excellence of
   University (Phase Ⅱ)-Content Science for a Media-Rich
   NTU Center for Information and Electronics
   The National Science & Technology Program for
   Telecommunications (NTP)電信國家型計畫-數位家庭: 網
   路, 平台, 與應用
   Intimate Media Agent: Enabling Affective Content
   Experience from Media Context. 產學合作計畫-感人媒體

4. Selected Research Results:
 Image and Vision Lab          (Prof. Yi-Ping Hung)
   Multi-Resolution Displays           Virtual Exhibition

      Visual Surveillance            Computer-Human Interaction

            Embedded Systems and Wireless Networking Lab
            (Prof. Chi-Sheng Shih)
                                        Assisted Living

Nth Dwell           (N+1)th Dwell                 Real-Time

                                    Embedded     Performance
                                     Systems      and QoS

Embedded Systems and Wireless Networking Lab
(Prof. Ai-Chun Pang)

                     SoCOS Architecture
Embedded Systems and Wireless Networking Lab.
(Prof. Chih-Wen Hsueh)

          User              SOCOS on SOA

          Kernel                        Device                        Space
                      Middlewares                     Libraries
         Services                       Drivers                       Kernel

                    Ubiquitous Message Passing



         NIC   DMA    GPU     CPU           UniCore   DualCore    MultiCore
                                                                               …    18
                                Tiling Slideshow

                                                       5                      7

  2           1            3         4

                                                       6                      8

                                                                                  Music Beats

          1       2    3         4         5       6          7           8            Time

• A kind of new media that provides user elaborate photo browsing experience.
• Photo filtering & organization
• Music beat analysis
• Spatial and temporal composition issues
J.-C. Chen, W.-T. Chu, J.-H. Kuo, C.-Y. Weng, and J.-L. Wu, “Tiling Slideshow,” Proceedings
of ACM Multimedia Conference, pp. 25-34, 2006. (Best technical full paper award)
           Visual Region-of-Interest Determination
                                                         • Video segmentation
                                                         • Visual attention modeling
                                                         • Camera motion registration
                                                         • Media aesthetics theory
                                                         • Feature fusion issues

W.-H. Cheng, W.-T. Chu, and J.-L. Wu, “A Visual Attention Based Region-of-interest
Determination Framework for Video Sequences,” IEICE Transactions on Information and20
Systems Journal, vol. E-88D, no. 7, pp. 1578-1586, July 2005.
    Cubical Marching Squares: Adaptive Surface Extraction from
      Volume Data with Sharp Features and Better Topology


       Comparison of methods

•   Resolving topology ambiguity with sharp features and eliminating inter-cell
    dependency by sampling face sharp features. Best one for sculpting etc.
•   Chien-Chang Ho, Pei-Lun Lee, Yung-Yu Chuang, Bing-Yu Chen, Ming Ouhyoung,
    Eurographics 2005, Computer Graphics Forum, Vol. 24, No. 4, pp. 537-545, 2005 ,
    Ireland, August, 2005. (Best Student Paper Award)
    Hand Shadow Illusions and 3D DDR Based on Efficient
                      Model Retrieval

•     Real-time installation art
      and demo
•     First one from Taiwan
•     Got most discussion in Internet,
       and attracted hundreds of
      participants for personal trial.

    • J.S. Yeh, J.Y Chiang, T.H. Huan, L.F. Lin, Y.C Tsai, L.K Wang, D.Y.Chen, Y.Y
      Chuang, B.Y. Chen, M. Ouhyoung, "", Emerging Technology, SIGGRAPH2006,
      Boston, USA, July 2006.

                                 Animating Picture

                                     We explore the problem of enhancing still
                                     pictures with subtly animated motions. The
                                     result is a looping video texture created from
                                     a single still image. We demonstrate the
                                     technique on a variety of photographs and
Yung-Yu Chuang et. Al. Animating Pictures with Stochastic Motion Textures. In ACM        23
Transactions on Graphics (Proceedings of ACM SIGGRAPH 2005), 24(3), Los Angeles, 2005.
                    Real-Time Triple Product on GPU

                                                 We implemented triple product on
                                                 GPUs so that it can render the effects
                                                 of bump mapping, SBRDF, anisotropic
                                                 BRDF, soft shadows and glossy
                                                 materials in real time.

Wan-Chun Ma et. al. Real-Time Triple Product Relighting Using Spherical Local-Frame                24
Parameterization. In The Visual Computer (Proceedings of Pacific Graphics 2006), 22(9),, Taipei,
Communications & Multimedia Lab.
                                            Large-Scale Video Structuring,
(Prof. Winston Hsu)                            Threading, and Retrieval
                Feature fusion and selection from heterogeneous modalities
                Automatic discovery of semantic mid-level features
                Semantic threading across video sources
                Video search reranking through recurrent patterns           topic
                 low-level                             document
                  features                             similarity
 content                                                                       video
                                     feature           models &
                   video            selection          classifiers       video unit
Communications & Multimedia Lab.
(Prof. Winston Hsu)
                                                   TREC Video Retrieval Evaluation
      Goal – to promote progress in content-based video retrieval via open
       metric-based evaluation, supported by NIST, USA
      Tasks including video story segmentation, high-level concept detection,
       rushes exploitation, and automatic video search
      Achieving one of the best systems since 2003
      Affiliating with Columbia University and IBM TJ Watson
                                                                  TRECVID          2005
                                   TRECVID                            38              65
          TRECVID                    2002                        Participants    Participants
            2001                        17        Participants
              12                   Participants
                                   73 Hours of    133 Hours of
         11 Hours of                               1998 ABC,     173 Hours of   220 Hours of
                                   video from
         NIST video                                CNN news       1998 ABC,      ARB, ENG,
                                                   & C-SPAN       CNN news      & CHN news,
                                                                  & C-SPAN          BBC
                                                                                 stock shots
*courtesy of John Smith, IBM TJW
Communications & Multimedia Lab.Augmenting Image/Video Search                                           with
(Prof. Winston Hsu)                  Multimodal Recurrences
       Improving text-based image/video search with multimodal similarities between
        documents across sources and domains
       Formulating the solution as a random-walk framework
       Requiring no query expansion, search examples, or pre-trained models
       First work to consider recurrent patterns – improving text-based search up to 40%

        Arabic                 English                        Chinese

Examples of topic “Pope sorry for his remarks on Muslim” in three languages, collected on 09/17/2006
 (Prof. Shou-De Lin)         Intelligent Information Process

5: Information Retrieval                                            1. Electronic Holmes
                                 6: Ancient Script
and Information                                                     (Knowledge discovery in
Extraction                                                          complex networks)

                         Artificial       Machine
                       Intelligence       Learning
                                      4              1
                                          5     2
                                              6 Knowledge
                              Natural         3 Discovery
                             Language           and Data
                             Processing          Mining
4: Semantic Analysis                                                2. Interesting Instance
(how machine can
                                                                    Discovery (finding
understand human                  3: Explanation-based              interesting things from
language)                         Knowledge Discovery                                     28
(Prof. Ming-Sui Lee)    Image Mosaic and Super Resolution

                       MPEG Enc

                                        Mosaicking                                     Resolution
                                                                                     & Enhancement

                       MPEG Enc    Temporal synchronization
                                  Focal length compensation
                                       White balancing
                                        Color Matching

                                                                           zoom in
                SD level

                         MPEG-2, MPEG-4
                         SD level (720x480)   MPEG-2, MPEG-4                         MPEG-2, MPEG-4
                                              HD level (1280x720)                    HD level
                                                       (1920x1080)                                 29
                                                                                     High Visual Quality
B. Services
Prof. Ja-Ling Wu
•    IEEE Consumer Electronic Society – Taipei Section: Chairman, 2004-2006.
•    IEEE International Conference on Consumer Electronics (ICCE) 2005, 2006, Technical Program
     Committee: Chinese Representative.
•    IEEE International Conference on Multimedia & Exposition (ICME) 2004, Organizing
     Committee: Demonstration Chair.
•    International Workshop on Inter-media Semantic Extraction and Reasoning (ISERE) 2005:
     Organizing Committee.
•    International Journal of Fuzzy Mathematics: Advisory Editor
•    Journal of Visual Communications & Image Representation: Editor, Since 2004.
•    Journal of Information Science and Engineering: Editor, since 2003.
•    Reviewers for (1987 ~ present):
    IEEE Transactions on Signal Processing, IEEE Transactions on Image Processing, IEEE
     Transactions on Multimedia, IEEE Transactions on Circuits and System for Video Technology,
     IEEE Transactions on Information Theory, IEEE Transactions on Communications, IEEE Journal
     on Selected Area on Communications, IEEE Signal Processing Letters, IEEE Conferences: ICIP,
     ISCAS, ICASSP, ICME, ICCE, and ISCE, IEE Proceedings part-I, IEE Proceedings part-F, IEE
     Electronics Letters, International Journal of Signal Processing, Signal Processing: Image
     Communications, Optical Engineering, Multimedia Systems, EURASIP Journal on Applied 30
     Signal Processing
Prof. Ming Ouhyoung
Guest Editor
  • Special Issue on Search and retrieval of 3D content and associated knowledge
extraction and propagation ,2006. EURASIP Journal on Applied Signal Processing
Program Co-Chair
  • 2006 PacificGraphics Conference (PG2006),
Program Committee Member
  • ACM Symposium on Interactive Computer Graphics and Games 2007
  • ACM Virtual Reality Software and Technology (VRST), 2002, 2003, 2004
  • PacificGraphics, 2000-2006.
  • ChinaGraph, 2000-2006
General Co-Chair
  • International Conference on Artificial Reality and Tele-existence (ICAT), 2000-
  • International Conference on Computer Graphics and Imaging (CGIM), 2003-
2005                                                                                  31
Prof. Yi-Ping Hung
• Editorial Board Member, International Journal of Computer Vision (IJCV), Kluwer
  Academic Publishers, 2004 – present
• Program Co-Chair, Multimedia Track, Third Taiwanese-French Conference on Information
  Technology (TFIT), Nancy, France, March 28-30, 2006
• Area Chair, Seventh Asian Conference on Computer Vision (ACCV’06), Hyderabad, India,
  January 22-25, 2006.
• Workshop Co-Chair, International Workshop on Task-Relevant Ubiquitous Media Access
  (TRUMA’05), Taipei, Dec. 19-20, 2005.
• Workshop Co-Chair, Second IEEE Workshop on Image and Video Registration (IVR’04),
  Washington DC, July 2, 2004.
• Workshop Co-Chair, International Conference on Computer Vision (ICCV’03), Nice,
  October 13-16, 2003.
• Registration Chair, International Conference on Robotics and Automation (ICRA’03), Taipei,
  September 14-19, 2003.
• Advisory Committee Member, Asian Conference on Computer Vision (ACCV’02), Melborne,
  January 2002.
• Program Committee Member: ICPR’06, ICCV’05, MVA’04, ICMI’04, ICPR’04, ACCV’04,
  ICCV’03, ICRA’03, ICPR’02, MVA’02, ICCV’01, ICDAR’01, MVA’00. ICPR’00, etc.
• Directorate, the Chinese Image Processing and Pattern Recognition Society, 1997 – present

Prof. Ai-Chun Pang
• Guest Editor: IEEE Wireless Communications Special Issue on Voice over
  Wireless Local Area Network
• Conference Committee:
   • IEEE Wireless Communications and Networking Conference (WCNC) 2007
   • International Conference on Mobile Computing, Communications, and
     Applications (ICMOCCA) 2006
   • IEEE International Conference on Sensor Networks Ubiquitous and
     Trustworthy Computing (SUTC) 2006
   • International Conference on Communications, Circuits and Systems
   • The 11th International Conference on Parallel and Distributed Systems
   • IADIS Web Applications and Research (WARC2005) Conference
   • The Third IASTED International Conference on COMMUNICATIONS
   • Mobile Computing Workshop 2004 and 2005
• Workshop Chair: The IEEE International Workshop on Mobility, Agents, and
  Mobile Services
Prof. Chi-Sheng Shih
•Publicity chair for RTAS 2005.
•Advisory committee of OSSF.
•Member of the Program Committee of ICPADS 2007.
•Member of the Program Committee of TFIT 2007.
•Member of the Program Committee of ICESS 2007.
•Workshop Program Co-Chair of EUC 2007.
•Member of the Program Committee of ATC 2006, 2007.
•Member of the Program Committee of TENCON 2006.
•Member of the Program Committee of WESE 2006.
•Member of the Program Committee of RTCSA 2004 - 2007.
•Member of the Program Committee of ICPADS 2005.
Prof. Chih-Wen Hsueh
•Program Committee member: RTCSA 2000, 2003, 2004, 2005, EEE04, 05, ADSN
•Publication Chair: EEE04
•Registration Coordinator: RTAS 2001
•Program Co-chair: RTCSA 2006                                              34
Ⅴ.Future Developments
                        The curriculum of GINM should be evolutionary enhanced so that
                        the students graduate with most needed Networking and
     Education          Multimedia technology skills, cultivated skills and hands-on

                        GINM seeks the cooperation with research
                        institutes/universities in the country and all over the world.
                        GINM also accepts the admission from foreign countries and
     Research           welcomes the faculty member from foreign countries.
                        GINM should be recognized throughout the world as a leader in
                        the research of networking and multimedia in the near future.

                        For cooperation with research institutes and industry in the country,
                        GINM pursues the cooperation with other departments/institutes
 Industrial-academics   within NTU to promote the research results to the industry. Through
     collaboration      the interaction with the industry, the research agenda in GINM will
                        be highly related to the research and design needs of the industry
                        so as to advance the technology development.


To top