Dolby Trademark Agreement Guideline by ufn16927

VIEWS: 254 PAGES: 54

Dolby Trademark Agreement Guideline document sample

More Info
									         INTERNATIONAL ORGANISATION FOR STANDARDISATION
          ORGANISATION INTERNATIONALE DE NORMALISATION
                      ISO/IEC JTC 1/SC 29/WG 11
               CODING OF MOVING PICTURES AND AUDIO


                                       ISO/IEC JTC 1/SC 29/WG 11         N3376
                                                                                    June 2000
 Source:     Leonardo Chiariglione – Convenor
 Title:      Report of 52nd WG 11 meeting
 Status:



1. Opening
The 52nd WG11 meeting was held in Geneva, CH on 00/05/31-06/02 at the kind invitation of the
Swiss National Body.

2. Roll call of participants
The attendance list is given in annex 1.

3. Approval of agenda
The approved agenda is given in annex 2.

4. Allocation of contributions
The list of input documents is given in annex 3.

5. Communications from Convenor
There were no communications.

6. Report of previous meeting
The report of the Noordwijkerhout meeting was approved.

7. Processing of NB Position Papers
Papers from the National Bodies of FR, JP, UK, US were considered and responses drafted.

8. MPEG Phase 2
The following MPEG-2 amendments and corrigenda were approved:
ISO/IEC 13818-2:2000/DCOR1 (N3436)
DoC on ISO/IEC 13818-2:2000/PDAM1 (N3437)
ISO/IEC 13818-2:2000/FPDAM1 (N3438)
And the following request of amendment was made
Request for Amendment on 13818-1 for the carriage of metadata over MPEG-2 Transport (N3389)



                                                   1
9. MPEG Phase 4
   9.1.   Version 3
Amendment 2 of MPEG-4 Systems reached FPDAM (N3383).
The Working Draft of Amendment 2 of conformance was produced (N3384)
   9.2.   Version 4
The Working Draft of Amendment 3 of MPEG-4 Systems was produced (N3385)
   9.3.   Workplan
This was approved

10.MPEG Phase 7
The following working drafts were approved
     WD of 15938-1 (Systems)                                           N3390
     WD of 15938-2 (Description Definition Language)                   N3391
     WD of 15938-3 (Visual)                                            N3399
     WD of 15938-4 (Audio)                                             N3401
     WD of 15938-5(Multimedia Description Schemes)                     N3411
     WD of 15938-6 (Reference SW)                                      N3410
                                                                       N3398

11.MPEG phase 21
The MPEG-21 WD 0.2 (N3400) was approved.
The SC29 Secretariat was requested to change the title of the Project to Multimedia Framework.

12.Overall WG11 workplan
This was approved.

13.Liaison matters
A reduced number of liaison documents were produced.

14.Administrative matters
The plan of future meetings was approved.

15.Organisation of this meeting
   15.1. Tasks for subgroups
Tasks were assigned to subgroups.
   15.2. Joint meetings
The following joint meetings were held
Group 1     Group 2                  What                         Where     When
Systems     MDS, Req                 Profiles, packages           Req       Thu 09:00-10:00
Systems     Video, Audio             Binary                       Video     Thu 10:00-11:00
Req         MDS                      Conceptual modeling          MDS       Thu 10:00-10:30
MDS         ISG                      XM evolution                 MDS       Wed 17:00-18:00
MDS         Audio, Video, Systems DDL                             Req       Wed 18:00-19:30
Systems     MDS, Video               MPEG-7 and XMT               MDS       Thu 11:00-12:00


                                                2
Video      ISG                   XM integration           Video    Wed 16:00-17:00


16.Planning of future activities
The following ad hoc groups were established
3432 AHG on Audio, Video, MDS harmonization
3395 AHG on binary and dynamic MPEG-7 data representation
3433 AHG on Conceptual Modeling
3447 AHG on Core Experiments for color/texture descriptor in MPEG-7
3454 AHG on core experiments for shape/motion descriptors in MPEG-7
3455 AHG on editing text of MPEG-7 visual XM and WD
3430 AHG on Editing the Multimedia Description Schemes XM and WD
3435 AHG on Integration of MPEG-7, SMPTE, EBU/Pmeta Metadata
3452 AHG on MPEG-21
3451 AHG on MPEG-7 Applications & Promotion to Industry
3407 AHG on MPEG-7 Audio Core Experiments
3394 AHG on MPEG-7 DDL
3431 AHG on MPEG-7 DS Core Experiments
3450 AHG on MPEG-7 IPMP
3393 AHG on MPEG-7 Systems
3439 AHG on the study of MPEG-2 Video Content Description Data proposed amendment
3434 AHG on the TV-Anytime Application
3409 AHG on XM Development

17.Resolutions of this meeting
These were approved.

18.A.O.B
There were no other businesses

19.Closing
The Meeting closed at 21:40.




                                           3
                                        Annex 1
                                List of participants

LAST NAME      FIRST NAME    COMPANY                                NB
Scott          Ed
Tam            Audrey        JUT                                    AU
Vandewalle     Rik           RUG                                    BE
Reichhart      Witold        Starlab                                BE
Saraceno       Caterina      Starlab NV/SA                          BE
Haighton       Peter         Telexis Corporation                    CA
Nuttall        FX            audiosoft                              CH
Flasker        Dejan         Avicom Ltd                             CH
Ebrahimi       Touradj       EPFC                                   CH
Mattavelli     Marco         EPFL                                   CH
Abdeljaoued    Yousri        EPFL                                   CH
Fatemi         Nastaran      EPFL                                   CH
Tolga          Capin         EPFL                                   CH
Erne           Markus        ETHZ                                   CH
Ledermanu      David         Swisscom                               CH
Souher         Ben Yacour    Swisscom                               CH
Muller         Wolfgang      Univ. Geneva                           CH
Qi             Wei           Tsinghua                               CN
He             Yun           Tsinghua                               CN
Feiten         Bernahard     Deutsche Telekom (T-Nova)              DE
Brandenburg    Karlheinz     Fraunhofer IIS                         DE
Herre          Jürgen        Fraunhofer IIS                         DE
Weber          Walter        Blaxxun Interactive                    DE
Putz           Wolfgang      GMD-IPSI                               DE
Ohm            Jens-Rainer   HHI                                    DE
Meiers         Thomas        HHI                                    DE
Smolic         Aljoscria     HHI                                    DE
Heuer          Joerg         Siemens AG                             DE
Herrmann       Stephan       TU-Munich                              DE
Wollborn       Michael       University of Hannover                 DE
Klefenz        Frank         University of Menar                    DE
Conde          Jorge         SGAE                                   ES
Palmeno        Juan          SGAE                                   ES
Villegas       Paulo         Telefonica                             ES
Salembier      Philippe      Universitat Politecnica de Catalunya   ES
Martinez       Jose          UPM                                    ES
Huopaniemi     Jyri          Nokia                                  FI
Väänänen       Mauri         Nokia Research Center                  FI
Boughoufalam   Souhila       ENST                                   FR
Bouilhaguet    Frederic      ENST                                   FR
Dufourd        Jean-Claude   ENST                                   FR
Hoogforst      Philippe      ENST                                   FR
Mary           Didier        FIAPF                                  FR
Avaro          Oliver        France Telecom R&D                     FR
Preteux        Françoise     INT                                    FR
Zaharia        Titus         INT                                    FR
Amatriain      Xavier        IRCAM                                  FR


                                           4
de Cheveign    Alanin      IRCAM                            FR
Plamann        Tobias      IRCAM                            FR
Puig           Vincent     IRCAM                            FR
Devillers      Sylvain     LEP                              FR
Ruiloba        Rosa        LIP-6/UPMC                       FR
Benoit         Mory        Philips LEP                      FR
Guez           Marc        SCPP                             FR
Guezvucher     Marc        SCPP                             FR
Seyrat         Claude      UPMC                             FR
Strintzis      Michael     University of Thessaloniki       GR
Lifshitz       Zvi         Optibase Ltd.                    IL
Gill           Aharon      Zoran Microelectronics Ltd.      IL
Sannar         Gomathi     Silicon Automation Systems       IN
Sherlekar      Sunil       Silicon Automation Systems       IN
Chiariglione   Leonardo    CSELT                            IT
De Petris      Gianluca    CSELT                            IT
Di Cagno       Gianluca    CSELT                            IT
Franceschini   Guido       CSELT                            IT
Graziani       Andrea      StMicroelectronics               IT
Marchisio      Claudio     StMicroelectronics               IT
Leonardi       Riccardo    University of Br                 IT
Yamakage       Tomoo                                        JP
Kaneko         Itari       ASCII                            JP
Shiiyama       Hirotaka    Canon Inc.                       JP
Masahiko       Takaku      Canon Inc.                       JP
Hasida         Koiti       ETL                              JP
Kazui          Kimihiko    Fujitsu                          JP
Fujita         Takehiro    Hitachi, Ltd                     JP
Azami          Tomohiro    JVC                              JP
Sugano         Masaru      KDD R&D Labs                     JP
Emura          Koichi      Matsushita Electric Industrial   JP
Kogure         Takuyo      Matsushita Electric Industrial   JP
Asai           Kohtaro     Mitsubishi Electric              JP
Kazuo          Sugimoto    Mitsubishi Electric              JP
Iwadare        Masahiro    NEC                              JP
Yamada         Akio        NEC                              JP
Shibata        Masahiro    NHK                              JP
Shishikui      Yoshiaki    NHK                              JP
Sakamoto       Hideaki     NTT                              JP
Sekiguchi      Shun-ichi   NTT Do.Co.Mo.                    JP
Fukunaga       Shigeru     Oki Electric Industry            JP
Tomohiro       Miyazaki    Oki Electric Industry            JP
Day            Neil        Ricoh Company, Ltd.              JP
Tokumo         Yasuaki     Sharp Corporation                JP
Tomioka        Yoshiaki    Sharp Corporation                JP
Watanabe       Shuichi     Sharp Corporation                JP
Bossen         Frank       Sony Corporation                 JP
Kuhn           Peter       Sony Corporation                 JP
Shibata        Yoshiaki    Sony Corporation                 JP
Suzuki         Teruhiko    Sony Corporation                 JP
Tahara         Katsumi     Sony Corporation                 JP


                                          5
Walker          Toby         Sony Corporation                       JP
Hori            Osamu        Toshiba Corporation                    JP
Toshinori       Odaka        Toshiba Corporation                    JP
Yamada          Hisashi      Toshiba Corporation                    JP
Watanabe        Toshiaki     Toshiba Corporation                    JP
Kaneko          Toshimitsu   Toshiba Corporation                    JP
Aoki            Teramasa     University of Tokyo                    JP
Jung            Ki Young     DNC Tech Inc                           KR
Lee             Jaekwang     DNC Tech Inc                           KR
Won             Chee Sun     Dongguk University                     KR
Jeon            Jun Genn     ETRI                                   KR
Won             Jeong Wook   ETRI                                   KR
Kim             Munchurl     ETRI                                   KR
Kyeongok        Kang         ETRI                                   KR
Lim             Young-Kwon   ETRI                                   KR
Park            Soo Jun      ETRI                                   KR
Chang           Hyun Sung    ETRI                                   KR
Kim             Whoi-Yul     Hangang University                     KR
Sim             Dong-Gyu     Hyundai Electronics                    KR
Chung           Jae Won      Hyundai Electronics                    KR
Lee             Sangyeun     Korea Telcom                           KR
Kim             Heon Jun     LG Corporate Institute of Technology   KR
Cha             David        LG Electronics                         KR
Gu              Sewan        LG Electronics                         KR
Lee             Jin-Soo      LGCIT                                  KR
Song            Jungmin      LGCIT                                  KR
Yoon            Kyoungro     LG-ELITE                               KR
Choi            Vanglim      Samsung Electric Company               KR
Lee             Yung Lyul    Samsung Electronics                    KR
Kim             Hae-Kwang    Sejong University                      KR
Dashti          Ali          Kuwait University                      KW
Chaubeau        Andre        FIAPF                                  liaison
Shapiro         Ted          MPA/FIAPF                              liaison
Nack            Frank        CWI                                    NL
Mies            Ronald       KPN Research                           NL
Koenen          Rob          KPN Research                           NL
Mulder          Peter        NOB                                    NL
Van Der Meer    Jan          Philips                                NL
Gelissen        Jean         Philips Research                       NL
Oltmans         Erik         Telematica Institute                   NL
Pedersen        Lena         Telenor R&D                            NO
Santos          Ernesto      Imesc Porto                            PT
Pereira         Fernando     IST                                    PT
Rowe            Simon                                               SE
Christopoulos   Charilaos    Ericsson                               SE
Bjork           Niklas       Ericsson                               SE
Lindquist       Morgan       Ericsson Research                      SE
Cognell         Anna         Telia Research                         SE
Dalquist        Marie        Telia Research                         SE
Lin             Weisi        IME                                    SG
Powell          Ged          Infineon                               SG


                                           6
Tian            Qi              Kent Ridge Digital Labs              SG
Wang            Lei             Panasonic Singapore Laboratories     SG
Soon            LimChong        PSI                                  SG
Smith           Jim             British Standards                    UK
Morrison        Geoff           BT                                   UK
Charlesworth    Jason           Canon Research Centre                UK
Garner          Phil            Canon Research Centre Europe, Ltd.   UK
Armati          Douglas         InterTrust                           UK
Rump            Niels           InterTrust                           UK
Lopes           Rui             Lancaster University                 UK
Hill            Keith           MCOS LTD                             UK
Cooper          James           Mitsubishi                           UK
Bober           Miroslaw        Mitsubishi Electric                  UK
Cieplinski      Leszek          Mitsubishi Electric                  UK
Grant           Catherine       Nine Tiles                           UK
Potter          Stephen         Scipher-QED                          UK
Bray            Ahvar (?)       UBQT Media                           UK
Bangham         J Andrew        UEA Norwich                          UK
McGinty         Michael         AKD Dot Net                          US
Mantegna        John            America Online                       US
Singer          David           Apple Computer                       US
Quackenbush     Schuyler        AT & T                               US
Morgan          Oliver          Avid Technology, Inc.                US
Rynderman       Michel          Avid Technology, Inc.                US
Benitez         Ana             Columbia University                  US
Eleftheriadis   Alexandros      Columbia University                  US
Jot             Jean Marc       Creative ATC                         US
Goodman         Ron             Creative Technologies                US
Strat           Thomas          DiamondBack Vision, Inc              US
Haidamus        Ramzi           Dolby Laboratories                   US
Topiwala        Pankaj          FastVideo LLC                        US
Goldman         Matthew         Harmonic                             US
McFarland       Thomas          Hewlett-Packard Company              US
Burns           Ron             HRL                                  US
Dao             Son             HRL                                  US
Yang            Chao-Kung       Hughes Electronics                   US
Kim             Michelle        IBM                                  US
Schirling       Peter           IBM                                  US
Wood            Stephen         IBM TJ Watson Research               US
Smith           John            IBM Watson                           US
Ahanger         Gulrukh         Informix Software                    US
Pendakur        Ramesh          Intel Corporation                    US
Gray            Patricia        Intel Corporation                    US
Iverson         Vaughn          Intel Corporation                    US
Coffin          Zachary         KPMG Consulting                      US
Paley           Mark            Liquid Audio                         US
Tescher         Andrew          Lockheed-Martin                      US
Tabatabai       Ali             Media Soft Labs-Sony Electronics     US
Casey           Michael         MERL                                 US
Sullivan        Gary            Microsoft                            US
Fritsch         Jean- Georges   Minerva Networks, Inc.               US


                                              7
Kim           Youngmoo      MIT Media Lab              US
Vetro         Anthony       Mitsubishi                 US
Narasimhan    Sam           Motorola                   US
Rubinfeld     Mike          NIST                       US
Jeannin       Sylvie        Philips Research           US
Cates         Joseph        RIAA                       US
Huang         Sijun         Scientific Atlanta, Inc.   US
Sezan         Ibrahim       Sharp                      US
Messing       Dean          Sharp Labs of America      US
van Beek      Peter         Sharp Labs of America      US
Hawley        Rising        Sony Corporation           US
Swaminathan   Viswanathan   Sun Microsystems           US
Jorgensen     Corrine       SUNY Buffalo               US
Lu            Jiuhuai       Tektronix, Inc.            US
Yu            Haoping       Thomson Cons. Ele.         US
Manjunath     B.            UCSB                       US
Chen          Sho Long      VWGB Corp.                 US




                                           8
                   Annex 2
                  Agenda

1.        Opening
2.        Roll call of participants
3.        Approval of agenda
4.        Allocation of contributions
5.        Communications from Convenor
6.        Report of previous meeting
7.        Processing of NB Position Papers
8.        MPEG Phase 2
8.1       Workplan
9.        MPEG Phase 4
9.1       Version 3
9.1.1     Requirements
9.1.2     Tools
9.1.3     Amendment
9.2       Version 4
9.2.1     Requirements
9.2.2     Tools
9.2.3     Amendment
9.5       Workplan
10.       MPEG Phase 7
10.1      Requirements
10.2      Tools
10.2.1    Systems
10.2.2    Description Definition Language
10.2.3    Visual
10.2.4    Audio
10.2.5    Description Schemes
10.2.6.   Reference software
10.3      Working Drafts
10.4      Workplan
11.       MPEG phase 21
12.       Overall WG11 workplan
13.       Liaison matters
14.       Administrative matters
14.1      Schedule of future MPEG meetings
14.2      Promotion of MPEG
15.       Organisation of this meeting
15.1      Tasks for subgroups
15.3      Joint meetings
16.       Planning of future activities
17.       Resolutions of this meeting


                      9
18.   A.O.B
19.   Closing




                10
                                                   Annex 3
                                      List of input documents
 No.                  Source                                              Title
5968   Pete Schirling                        Document Register for 52nd meeting in Geneva, CH
5969   Olivier Avaro                         Systems March 2000 Meeting Report
5970   ITU-R JWP 10-11Q                      Liaison Statement
5971   Carsten HERPEL                        Draft Integration of Systems COR1 (N3278) into IS14496-1
                                             (N2501)
5972   Carsten HERPEL                        MPEG-4 Systems Overview Slides (presented in
                                             Noordwijkerhout)
5973   The SC 29 Secretariat                 Summary of Voting on JTC 1 NP: Digital audio-visual
                                             framework (MPEG-21)
5974   Zvi Lifshitz                          IM1 Core code + authoring tools version 4.3
5975   SC 29 Secretariat                     Late Comments on ISO/IEC 13818-2:2000/PDAM 1 (SC 29
                                             N 3611)
5976   JNB                                   Request for Corrigendum to 13818-2
5977   Whoi-Yul Kim, Yong-Sung Kim,          The detailed description of ART (Angular Radial Transform)
       Young-Sum Kim, Dong-Gyu Sim           Descriptor
5978   Sangyoun Lee, Hae-kwang Kim,          Cross check result of CE on CT4, Edge Histogram Descriptor
       YoungSik Choi, Sang-hong Lee
5979   Whoi-Yul Kim, Yong-Sung Kim,          Results of the CE on the region-based shape descriptor
       Dong-Gyu Sim, Young-Sum Kim           focusing on the retrieval accuracy versus descriptor size
5980   ITTF                                  Table of Replies on ISO/IEC 13818-6/FDAM 2 (SC 29 N
                                             3637)
5981   IEC TC 100                            IEC NP (61937-6): Interface for non-linear PCM encoded
                                             audio bitstreams applying IEC 60958 -- Part 6: Non-linear
                                             PCM bitstreams according to the MPEG2 AAC format(s) (SC
                                             29 N 3638)
5982   IEC TC 100                            IEC NP (61937-7): Interface for non-linear PCM encoded
                                             audio bitstreams applying IEC 60958 -- Part 7: Non-linear
                                             PCM bitstreams according to the ATRAC and ATRAC2/3
                                             formats (SC 29 N 3639)
5983   Patty Gray, Katsumi Tahara            MPEG-2 Video Amendment AHG Report
5984   Soo-Jun Park/ Chee Sun Won, Dong      Core Experiments on MPEG-7 edge histogram descriptors
       Kwon Park
5985   Niels Rump, Keith Hill                MPEG-7 IPMP AHG Report
5986   Niels Rump                            MPEG-7 Requirements Document V10a
5987   Akio Yamada, Eiji Kasutani            Result of Core Experiment on CT3, Color Layout Extension
                                             for video segment DS
5988   Akio Yamada, Eiji Kasutani            Updated Reference Software for Color Layout Descriptor
5989   Simon Rowe, Michael Taylor            Gaze in MPEG-4 Multi-user
5990   Youngmoo Kim                          Core experiment proposal for a melody DS
5991   B. S. Manjunath, V. Vinod             Report of the AHG on Color/Texture Core Experiments
5992   Rosa Ruiloba, Philippe Joly           Comparative study between SMPTE standard on Transfer of
                                             Edit Decision Lists and VideoEditing DS.
5993   Rosa Ruiloba, Philippe Joly           Validation Experiment for VideoEditing DS
5994   Rosa Ruiloba, Philippe Joly           A synthetic and analytic DS to describe digital video editing
                                             processes
5995   A. G. Tescher for USNB                USNB Contribution: Technical Corrigendum of ISO/IEC
                                             13818-2
5996   A. G. Tescher for USNB                USNB Contribution: ITU-T Rec. H.262 ³ ISO/IEC 13818-
                                             2:2000/PDAM1 text
5997   A. G. Tescher for USNB                USNB Contribution: Test bit streams in ITU-T Rec. H.262 ³
                                             ISO/IEC 13818-4:2000
5998   A. G. Tescher for USNB                Timely publications of conformance specifications
5999   Ibrahim Sezan, Gandhi Vaithilingam,   Report of AhG on the TV-Anytime Application
       Carsten Herpel, Jean Pierre Evain
       (Chairpersons)



                                                      11
 No.                 Source                                              Title
6000   Lei Wang, Thiow Keng Tan               Experimental Results of Face Description Based on the 2nd-
                                              order Eigenface Method
6001   Lei Wang, Thiow Keng Tan               Experimental Results of Face Description Based on the 2nd-
                                              order Eigenface Method
6002   Peter Kuhn, Teruhiko Suzuki,           Report on the Transcoding Hint DS Core Experiment
       Anthony Vetro, John R. Smith, Ana
       B. Benitez, Charilaos Christopoulos
6003   Peter Kuhn                             Cross Verification Results of the CE on Spatial Localized
                                              Motion Activity (CE MS3)
6004   Lei Wang, Thiow Keng Tan               The results of Cross-check for Face Description Core
                                              experiment CT6
6005   Mark Pickering, Michael Frater, John   Results of the Core Experiment on Face Descriptors
       Arnold
6006   Dulce Ponceleon, Peter van Beek,       Report on the CE on Summarization Description Schemes
       Ibrahim Sezan, Osamu Hori, Masaru
       Sugano, Nevenka Dimitrova,
       Gulrukh Ahanger, C. Christopoulos ,
       Y. Abdeljoued
6007   Philippe Salembier, Peter van Beek,    MPEG-7 Multimedia Description Schemes XM (Version 2.1)
       Ana B. Benitez, Joerg Heuer, Jose
       Martinez, John Smith, Toby Walker
6008   Philippe Salembier, Peter van Beek,    MPEG-7 Multimedia Description Schemes WD (Version 2.1)
       Ana B. Benitez, Joerg Heuer, Jose
       Martinez, John Smith, Toby Walker
6009   Philippe Salembier, Peter van Beek,    Report of the AHG on Editing the MDS XM and WD
       Ana B. Benitez, Joerg Heuer, Jose
       Martinez, John Smith, Toby Walker
6010   Masahiro Shibata, Yeun-Bae Kim         Report of the Core Experiment on Description Schemes for
                                              Linguistic Structure (For the part of Linguistic Annotation
                                              DS)
6011   Fernando Pereira                       About Profiling in MPEG-7
6012   Riccardo Leonardi                      Ad-hoc Group report: Mpeg-7 Semantic Information
                                              Representation
6013   The National Body of Japan (JNB)       Comments on ISO/IEC13818-2:2000/PDAM1
6014   Benoit Mory                            Report on camera motion core experiment : Compactness &
                                              quantization
6015   Jose M. Martinez                       Report of the AHG on the Overview of MPEG-7
6016   Karsten Müller, Jens-Rainer Ohm        Results of 2D/3D Shape Core Experiments MS-6
       (HHI), James Cooper (Mitsubishi
       Electric ITE), Miroslaw Bober
       (Mitsubishi Electric ITE)
6017   Blaise Lugeon, John R. Smith           Informative Report on development of an MPEG-7 Visual
                                              Annotation Tool
6018   Dean Messing, Peter van Beek,          Results of CE CT1 on Color Spaces and Color Quantization
       Ibrahim Sezan
6019   Jim Errico, Peter van Beek, Ibrahim    MPEG-7 XM Software Integration of User Preference DS: A
       Sezan                                  Content Filtering Agent
6020   John R. Smith, Hawley K. Rising III    Report of the AHG on Conceptual Modeling
6021   John R. Smith on behalf of MPEG-7      MPEG-7 Principal Concepts List (V0.8)
       Conceptual Modeling AHG
6022   P. van Beek, Y. Tomioka, K. Yoon,      Report of CE on User Preference DS
       G. Vaithilingam, I. Sezan
6023   Ana Benitez, Toby Walker, Hawley       Work Plan for Core Experiment on Entity-Relationship Graph
       Rising, Ajay Divakaran                 DSs
6024   Jiuhuai Lu, Guy Cherry                 Proposal of A Description Scheme for Media Quality
6025   Jane Hunter, Claude Seyrat             Report of the MPEG-7 DDL AHG
6026   Jane Hunter                            MPEG-7 DDL WD 2.0
6027   Yoshiaki Shibata , Jin-Soo Lee,        Report on Core Experiment for the Weight DS
       Koichi Emura



                                                       12
 No.                  Source                                              Title
6028   Tsutomu Ando, Hiroshi Inoue,          Conceptual draft of Call for Proposals for an advanced IPMP
       Masahiko Takaku                       system
6029   Patrick Ndjiki-Nya, Jan Restat,       Subjective Evaluation of the MPEG-7 Retrieval Accuracy
       Thomas Meiers, Jens-Rainer Ohm,       Measure (ANMRR)
       Anneliese Seyferth, Ruediger
       Sniehotta
6030   Jens-Rainer Ohm, Bela Makai           Results of CE CT1 on interoperability between different color
                                             histogram quantizations
6031   Jens-Rainer Ohm, Bela Makai           Results of CE CT5 on scalable representation of color
                                             histograms
6032   Oscar Fernandez, Jose M. Martinez,    Report on Intermediate Results of the Core Experiment on the
       Clara Garcia                          Controlled Term D
6033   Jose M. Martinez (on behalf of the    MPEG-7 harmonisation with existing practices (version 0.1)
       MedMet AHG)
6034   Jose M. Martinez (on behalf of the    Report of the AHG on Media and Meta DSs and
       MedMet AHG)                           Harmonization with other Schemes
6035   Shuichi Watanabe, Yasuaki Tokumo      Implementation Details of CE on Spatial Localized Motion
                                             Activity (CE MS3)
6036   Yasuaki Tokumo, Shuichi Watanabe      CE methodology and dataset on Spatial Localized Motion
                                             Activity (CE MS3)
6037   Yasuaki Tokumo, Shuichi Watanabe      Results of CE on Spatial Localized Motion Activity (CE
                                             MS3)
6038   Xin Xing, Lansun Shen, Kongqiao       Automatic Human Face Detection
       Wang, Kebin Jia
6039   Jim Atkinson, Miroslaw Bober          Report on further optimisation of the Contour Shape
                                             Descriptor
6040   Miroslaw Bober, Jim Atkinson          New results and modifications to the CSS Contour based
                                             Shape Descriptor
6041   Philip N. Garner, Yoshiaki Shibata    Report of MPEG-7 DDL Integration Ad-Hoc Group
6042   P. N. Garner, J. J. Rajan             Validation Report for Sound Effects Core Experiment
6043   Sylvie Jeannin, Leszek Cieplinski,    Report of the AHG on editing the MPEG-7 Visual XM and
       Jens Rainer Ohm, Munchurl Kim         WD documents
6044   Sylvie Jeannin, Leszek Cieplinski,    MPEG-7 Visual Part of Experimentation Model, Version 5.1
       Jens Rainer Ohm, Munchurl Kim
6045   Sylvie Jeannin, Leszek Cieplinski,    MPEG-7 Visual Part of Working Draft, Version 2.1
       Jens Rainer Ohm, Munchurl Kim
6046   Perfecto Herrera, Xavier Amatriain,   Core experiment on timbre similarity for non-sustained
       Geoffroy Peeters, Tobias Plamann      sounds
6047   Joerg Heuer, Andre Kaup               Report on Core Experiment on RegionLocator
6048   Joerg Heuer, Dulce Ponceleon, Eric    Results on Time CE
       Rehm
6049   Joerg Heuer, Andre Kaup, Sanghoon     Proposal of a ReferenceDefinitions DS
       Sull
6050   E.Hartley, on behalf of UKNB          United Kingdom National Body Position on WWW & FTP
                                             Services
6051   E. Hartley on behalf of the UK        UK position on participation in the work of SC29/wg11
       National Body
6052   Sylvie Jeannin, Santhana              Crosscheck of CT5: Scalable representation of color
       Krishnamachari                        histograms
6053   Keith Hill                            MPEG-21 AHG Report
6054   Ajay Divakaran, Kadir Peker,          Update on Core Experiment on Spatial Distribution of Motion
       Anthony Vetro, Huifang Sun            Activity
6055   Takehiro Fujita, Takafumi Miyatake    Results of Core Experiment on ColorLayout Extension for
                                             Video Segment DS (CT3)
6056   Osamu Hori, Toshimitsu Kaneko,        A Proposal for the Temporal Interpolation Descriptor
       Sylvie Jeannin
6057   Hyun Sung Chang, Jae-Gon Kim,         Improved Structure of HierarchicalSummary DS
       Munchurl Kim, and Jinwoong Kim
6058   Ana B. Benitez on behalf of the AHG   Report of the AHG on MPEG-7 DS Validation and Core



                                                      13
No.                   Source                                              Title
       on the MPEG-7 DS Core                  Experiments
       Experiments
6059   Ana B. Benitez, Hawley Rising, Toby    Work Plan for Core Experiment on Entity-Relationship Graph
       Walker, Ajay Divakaran                 DSs
6060   Young-Woo Yoon, Kee-Hwan Park,         An application of MPEG-7 shape descriptor for trademark
       Tae-Hwan Yang, Whoi-Yul Kim            retrieval system
6061   Michael Wollborn, Sven Bauer,          Binary format for multimedia description structures
       Andreas Engelsberg, Jens Rainer
       Ohm
6062   AHG on MPEG-7 Semantic                 Report of the CE on the Semantic DS
       information representation
6063   Changduck Suh, Whoi-Yul Kim            A New Metric to Measure the Retrieval Effectiveness for
                                              Evaluating Rank-base Retrieval Systems
6064   Jae-Ho Kwak, Whoi-Yul Kim              Result of CT2 CM bit optimization
6065   Kyoungro Yoon, Jin-Soo Lee,            Improvements of User Preferences DS for Filtering Operation
       Jungmin Song, Hee-Yeon Lee             and Storage Efficiency
6066   Heon Jun Kim, Jin-Soo Lee,             Result of CT1: Color spaces and Interoperability between
       Kyoungro Yoon                          different quantizations - Color Histogram and Color Structure
                                              Histogram
6067   Heon Jun Kim, Jungmin Song             Result of CT2: Confidence Measure Bit Optimization in
                                              Dominant Color Descriptor
6068   Munchurl Kim                           Cross-verification results of Region based Shape Descriptors
6069   Osamu Hori, Toshimitsu Kaneko,         A Proposal for the Spatial Coordinate System Descriptor
       Joerg Heuer, Aljoscha Smolic, Jens-
       Rainer Ohm, Sylvie Jeannin
6070   Audrey Tam, Koiti Hasida, Masahiro     Report of the CE on DSs for Linguistic Structure
       Shibata
6071   Jun Geun Jeon, Young-Kwon Lim,         A proposal for the encoding hints in the XMT framework
       Myoung Ho Lee, Chieteuk Ahn
6072   Miroslaw Bober                         MS7- core experiment cross verification results
6073   Stephan Herrmann                       Report of AHG on XM Development
6074   Neil Day, Kate Grant, Caterina         Building Guidelines on the Usage of XM Description Tools
       Saraceno, Witold Reichart              and Beyond
6075   Neil Day, Witold Reichart, Caterina    Report of the AHG on MPEG-7 Applications and Promotions
       Saraceno                               to Industry
6076   HASIDA Koiti                           Semantics of References and Links
6077   Ahmet Ekin, Rajiv Mehrotra, A.         Suggestions to SemanticDS Syntax
       Murat Tekalp
6078   A Lindsay, M Casey, G Peeters, A de    Report of AHG on MPEG-7 Audio Core Experiments
       Cheveigne, J Charlesworth, S
       Pfeiffer, S Quackenbush
6079   Audrey Tam, Koiti Hasida, Masahiro     Recommendations of the CE on DSs for Linguistic Structure
       Shibata
6080   Alain de Cheveigne                     Scalable Series update
6081   C. Dorai, R. Bolle, N. Dimitrova, L.   Core Experiments on the VideoText DS
       Agnihotri, Gang Wei
6082   G.Vaithilingam, I. Sezan, P. vanBeek   Core Experiment on Media Review DS
6083   Neil Day, Caterina Saraceno, Witold    List of MPEG-7 Applications, Projects and Papers
       Reichart
6084   Neil Day                               Interoperability: How Style sheets can help MPEG-7
                                              Applications Development
6085   P. N. Garner                           Spoken Content as Annotation
6086   Alain de Cheveigne                     A note-lattice descriptor for melody
6087   Gary J. Sullivan                       Issues regarding MPEG-4 video motion vector difference
                                              calculation
6088   Anthony Vetro, Huifang Sun and         Adaptive object-based transcoding using shape and motion-
       Ajay Divakaran                         based hints
6089   Anthony Vetro                          Verification of Motion Hint for Reduced Complexity
                                              Encoding



                                                       14
 No.                  Source                                               Title
6090   Anthony Vetro                          Verification of Difficulty Hint for CBR-to-VBR Conversion
6091   Oliver Morgan                          AHG Report, MPEG 7 Integration with SMPTE, EBU
6092   Oliver Morgan                          AHG Report, MPEG 7 Systems
6093   Oliver Morgan                          MPEG 7 Systems V0.4 input
6094   Oliver Morgan                          Liaison input from SMPTE
6095   Oliver Morgan                          SMPTE RP205 - Application of Unique Material Identifiers
6096   Oliver Morgan                          SMPTE RP210.2 Draft Metadata Dictionary Version 2
6097   Oliver Morgan                          Presentation on SMPTE Metadata
6098   Oliver Morgan                          Proposed DS for Authoring
6099   Wolfgang M³ller, Henning M³ller,       MRML: A Communication Protocol for Content-Based Multi
       Stiphane Marchand-Maillet, Thierry     Media Retriev
       Pun, David McG. Squire, Zoran
       Pecenovic, Christoph Giess, Arjen P.
       de Vries
6100   Sylvie Jeannin, Miroslaw Bober         Report of the AHG on Motion and Shape Core Experiments
6101   Philippe Hoogvorst                     Core Experiment on 3D Shape: Filtering of the 3D Mesh
                                              VRML Models
6102   Michael A. Casey                       Sound Effects CE and ICA Descriptor Interim Report
6103   Titus Zaharia, Francoise Preteux       3D Shape Core Experiment: The influence of mesh
                                              representation
6104   Titus Zaharia, Francoise Preteux       3D Shape Core Experiment: Semantic versus geometric
                                              categorization of 3D mesh models
6105   Photina Jaeyun Jang, Chalapathy        Interaction Description Schemes
       Neti, Stephane Maes
6106   Hawley K. Rising III, Ali Tabatabai    Proposed Schema for Command DS
6107   Hawley K. Rising III                   Report on CE on Entropy Measurement
6108   Hawley K. Rising III                   Update on Mathematical Model
6109   Hawley K. Rising III, Ali Tabatabai    Comments on the syntax of DS in MDS WD 2.1
6110   Michelle Kim, Olivier Avaro, Mikael    Extensible MPEG-4 Textual Format (XMT)
       Bourges-Sevenier, Lai-Tee Cheok,
       Aaron Cohen, Alex Eleftheriadis,
       Rich Rafey, John Smith, Steve Wood
6111   Hirotaka Shiiyama                      The relationship between Ds/DSs and MPEG stream
6112   Toby Walker                            Some Comments & Issues for the MDS WD
6113   Alejandro Jaimes, Corinne Jorgensen,   Report of CE on Multi-Level Indexing Pyramid
       Ana B. Benitez, Shih-Fu Chang
6114   Alejandro Jaimes, Ana B. Benitez,      Multiple Level Classification of Audio Descriptors
       Shih-Fu Chang
6115   Michelle Kim                           AHG Report on Extensible MPEG-4 Textual Format (XMT)
6116   IEC TC 100                             IEC NP: Baseline Digital Terrestrial Television Specification
                                              -- Part 1: Receivers for the DVB-T system (SC 29 N 3651)
6117   IEC TC 100 via the SC 29 Secretariat   Liaison Document of IEC TC 100 Advisory Group on
                                              Strategy
6118   French National Body                   Request for a Call for evidence justifying the testing of audio
                                              coding technology




                                                       15
                                             Annex 4
                                Requirements Group Report

Source: Rob Koenen, Keith Hill

20.MPEG-4
The MPEG-4 Overview was updated with text on the new work items and subjective test results.
(N3444)

21.MPEG-7
   21.1. IPMP
m5985 Niels Rump, Keith Hill — MPEG-7 IPMP AHG Report
The MPEG-7 IPMP requirements were further detailed, to the satisfaction of meeting participants.
During the plenary meeting, however, concerns were voiced, especially with respect to section
4.5.2, requirement 3. It was decided to keep the document (N3446) in a draft status, and to not make
it publicly available. NB‘s are requested to give input to the 53rd meeting.

m5999 Ibrahim Sezan, Gandhi Vaithilingam, Carsten Herpel, Jean Pierre Evain (Chairpersons) —
Report of AhG on the TV-Anytime Application
The TV Anytime metadata requirements contain many IPMP related statements. MPEG has not
evaluated these requirements from an IPMP point of view, but the meeting agreed that this was
necessary. After a brief introduction of these requirements by the chair of the TVA AHG, the work
will further be carried out in the MPEG-7 IPMP AHG (N3450).
   21.2. Industry Focus and Overview
m6015 Jose M. Martinez — Report of the AHG on the Overview of MPEG-7
m6075 Neil Day, Witold Reichart, Caterina Saraceno — Report of the AHG on MPEG-7
Applications and Promotions to Industry
m6074 Neil Day, Kate Grant, Caterina Saraceno, Witold Reichart — Building Guidelines on the
Usage of XM Description Tools and Beyond
m6083 Neil Day, Caterina Saraceno, Witold Reichart — List of MPEG-7 Applications, Projects
and Papers (if available)

Not much happened in the AHG on the Overview, unfortunately. The work will move to the AHG
on Applications & Promotion to Industry. This activity wants to make available industry-specific
documentation, so it must be possible to make at least one MPEG-7 Overview that is readable tot
the non-initiated. A new MPEG-7 Overview was issued nonetheless (N3445).

The group working on Applications and Promotions to Industry (Industry Focus Group) will take up
a number of activities to promote MPEG-7 to industry and to seek input in return.
Notably, the following will be done: (a complete set of activities can be found in N3448)
1) A workshop (MPEG-7 Awareness Event) will be organised in Paris on Friday 20 October, with
    invited speakers and MPEG-7 speakers.
2) A website will be created using the domain name mpeg-7.com. This website will contain
    information on MPEG-7 uses, be a forum for discussion and contain demo applications.
3) Documentation will be developed, both generic and industry-specific.

An AHG will work on this. (N3451)
   21.3. Conceptual Modeling
m6020 John R. Smith, Hawley K. Rising III — Report of the AHG on Conceptual Modeling


                                                16
m6021 John R. Smith on behalf of MPEG-7 Conceptual Modeling AHG — MPEG-7 Principal
Concepts List (V0.8)
The principal concepts list has proven of great use to the requirements work. In particular, on two
points: the distinction between Ds and DSs and the tracing of unmet requirements.

1) The meeting decided that the distinction between Ds and DSs is useful in thinking and talking
   about the MPEG-7 Standard. It was also decided to adopt the proposal of the AHG to define Ds
   and DSs respectively according to the following criteria:
 Descriptors are defined as concepts that are attributes
 Description Schemes are defined as concepts that are entities and relationships
 The definitions in the requirements document will be updated accordingly

2) The meeting decided that during the next meeting, decisions need to be taken to either start
   work on unmet requirements or to drop these requirements.

   21.4. Profiles and related issues
(in a joint meeting with Audio, ISG, MDS, Systems and Video)
m6011 Fernando Pereira — About Profiling in MPEG-7
A long and interesting discussion resulted from this contribution. It was clear the profiles are meant
to restrict complexity in MPEG-7 devices that do not need certain functionality, but would rather be
burdened by it.
It became also clear that profiling needs depend very much on
 What is expected from a parser and how complicated this parser is.
 How normative behaviour is defined. If only parsing is required, the needs for profiling may be
    limited.
In MPEG-1, -2 and -4, paramaters like bitrate played a large role in defining conformance points. It
is not clear how this will be for MPEG-7, although one can imagine that there is a limited to what
e.g. a broadcast receiving device can cope with, when realtime metadata is sent to the decoder.
It was clear that we want as few profiles as possible, and as few profile dimensions as possible. The
discussion will continue with taking one example, to move the discussion from abstract to concrete.
The example chosen is the TVanytime application.

m6017 Blaise Lugeon, John R. Smith — Informative Report on development of an MPEG-7 Visual
Annotation Tool
After hearing this presentation, the following conclusion were drawn:
 The contributors propose to define a package DS. The meetings agrees that this is useful, and
   that a package DS could be added tot the MPEG-7 Standard.
 The DS could be an answer to the question of how to provide a root – or a wrapper, since we the
   structure is like a forest, not a tree.
 More thought needed for restrictions in packages, e.g. depth, recursion in hierarchical DSs
 Perhaps fixed packages can be used to define profiles – if need may be.

m6084 Neil Day — Interoperability: How Style sheets can help MPEG-7 Applications Development
After hearing this presentation, the following conclusion were drawn:
 Style sheets can be used for various purposes without explicit support in the MPEG-7 Standard,
   given that we have chosen to adopt XML Schema Language
 Style sheets may also be used to define interfaces with other standards, as a translation
   mechanism.
 It may be desirable to define style sheets normatively when they are used for translation
   purposes.


                                                 17
22.MPEG-21
m6053 Keith Hill — MPEG-21 AHG Report
MPEG-21 has been formally approved by SC29 as a new work item for WG11. The task of
developing the Technical Report continued, with the objective of producing a Committee Draft by
the conclusion of the 53rd meeting in Beijing. MPEG-21 is gaining a critical mass of participants
from a cross-section of industries who have an interest in defining a vision for an integrated
multimedia framework. Some time was spent during the Geneva meeting to provide new
participants with a rapid overview of the work of MPEG-21 to date.
A second working draft (N3400) was published at the end of the meeting. The major changes
include:
    1. A high-level vision statement and goal for MPEG-21, and sub-goals for each of the
        ‗elements‘ which comprise the framework.
    2. An elaboration about the component architectures of a multimedia framework.
    3. Development of the 6 ‗elements‘ of the framework (within ‗breakout‘ groups).
    4. The first version of a glossary to support the Technical Report.

The mandate of the ‗ad-hoc‘ group until Beijing (N3452) reflects the demanding timescale for the
delivery of the Technical Report. The proposed structure must be fully elaborated and a new section
about the relevance of transactions within the framework is to be written. Attempts at defining a
multimedia framework in other domains will be assessed. The key areas which MPEG-21 will
recommend for future specification and standardization will be identified within the final section of
the Technical Report.




                                                 18
                                                      Annex 5
                                          Systems Group Report
Source: Olivier Avaro


23.Overview
The main results of the meeting from the Systems Sub-group perspective are:
      23.1.1.     MPEG-2 Systems
1.   Request for Amendment on 13818-1 for the carriage of metadata over MPEG-2 Transport
         23.1.2.      MPEG-4 Systems Version 1&2
2. Systems Software Version 2 Status, Implementation Workplan and Demo. Pack
3. Framework for the carriage of MPEG-4 over IP based protocols
4. Draft Integration of Systems COR1 into IS14496-1
         23.1.3.      MPEG-4 Systems Version 3
5.   Disposition of comments ISO/IEC 14496-1/FPDAM 2
6.   Text of ISO/IEC 14496-1/FPDAM 2
7.   WD of ISO/IEC 14496-4/PDAM 2
8.   Systems Software Version 3 Status, Implementation Workplan and Demo. Pack
         23.1.4.      MPEG-4 Systems Version 4
9. MPEG-4 Textual Format WD 2.0
10. Systems Software Version 3 Status, Implementation Workplan and Demo. Pack
         23.1.5.      MPEG-4 Systems Version 5
11. Multi-users technology requirements and architecture
         23.1.6.      MPEG-7 Systems
12. MPEG-7 DDL WD 3.0
13. MPEG-7 Systems WD 0.5

A detailed report can be found below.




                                                           19
24.General issues
The following contributions have been reviewed:

                                 N°                        Title
                               5969      Systems March 2000 Meeting Report

1.   M5969: The report was approved without comments.

25.MPEG-2 Systems
To avoid region and / or application specific solutions for carriage of metadata it is proposed to
develop an amendment to ISO/IEC 13818-1:2000 that offers a generic solution for carriage of
metadata.
Also the request was formally approved at the WG11, concerns where raised about the content and
the timing of such amendment. This should be clarified during the Beijing meeting.

26.MPEG-4 Systems
     26.1. General
The following contributions have been reviewed:

              N°                                           Title
             5971     Draft Integration of Systems COR1 (N3278) into IS14496-1 (N2501)
             5972     MPEG-4 Systems Overview Slides (presented in Noordwijkerhout)

2.   M5971 Systems Specification: In Noordwijkerhout, ETRI committed to provide an integrated document for the
     Version 1, Version 2 and Corrigendum 1 of the MPEG-4 Systems specification with the following timeline : WD in
     July 2000 and final approval in October 2000. This document provided by Thomson multimedia is a first step
     toward this integrated document.
3.   M5972 MPEG-4 Systems Overview : presentation of MPEG-4 Systems for use in particular for MPEG-7 Systems
     people for build the MPEG-7 on MPEG-4 specification.

It is observed that the specification of MPEG-4 transport over IP as defined through Internet Drafts submitted to IETF
to date is incomplete. Therefore, a framework document will be prepared and agreed within MPEG that proposes a
complete specification. This draft document will be made available on the joint MPEG/IETF reflector so that IETF
members can comment and contribute. The resulting version of the MPEG-4 over IP framework will be submitted by
some interested MPEG members as an Internet Draft to the IETF meeting in August. Implementation and verification
should occur before the December IETF meeting, so that promotion to RFC can happen as soon as possible.

     26.2. Amendment 3
         26.2.1.      XMT (Extensible MPEG-4 Textual Format)
             26.2.1.1.         Reviewed documents
The group reviewed the following documents:

                      N°                                     Title
                    6110      Extensible MPEG-4 Textual Format (XMT)
                    6071      A proposal for the encoding hints in the XMT framework

4.   M6110 : proposed updates of the XMT Specification. Document approved.
5.   M6071 : Document integrated in the output XMT specification.
             26.2.1.2.         Achievements
The following topics have been addressed :
6.   Integration with W3C/SMIL and Web3D/X3D : XMT will develop a two stage architecture : XMT-A which
     contains a subset of Web3D/X3D and XMT-Ω which contains a subset of W3C/SMIL.
7.   XMT conformance points :


                                                          20
       XMT-A : conformance on textual format will comprise validation of the syntax (against DTDs or XML
        Schema) as well as encoding (with a conforming encoder) to mp4 and check the conformance of the mp4file.
        Conformance on encoders: conforming encoder respecting encoding hints should provide same binary stream.
        Conformance on binary format: SDSM and ODSM in mp4 are conformance points.
    The validity of the XMT-Ω file will be done by compiling XMT-Ω to XMT-A with a reference encoder (output
        being either XMT-A or mp4 (SDSM, ODSM)), and checking conformance on the output. The validity of
        XMT-Ω file consumer behavior will be done in the following way : XMT-Ω ref software generates XMT-A,
        XMT-Ω consumer generates XMT-A, reference XMT-A decoder consume both on the same terminal : there
        should be no frame difference ideally, there should be no visual difference practically.
8. XMT reference software. It will comprise :
    An XML parser
    A reference encoder from XMT-A to mp4
    A diff tool in mp4 space (ENST)
    An mp4 to XMT-A (IBM, ENST)
    An XMT-A to mp4 (IBM, iVast + Sony, ENST?)
    An XMT-Ω (to XMT-A?) to mp4 (IBM)
9. Mapping issues : XMT-A will provide a deterministic mapping to MPEG-4 Systems
10. Integration of MPEG-7 into XMT (as described in the diagram below)

                                           MPEG-4/
                                                                              XMT
                      AV Data
                          +                 MPEG-7                           MPEG-7
                      Systems           Authoring Tool                      Description




                         XMT- Ω                                MPEG-7
                                                               Schema
                         Definition                            Definition




                                               XML
                                              Schema
                                             Language




11. Profiles in XMT : Profiles in XMT-A will be MPEG-4 profiles. It is foreseen that there will be XMT profiles :
    XMT-A and Profiles for XMT-Ω (XMT-A inclusive).

Finally, the Systems group has adopted the following XMT logo :




27.MPEG-4 Reference Software
    27.1. General

The usual documents on Im1 status and implementation work plan have been produced

The following document has been reviewed:

                          N°       Title
                          5974     IM1 Core code + authoring tools version 4.3

12. M5974 : Release of the Im1 software. Document approved.




                                                         21
28.MPEG-4 Exploratory activities
    28.1. Multi-user application
The following contribution has been reviewed :
                                 N°                          Title
                               5989         Gaze in MPEG-4 Multi-user

The requirement document has been updated accordingly as well as through discussions. The Call
for Proposal will be issued in July, expected date for the finalization of the requirements by the
AHG. The effort will be conducted jointly with Web3D.

29.MPEG-7 Systems
    29.1. General
The following contributions have been reviewed:
          N°                                                 Title
        6093      MPEG 7 Systems V0.4 input
        6061      Binary format for multimedia description structures
        6099      MRML: A Communication Protocol for Content-Based Multi Media Retriev
        6111      The relationship between Ds/DSs and MPEG stream
        6011      About Profiling in MPEG-7

13. M6093 : Input document forthe Systems specification. Document approved.
14. M6061 : First input document addressing the binary representation of MPEG-7 data. Discussions have clarified
    architecture, requirements and process issues. Follow-up on the AHG.
15. M6099 : Multimedia Retrieval Mark up language. It extend the scope of the standard (standardization of queries).
    The XM may use it if they want. Can be discussed in requirement as well.
16. M6111 : Architecture consideration on the organization of MPEG-7 content and multimedia content. Analysis and
    merits of different architecture (with or without the content). For discussion on MPEG-7 file format and streaming.
    Suggestion to send the key frames along with the metadata (DS for describing the preview frame =>File format or
    on the wire format should support this).

    29.2.    DDL
             29.2.1.1.         Reviewed documents
During this meeting the DDL AHG reviewed the following documents :
                                 N°                           Title
                               6026         DDL Working Draft 2.0


             29.2.1.2.         Activities
Due to the recent orientation of the DDL (XML Schema), the DDL AHG had to clarify the use of
the DDL with other groups. The notions of complexTypes, elements are new to the majority of the
MPEG-7 groups and many questions raised during joint meetings. Based on the joint meetings with
the requirements, video, audio and MDS, the DDL AHG discussed the following issues:
1. Handling data-inheritance by the use of global variables and internal references.
Headers are placeholders for global variables and can be expressed with DDL constructs (element
and complexType).
The proposal for referencing used the key and keyref constructs of XML Schema. The current DDL
doesn‘t provide these constructs. Referencing can be expressed with the current DDL constructs (ID
and IDREF).
The DDL AHG supports this mechanism as a good candidate for the solution of this problem.
2. Automatic parsing of external documents
An MPEG-7 DDL parser will check if the link is correct with the respect to its schema. But, it is the
matter of the application to trigger any further parsing/validation (e.g. other XML document).



                                                          22
3. Can “include”, “import” constructs be used within an instance document so that the
   description is composed of several files
Currently it is not possible to import external XML documents.
4. Instantiation of Derived-type Element
The DDL AHG believes that DS and Ds should be expressed as complexTypes which allow reuse
and refinement. However in some cases, where polymorphism is overused, the description might
become too large (xsi:type). In such a case there is the possibility to use the equivClass mechanism.
5. Conditional Instantiation
Conditional Instantiation is not expressed using the DDL in the form of a procedural construct. The
mechanism available for expressing the same semantics are Choice, minOccurs and maxOccurs.
The DDL AHG provided solutions for exhibited cases. One of the cases seems to require
minOccursPar and maxOccursPar.
6. Binary description
The matter of binary description will be discussed in a newly established AHG. The DDL AHG will
contribute to this discussion.

The following issues have been solved or clarified:
        29.2.2.     Parameterized Occurrences of element
We need to be able to provide a mechanism which forces the parser to restrict the size of arrays and
matrices to the value of an attribute at the time of instantiation. In the previous DDL (V1.1) this
functionality was provided by minOccursPar and maxOccursPar. Using the new list datatype, we
want to be able to specify a parameter to provide the facet value.
The DDL AHG is aware of suggestions made using minOccursPar and maxOccursPar. The DDL
AHG will investigate provided examples which shows the need for this feature. If there are other
ways in the current DDL to express the same semantic without these constructs, the DDL AHG will
decide if the feature is incorporated into the DDL or not.

        29.2.3.    Links to procedural code ; Links to thesauris and ontologies
In the opinion of the DDL AHG, the definition of the syntax needs to be done by those developing
the link structure, most likely in form of a DS. And the DDL already provides all the syntactic
means to express this kind of link mechanism.

        29.2.4.     Encoding of large matrices
The DDL AHG sent a solution to the XML Schema Working Group for evaluation. However, this
solution is yet not parsable by existing XML Schema parsers and therefore the DDL AHG suggest
to use the solution described in 7.2.2 of the WD.

Parser handling of MPEG-7 specificity
The DDL Parser should be based on an XML Schema parser. The AHG identified three potential
candidates available in Java and C++ and which support XML Schema validation to varying
degrees. These include:
    XSV – http://cgi.w3.org/cgi-bin/xmlschema-check
    XML Spy – http://new.xmlspy.com/
    Xerces – http://xml.apache.org/
The DDL AHG envisaged solutions to adapt XML Schema parsers both to check the accepted
subset of XML Schema and the extensions specific to MPEG-7 DDL. These solutions need further
investigation. We expect to have results on this investigation by Beijing.
            29.2.4.1.       Specific recommendation
Currently some descriptors are designed by first providing binary descriptions. This may cause bad
designed Ds and DSs when designing textual descriptor. The design of data structures should be



                                                  23
designed using the DDL at the beginning. Existing descriptors should be reviewed to allow efficient
mapping. The DDL AHG will revise existing descriptors and suggest improvements.




                                                24
                                              Annex 6
                    Multimedia Description Schemes Group Report
Source: Philippe Salembier, Ana Benitez, John Smith, Toby Walker
   29.3. Overview:
The main activity during the week has been to:
1. Review the results of the core experiments started at the Holland meeting,
2. Select the DSs for inclusion in the XM and in the WD,
3. Define the workplan for software integration of the DS promoted to the XM,
4. Review input contributions,
5. Define new Core experiments.


   29.4. Kick-off of the work
During the kick-off session, the workplan for the week was discussed and approved. Furthermore,
the following points were discussed:
  Creation of an end-to-end description using a large number of DSs: The current Core
     Experiment work and the various sections in the MDS XM and WD only focus on a limited set
     of DSs. In order to reveal potential problems related to the use of a large number of DSs and
     also to illustrate how DSs can be used together, it was decided to create a full description of a
     limited set of AV documents. This activity will be organized by John Smith.
  In order to improve the quality of the MDS XM & WD documents, reviewers have been
     assigned to specific sections. They will report any error, inaccuracy and suggest improvements
     to the editors. The current list of reviewers is:
      Basic Elements:                   Yoshi Shibata
      Content Description: Ed Hartley, Ali Tabatabai, Riccardo Leonardi, Rosa Ruiloba
      Content management: Michael Wollborn, Oliver Morgan, Masahiro Shibata
      Navigation and Access:            Munchurl Kim
      Content Organization: Hawley Rising
      User preferences:        Michel Rynderman
 The necessity to work on missing DSs such as root elements for the description, application-
    oriented DSs (package) and AudioVisual segments was discussed. At the end of the week a CE
    targeting the two first items was approved. The AudioVisual Segment DS will be discussed
    within the framework of the AHG on Audio, Video, MDS Harmonization (N3432).
 Finally, the possibility to support partial interoperability for non-standard DSs was briefly
    discussed. In the future, it may be necessary to study how non standard DSs can be created and
    if interoperability can be partially provided under certain restrictions.



   29.5. Review of Validation and Core Experiments results

  Num.                                     Contributions
 6002 Report on the Transcoding Hint DS Core Experiment
 6006 Report on the CE on Summarization Description Schemes
 6010 Report of the Core Experiment on Description Schemes for Linguistic Structure (For the
       part of Linguistic Annotation DS)
 6022 Report of CE on User Preference DS
 6027 Report on Core Experiment for the Weight DS
 6032 Report on Intermediate Results of the Core Experiment on the Controlled Term D
 6048 Results on Time CE


                                                 25
  Num.                                    Contributions
 6062 Report of the CE on the Semantic DS
 6070 Report of the CE on DSs for Linguistic Structure
 6081 Core Experiments on the VideoText DS
 6082 Core Experiment on Media Review DS
 6107 Report on CE on Entropy Measurement
 6113 Report of CE on Multi-Level Indexing Pyramid

All these contributions were discussed in the AHG meeting during the two days before the meeting
and AHG made recommendations for promotion to the XM and WD.

        29.5.1.      Basic elements:
        29.5.2.      Weight DS:
M6027 Report on Core Experiment for the Weight DS
      Yoshiaki Shibata (Sony), Jin-Soo Lee (LG GIT), Koichi Emura (Matsushita)
      In view of the results of the CE and the resulting discussion, it was decided promote the three individual
      weighting functionalities to the XM: Matching Hint, Point of View and Affective DSs. However, these DSs are
      not derived from the generic weight DS anymore. The three DSs will still be under CE to check and optimize
      their syntax (taking into account the fact that they are not derived from the weight DS) and to make cross
      validation. Since the weight DS is not used by any specific entity, it was moved from the WD to the XM.

        29.5.3.      Annotation DS:
M6010 Report of the Core Experiment on Description Schemes for Linguistic Structure (For the part of Linguistic
      Annotation DS)
      Masahiro Shibata, Yeun-Bae Kim
M6070 Report of the CE on DSs for Linguistic Structure
      Audrey Tam, Koiti Hasida, Masahiro Shibata
M6113 Report of CE on Multi-Level Indexing Pyramid
      Alejandro Jaimes
      Intermediate results were reported and discussed. This activity will continue until the Beijing meeting. It was
      also decided to merge the CE on "Multi-level Indexing Pyramid" with the one on "Linguistic Structure".

        29.5.4.      Controlled Term D:
M6032 Report on Intermediate Results of the Core Experiment on the Controlled Term D
      Oscar Fernandez, Jose M. Martinez, Clara Garcia
      This report was also an intermediate report and the work should be finalized in July. It was suggested to the
      participants to study how an enumerated list could be extended by a controlled term D.

        29.5.5.      Time DS:
M6048 Results on Time CE
      Joerg Heuer, Dulce Ponceleon, Eric Rehm
      The goal of this CE was to improve the syntax of the time DS to have a more compact textual representation.
      The results were approved and the WD will be updated following the CE recommendations. The new syntax is
      closer to the XML Schema representation of time. The main difference can be summarized as follows: the
      XML Schema specifies a fraction of a second using a decimal expression, whereas fractions of a second are
      counted in the MPEG-7 Time DS. This is to support the current practice in AV material to work with time
      stamps.

        29.5.6.      Content Management:
        29.5.7.      MediaReview DS:
M6082 Core Experiment on Media Review DS
      G.Vaithilingam, I. Sezan, P. vanBeek
      The MediaReview DS is proposed as an extension of the Classification DS and conveys subjective information
      about the AV material. The decision has been to include this new DS in the XM.

        29.5.8.      Media Transcoding Hint DS:
M6002 Report on the Transcoding Hint DS Core Experiment


                                                         26
        Peter Kuhn (Sony), Teruhiko Suzuki (Sony), Anthony Vetro (Mitsubishi USA), John R. Smith (IBM), Ana B.
        Benitez (Columbia University), Charilaos Christopoulos (Ericsson)
        The Media Transcoding Hint DS has been designed for Universal Multimedia Access (UMA). UMA is used in
        an application that deals with delivery of image, video, audio and multimedia content under different network
        conditions, user and publisher preferences, and capabilities of terminal devices. The CE reported on the Utility
        Scaling DS, the Motion Hint DS, the Difficulty Hint DS, and the Importance Hint attribute. All DSs were
        promoted to the XM except the Utility scaling that will continue under CE. Moreover, it was suggested to
        investigate the search dependency of the Motion Hint DS.

        29.5.9.       Content Description:
        29.5.10.      VideoText DS:
M6081 Core Experiments on the VideoText DS
      C. Dorai, R. Bolle, N. Dimitrova, L. Agnihotri, Gang Wei
      The CE on VideoText DS was performed in the context of efficient video browsing and classification.
      Videotext refers to text superimposed on still images and video frames. The entities dealing with the structural
      aspects of the DS were promoted to the XM.

        29.5.11.      Semantic DS:
M6062 Report of the CE on the Semantic DS
      AHG on MPEG-7 Semantic information representation
      This activity will be ongoing until the Beijing meeting. A full convergence among the CE participants had not
      been reached at the beginning of the meeting. As a result, a breakout group was created to improve and
      stabilize the specification. An updated version of the CE was approved at the end of the week.

        29.5.12.      Navigation and Access
        29.5.13.      Summarization DS:
M6006 Report on the CE on Summarization Description Schemes
      Dulce Ponceleon, Peter van Beek, Ibrahim Sezan, Osamu Hori, Masaru Sugano, Nevenka Dimitrova, Gulrukh
      Ahanger, C. Christopoulos, Y. Abdeljoued
      The goal of this CE was to improve the Summarization DS by including textual information to
      SequentialSummary DS, such as, keywords, phrases or topical summaries, by further developing Audio
      summaries associated with key-audio-clips, key-notes (music) or key-words (speech) and defining tools for
      Time synchronization of audio/keyframes/text in SequentialSummary DS. All the recommendations of the CE
      were accepted. The Sound and Text Properties will be included in the XM and the remaining entities already
      included in the WD will be updated.

        29.5.14.      User
        29.5.15.      User Preferences DS:
M6022 Report of CE on User Preference DS
      P. van Beek (SLA), Y. Tomioka (Sharp), K. Yoon (LG-Elite), G. Vaithilingam (Philips), I. Sezan (SLA)
      The CE made some refinements on some entities already in the WD (CreationPreferences,
      ClassificationPreferences, SourcePreferences). These modifications of the WD were accepted. Moreover, it
      was decided to include the DatePeriod and the KeywordPreference in the XM. The Usage History has not
      been promoted. Further experiments and cross-validation are still necessary.

        29.5.16.      Entropy measurement:
M6107 Report on CE on Entropy Measurement
      Hawley K. Rising III
      This CE reported that it is behind schedule. It was decided to pursue the work with a new workplan. Results
      are expected at the Beijing meeting.

    29.6. Description Schemes Promoted to XM and WD
During the meeting, a decision was made on which description schemes (and descriptors) to
promote to either Working Draft (WD) or Experimentation Model (XM). The initial
recommendations were made by the AHG on MDS CE. These recommendations were reviewed and
discussed Wednesday afternoon by the entire MDS group. Moreover, entities that were in the XM
and that have also been integrated in the XM Software were promoted from XM to WD (Collection
Structure DS, Space Frequency View DS, State Transition Model DS, Mosaic DS, User Preference
DS). Also after being checked by IPMP expert, the Usage Meta Information will be moved from


                                                          27
XM to WD. Finally, the Temporal Interpolation (developed by the Video group) and the Scalable
Series (developed by the Audio group) elements will be included in the MDS documents because
their scope goes beyond pure video or pure audio description. The following table summarizes the
group decision.

       Description Scheme               Decision
       User Preference DS:
          Refinements                       Promote to WD
           DatePeriod                       Promote to XM
         KeywordPreference                  Promote to XM
       Media Review DS                      Promote to XM
       Media Transcoding Hint DS
         MotionHint DS                      Promote to XM
         DifficultyHint DS                  Promote to XM
         ImportanceHint attribute           Promote to XM
       Weight DS                            Move from WD to XM
         PointOfView DS                     Promote to XM
           MatchingHint DS                  Promote to XM
          Affective DS                      Promote to XM
       Video Text DS                        Promote to XM
       Summary DS:
           Minor modifications              Promote to WD
           SoundProperty                    Promote to XM
           TextProperty                     Promote to XM
       Time DS                              Update the WD
       Collection Structure DS              Promote from XM to WD
       Space Frequency View DS              Promote from XM to WD
       State Transition Model DS            Promote from XM to WD
       Mosaic DS                            Promote from XM to WD
       User Preference DS                   Promote from XM to WD
       UsageMetaInformation                 Promote from XM to WD
       Temporal Interpolation               From the Video group
       Scalable Series                      From the Audio group

                        Table 1. Description Schemes Promoted to XM or WD.


   29.7. Joint meeting with ISG on Software integration and XM evolution

        Num.                             Contributions
       6017 Informative Report on development of an MPEG-7 Visual Annotation Tool
       6099 MRML: A Communication Protocol for Content-based Multimedia

       29.7.1.     Review of the DS software integration work
       Stephan Herrmann
       The ISG group has received the software corresponding to entities promoted to the XM in Holland. This
       software will be integrated soon. The Generic DS API seems to be stable.

       29.7.2.     Workplan for software integration
       Ana Benitez, Toby Walker
       The following workplan for software integration was approved by the ISG and MDS groups:




                                                     28
Description        Organization           Extraction            Search Tool        Integration
Scheme                                    Tool                                     Due Date
Video Text DS      IBM (C. Dorai)         Video Text DS         Video   classifier July 7, 2000
                   Philips                Extraction      for   using   videotext
                   (L. Agnihotri,         MPEG-2 Video          DS.
                   N. Dimitrova)          (Text     Detection
                                          only—no OCR)
Temporal           Toshiba (O. Hori)      Conversion from       N/A                July 7, 2000
Interpolation DS   Philips (S. Jeannin)   C++         from/to
                                          description (DOM)
User Preferences Sharp Labs               N/A                   Update           to July 7, 2000
DS               (I. Sezan)                                     filtering agent for
(updates to WD) LG-Elite                                        modifications.
                 (Y. Kyongro)
Importance Hint IBM (J. Smith)            N/A                   Transcoder         July 7, 2000
DS
Motion Hint DS Sony                       Hint  extraction Transcoder       July 7, 2000
                 (P. Kuhn,                tool   (modified (modified
                 T. Suzuki)               MPEG-2 decoder). MPEG-2
                                                           encoder)
Difficulty   Hint Sony                    Hint  extraction Transcoder       July 7, 2000
DS                (T. Suzuki,             tool   (modified (modified
                  P. Kuhn)                MPEG-2 decoder). MPEG-2
                                                           encoder)
Media Review       Philips                N/A              Content matching July 7, 2000
DS                 (G.Vaithilingam)                        based on review
Media Review       Sharp (I. Sezan)                        DS.
Preference DS
Affective DS       Sony (Y. Shibata)      N/A                 Segment    Filter    July 7, 2000
                                                              Tool generating
                                                              summary DS.
Matching     Hint LG-Elite (J. S. Lee)    Weight     learning Similarity           July 7, 2000
DS                                        for          visual matching      for
                                          descriptors based Segment        DS
                                          on feedback.        using matching
                                                              hint.
Point Of View Matsushita                  N/A                 Segment    Filter    July 7, 2000
DS            (K. Emura)                                      Tool generating
                                                              summary DS.
Summary DS         KDD (M. Sugano)        Summary             N/A                  July 7, 2000
                                          extraction     from
                                          audio stream
Summary DS         IBM                    Summary             N/A                  July 7, 2000
(Sound Property)   (D. Ponceleon)         extraction

Summary DS         IBM                    Textual extraction Search           July 7, 2000
(Text Property)    (D. Ponceleon)         from synchronized application using
                                          text transcript.   textual summary.




                                                29
 Time DS                Siemens                    Update to new Update to new July 7, 2000
                        (J. Heuer)                 lexical expression. lexical
                                                                       expression.

M6017 Informative Report on an MPEG-7 Visual Annotation Tool
      Blaise Lugeon, John R. Smith
      An annotation tool was presented to illustrate how DSs can be manually instantiated, how a complete
      description can be created and how the graphical user interface can be dynamically configured based on the
      schema definition. Currently the tool only supports manual instantiation but, in the future, plugging of
      automatic extraction tools should be supported. The general feeling from both the ISG and the MDS groups
      was that this tool could be very useful in the framework of the XM developments in particular to support
      demos and realistic applications. It could also be used as a basis for browsing and visualization of MPEG-7
      descriptions. The proposer was asked to check under which conditions this tool could be made available to the
      MPEG community.

M6099 MRML: A Communication Protocol for Content-based Multimedia
      Wolfgang Müller, Henning Müller, et al
      This contribution proposed a protocol to handle shipping of queries in different query language encapsulated in
      XML. Beside the tool itself, the contribution raised some more global issues such as the Systems implication as
      well as the scope of the standard. This contribution was further discussed in the Systems and the Requirements
      groups.


    29.8. Joint meeting with DDL, Audio, Video on XML Schema design

                              Num.             Contributions
                             M6049 Proposal of a ReferenceDefinitions DS

M6049 Proposal of a ReferenceDefinitions DS
      Joerg Heuer, Andre Kaup, Sanghoon Sull
      This contribution proposed on the first hand side a possible solution to the data inheritance problem involving
      the definition of Header. This functionality is already used by the Audio group and seems to be useful for
      several MPEG groups. Discussions on this topic will be carried on in the AHG on Audio, Video and MDS
      harmonization. On the second hand side, the contribution proposed the use of Key/keyref from XML Schema
      to have a compact linking mechanism. The DDL group mentioned that this kind of feature are not covered by
      the MPEG-7 DDL because it involves a rather high complexity of the parser. This issue should be further
      studied.

        XML Schema design policy and open issues
        Members of the Audio, Video and MDS groups raised issues dealing with XML Schema design and the DDL
        group gave some recommendations. The major conclusions of this part of the meeting are:
           A guideline document defining the D / DS design policy in XML Schema should be
            created. An initial version of this document is expected as input to the Beijing meeting.
           The Video group raised the issue of describing a large number of temporal instances of a
            descriptor in a segment. The Audio group has studied the same problem and has defined
            the Scalable Series descriptor for this purpose. The video group will study its application
            for visual descriptors and the MDS document will include the Scalable Series as a
            generic entity.


    29.9. Joint meeting with Requirements and Systems on Profiles and Packages
        (partially with the Video and the Audio group)

      Num.                                  Contributions
     M6011 About Profiling in MPEG-7
     M6084 Interoperability: How Style sheets can help MPEG-7 Applications Development


                                                         30
      Num.                              Contributions
     M6017 Informative Report on an MPEG-7 Visual Annotation Tool

M6011 About Profiling in MPEG-7
      Fernando Pereira
      This contribution made a review of profiling in MPEG-1, 2, 4 and its relation with decoder complexity Bound.
      The presentation highlighted the danger of having too many profiles and the resulting limitation of
      interoperability. In view of the application document, it seems that MPEG-7 will also need to define profiles
      because there exist very simple applications. The decision was to start the study with the concrete case of
      TVAnyTime.

M6084 Interoperability: How Style sheets can help MPEG-7 Applications Development
      Neil Day
      The contribution made a review of several XML-related industry domains. XSLT are transformations to handle
      the mapping between various XML-related standards. They also allow the definition of sets of D/DS useful for
      a certain application. The implication of XSLT in terms of normative aspects of the MPEG-7 standards has to
      be clarified.

M6017 Informative Report on an MPEG-7 Visual Annotation Tool
      Blaise Lugeon, John R. Smith
      This contribution was the same as the one presented during the joint meeting with ISG. However, in the
      context of this presentation, the goal was to stress the notion of Packages. It was proposed to create new DSs to
      organize and combine descriptive DSs and Ds in a way that is useful for a certain application domain. The
      groups felt that the notion of packages seems indeed useful. Some work is still needed to extend the
      functionality of packages (constraints on the complexity of the description, on the schema recursion, etc.). A
      Core Experiment was launched on this issue at the end of the week.


    29.10. Joint meeting with Requirements on Conceptual Modeling

          Num.                             Contributions
          m6020 Report of the AHG on Conceptual Modeling
          m6021 MPEG-7 Principal Concepts List (V0.8)

M6020 Report of the AHG on Conceptual Modeling
      John R. Smith, Hawley K. Rising III
M6021 MPEG-7 Principal Concepts List (V0.8)
      John R. Smith on behalf of Conceptual Modeling AHG
      After discussion on the AHG report, the following decisions were made:
       Use the guidelines for distinction of DS and D created by the CM AHG to
           Produce new definition of DS and D in the MPEG-7 Requirements document based on the viewpoint
               of conceptual modeling.
           Rename / distinguish all DSs and Ds in MPEG-7 according to the guidelines. This implies that
               pervasive changes to XM / WD documents must be carried out.
       Study holes in MPEG-7 development identified by CM AHG in order to
           Remove requirements that may no longer be necessary
           Determine how development shall be carried out on the undeveloped areas


    29.11. Basic elements

                                  Num.          Contributions
                                  M6085 Spoken Content as Annotation

M6085 Spoken Content as Annotation
      P. N. Garner




                                                          31
        This contribution started by a presentation of the corpus of annotated pictures from Melbourne. Then two
        issues were discussed:
         Can the segment include audio annotation (annotations that are in audio and not in textual format). Two
             solutions were proposed: attach the SpokenContent D or AudioDescriptor content in the annotation DS.
         Collection DS: How to organize a collection of images with annotation? This issue has some implication
             about the header of the spoken content DS.
        After discussion, it was suggested to create an annotation relationship to state that a multimedia material
        annotates another multimedia material. This could be discussed within the framework of the AHG on Audio,
        Video and MDS Harmonization.


    29.12. Joint meeting with System

                           Num.              Contributions
                          M6110 Extensible MPEG-4 Textual Format (XMT)
                          M6106 Proposed Schema for Command DS

M6110 Extensible MPEG-4 Textual Format (XMT)
      Michelle Kim, Olivier Avaro, Mikael Bourges-Sevenier, et al
      This contribution was mainly informative for the MDS group and reviewed the goals of XMT: the textual
      format for MPEG-4. Since XMT will be based on XML Schema and will provide some information about the
      content, collaboration between the MDS and Systems groups was suggested. The work will be done under the
      XMT AHG. See Doc 3297, Holland meeting.

M6106 Proposed Schema for Command DS
      Hawley K. Rising III, Ali Tabatabai
      This proposal was related to m6061. It defined commands to add, delete, and update the description. Some
      features related to security are also supported (authority to modify the description). The syntax of the command
      DS is defined in XML Schema. The group felt that the solution was interesting and deserves a careful study. It
      was agreed to further work on this issue jointly with people from the DDL and System groups in the
      framework of the AHG on binary representation.

        Linking
        The linking issue was jointly discussed. The main question for the MDS group was to know how to define a
        textual representation of the linking mechanism. It was concluded that although the textual representation of
        the linking mechanism could be defined in the MDS group, it is still an open issue at the System level. It is
        necessary to define first the delivery mechanism and its strategy. The Systems group will work on this issue.


    29.13. Content Management

            Num.                              Contributions
           M6095     SMPTE RP205 - Application of Unique Material Identifiers
           M6096     SMPTE RP210.2 Draft Metadata Dictionary Version 2
           M6097     Presentation on SMPTE Metadata
           M6098     Proposed DS for Authoring
           M6024     Proposal of A Description Scheme for Media Quality
           M6088     Adaptive object-based transcoding using shape and motion-based hints

M6095 SMPTE RP205 - Application of Unique Material Identifiers
      Oliver Morgan
M6096 SMPTE RP210.2 Draft Metadata Dictionary Version 2
      Oliver Morgan
M6097 Presentation on SMPTE Metadata
      Oliver Morgan
M6098 Proposed DS for Authoring
      Oliver Morgan


                                                         32
        This set of contributions was mainly informative. This material can be used in the work of the AHG on
        metadata harmonization between SMPTE, EBU.

M6024 Proposal of A Description Scheme for Media Quality
      Jiuhuai Lu, Guy Cherry
      The media Quality DS addresses the description of the quality of the media as opposed to the artistic quality
      (handled by the Media Review). During the discussion, it was highlighted that the rendering quality is not only
      related to the signal quality. What about the quality of service? What is the relation between this DS and the
      Variation DS and the Transcoding Hint DS? At the end of the week a CE on this topic was started.

M6088 Adaptive object-based transcoding using shape and motion-based hints
      Anthony Vetro, Huifang Sun and Ajay Divakaran
      This contribution proposed transcoding techniques based on the Objects. Two new transcoding hints were
      proposed: The first is a motion-based hint and the second is a shape-based hint. They were judged as useful
      and were included in the continuing CE on Transcoding.


    29.14. Content Description

    Num.                                        Contributions
   M5992 Comparative study between SMPTE standard on Transfer of Edit Decision Lists and
         VideoEditing DS
   M5993 Validation Experiment for VideoEditing DS
   M5994 A synthetic and analytic DS to describe digital video editing processes
   M6023 Work Plan for Core Experiment on Entity-Relationship Graph DSs
   M6076 Semantics of References and Links


M5992 Comparative study between SMPTE standard on Transfer of Edit Decision Lists and VideoEditing DS.
      Rosa Ruiloba, Philippe Joly
M5993 Validation Experiment for VideoEditing DS
      Rosa Ruiloba, Philippe Joly
M5994 A synthetic and analytic DS to describe digital video editing processes
      Rosa Ruiloba, Philippe Joly
      The proposers made a review of the past presentations and recommendations on the description of Video
      Editing work. The top level of the structure is called "analytic" and describes the components of the final AV
      document generated by the edition process. The remaining components called "synthetic" were originally
      developed for evaluation purposes. Their main goal is to define editing patterns allowing several possible
      reconstructions of the AV material. The group recommendation was to start a Core Experiment but focussing
      mainly on the analytical part. The synthetic part should be discussed with the Requirements group to see
      whether it is within the scope of the standard.

M6023 Work Plan for Core Experiment on Entity-Relationship Graph DSs
      Ana Benitez, Toby Walker, Hawley Rising, Ajay Divakaran
      This contribution proposed a Core Experiment for improving the specification of the EntityRelationGraph DSs
      (ER Graphs) in terms of formalizing their semantics, updating their syntax, and proposing the standardization
      of relationships and relationship types. The experiment will examine the following test scenarios: the
      description of relationships among segments, the description of semantic configurations, and the description of
      relations between pairs of graphs. The group felt that this was indeed a much-needed CE.

M6076 Semantics of References and Links
      HASIDA Koiti
      This contribution could be considered as an input to the previous Core Experiment. The proposer agrees to
      joint the CE resulting from the previous contribution (M6023).


    29.15. Navigation and Browsing

                         Num.                          Contributions


                                                         33
                         Num.                 Contributions
                        M6057 Improved Structure of HierarchicalSummary DS

M6057 Improved Structure of HierarchicalSummary DS
      Hyun Sung Chang, Jae-Gon Kim, Munchurl Kim, et al
      This contribution proposed to clarify some elements of the HierarchicalSummary DS. First, a
      SummaryTypeList was proposed to clarify the "mixed" SummaryType. Second, the current structure related to
      the keyEvents summary was improved to avoid the possible redundancy problems by letting the
      HighlightLevel DS have the attribute themeId. Finally, a ToC-like structure for SummaryThemeList was
      proposed. Its goal is to make it much easier to navigate in the event structure and to search the preferred items.
      After discussion, it was agreed to update the WD for the two first items. The last item should be further
      discussed at the Beijing meeting (to give time to people to study the proposal).



    29.16. User Preferences

   Num.                                  Contributions
  M6065 Improvements of User Preferences DS for Filtering Operation and Storage Efficiency

M6065 Improvements of User Preferences DS for Filtering Operation and Storage Efficiency
      Kyoungro Yoon, Jin-Soo Lee, Jungmin Song,et al
      This contribution proposed to define a dictionary of names where each name should be defined together with
      its possible variations (even including various transcriptions in different language). During the discussion, it
      appeared that this issue is related to the work on classification carried out in the ControlledTerm CE. The
      proposer agreed to join this CE.



                                   Num.         Contributions
                                  M6108 Update on Mathematical Model

M6108 Update on Mathematical Model
      Hawley K. Rising III
      This document was an update of a contribution originally submitted at the Maui meeting. The goal of this work
      is to build an axiomatic approach to the notions used for content description. This document was approved as
      an output document but it was mentioned that, in its current state, the document is not easily accessible by wide
      audience.


    29.17. New Core & Validation experiments:

The following experiments were approved during the Geneva meeting:

              DSs                  Organizations              Application      Related documents
       Entity-                   Columbia                 Description     of Workplan: M6023
       Relationship               University               semantic       and Proposal: M6076
       Graph DSs                 Sony                     segment graphs
                                 Mitsubishi
                                 ETL
       Media Quality             Tektronix                Media       content Proposal: M6024
       DS                        IBM                      browsing based on
                                 Avid Technology          media quality




                                                          34
Video   Editing    LIP6/UPMC          Video editing and Workplan: M5994
DS                 Avid Technology    browsing           Proposals: M5992,
                   University    of   document structure M5993
                    Brescia
User Preference    Sharp             Multimedia              Report: M6022
DS                 LG-Elite          filtering        and
                                      searching
                                      according          to
                                      preference
Package DS         IBM               Instantiation      of   Proposal: M6017
                   Columbia          packages and root
                    University        elements          for
                                      descriptions
Weight DS          University     of Weighting        and    Reports:    M6027,
                    Brescia           ordering          for   M5440,      M5460,
                   Sony              retrieval        and    M5464,      M5618,
                   Philips           browsing                M5822
Controlled         Polytechnic       Filtering, retrieval,   Report: M6032
Term DS             University     of and        browsing     Proposal: M5911
                    Madrid            application
                   SUNY/Buffalo
                   NHK
                   LG-Elite
Point Of View      Matsushita         Segment filtering      Reports:    M6027,
DS                 Sony                                      M5440,      M5460,
                   LG-Elite                                  M5464,      M5618,
                                                              M5822
                                                              Proposals: M5481,
                                                              M5605, M5821
Affective DS       Sony               Pre-processing of      Reports:    M6027,
                   LG-Elite           video summaries        M5440,      M5460,
                   Matsushita                                M5464,      M5618,
                                                              M5822
                                                              Proposals: M5481,
                                                              M5605, M5821
Matching Hint      LG-Elite           Retrieval based on     Reports:    M6027,
DS                 Sony               weighting              M5440,      M5460,
                   Matsushita         descriptors            M5464,      M5618,
                                                              M5822
                                                              Proposals: M5481,
                                                              M5605, M5821
Media              Sony               Delivery       and     Report:     M6002,
Transcoding        Mitsubishi (USA)   transcoding     of     M5803
Hint DS            Ericsson           visual content         Proposals: M6088
                   Columbia
                    University
                   IBM




                                       35
Structured         Victoria        Discovery      and    Linguistic
Textual             University   of recovery        of    Report: M6079
Description         Technology      structured textual    Workplan: M5952
                   ETL             descriptions    of    Proposals: M4754,
                   NHK             multimedia data       M5251, M5593
                   Columbia
                    University                           Multi-Level Pyramid
                   SUNY/Buffalo                         Report: M6113
                   Telematica                           Workplan: N5855
                    Institute                            Proposals: M5738,
                                                         M5705, M5794
Semantic DS        ETL              Retrieval      and Reports:      M6062,
                   Sony             descriptive power M5936, M5781
                   University    of of         semantic Proposals: M5941,
                    Brescia          descriptions        M5937
                   Columbia
                   U. of Rochester
                   SUNY/Buffalo
                   Kodak
                   U. of Lancaster
Measuring          Sony             NA (methodology)     Report:     M6107,
Entropy of Ds      State University                      M5935
and DSs             of New York at                        Proposal: M5612
                    Buffalo

              Table 2: Description Schemes in Core Experiments.




                                     36
    29.18. List of Output documents:

          Number                                TITLE
          N3410      MPEG-7 Multimedia Description Schemes XM (v3.0)
          N3411      MPEG-7 Multimedia Description Schemes WD (v3.0)
          N3412      Workplan for DS Software integration
          N3413      MPEG-7 Principal Concept List
          N3414      Mathematical models for Description Schemes Concept (v3)
          N3415      MPEG-7 MDS Core Experiments
          N3416      Workplan for CE on Entity-Relationship Graph DSs
          N3417      Workplan for CE on Video Editing DS
          N3418      Workplan for CE on Structured Textual Description
          N3419      Workplan for CE on Controlled Term DS
          N3420      Workplan for CE on Media Transcoding Hint DS
          N3421      Workplan for CE on Point Of View DS
          N3422      Workplan for CE on Affective DS
          N3423      Workplan for CE on Matching Hint DS
          N3424      Workplan for CE on Semantic DS
          N3425      Workplan for CE on User Preferences DS
          N3426      Workplan for CE on measuring entropy of Ds and DSs
          N3427      Workplan for CE on Media Quality DS
          N3428      Workplan for CE on Package DS
          N3429      Workplan for CE on Weight DS

       (Note: Documents N3410 and N3411 will be released on the 19th of June 2000)
    29.19. List of AHG approved by the MDS group:

         Number                                TITLE
         N3430      AHG on Editing the Multimedia Description Schemes XM and WD
         N3431      AHG on MPEG-7 DS Core Experiments
         N3432      AHG on Audio, Video, MDS harmonization
         N3433      AHG on Conceptual Modeling
         N3434      AHG on the TV-Anytime Application
         N3435      AHG on Integration of MPEG-7, SMPTE, EBU/Pmeta Metadata

    29.20. Next targets for the Beijing meeting:
   Perform the software integration of the DSs that have been promoted during the Geneva
    meeting to XM and WD.
   Perform the Core experiments approved during the Geneva meeting and review the results.
   Continue the harmonization and integration work with relevant standards.
   Harmonization of Audio, Visual and MDS entities.
   Update the XM and WD.
   Define and plan new core experiments.




                                              37
                                                Annex 7
                                       Video Group Report
Source: M.Z. Bober, P. Gray, T. Sikora


MPEG-2

In the MPEG-2 breakout group, comments from the JNB, the German National Body, and the
USNB were reviewed. In addition to these three groups, Aharon Gill from the Israel NB, attended
all meetings. At the conclusion of the breakout meetings, consensus (not unanimous) was reached
for the following:

 development of DCOR1 to 13818-2:2000 to clarify the syntax for table 6.2.2.21 so that it
  reflected what was described in the semantics with respect to reserved extension start codes.

 progression of PDAM1 to 13818-2:2000 to FPDAM1 with many of the changes recommended
  by the national bodies.

There was still a strong objection from the USNB to change the syntax location to a reserved
extension ID. The JNB had originally agreed with this position under certain conditions. However,
they withdrew this position once it became known that the company that had reported failures with
the use of extra_information_picture was actually failing for another reason.

An adhoc group was formed to continue to review the amendment for its technical merit and it is
expect that the USNB will continues to support its position requesting that the syntax be moved to
an extension ID.


MPEG-7

This MPEG-7 report summarises work and conclusions of the video group in 5 sections:
 Review of the Results of Core Experiments and decisions
 Joint Meetings of video with other groups.
 Other contributions, work items
 Other issues discussed:
   Some notes from Thursday Night chairs meeting.



1. Review of the Results of Core Experiments and decisions

1.1 Motion/Shape
 MS-1 Core Experiment on Camera Motion
    include in the XM, CE completed. Implementation in the XM software should be provided July
    6th . MPEG decoder software should be integrated into XM. To be considered for WD in
    Beijing.
 MS-2 Core Experiment on Spatial Attribute of Motion Activity
    No significant improvement over current XM shown, CE closed.
 MS-3 Core Experiment on Spatial Localised Motion Activity
        continue CE, jointly review the test dataset, implement all the techniques in software XM
        and conduct the experiments using the XM software, answer the technical queries on the


                                                     38
        technique (discussed between the participants during the meeting). Core Experiment
        description reviewed and accepted. Results to be presented in Beijing
   MS-4 3D shape Core Experiment
    Categorisation proposed and initially agreed between participants during the meeting – to be
    refined within one week after the meeting. Core Experiment description reviewed and accepted.
    The proposers declined to share the source code or the executables with other participants on the
    grounds that every participant should implement the technique on their own. Results to be
    presented in Beijing.
   MS-5 CE on region-based shape descriptor
        Significant reduction in the descriptor size achieved. Problems with cross-check (the same
        error present in the cross-checked and original results). Continue the CE and present cross-
        verified result during the meeting in Beijing.
   MS-6 Core Experiment on 2D/3D shape
    2D/3D demos and results shown. There was no consensus on inclusion into XM. Core
    Experiment to continue: perform 3D to 3D matching based on the same data set as MS-4.
    Consider using more views for representation of each shape and see if there are improvements
    and where the optimum is. CE description approved.
   MS-7 Region Locator -> accepted for XM, CE completed. The be integrated in the software
    XM.


1.2 Colour & Texture
 CT-1 Colour Spaces and Interoperability between different quantisations: Colour Histogram
    and Colour Structure Histogram
    CS-histogram is inter-operable in HMMD colour space but not in other colour spaces.
    Reduction of quantization range. Colur structure histogram expressed in the HMMD colour
    space is recommended for XM integration. The number-of-bins parameter will be restricted to
    256, 128 and 64 bins. Software will be integrated into XM by July 6th. Text for the XM
    document to be prepared by Friday (draft), and the full version within one week. The CE will
    continue. CE description reviewed and approved.
 CT-2 Confidence Measure Bit Optimisation in dominant colour descriptor
    No results were presented due to short too short time between meetings. Continue CE. CE
    description discussed and accepted.
 CT-3 Colour Layout Extensions for Video Segment/Moving Region DS
    Good results presented, consensus that it is new and useful application of the Colour Layout to
    video segment/moving region. Include in the XM usage section information on how to use this
    descriptor for video segment to video segment matching. Recommend to MDS to assign this
    descriptor on the video segment and moving region in order to support this functionality. Re-
    visit the issue of the increase in size when expressed as DS (compared to D only solution), when
    the binary representation and coding for DS is proposed. CE completed successfully.
 CT-4 Core Experiments on Edge Histogram Descriptor
    Size reduced to 80binx x 6 bits
    Recommendation: include changes XM, but wait till Beijing for the WD, continue CE to try to
    optimise even further. CE description approved.
 CT-5: Compact Colour
    scalable, very good performance (ANMRR=0.05), continue experiment and explore non-
    uniform quantisation in Haar domain. CE description discussed and agreed.
 CT-6 Face Descriptor
    two proposals: spatially-weighted eigenfaces and 2nd order eigenfaces
    good results presented, comments: too small the database. Combined proposal to be submitted
    to Beijing. Continue the CE, use larger dataset, usual cross-verification within XM software.


                                                 39
    Database available under NDA: contact Manjunath. CE description reviewed, results to be
    presented in Beijing.
   CT-7 cancelled
   CT-8 cancelled

1.3 Recommendations from the Integration AHG considered by video
 A proposal for the integrated coordinate system: M6069. Recommendation of the integration
    AHG is to include in the visual XM. Video group did not object.
 Interpolation – M6056.
    Recommended by the integation AHG to be included in the MDS XM. Influences motion
    trajectory and spatio-temporal locator. Change of structure. No objections raised.
The video group accepted the proposed coordinate system for the visual XM and reviewed
interpolation DS (no comments). The software will be implanted within two weeks. The software
depending on the changes will be updated by 6th of July.

2.0 Joint Meetings of video with other groups.

2.1 Joint Video/Audio/MDS/DDL meeting: key points

   referencing of common part of descriptor (header) -- m6049
    - use key/keyref field
    - problem: key/keyref makes parser more complex and is at the moment excluded
   XML Schema design guide-lines
    - to ensure consistency between different parts of the standard
    - id attribute -- which Ds/DSs need them
    - different Word styles for DDL and examples
   DDL representation
    - instances in external documents: not parsable
    - instantiation of derived-type elements
      (currently uses xsi:type=... for complexType, equivClass for element)
    - parametric attributes -- do we really need them?
    - conditional instatiation
   DDL vs binary
    - video needs efficient binary representation, but currently MDS supports only DLL
    - both representations needed
    - do we need two parsers? (not normative so does not really matter)
   efficient time representation is needed!

2.2 Joint Video/Audio/MDS/Systems/Requirements
 Fernando Pereira presentation on profiling
    - complexity and interoperability
    - what should be normative?
    - gluing tool (DDL, description root)
    -
    Subsets of tools needed. Profiles are complete and useful for an application domain. Can DDL
    be implemented in simple devices- maybe a different gluing tool? Profiling can be implemented
    separately in the DS/DDL/Systems domain or jointly across domains.
    Points in discussions:
    Parsing is the key issue. Everybody should you the same syntax. All textual and binary
    description should follow. The number of descriptors does not influence the complexity of
    parser. Normative behaviour is the parser does not crash, it does not matter what parser does to


                                                 40
    the parsed data (?). Parser is the only normative behaviour we can guarantee. What is the
    MPEG decoder - is it just the parser?
    More discussions needed to come to a clear conclusion

   TV Anytime: M5999

2.3 Joint Video/Audio/Systems

   binary representation: M6061 (Bosch/HHI)
    - Why do we need binary encoding. (efficient encoding, re-synchronisation and random access).
    Proposal – binary header + data. static syntax elements representations
    - dynamic (re)definitions of DSs
    - Binary header is structured, eg video, audio, general, etc.
    - What are the requirements for the binary representation? Incremental transfer. One-to-one
        mapping is required. Dynamic part of the description. Fast parsing and compactness.

2.4 Joint Video – ISG
   Discussion on the current state of the XM.
   Some updates are missing for the code reuse and extraction tools. All techniques need to provided 16/06.
   Integrate HHI tools for evaluating retrieval rates.
   Conventions have to be set up regarding the way results are written to the file. Jens will sent the stand-alone
    performance computation code for colour descriptors.
   MPEG-2 video decoder will be modified to allow access to arbitrary frames.
   Deadlines for contributions of the video XM software set with the ISG group


3.0 Other contributions, work items
 M6039
       Contribution on improvements to the quantisation of the contour shape. Better quantisation
       range and quantisation parameters proposed. Significant improvement, no changes to
       descriptor size. Results corss-verified by HHI. CE started.
 M6029 Contribution on Subjective Evaluation of the MPEG-7 Retrieval Accuracy Measure
    (ANMRR)
    shown very good correlation between ANMRR and subjective assessment.
 M6063 A New Metric to Measure the Retrieval Effectiveness for Evaluating Rank-base
    Retrieval Systems


4.0 Other issues discussed:

The meeting was very short and consequently very little time was left for general discussions. The
chairman encouraged participants in the visual group to examine current technology for
completeness.


5.0 Some notes from Thursday Night chairs meeting.
Requirements:
IPMP – requirements agreed for the entire IPMP system. Proposals should cover entire systems.
This should be in agreement with MPEG-21.
MPEG-7 IPMP – similar discussions. MPEG-7 should not by design enable to break or circumvent
the content protection systems.

                                                          41
MPEG-7 applications work: Workshop in Paris will take place.
Web-site under construction: working on the outline and the sprit of the MPEG. Want to have the
demonstrations.

Systems:
Packaging of MPEG4 on IP – needs cleaning (several solutions exist). How do you access
descriptors. The big picture on how to send the MPEG-4 on the IP. Textual format in good shape.
XMT-alpha (text based) and XMT-omega (smile based). Nice way of integrating of the MPEG7 in
XMT. Transport of MPEG-7 on top of MPEG-4. MPEG-7 systems – first contributions on the
binary system. Two views: direct bit mapping (Bosch,HHI): bit vs Binary streaming XML using
bifs concept from Apple. Sony (Ali). Evaluation process and timeline is needed. Core Experiment
will be performed. Maybe a call will be issued. Labolle is the deadline. Maybe just a basic core will
be added.
Transport of MPEG-7 data. New initiative of MPEG-7 over MPEG-2 systems. Priority of SMPTE
metadata over MPEG-2 systems. Finalised in March.




                                                 42
                                                    Annex 8
                                          Audio Group Report

Source: S. Quackenbush,                        Chair        Audio Subgroup

30.Opening of the meeting
The MPEG Audio Subgroup meeting was held during the 52nd meeting of WG11 in Geneva,
Switzerland, May 31 to June 2. The list of participants is given in Annex A-1. The Chair
welcomed the delegates to the meeting and outlined the work for this short meeting of three days.

31.Administrative matters
    31.1. Approval of agenda
The agenda, as presented in Annex A-II, was discussed, edited and approved.
    31.2. Noordwijkerhout meeting report
The Audio Subgroup Noordwijkerhout meeting report, March, 2000, had been previously
distributed by email and was approved.
    31.3. Allocation of contributions
All contributions (see Annex A-IV) were allocated to the agenda and were discussed either in the
task groups or in Audio plenary. The Chair brought other relevant documents from Test, Systems,
and Requirements to the attention of the group.
    31.4. Communications from the Chair
The Chair summarised the issues raised at the Tuesday evening Chair‘s meeting and indicated the priorities for the
week‘s work.

    31.5. Joint meetings
Joint meetings over the course of the week are listed here and are reported on below.
Day                 Time                Meeting With         Topic               Location
Wed                 6-7:30 PM           MDS, Visual          DDL                 Req
Thur                9-10AM              All                  Profiles            Reqm
Thur                10-11AM             Systems, Visual      Binary DDL          Visual

    31.6. Received National Body Comments and Liaison matters
There were two Liaison documents or National Body Comments, shown below. Neither required a
response at this meeting. Because there is no MPEG-2 or MPEG-4 business on the agenda of
meeting, a response to the French NB comment, if any, is postponed to the next meeting.
Document     Title                                                  Source                 Author of Response
5981         Interface for non-linear PCM encoded audio             IEC                    None
             bitstreams … according to MPEG-2 AAC
6118         Call for audio testing                                 French NB              None

    31.7. Task Groups
Three task groups were convened for the duration of the MPEG meeting, as shown in ANNEX-III.
Results of task group activities are reported below.


                                                       43
32.Record of Audio plenary, joint meetings and task group activities
    32.1. Audio plenary discussions
The chair reminded the Audio group that the Audio report is a collaborative effort. Specifically,
that each task group should contribute a summary of key decisions so that these can be recorded in
the Audio report and hence do not need to be re-visited in future meetings. Those contributions are
shown in the section ―Task group discussions.‖
The Audio chair insured that all contributions were reviewed either in task groups or in Audio
plenary. If task group activity could not progress, those discussions were moved to Audio plenary.
In this way, plenary activity was primarily that of the Audio chair sharing information with the
group or getting task group status from the group, or approval of output documents, audio
resolutions and ad hoc group mandates.
The following topics were discussed in Audio plenary.
Anna Benitz presented m6114, ―Multiple Level Classification of Audio Descriptors.‖ It was agreed
that the higher level semantic descriptor would be quite useful to tag with their level. For example,
―fear‖ can be a place name (Cape Fear) or an emotion. The concept of levels of
    32.2. Joint meeting discussions
Joint meeting with Audio, Video, MDS on DDL issues: Presented m6049, ―Proposal of a
ReferenceDefinition DS.‖ This proposes to use key/keyref instead of id/idref so as to easily
partition the reference spaces. The problem is that id is only global in scope. A second proposal is
that all external references be grouped into one section of a document and key/keyref be used
throughout the document to point to the actual external reference. This permits efficient ―re-
routing‖ of external references.
Toby Walker presented open issues in DDL. They were:
 An AhG is needed to specify a ―DDL Style Manual‖ so that the DDL specifications for all
    subgroups are consistant.
 Validation of DDL text: if all DDL text is of Microsoft Word style type ―DDL,‖ then the ―table
    of contents‖ feature of Word can be used to extract the text into a single point in the document.
    This text can then be extracted to a true ASCII file for validation by a XML tools.

Joint meeting of all subgroups on Profiles in MPEG-7: Presented m6011, ―Profiling in MPEG-7.‖ The presentation
    was a tutorial on the objective of profiles in the context of MPEG. Profiles are a means to trade off complexity and
    interoperability. Profiles can be defined at any time, even long after the standard has issued. They should be
    defined only when it is apparent that a profile serves the needs of a wide segment of industry needs.
Profiles may be a limitation on the capability, and hence complexity, of the DDL implemented in the MPEG-7 terminal.
Profiles also may be a limitation on the number of DS‘s that must be parsed by the MPEG-7 terminal. However
comments from others in the room were that the normative behavior in MPEG-7 is only that the ―bitstreams‖ are
syntactically correct and that the decoder is able to parse all syntactically correct ―bitstreams.‖ It is not clear that
MPEG-7 is able to impose any other normative behavior on an MPEG-7 decoder.
As a conclusion, it was agreed to use TVAnytime as an example application for investigating how profiles might be
developed in MPEG-7. The principal D‘s and DS‘s that are appropriate in the TVAnytime application are described in
document m5999.
Joint meeting of all subgroups on Binary representation of DLL: Audio did not attend this meeting.

    32.3. Task group discussions
        32.3.1.    MPEG-7 Audio 15938-3
All Descriptors and Description Schemes in the WD were converted to XML-Schema, the MPEG-7
DDL. Four new low-level descriptors were added to the WD: spectral centroid, spectral spread,
harmonicity and fundamental frequency. The WD will be available after a 2-week editing period.
        32.3.2.    MPEG-7 Audio core experiments
There will be a new core experiment on melody description. There were two input documents on
this topic. The experiment will begin based on the simpler of the two proposals (m5990), and we


                                                          44
expect the complexity and flexibility of the Ds and DSs to increase as the experiment progresses.
The two core experiments on timbre similarity and sound classification will continue.
        32.3.3.   MPEG-7 discussions
MPEG-7 will progress to CD at the October MPEG meeting. The chair expressed some concerns
about the emerging standard. He is confident that the standard will be robust and of high quality.
He is also happy to see the increasing number of low-level descriptors. However, he is concerned
that the number of high-level description schemes is quite small, and is worried that some important
application domains will not be addressed.

33.Meeting deliverables
    33.1. Press statement
The Chair prepared the Audio part of the press statement in Audio plenary. It was reviewed and approved.

    33.2. Dispositions of Comments
There were none

    33.3. Responses to Liaison and NB comments
The responses to the French NB comment, m6118, and the IEC Liaison, m5981, will be prepared at the Beijing
meeting.

    33.4. Recommendations for final plenary
A list of Audio recommendations were reviewed and approved.

    33.5. Establishment of new Ad-hoc Groups
The following ad-hoc groups were established:
 Title                     Chair                                                   No.      Meeting
 AHG on MPEG-7 Audio Core Chair: S. Quackenbush,                                  3407      July 16
 Experiments               Co-chair: M Casey, T. Plamann, Y-M.
                           Kim
    33.6. Approval of output documents
All output documents, shown in Annex-IV, were presented to Audio plenary and were approved.


34.Future activities
    34.1. Schedule of future meetings
    34.2. Agenda for next meeting
The agenda for the July MPEG meetings was already presented and approved at the Noordwijkerhout meeting. It is
shown in Annex A-V of this report.

    34.3. All other business
There was none.
    34.4. Closing of the meeting
The chair thanked the participants for attending this MPEG meeting.




                                                         45
                          35. Annex A-I: Meeting Participants List
Name           First Name     Count     Affiliation           e-mail address
                              ry
Amatriain      Xavier         SP        IUA/Cidad             xavier.amatriain@iua.upf.es
Brandenburg    Karlheinz      DE        FhG-IIS               Bdg@iis.fhg.de
Casey          Mike           US        MERL                  mkc@merl.com
Charlesworth   Jason          UK        Canon                 jasonc@cre.canon.co.uk
DeCheveigné    Alain          FR        IRCAM/CNRS            Cheveign@ircam.fr
Erine          Marcus         CH        ETH                   Erne@isi.ee.ethz.ch
Feiten         Bernhard       DE        T-Nova                Bernhard-Feiten@telekom.de
Garner         Philip         UK        Canon                 philg@cre.canon.co.uk
Goodman        Ron            US        Creative ATC          Rong@creativelabs.com
Hererra        Perfecto       FR        IUA/Cuidad            Pherrera@iua.upf.es
Huopaniemi     Jyn            FI        Nokia Res Center      Jyri.huopaniemi@nokia.com
Iwadare        Masahiro       JP        NEC                   Sc29a@dsp.cl.nec.co.jp
Jot            Jean-Marc      US        Creative ATC          Jmj@atc.createive.com
Kang           Kyeongok       KR        ETRI                  k.kang@etri.re.kr
Keefenz        Frank          DE        FhG-AEMT              Frank.keefenz@etc.tu-
                                                              ilmenau.de
Kim            Youngmoo       US        MIT Media Lab         Moo@media.mit.edu
Lindqvist      Morgan         SE        Ericsson              Morgan.lindqvist@era-
                                                              t.ericsson.se
Plamann        Tobias         FR        IRCAM/Cuidad          Plamann@ircam.fr
Puig           Vincent        FR        IRCAM/Cuidad          Puig@ircam.fr
Quackenbush    Schuyler       US        AT&T                  Srq@research.att.com
Väänänen       Mauri          FI        Nokia Res. Center     Mauri.vaananen@nokia.com
                                           36.




                                            46
                 37. Annex A-V: Agenda for the Geneva Audio Meeting
Agenda Item                                                   Contributions
1. Opening of the meeting
2. Administrative matters
   2.1. Approval of agenda
   2.2. Allocation of contributions
   2.3. Communications from the Chair
   2.4. Joint meetings
   2.5. Received national body comments and liaison matters   5981 (AAC), 6118
   2.6. Review of AhG reports                                 6078
   2.7. Review of task group mandates
3. Task group activities
   3.1. MPEG-7 Audio 15938-3 (CD Oct 00)
       3.1.1. Text editing: WD syntax, DDL syntax
             consistency
   3.2. MPEG-7 Audio core experiments
       3.2.1. Review progress                                 6042, 6046, 6102,
       3.2.2. Consider new core experiments                   5990, 6086
       3.2.3. Review of core experiment process document
   3.3. MPEG-7 discussions
       3.3.1. Low-level audio descriptors                     6080, 6114
       3.3.2. DDL issues
       3.3.3. XM integration issues
       3.3.4. Completeness of MPEG-7 Audio
           3.3.4.1.   Other Audio meta-data standards
       3.3.5. MPEG-7 ―New delegate guide‖ FTP sites and
             home pages
   3.4. Promotion of MPEG-7 Audio
       3.4.1. MPEG-7 Demonstrations (Neil Day workshop)
       3.4.2. MPEG-7 Audio overview document
4. Discussion of unallocated contributions
5. Meeting deliverables
   5.1. Press statement
   5.2. Responses to NB comments
   5.3. Liaison statements
   5.4. Recommendations for final plenary
   5.5. Establishment of new Ad-hoc groups
   5.6. Approval of output documents
6. Future activities
   6.1. Agenda for next meeting
7. A.O.B.
8. Closing of the meeting
               38. Annex A-III: Task Groups at the Geneva Audio Meeting
1. MPEG-7 Audio 15938-3 (CD Oct 00)
   Chair: Phil Garner
   Mandates: editing text as needed to correct WD syntax, DDL syntax consistency, create new
―MPEG-7 Audio contrib to WD‖

2. MPEG-7 Audio core experiments
   Chair: Schuyler Quackenbush
      Mandates: Review CE progress,
             consider new core experiments,
             review core experiment process document
             create overview document of CE history and status

3. MPEG-7 discussions
     Chair: Alain de Cheveigné
     Mandates: Low-level audio descriptors
            DDL issues, XM integration issues
            Completeness of MPEG-7 Audio
            Other Audio meta-data standards
            MPEG-7 ―New delegate guide‖ indicating FTP sites and home pages
                        39.      Annex A-IV: Input and Output Documents

   39.1. Contributed documents
The following documents were contributed to the Audio Subgroup and were considered during
this meeting:
 No.   Section                         Source                                        Title
5990   Audio     Youngmoo Kim                                   Core experiment proposal for a melody DS
6042   Audio     P. N. Garner, J. J. Rajan                      Validation Report for Sound Effects Core
                                                                Experiment
6046   Audio     Perfecto Herrera, Xavier Amatriain, Geoffroy   Core experiment on timbre similarity for non-
                 Peeters, Tobias Plamann                        sustained sounds
6078   Audio     A Lindsay, M Casey, G Peeters, A de            Report of AHG on MPEG-7 Audio Core
                 Cheveigne, J Charlesworth, S Pfeiffer, S       Experiments
                 Quackenbush
6080   Audio     Alain de Cheveigne                             Scalable Series update
6086   Audio     Alain de Cheveigne                             A note-lattice descriptor for melody
6102   Audio     Michael A. Casey mkc@merl.com                  Sound Effects CE and ICA Descriptor Interim
                                                                Report
6114   Audio     Alejandro Jaimes, Ana B. Benitez, Shih-Fu      Multiple Level Classification of Audio
                 Chang                                          Descriptors


   39.2. Output Documents
The following output documents were produced in whole or part by the Audio Subgroup. Those
shown in Italics were approved for public release.
           Title                                                             No
           MPEG-7 Audio WD                                                  3401
                                                                            3402
           Status of MPEG-7 Audio Core Experiments
                                                                            3403
           Workplan for MPEG-7 Timbre Description Core Experiment
           Workplan for MPEG-7 Sound Effects Core Experiment                3404
           Workplan for MPEG-7 Melody Core Experiment                       3405
           MPEG-7 Audio Information                                         3406




                                                     49
                 40. Annex A-VI: Agenda for the Beijing Audio Meeting
Agenda Item                                                  Contributions
1. Opening of the meeting
2. Administrative matters
   2.1. Approval of agenda
   2.2. Approval of Noordwijkerhout and Genevea meeting
        reports
   2.3. Allocation of contributions
   2.4. Communications from the Chair
   2.5. Joint meetings
   2.6. Received national body comments and liaison matters
   2.7. Review of AhG reports
   2.8. Review of task group mandates
   2.9. Report status of MPEG-4 reference software framework
        re-write
3. Task group activities
   3.1. MPEG-4 V2 conformance, 14496-4/Amd 1 (FPDAM
        Jul 00)
       3.1.1. Doc and text
       3.1.2. Bitstream status
   3.2. MPEG-4 V1 Corrigenda or 2nd Edition
       3.2.1. Workplan for editing
   3.3. MPEG-7 Audio 15938-3 (CD Oct 00)
       3.3.1. Text editing: WD syntax, DDL syntax
             consistency
   3.4. MPEG-7 Audio core experiments
       3.4.1. Review progress
   3.5. MPEG-7 discussions
       3.5.1. Low-level audio descriptors
       3.5.2. Completeness of MPEG-7 Audio
   3.6. Promotion of MPEG-7 Audio
       3.6.1. Candidate application demos
       3.6.2. MPEG-7 Audio overview document
   3.7. MPEG Audio web page / FAQ / FTP site / press
        statement
4. Discussion of unallocated contributions
5. Meeting deliverables
   5.1. Press statement
   5.2. Dispositions of comments
   5.3. Responses to NB comments
   5.4. Liaison statements
   5.5. Recommendations for final plenary
   5.6. Establishment of new Ad-hoc groups
   5.7. Approval of output documents
6. Future activities
   6.1. Agenda for next meeting
7. A.O.B.
8. Closing of the meeting


                                          50
51
                                            Annex 9
                                     ISG Group Report
Source:        ISG Chair
Editor:        Marco Mattavelli (EPFL)

41.Overview
The main topic of the Implementation Subgroup activity in Geneva is:
       1. MPEG-7 XM development for video/audio descriptors and Descriptor Schemes,
Input contributions w.r.t. the above item are summarized according to the following table:



                             MPEG-7 XM development
M6073     Report of AHG on XM Development. Stephan Herrmann
M6017     ―Informative Report on development Blaise Lugeon, John R. Smith
          of an MPEG-7 Visual Annotation
          Tool‖.
M6049     ―MRML: A Communication Protocol Wolfgang Müller, Henning Müller,
          for Content-Based Multi Media Stéphane Marchand-Maillet, Thierry
          Retrieval‖                         Pun, David McG. Squire, Zoran
                                             Pecenovic, Christoph Giess, Arjen P.
                                             de Vries



42.Detailed Report

   42.1. MPEG-7 XM development

Several joint meetings have been taken place between the ISG team involved in the XM
development and the audio, video and DS groups.

        42.1.1.    XM Visual tools
Discussions have started with the video group with a review of the status of the XM integration
of visual tools.
The discussion and conclusions can be summarized as follows:
     Modifications for link count mechanisms for code reuse are due within two weeks (16th
        June), a few Ds are still missing (camera motion, Motion activity, group of frame
        histogram),
     Evaluation tools retrieval rate will be completed by the end of June,
     Decoders integration for processing segment of sequences: it is needed to achieve
        random access on bitstreams to extract single images or isolated segments. Code is in the
        CVS server but it is not yet integrated in the XM and tested. This functionality is needed
        by descriptors that handle more images at the same time. Three volunteers will solve the
        issue by 15 June.
Problems to be solved are:



                                               52
     The code usually is not given in the correct format for integration (overhead integration
      effort) so recommendations have been given to the group for an appropriate formatting,
   The correct procedure to use the CVS server for the integration of the version 4 of the
      XM has been defined, the version on the CVS server has to be checked so as to avoid
      correct bugs already solved
Complexity issues has been discussed:
   Some example and problems from the use of the XM provide some preliminary
      interesting results. Even if DDL has a binary representation it appears that for instance an
      example of descriptor expressed as DDL description appears 6 times larger. The
      implications of combining several descriptors in a DS using DDL instead of using a
      standard DS are still unclear in terms of generating huge amount of descriptor data.
      Another problem observed appears when we need to add some data to a large database of
      descriptors. Do we need to re-parse all the data? Can we make incremental updates?

      42.1.2.     Integration of DS in the XM
      42.1.3.
Review of he DS software integration work:
    The code is available but not completely integrated (a feedback from Stephan on the
      email reflector will provide the information if everything is OK or some more work is
      needed for the integration),
    Integration of description schemes for the WD dead line is 7 July,
    New functionalities for decoders: transcoding: definition of requirements should be done
      on the reflector.

An interesting contribution presenting a Visual Annotation Tool has been discussed (contribution
M6017):
    Functionalities are: - import of any DDL (XML Schema) of packages, - validation by a
       GUI (a questions is the code availability for MPEG, when and how many additional
       libraries are needed since the tool is written in JAVA). JAVA is needed anyway and
       make the code portable, availability could be directly from IBM so probably no source
       code will be available. Conclusion: the tool is certainly very helpful obviously source
       code availability would be ideal, but also package distribution like XML parser could be
       useful for XM development and usage for experiments. The answer to the possible code
       availability for the XM within 2-3 weeks.
Another interesting contribution has been discussed during the joint meeting: (M6099 ―MRML:
A Communication Protocol for Content-Based Multi Media Retrieval‖)
    The goal is to propose a common protocol for interchangeable UI between search tools.
       Such tool presents nice and useful functionalities, but more discussions are needed to
       verify how this tool could be integrated in the XM. In fact the tool requires an extension
       of the scope of the XM as specified by the requirement group and systems group. An
       independent user interface platform is already available. Query by DS is not presently
       available but could be implemented. MRML as proposed in the document could be a
       standard query language for all MPEG-7 standard or just for the XM experiment. This
       decision has to be taken by Requirements and Systems groups. Following that ISG will
       decide if integrate such language as example and tool for the experiments or as integral
       part of the standard.

       42.1.4.    JOINT MDS-Requirements-Video-Systems-Audio

Contribution 6011 ―About profiling in MPEG-7‖has been presented.


                                               53
The main issues discussed are: - Complexity and interoperability, - need of normative subsets, -
need of subsets functional for specific application domains, - issues for the XM still need to be
understood.

        42.1.5.      Joint-ISG Audio

Main issue discussed is the problem of integrating the ―Spoken Content‖ DS in the XM. Audio group proposed to
use a single C++ class for each MPEG-7 descriptor. Their idea is that XM structure would be better represented and
understandable by a single class instead of a jungle of classes mainly developed for video tools. XM compilation
appears problematic for the large number of paths and flags combination possible. Unfortunately, no evidence that
the problem can be solved applying this strategy has been given to support the proposition.
Except the ―spoken content‖ that remain a problem it has been decide to proceed with a
workplan for the integration of the other audio DS. A workplan will be defined at next July
meeting.

        42.1.6.      General conclusions

Main achievements of the meeting are:
    The definition of new updated Work schedules for the XM integration (video and DS)
    A more clear understanding of the requirements for the XM integration with Video,
       Audio, MMDS and DDL
Next steps and progress needed for the XM development are:
                 Extraction of a set of key applications covering as much normative DS as
       possible,
                 Solicit the definition of applications covering (possibly) all normative DS,
                 Investigation of possible wrapper tools for XML/DDL for integration in the
       XM possibly for the explicitation of MPEG-7 ―packages‖.


43.Resolutions
The above activities have led to the following resolutions.


To approve the following document:
Schedule for the software integration of XM visual audio and MDS tools.                  N3408

To establish the following ad-hoc groups:
Title                                  Chair(s)             No.                                        Mtg
AHG on MPEG-7 XM Development Stephan Herrmann, Toby Walker, N3409                                      N
                                       J.Charlesworth

To provide key application examples for normative Description Schemes since this is an
essential contribution for the further development of the XM functionality and a necessary step
to achieve the XM scope.




                                                       54

								
To top