AR Authoring for Urban Planning and Product Design - ISCTE by wuzhenguang


									    AR Authoring for Urban
Planning and Product Design
 VR-NET Seminar on Virtual Reality
 Visualisation and Modelling of Cities
 and Terrains Northumbria University,          Eng. Pedro Santos
 28th January 2005                             

                                                          Prof. Miguel Dias

                                                 ADETTI/ISCTE/Portugal - Jan
                                                This work is part of an Msc thesis in
                                              Computer and Telecom. Engineering –
                                                                Computer Graphics             

 State-of-the-art
   Tangible interaction for Architectural and Industrial
   Authoring tools for AR Design applications
 The ‘Performance Plaza’ AR authoring tool
   User requirements
   System architecture
 Conclusion

Tangible interaction for
     Architectural and
     Industrial Design
Augmented Urban Planning Workbench:
Overlaying Drawings, Physical Models and
Digital Simulation
 “Luminous Table”: Augmented Reality Workbench that             Hiroshi Ishii, John Underkoffler
                                                                      Dan Chak, Ben Piper
  integrates multiple forms of physical and digital                   MIT Media Laboratory
                                                                       Eran Ben-Joseph,
 2D drawings, 3D physical models, and digital simulation           Luke Yeung*, Zahra Kanji
  are overlaid into a single information space in order to   MIT School of Architecture and Planning
  support the urban design process.
Inexpensive Non-Sensor Based Augmented Reality
Modeling of Curves and Surfaces in Physical Space

 Augmented reality system where a user can model
  surfaces with his hands, and without expensive sensing
  systems.                                                         Adrian David Cheok,
                                                               Neo Weng Chuen Edmund
 The system uses computer vision based methods for the             and Ang Wee Eng
  tracking of the user’s head and hand position.             National University of Singapore
 Using a glove and the tracking system, the user can draw
  smooth lines or surfaces with her hands in a physical
 MagicCup: A Tangible Interface for Virtual
 Objects Manipulation in Table-Top AR
 City-planning system based on augmented reality with
  tangible interface.                                              Hirokazu Kato, Keihachiro Tachibana,
 Tangible interface for virtual object manipulation in table-      Masaaki Tanabe, Takeaki Nakajima,
                                                                              Yumiko Fukuda.
  top augmented reality based on ARToolKit.                      Osaka University, Hiroshima City University,
 User holds a transparent cup upside down and can pick              Knack Images Production Center,
                                                                     Hiroshima Institute of Technology
  up, move or delete a virtual object by using it.
Interactive Mediated Reality

 Mediated reality describes the concept of filtering
  our vision of reality, typically using a head-worn          Raphael Grasset,
                                                           Jean-Dominique Gascuel
  video mixing display.                                        iMAGIS/GRAVIR
 Proposes a generalized concept and new tools for                France

  interactively mediated reality.                             Dieter Schmalstieg
                                                        Vienna University of Technology
 First prototype system for painting, grabbing and             Vienna, Austria
  glueing together real and virtual elements.
Collaborative Augmented Sketching

 Software prototype using AR Toolkit for
  collaborative augmented reality sketching in             Hartmut Seichter
  architectural design.                                Department of Architecture
                                                      The University of Hong Kong
 Non-intrusive interaction technique developed for
  this prototype.
 Sketching and distribution mechanisms are
  discussed and illustrated.
Collaborative Mixed Reality Visualization of
an Archaeological Excavation

 VITA (Visual Interaction Tool for Archaeology) tool.
 Experimental collaborative mixed reality system for            Hrvoje Benko,
  offsite visualization of an archaeological dig.              Edward W. Ishak,
 System allows multiple users to visualize the dig site in      Steven Feiner
                                                              Columbia University
  a mixed reality environment.
 Tracked, see-through, head-worn displays are
  combined with a multi-user, multi-touch, projected table
  surface, a large screen display, and tracked hand-held

   Authoring tools for
AR Design applications
Mix It

 Visual interface for authoring AR/MR.
 Magic Book metaphor. Books are made of markers and associated 3D
 Editor + AR Viewer.
 Virtual Flashlight live demo.

 A Mixed Reality Authoring tool.
 The main objective of AMIRE is to enable non-
  expert researchers:
    to use Mixed Reality (MR) for their applications
    to create and modify these MR applications
      with the support of dedicated tools that foster
      an efficient authoring process for MR.
Authoring of a Mixed Reality Assembly
Instructor for Hierarchical Structures
 Mixed Reality based step-by-step furniture          Jurgen Zauner, Michael Haller,
                                                            Alexander Brandl
  assembly application.                                Upper Austria University of
 Context related actions are given to the user to   Applied Sciences (MTD), Austria

  install elements.                                          Werner Hartmann
 Intuitive way for authors to create new MR based   Institute for Applied Knowledge
                                                        Processing (FAW), Austria
  assembly instructions.
DART: The Designer’s Augmented
Reality Toolkit
 Designer’s Augmented Reality Toolkit (DART).
 Allows users to easily create augmented reality (AR)
                                                            Blair MacIntyre, Maribeth Gandy,
  experiences.                                                   Jay Bolter, Steven Dow,
 Can be used by technologists, designers and students             Brendan Hannigan
  alike.                                                    Georgia Institute of Technology,
                                                                       Atlanta, GA
 Rapidly prototype AR applications without extensive
  programming and content creation as well as knowledge
  of technical topics involving cameras, trackers, and 3D
Immersive Authoring of Tangible Augmented
Reality Applications

 New approach for authoring tangible augmented              Gun A. Lee α Claudia Nelles β
  reality applications, called ‘immersive authoring.’            Mark Billinghurst β
                                                              Gerard Jounghyun Kim α
 Allows the user to carry out the authoring tasks
  within the AR application being built.                  α Pohang University of Science and
 The development and testing of the application can
                                                        β New Zealand, University of Canterbury
  be done concurrently throughout the development

 DesignAR allows a way of authoring augmented
  reality environments without needing to write code in        Rod Berry
  C++ or other programming languages.                     ATR Media Information
                                                          Science Laboratories
 The environment centers around Touch Designer, a
  commercial 3D modelling package by Derivative.
The ‘Performance Plaza’
AR authoring tool
User requirements
 Project partner (User Requirements):
     NOA - Design agency in Germany.
     Develops modern 3D products in the context of market,
      communication, technology and production.

 Specification of the core technology: MxToolkit
     Handles user interaction, hardware interfaces, system management, etc
     Independent of application to be developed; provides generic
      programming language mechanisms for VR/AR/MR applications.
 Specification of a new AR authoring tool: Performance Plaza
     Based in MxToolkit.
     Geared towards designers and 3D artists.
     Proposes a visual and intuitive new Human-Computer Interaction
 Two different work paradigms: design and presentation
     Design: interactively prepare 3D models for presentation.
     Presentation: show and interact with 3D animated models in AR.
User requirements
 Design phase:
    Highlight and select subscenegraphs of
     3D models.
    Transform, measure, cut and change
     appearance of models.
    Insert text and voice anotations.
    Allow model version control based in
     product development timeline. E.g.:
     problem level model, concept level
     model, design level model, realization
     level model.
    With these operations author a
     “powerpoint-style” 3D presentation:
       Timeline based.
       User’s (designer, architect, engineer,
        marketeer) actions trigger events.
       Create    automatic     or    event-based
User requirements
 Presentation phase:
    Users interact with models (view, pick, move around, etc).
    Arrange models in a life-situation.
    Show or hear, select and change text and voice annotations.
    See/switch between time-related and speciality-related
     (architect, designer, engineer, marketeer) model versions.
    Launch presentation prepared in Design phase; trigger events
     and animations.
System architecture
 Hardware
     Peripherals: webcam(s), microfone, speaker.
     Input devices: human hand, AR fiduccial marker(s), keyboard (or equivalent for
      text anotations).
     Output devices: computer monitor, HMD, “Paycheck” screen.

 Software
                                Performance Plaza

       Design phase                                            Presentation phase

   Marker-based Tracking               Mx Toolkit               Image Processing

      Image Rendering in 3D                                Hardware interfaces

                       Video Capture         Tangible User Interfaces
System architecture

 Physical set-up: “Paycheck”, the movie.
AR Authoring for Urban Planning and Product Design

           Thank you for your attention!

        Eng. Pedro Santos                           Prof. Miguel Dias

                       ADETTI/ISCTE/Portugal - Jan 2005

To top