index by jizhen1947


									Snapdragon AR: Drag and Drop2D
  Augmented Reality Authoring
Caitlin Fisher, Canada Research Chair
in Digital Culture, Associate Professor,
  Department of Film, York University
         July 12th, 2010 1-2:30 p.m. ET
   Presentation slides + links to additional video
What is augmented reality?
-merges real and virtual image streams
-historically an industrial application
-Traditionally very expensive immersive tracking hardware
and video see-through displays … more recently,
smartphone-enabled experiences
- we‟re interested in all kinds of AR, but have focussed
recent attention on inexpensive computer vision solutions
and easy-to-use interfaces to introduce new
audiences to ar as a creative medium               QuickTime™ and a
                                             are neede d to see this picture.
Our innovation: SnapDragonAR
SnapDragonAR is a unique
new tool for artists, educators,
and storytellers of all ages.
                                                  QuickTime™ and a
We wanted to build                                 decompressor
                                           are neede d to see this picture.
expressive tools for non-
programmers so we
generated a wish list that
prioritized easy buy-in, drag
and drop, scaleability, high
resolution 2D, and extremely
low cost
SnapDragonAR Interface

              QuickTime™ and a
        are need ed to see this picture.

                                                  QuickTime™ and a
                                           are neede d to see this picture.
What do you need?
Mac computer (at the moment the software is for mac
(intel) only), webcam, printer (or printed markers)
What else could you use?
Data projector -- for showing your ar masterpiece to a
Inexpensive gaming goggles - if you would rather have
the uncanny effect of seeing your paper marker come to
life in your hand, rather than on your computer screen
Camera with a longer cord to explore markers further
away from your computer
Is it easy?
Yes. Transform any surface into a screen simply by
adding a marker.
Print stickers at any size you like, using your regular
Bring everyday objects to life and make your own
projects at home.
Simply print your markers, turn on the camera, and
start dragging 2D images from your computer into the
drop zones.
How does SnapDragon work?
Computer vision techniques provide augmented reality programmers a low
cost solution to achieving accurate registration.
Markers -- fiducials-- are used to mark coordinates in a real scene.
There are many marker systems available. The Mfd-5 marker library, a
particularly robust tracking system developed by our collaborator Dr. mark
Fiala, is being used exclusively by our lab to create new tools for artists
and designers.
- Snapdragon is a stand-alone application built as a plug-in to Max/MSP
(but you don‟t need to have Max/MSP to run it). Great for rapid prototyping
of these kinds of experiences - very inexpensive, scalable, easy to
produce. We can‟t offer you the Max code, but we create custom
interfaces depending on the project or installation we‟re working on.
SnapDragon has the most popular of these features.
SnapDragonAR projects: Andromeda

Andromeda -- augmented reality poetry, co-winner
of the Vinaròs 4th International Digital Literature
Award 2008.
                                          Qui ckTi me™ and a
                                            decompresso r
                                   are ne eded to see th is pi cture.

                                                               QuickTime™ and a
                                                         are neede d to see this picture.
SnapDragonAR projects: Circle

Circle augmented
reality tabletop
theatre (Caitlin
Fisher), presented
at the Digital Arts          QuickTime™ an d a
                      are need ed to see this p icture .
and Culture
Conference 2009,
UC Irvine.
SnapDragonAR projects: 52 card cinema

Geoffrey Alan Rhodes' 52 Card Cinema
“52 Card Cinema is an installation-based
investigation into cinematic structures and
interactive cinema viewership. The concept is
simple: 52 cards, each printed with a unique
identifier, are replaced in the subject's view by the
individual shots that make up a movie scene. The
cards can be stacked, dealt, arranged in their
original order or re-composed in different
configurations, creating spreads of time. The
technology used is marker-based augmented
reality, where special printed markers are
recognized in the video feed and pass data
regarding their unique identifier, their position, and
their orientation. The computer then feeds a
display overlaying the video clips of each shot
onto the appropriate card and continually mapping
their position and orientation.The 52 Card Cinema
project is an exemplar of the unique architecture
of cinematic pieces mapped on to the real world,
made possible by AR technology. The medium of
the animated image, in its wedding with the real
world, loses the privileged linearity of the screen,
and gives the opportunity to re-perceive cinema as
the juxtaposition of its parts.”
SnapDragonAR projects: Wonderturner

Helen Papagiannis Wonderturner (an augmented
reality exquisite corpse)-- on display at the Ontario
Science Centre summer 2010

                                                  QuickTime™ and a
                                            are neede d to see this picture.
SnapDragonAR Projects: living Postcards

Andrew Roth - Living
Postcards kiosk

Living Postcards is an interactive display
designed for use at the Future of the Internet
Conference, Prague (2009) and the Canada
3.0 Conference, Stratford (2009). Users
approach the booth and can watch a mirrored
projection of themselves holding a movie clip
in the palm of their hands.
SnapDragonAR Projects: Expo 67 maquettes

How might ar be used to give new audiences a
sense of the viewing experience of multi-screen and
immersive cinema works that can never be seen in
situ again? The creation of inexpensive models to
which historical film footage can be added, as it is         QuickTime™ an d a
found, has been used for the collection of film        are need ed to see this p icture .

fragments -- augmented reality recreation as
methodology -- if such models were easy and
inexpensive to generate, if they could be built and
rebuilt within a day, rather than a month.
SnapDragonAR lets you do this.
SnapDragonAR Projects:
Neighbors, Boaz Beri

                    QuickTime™ an d a
                   H.264 de compressor
              are need ed to see this p icture .
  SnapDragonAR in the classroom
-- bring maps, charts, family trees, historical presentations to life with
audio and video
-- living postcards, objects, toys, video puzzles, animated chess sets
-- ar markers on classroom walls and ceilings, shirts and masks, quick-
change theatre costumes
-- „Harry Potter‟ newspapers and sorting hats
-- easy multichannel cinema, ar poetry and ar pop-up books
-- device for understanding cinematic and literary conventions,
storyboarding games
-- uses we haven‟t thought of yet -- tell us!
SnapDragonAR in the classroom

                QuickTime™ and a
          are neede d to see this picture.
 SnapDragonAR in the classroom
easy-to-produce, reconfigurable, low cost and low tech
buy-in invites play, exploration, mash-up
From JK-University
SnapDragonAR is free to try
The free download gives you a full feature version with
a time-out… long enough for a student to demo a

If you enjoy using SnapDragonAR you can buy the full
version of the software with incredible features:
    * Resize your image in real time.
    * Move the image right off the marker.
    * Record video at the press of a button.
    * Read images from any Quicktime movie or jpg
hosted online (so you can pull from youtube, add
immediate context to your project via the weather
channel or cnn or …)
 SnapDragonAR future features

In the lab we‟re working on a variety of new features,
*collision detection (marker A + marker B = event C) … great
for math instruction, storyboarding of complex interactive
narratives, interactive storytelling and tabletop theatre)
*detection of marker rotation (use a marker like a dial! …
take your story from sun-up to sundown… use your marker
as a time machine to move through historical material!)
* If demand is sufficient, a pc version is possible
Try or Purchase
Try or purchase snapdragon:

Find out more
Information about York University‟s Augmented Reality
Our YouTube channel: thearlab

Canada Research Chairs Program
Canada Foundation for Innovation
Canadian Media Research Consortium

 Development Team:
 Andrew Roth -- A.R. System Design
 Andrei Rotenstein - Lead Software Developer
 Mikhail Sizintsev - Software Developer
 Marker Tracking System: Mark Fiala
 Many thanks to all of the graduate students associated with the AR lab and the Future Cinema class,
 especially those students whose work has been documented here: G. Alan Rhodes, Helen
 Papagiannis, Boaz Beri. Thanks, too, to Andrew Roth, the lab‟s Technology Manager, who has
 tirelessly created installations, assisted with all lab projects and has a hand in every success.

To top