public 3DUI data with countries

Document Sample
public 3DUI data with countries Powered By Docstoc
					               Timestamp                                     6/16/2011 12:46:26
               COUNTRY                       Finland
                 Gender                      Male
                  Age                                                       25
  Experience in computer programming                                         7
 Are you a professional or hobbyist 3DUI
               developer?                Student
   Years of experience in _developing_
                  3DUIs                  0-1 years

  How many years has it been since last
time you programmed a 3DUI application?                                      0
How many 3DUI application projects have
             you worked on?                                                  1
   How many of those 3DUI application
         projects were finished?                                             0
     I like to explore new technologies                                      7
I want human-computer interaction to be
                 more natural                                                7
  I want human-computer interaction to
          stimulate my senses more                                           4
 The 3DUI that I want for myself does not
                   exist yet                                                 6
I There to create 3DUIs that be made with
  want is a lot of money to benefit others                                   7
                   3DUIs                                                     4




 What other reasons have motivated you
          to work with 3DUIs?          School course
            Application area                 Entertainment
 Input devices that your 3DUI is based
                 upon                        6DOF device or 3D mouse, Head tracking


 Output devices that your 3DUI is based
                 upon                        Surround-screen displays (e.g. CAVE, ...)




 Describe briefly your 3DUI application      grabbling hook meets spiderman, in space :)
    What is the status of your 3DUI          Application is incomplete and I will not
      application development?               develop it further




If you could not get past the beginning of
  the development or your application is
incomplete, describe the reasons for that
         Programming language                processing

How many other people were developing
    the 3DUI application with you?    2-3 people
Was your 3DUI application developed as a
commercial, research, or hobby project? Research
 Features of your 3DUI application and
    their origin [3D stereographics]     Inherited from 3DUI platform

  Features of your 3DUI application and
their origin [Head tracked view rendering]   Inherited from 3DUI platform
  Features of your 3DUI application and
     their origin [Full-body interaction]    Not present in my application
  Features of your 3DUI application and
   their origin [Two-handed interaction]     Inherited from 3DUI platform
  Features of your 3DUI application and
       their origin [Finger interaction]     Not present in my application
  Features of your 3DUI application and
      their origin [Gesture recognition]     Not present in my application
  Features of your 3DUI application and
    their origin [Navigation techniques]     Not present in my application
  Features of your 3DUI application and
      their origin [Object manipulation
                  techniques]                Not present in my application
  Features of your 3DUI application and
        their origin [Physics engine]        Not present in my application
  Features of your 3DUI application and
            their origin [3D audio]          Not present in my application
   Does your application's 3DUI work on
        multiple operating systems?          Yes
   Can the application's 3DUI usage be
 simulated with just mouse and keyboard
             on other computers?             Yes

Is your 3DUI application meant to be used
   by multiple people at the same time?   No

  Did you consult 3DUI literature to help
design your application's 3D interaction? No
 Getting started with the development of
      my 3DUI application was easy                                           3
   The 3DUI development process was
                frustrating                                                  5
I reached most of the goals that I had for
        the 3DUI of my application                                           4
 I am satisfied with my 3DUI application                                     5
        Reasons for satisfaction or
               dissatisfaction            We got the job done
Would you present your 3DUI application
          to a possible employer?         No
   Would you like to create more 3DUI
         applications in the future?      No
  The input devices required by my 3DUI
      application were too expensive                            1
 The output devices required by my 3DUI
      application were too expensive                            1
Getting input device drivers to work was
                   difficult                                    2
   There were too many steps required
between connecting the input device for
the first time and successfully streaming
data from the device into my application                        1
 Device input data was too low-level for
   quickly getting started with my 3DUI
                 application                                    1
Lack of documentation or tutorials about
       the 3DUI platform** made the
            development difficult                               5
The 3DUI platform** had a steep learning
                    curve                                       3
 The development was difficult because
       the 3DUI platform** had a bad
           programming interface                                4
  Programming in general was difficult                          2
   Creating mathematical algorithms
 required by my application's 3DUI was
                difficult                                       6
 Describe other relevant obstacles at the
   beginning of the 3DUI application
              development
   Input device performance was poor          2
 There were bugs in the 3DUI platform**
    that I used for developing my 3DUI
  application, making the development
                  difficult                   3

Lack of proper 3DUI building blocks made
it difficult to develop my 3DUI application   4
     Each added 3D interaction feature
increased application complexity, making
          the development difficult           3
 Constant testing and re-implementation
  was required, making the development
                   difficult                  3
  Testing of the application's 3DUI could
    not be carried out properly with just
     mouse and keyboard, making the
             development difficult            5
         Teamwork was difficult               5
 Legal status of using unofficial drivers
 and libraries for commercial purposes
               was unclear                    2
 Describe other relevant obstacles that
 came up later in the 3DUI application
             development


  What 3DUI platforms did you use for
   creating your 3DUI application?             RUIS




    What high-level 3DUI description
 languages or models did you use when
  building your 3DUI application, if any?




Fill in briefly other relevant details about
 the development environment, platform,
and tools that you used when developing
            your 3DUI application
            3D stereographics                         7
      Head tracked view rendering                     7
          Full-body interaction                       4
         Two-handed interaction              7
            Finger interaction               1
     Object manipulation techniques          7
         Navigation techniques               4
           Gesture recognition               4
             Physics engine                  7
                  3D audio                   4
  The 3DUI platform is available as a "1-
           click-install" package            7
The 3DUI platform is able to emulate input
    devices with mouse and keyboard          7
The 3DUI platform offers a set of basic 3D
    interaction techniques that can be
 combined like building blocks, to easily
        create sophisticated 3DUIs           6
   The 3DUI platform has an option for
   graphical programming of the 3DUIs        7
 The 3DUI platform has tools to present
     the interaction states, interaction
     variables, event triggers, and the
       dependencies between them             6
  The 3DUI platform is developed as an
            open source project              5




What other features would you like to see
       in a good 3DUI platform?
 Any other thoughts about how to make
 3DUI application development easier?




       Feedback on this survey
 What is the most important interactive
  element in your 3DUI application?       Visuals
  What is usually the most important
    interactive element in the 3DUI
    applications that you develop?        Visuals

How important are those features for your
 3DUI application? [3D stereographics] 5 Very important
How important are those features for your
  3DUI application? [Head tracked view
               rendering]                                   3

How important are those features for your
3DUI application? [Full-body interaction] 1 Not important
How important are those features for your
    3DUI application? [Two-handed
              interaction]                                  4

How important are those features for your
  3DUI application? [Finger interaction]  1 Not important
How important are those features for your
 3DUI application? [Gesture recognition] 1 Not important

How important are those features for your
3DUI application? [Navigation techniques]   1 Not important
How important are those features for your
 3DUI application? [Object manipulation
               techniques]                  1 Not important
How important are those features for your
   3DUI application? [Physics engine]                         3
How important are those features for your
      3DUI application? [3D audio]          1 Not important
  How many years ago was your 3DUI
          application released?                               0
 How many people were using your 3DUI
 application when it was most popular?      2-5
   Experience in user interface design
                          6/16/2011 14:25:10                   6/16/2011 15:23:23
Finland                                        Finland
Male                                           Male
                                         23                                   27
                                          4                                    3

Student                                        Student

No experience                                  No experience


                                          0                                    0

                                          1                                    1

                                          1                                    1
                                          6                                    5

                                          6                                    4

                                          6                                    5

                                          5                                    6
                                          6                                    5
                                          6                                    3




Design and Architecture                        Entertainment
6DOF device or 3D mouse, Head tracking      6DOF device or 3D mouse, Head tracking




Surround-screen displays (e.g. CAVE, ...)   Surround-screen displays (e.g. CAVE, ...)




                                            Ball busting game.
Application is complete and I will not      Application is complete and I will not
upgrade it further                          upgrade it further




processing                                  processing


1 person                                    2-3 people
Research                            Research

Inherited from 3DUI platform        Inherited from 3DUI platform


Inherited from 3DUI platform        Not present in my application

Not present in my application       Inherited from 3DUI platform

Inherited from 3DUI platform        Inherited from 3DUI platform

Not present in my application       Not present in my application

Not present in my application       Not present in my application

Not present in my application       Not present in my application


Implemented by us                   Not present in my application

Not present in my application       Implemented by us

Not present in my application       Not present in my application

Yes                                 Yes


Yes                                 Yes


No                                  No


No                                  No

                                2                                   6

                                5                                   2

                                6                                   6
                                7                                   6
Yes       No

Yes       Yes

      4         4

      4         4

      4         4




      4         4


      4         4


      3         4

      6         4


      5         5
      6         3


      6         2
4   4




5   3


4   2


3   2


7   6




7   6
1   1


4   4
RUIS       RUIS




       6          3
       6          6
       6          6
6   4
4   4
6   4
6   4
4   5
4   6
2   7

7   3

7   6




7   4

6   4




7   2

5   2
Visuals              Visuals


Visuals              Visuals


                   4 5 Very important


                   2 1 Not important


1 Not important      5 Very important


5 Very important                        3


1 Not important      1 Not important
1 Not important       1 Not important


1 Not important       1 Not important


                  4 1 Not important

1 Not important                         2

1 Not important       1 Not important

                  0                     0

6-15                  2-5
                6/16/2011 15:34:11                             6/16/2011 17:26:23
Finland                              Finland
Male                                 Male
                               24                                             23
                                4                                              3

Student                              Student

0-1 years                            0-1 years


                                0                                              0

                                1                                              1

                                0                                              1
                                7                                              5

                                7                                              3

                                7                                              5

                                7                                              6
                                7                                              4
                                7                                              6




Entertainment                        Design and Architecture
6DOF device or 3D mouse, Head tracking      6DOF device or 3D mouse, Head tracking


                                            Projector, Surround-screen displays (e.g.
Surround-screen displays (e.g. CAVE, ...)   CAVE; ...)




Application is incomplete and I will not    Application is complete and I will not
develop it further                          upgrade it further




processing                                  processing


2-3 people                                  1 person
Research                            Research

Inherited from 3DUI platform        Inherited from 3DUI platform


Inherited from 3DUI platform        Inherited from 3DUI platform

Not present in my application       Not present in my application

Inherited from 3DUI platform        Inherited from 3DUI platform

Not present in my application       Not present in my application

Not present in my application       Not present in my application

Implemented by us                   Implemented by us


Implemented by us                   Implemented by us

Inherited from 3DUI platform        Not present in my application

Not present in my application       Not present in my application

Yes                                 Yes


Yes                                 Yes


No                                  No


No                                  No

                                4                                   5

                                4                                   4

                                1                                   5
                                4                                   3
Yes       No

Yes       Yes

      4         4

      7         4

      1         3




      1         4


      1         2


      4         2

      4         2


      4         6
      1         3


      1         2
1   5




1   6


7   5


1   4


4   5




7   3
1   7


4   1
RUIS       RUIS




       7          6
       4          6
       7          4
4   4
4   3
7   6
7   5
4   6
4   5
7   3

4   5

7   6




7   6

4   6




7   6

1   3
Visuals                Visuals


Visuals                Visuals


5 Very important                         4


                   3                     4


1 Not important        1 Not important


5 Very important                         2


1 Not important        1 Not important
                   3                      3


5 Very important       5 Very important


5 Very important       5 Very important

5 Very important                          3

1 Not important        1 Not important

                   0                      0

2-5                    6-15
                         6/16/2011 17:39:17                   6/16/2011 19:47:03
Finland                                       Finland
Male                                          Male
                                        29                                   26
                                         5                                    4

Student                                       Student

0-1 years                                     1-3 years


                                         0                                    0

                                         1                                    3

                                         1                                    2
                                         5                                    6

                                         5                                    6

                                         5                                    7

                                         6                                    5
                                         6                                    6
                                         5                                    5




Simulator and training                        Entertainment
6DOF device or 3D mouse, Head tracking      6DOF device or 3D mouse, Head tracking




Surround-screen displays (e.g. CAVE; ...)   Surround-screen displays (e.g. CAVE, ...)




                                            ski jumping game
Application is incomplete and I will not    Application is incomplete and I keep
develop it further                          developing it




processing                                  processing


2-3 people                                  2-3 people
Hobby                               Research

Inherited from 3DUI platform        Inherited from 3DUI platform


Inherited from 3DUI platform        Inherited from 3DUI platform

Not present in my application       Not present in my application

Inherited from 3DUI platform        Inherited from 3DUI platform

Not present in my application       Inherited from 3DUI platform

Not present in my application       Not present in my application

Not present in my application       Not present in my application


Not present in my application       Not present in my application

Not present in my application       Implemented by us

Not present in my application       Not present in my application

Yes                                 Yes


Yes                                 No


No                                  No


Yes                                 Yes

                                5                                   5

                                2                                   3

                                5                                   6
                                5                                   6
Yes       Yes

Yes       Yes

      3         2

      7         2

      1         4




      3         5


      1         2


      5         2

      2         2


      6         3
      4         4


      4         3
5   4




5   4


5   2


5   3


5   2




5   5
5   3


6   4
RUIS       RUIS




       6          6
       5          6
       3          4
6   5
4   6
5   4
5   4
5   6
4   5
5   5

4   6

7   5




5   6

5   5




5   4

4   6
Visuals                Visuals


Visuals                Visuals


5 Very important                         4


5 Very important                         3


1 Not important        1 Not important


                   4                     4


1 Not important                          2
1 Not important       1 Not important


1 Not important       1 Not important


1 Not important       1 Not important

1 Not important                         4

                  3                     3

                  0                     0

6-15                  6-15
                6/16/2011 20:43:27                   6/16/2011 21:58:56
Finland                              Finland
Female                               Male
                               26                                   25
                                5                                    7

Student                              Student

0-1 years                            No experience


                                0                                    0

                                1                                    1

                                1                                    1
                                4                                    6

                                4                                    7

                                3                                    5

                                5                                    4
                                5                                    6
                                7                                    5




Entertainment                        Entertainment
6DOF device or 3D mouse, Head tracking        6DOF device or 3D mouse, Head tracking

 Surround-screen displays (e.g. CAVE, ...),
Headphones (audio), External speakers         Surround-screen displays (e.g. CAVE; ...),
(audio)                                       External speakers (audio)




                                              Simple FPS game in Upponurkka CAVE-like
                                              environment, using dual Wiimotes to shoot
                                              at enemies and head tracking to dodge
                                              enemy fire.
Application is complete and I will not        Application is complete and I will not
upgrade it further                            upgrade it further




processing                                    processing


2-3 people                                    2-3 people
Hobby                               Research

Inherited from 3DUI platform        Inherited from 3DUI platform


Inherited from 3DUI platform        Inherited from 3DUI platform

Not present in my application       Not present in my application

Inherited from 3DUI platform        Inherited from 3DUI platform

Not present in my application       Not present in my application

Not present in my application       Not present in my application

Not present in my application       Not present in my application


Not present in my application       Not present in my application

Inherited from 3DUI platform        Inherited from 3DUI platform

Not present in my application       Not present in my application

No                                  No


Yes                                 Yes


No                                  No


No                                  No

                                7                                   6

                                2                                   2

                                6                                   5
                                6                                   5
          The game would've required a lot more
          testing to make it reasonably fun. Now it just
          works, but it's more proof-of-concept than a
          game that I would play several times.

Yes       No

Yes       Yes

      4                                                2

      7                                                2

      3                                                1




      5                                                4


      3                                                1


      5                                                4

      2                                                2


      3                                                3
      1                                                3


      3                                                4
2   5




2   4


2   4


2   3


2   3




6   6
2   3


1   1
RUIS       RUIS




           jBullet was used, mostly just for collision
           detection
       7                                                 5
       7                                                 5
       7                                                 4
7   5
5   5
5   6
5   6
6   4
6   6
6   5

5   5

7   7




5   6

5   5




7   5

4   4
                     Why did I have to answer the same
                     questions first with radio buttons with
                     numbers 1 to 9 on them, and then using
                     dropdowns? I think sorting the radio button
                     ratings afterwards and picking four highest
                     ones would've yielded the same result.

Visuals              Visuals


Visuals              Visuals


5 Very important                                                   3


5 Very important                                                   4


                   3 1 Not important


5 Very important     5 Very important


1 Not important      1 Not important
1 Not important       1 Not important


1 Not important       1 Not important


1 Not important       1 Not important

1 Not important                         4

1 Not important       1 Not important

                  0                     0

2-5                   2-5
                6/17/2011 9:39:48                              6/20/2011 15:03:58
Finland                             Finland
Male                                Male
                              25                                              23
                               5                                               6

Student                             Student

0-1 years                           0-1 years


                               0                                               0

                               2                                               1

                               2                                               1
                               6                                               6

                               5                                               7

                               4                                               7

                               4                                               7
                               5                                               6
                               4                                               5




                                    I think working with them is fun.
Entertainment                       Entertainment
6DOF device or 3D mouse, Head tracking      6DOF device or 3D mouse, Head tracking


                                            Surround-screen displays (e.g. CAVE, ...),
Surround-screen displays (e.g. CAVE; ...)   Headphones (audio)




A ski jumping game / "simulator"            The Star Wars project.
Application is complete and I will not      Application is complete and I will not
upgrade it further                          upgrade it further




processing                                  processing


2-3 people                                  2-3 people
Research                            Hobby

Inherited from 3DUI platform        Inherited from 3DUI platform


Inherited from 3DUI platform        Inherited from 3DUI platform

Implemented by us                   Not present in my application

Inherited from 3DUI platform        Inherited from 3DUI platform

Not present in my application       Not present in my application

Not present in my application       Not present in my application

Not present in my application       Not present in my application


Not present in my application       Inherited from 3DUI platform

Implemented by us                   Inherited from 3DUI platform

Not present in my application       Implemented by us

Yes                                 Yes


Yes                                 Yes


No                                  No


No                                  No

                                2                                   7

                                6                                   4

                                5                                   5
                                6                                   5
In the end, everything went much better than
could be expected (given our problems with
time management and teamwork). The
application didn't seem to be missing
anything major. The only reason for a little
dissatisfaction is that we didn't have the time
to really tune all the needed constants, and Since we were making the game it would've
thus the "feel" of the game isn't as good as it been great if we had had more time to
could be.                                       playtest and make it fun to play.

Yes                                           No

Yes                                           Yes

                                          4                                              4

                                          4                                              4

                                          4                                              5




                                          4                                              3


                                          4                                              3


                                          3                                              3

                                          2                                              2


                                          2                                              4
                                          2                                              1


                                          5                                              5
RUIS wouldn't work on Mac OS X no matter
what. I spent over 10 hours in total trying to
get different versions of OpenCV and
JavaCV to work together, and then installing
everything inside a virtual machine and trying
to get hardware 3D acceleration to work
(which I couldn't). This was the biggest
obstacle for me in the beginning.
                                            1    5




                                            5    4


                                            2    6


                                            2    4


                                            3    5




                                            6    6
                                            6    5


                                            1    3
RUIS       RUIS




       7          7
       7          7
       5          4
7   4
3   3
5   6
4   5
5   5
1   2
4   5

2   7

6   5




3   6

1   6




5   6

7   2
Graphical programming of 3DUIs sounds
good, but it would require an amazingly good
UI itself. Graphical programming tools
haven't really had success in the past. Of
course there are UI designer applications,
but they rely on existing widget sets. It's hard
to imagine that a single chosen set of
widgets, actions, gestures etc could be
sufficient for a great proportion of 3DUIs. A
good 3DUI designer would probably need a Integrating the hardware with one click would
3DUI itself, and so with current technology it also be great, for example including stuff to
wouldn't be very accessible either.              connect wiimotes easily.




Visuals                                         Audio


Visuals                                         Audio


                                            4                                             2


5 Very important                                                                          4


5 Very important                                1 Not important


5 Very important                                5 Very important


1 Not important                                 1 Not important
1 Not important        1 Not important


1 Not important        1 Not important


1 Not important        1 Not important

5 Very important                         2

                   3 5 Very important

                   0                     0

6-15                   2-5
                6/22/2011 16:57:06                             6/22/2011 23:02:45
Finland                              Finland
Male                                 Male
                               22                                                31
                                6                                                 4

Student                              Student

0-1 years                            1-3 years


                                0                                                 0

                                2                                                 1

                                2                                                 1
                                6                                                 3

                                6                                                 5

                                6                                                 4

                                7                                                 6
                                7                                                 7
                                6                                                 5




                                     Sound in New Media, new ways of
                                     developing haptics for 3d user interface
                                     design that involve sound, various outlets for
                                     spatial sound applications
Entertainment                        Entertainment
6DOF device or 3D mouse, Head tracking      6DOF device or 3D mouse, Head tracking

                                             Surround-screen displays (e.g. CAVE; ...),
                                            Headphones (audio), External speakers
Surround-screen displays (e.g. CAVE; ...)   (audio)



                                            Our 3dui application was creating a 3d
                                            game. This was done by augmenting a
                                            scene from Star Wars, where Luke
                                            Skywalker trains to be a Jedi blindfolded, in
                                            a deflection game between a flying missile
                                            bot and his saber.
                                            The 3d sounds were augmented via binaural
                                            functions through a pure data programme
                                            and the visual environment and game logic
                                            (that triggered sounds via OSC) was
                                            programmed into RUIS.
Application is complete and I will not      Application is incomplete and I keep
upgrade it further                          developing it

                                            The application feels incomplete for me
                                            because it could not be tested with speakers
                                            or ambisonics as opposed to with
                                            headphones, which would have been the
                                            ideal environment for the game.
                                            Headtracking was not part of the
                                            headphones, so it assumed user stood
                                            place, which was fair enough for demo.
                                            Also there were glitches in the programme
                                            that needed to be sorted out too.
                                            The game visuals have to be enhanced to a
                                            convincing level for one to actually play it
                                            enjoyably. The sounds could be improved.
                                            In the game, one has to build the intro
                                            dramaturgy, levels, points of conflict etc
                                            more sharply and this one was just a demo.
processing                                  puredata


2-3 people                                  2-3 people
Hobby                               Hobby

Inherited from 3DUI platform        Inherited from 3DUI platform


Not present in my application       Not present in my application

Not present in my application       Not present in my application

Inherited from 3DUI platform        Implemented by us

Not present in my application       Inherited from 3DUI platform

Not present in my application       Inherited from 3DUI platform

Not present in my application       Inherited from 3DUI platform


Not present in my application       Inherited from 3DUI platform

Inherited from 3DUI platform        Inherited from 3DUI platform

Inherited from 3DUI platform        Implemented by us

Yes                                 Yes


Yes                                 Yes


No                                  Yes


No                                  Yes

                                6                                   4

                                3                                   5

                                5                                   4
                                5                                   4
          The 3d sounds could have been
          programmed better, and could have had a
          game logic within itself too.

No        Yes

Yes       Yes

      3                                             2

      3                                             6

      4                                             5




      4                                             6


      5                                             3


      3                                             6

      2                                             7


      4                                             6
      3                                             5


      2                                             5
     The alternative activities at Taik-design
    factory, which took away from the time spent
    on organizing meetings for carrying out this
    3dUI development properly.
    The huge gaps without mandatory mentor
    meetings.

    However compared to ones above, these
    were personal obstacles.
4                                              2




3                                              5


3                                              4


3                                              5


2                                              6




1                                              7
4                                              6


3                                              2
           * there was conflicting courses between the
           long project development phases, especially
           from my side, distance between team
           members too much
           - hands on approach, cannot work outside
           the control room (as serious as no.2 above)
           - control room booking timing too sparse
           - quite a radially new field with lack of tacit
           knowledge around in case of obstacles
           - spatial audio sound simulation for 3d
           sounds, environment complicated and
           testing was available only for headphones
           (as serious as no.2 above)
           - fragmentation between testing environment
           with osculator and windows based system at
           Tkk on main machine




RUIS       RUIS




           pure data..but for 3d sounds, could also use
           a variety of things in future..like c.sound,
           supercollider and surely max-msp
       5                                                 7
       3                                                 7
       3                                                 5
5                            6
3                            7
4                            6
4                            7
3                            7
5                            5
6                            5

6                            4

7                            6




5                            5

6                            5




4                            5

5                            6




    more options for sound
                                                 no




I feel there's some repetition in the questions
as first it asks "how important these 10
things are" and right after "which is the most good and thorough survey, maybe a bit long
important". Overally this made the              but its ok since now there is good qualitative
questionnaire a bit long.                       data!

Audio                                            Audio


Audio                                            Audio


                                             3 5 Very important


                                             4                                               4


1 Not important                                  1 Not important


5 Very important                                 5 Very important


1 Not important                                  5 Very important
1 Not important        5 Very important


1 Not important        5 Very important


1 Not important                           4

                   4                      3

5 Very important       5 Very important

                   0                      0

2-5                    2-5
                          6/24/2011 17:25:16                             7/18/2011 6:46:52
Finland                                        South Korea
Male                                           Male
                                          25                                            24
                                           3                                                7

Student                                        Professional

No experience                                  0-1 years


                                           0                                                0

                                           1                                                2

                                           0                                                0
                                           4                                                7

                                           6                                                7

                                           6                                                6

                                           7                                                7
                                           4                                                7
                                           5                                                5




                                               Intuitive- same as real world
                                               more dimension control than 2D.
It's a cool new technology with largely        Devices are being developped for 3D - that
unknown potential.                             means researches for 3DUI will be useful.
Entertainment                                  Communication and Collaboration
                                            Kinect, 6DOF device or 3D mouse, Data
6DOF device or 3D mouse, Head tracking      gloves


                                            Monitor (or TV), Tactile device (eg. rumble
Surround-screen displays (e.g. CAVE; ...)   device; ...)




                                            -Collaboration between multiusers by using
                                            Kinect, Stereoscopic display environ.
Application is incomplete and I will not    Application is incomplete and it is developed
develop it further                          further




processing                                  C/C++


2-3 people                                  2-3 people
Hobby                               Research

Inherited from 3DUI platform        Inherited from 3DUI platform


Inherited from 3DUI platform        Not present in my application

Not present in my application       Not present in my application

Implemented by us                   Inherited from 3DUI platform

Not present in my application       Not present in my application

Not present in my application       Inherited from 3DUI platform

Implemented by us                   Implemented by us


Implemented by us                   Implemented by us

Not present in my application       Inherited from 3DUI platform

Not present in my application       Not present in my application

Yes                                 No


Yes                                 No


No                                  Yes


No                                  No

                                6                                   2

                                6                                   4

                                2                                   2
                                3                                   3
Didn't get to implement enough features or       not intuitve yet to use 3DUI with 3D user
polish them enough.                              interaction

No                                               No

No                                               Yes

                                             1                                               6

                                             4                                               4

                                             4                                               3




                                             4                                               4


                                             2                                               5


                                             5                                               3

                                             5                                               6


                                             2                                               3
                                             2                                               4


                                             3                                               4
    Understanding of 3D graphics is needed.
    Devices test is difficult and a lot of times are
    consumed.
5                                                  4




5                                                  6


5                                                  4


6                                                  5


6                                                  5




6                                                  7
7                                                  6


4                                                  6
           OpenNI, PrimeSense NITE,
RUIS       OpenSceneGraph




       7                              6
       6                              6
       5                              2
6   6
4   5
6   7
4   7
5   5
4   2
6   5

6   3

6   3




6   4

4   4




6   5

5   6
Visuals               Visuals


Visuals               Visuals


                  4                     3


                  3 1 Not important


1 Not important       1 Not important


                  3 5 Very important


1 Not important       1 Not important
1 Not important                         2


                  4 5 Very important


                  4 5 Very important

                  4                     2

1 Not important       1 Not important

                  0                     1

2-5                   6-15
                                        6
                          7/21/2011 17:12:00                            7/26/2011 14:11:57
Canada                                           Finland
Male                                             Male
                                            24                                           27
                                             7                                            5

Professional                                     Professional

1-3 years                                        0-1 years


                                             0                                            2

                                             2                                            2

                                             2                                            2
                                             7                                            7

                                             7                                            7

                                             4                                            7

                                             5                                            4
                                             7                                            7
                                             2                                            3
I like being able to make a difference. If
something is harder to do than it should be, I
want to make a new UI that will let you do it
more easily.

I get inspired after using devices like iPhone,
or Mac OS X, or Windows with a Synaptics
multi-touch touchpad with custom drivers
(two-finger-scrolling)... I enjoy to think about
how a robust trackpad should work. How to
transition between different multi-touch
states. How to treat different types of input
devices in a common way. How to efficiently
map their inputs to interaction techniques.
It's fun to try to take things to as close to    research agenda of project funding my
perfection as possible.                          research
Simulator and Training                           Navigation
WiiMote, WiiMote Nunchuk attachment,
WiiMote Motion Plus attachment, Wii             inertial sensor (gyroscopes, accelerometers,
Balance Board, Dance Mat                        magnetometers)




Monitor (or TV), External speakers (audio)      Mobile display (e.g. tablet; mobile phone; ...)




It allows you to navigate a virtual
supermarket, with the task of finding certain
objects, putting them into a shopping cart,
and then putting them on a table near           motion based control of a navigation demo
starting point.                                 application on a nokia n800
Application is complete and it is NOT           Application is complete and it is NOT
developed further                               developed further




C/C++                                           flash, actionscript, puredata


1 person                                        2-3 people
Research                            Research

Not present in my application       Not present in my application


Not present in my application       Not present in my application

Not present in my application       Not present in my application

Implemented by us                   Implemented by us

Not present in my application       Inherited from 3DUI platform

Not present in my application       Not present in my application

Implemented by us                   Implemented by us


Implemented by us                   Implemented by us

Not present in my application       Not present in my application

Not present in my application       Not present in my application

No                                  No


Yes                                 Yes


No                                  No


Yes                                 No

                                5                                   2

                                5                                   2

                                5                                   4
                                2                                   5
I had to re-implement a 3DUI application
created by other people previously (it won
3DUI 2010 contest), so that I could run a
study and compare my own 3DUI application
(that uses keyboard/mouse primarily) against
this 3DUI app that uses Wiimotes and
balance board. It was frustrating because I
wasn't used to working with Wiimote devices,
and I didn't enjoy having to reimplement
someone else's work when I had my own
project to focus on improving.

No                                             Yes

Yes                                            Yes

                                          2          2

                                          2          2

                                          5          5




                                          6          5


                                          5          3


                                          3          4

                                          3          4


                                          2          4
                                          5          3


                                          5          3
I had to mess my code up a lot to quickly
hack in support for multiple Wiimote devices,
and to add support for "modes" where
depending on what mode you're in, different
things happen (that wasn't the case in my
code before, everything was in one mode).
But this is pretty generic stuff... Sorry, can't
think of anything concrete here atm.
                                               5   2




                                               1   4


                                               5   4


                                               6   5


                                               5   5




                                               2   5
                                               4   5


                                               4   4
Unofficial Wiimote programming library,
Custom platform




I kinda ported my existing mouse-based
3DUI application (OpenGL, Opcode) to make
use of the wiimote devices for object
selection and shopping cart. The wii balance
board and dance mat were used for            programmed from scratch using puredata/C
navigation.                                  and flash/actionscript
                                          5                                             5
                                          6                                             6
                                          5                                             5
                                              5    6
                                              5    7
                                              6    6
                                              6    6
                                              5    6
                                              5    5
                                              5    6

                                              7    7

                                              7    7




                                              6    5

                                              2    5




                                              3    6

It should have a nice input processing         7   5
interface that allows you to treat input
devices in a common way. For example, one
can think of a mouse as a device a certain
number of buttons (0/1 state, up/down
events), axes (input on a fixed scale, like 0-1
or 1-1280 absolute positions), sliders
(relative movement, e.g. +3.261). Similarly, a
Wiimote is also a device that presents a
larger amount of buttons, axes, sliders. Even
a 3D accelerometer is nothing more than 3
axes.

Then, you can build your own interaction
techniques on top of those raw input devices
and map hardware devices to these
interaction techniques. If your technique
requires 4 axes, pehaps you can use one
Wiimote or two computer mouses, or a
mouse and a joystick, etc.
Make it well known, make it easy for people
to try out and get started.

If no one knows about it, or they know about
it but figure "eh, it's probably crappy so I'll
just do it on my own using what I know" then
it won't be much help. You have to make it
very easy and friction-less for people to try it
out/get into it.




I'll send it to you separately in an email. This
is Dmitri.

Visuals                                            Visuals


Visuals                                            Visuals


                                               2 1 Not important


                                               2 1 Not important


                                               3 1 Not important


5 Very important                                                   4


1 Not important                                                    4
1 Not important        1 Not important


5 Very important                          4


5 Very important       5 Very important

                   2 1 Not important

                   2 1 Not important

                   1                      3

6-15                   6-15
                   4                      2
                          7/28/2011 10:40:14                 8/1/2011 19:43:20
Switzerland                                      Slovenia
Male                                             Male
                                            29                             23
                                             5                              5

Hobbyist                                         Hobbyist

1-3 years                                        0-1 years


                                             0                              0

                                             4                              1

                                             2                              0
                                             7                              6

                                             6                              7

                                             5                              6

                                             5                              7
                                             5                              7
                                             3                              5




I studied Interaction Design and thats part of
our progamm
Visualization                                    Art
Kinect                                         Kinect, WiiMote




Projector                                      Head-mounted display




everything can be found here:
http://www.michaelfretz.com/2011/06/11/vent
ana-interactive-shop-window-bachelor-
project/
Application is incomplete and it is developed Application is incomplete and it is developed
further                                       further




still some improvments needed to use in real
life and public space
processing, flash                              Java


No one else                                    1 person
Research                            Hobby

Not present in my application       Implemented by us


Not present in my application       Implemented by us

Implemented by us                   Inherited from 3DUI platform

Not present in my application       Implemented by us

Not present in my application       Implemented by us

Implemented by us                   Inherited from 3DUI platform

Implemented by us                   Not present in my application


Implemented by us                   Not present in my application

Not present in my application       Not present in my application

Not present in my application       Not present in my application

Yes                                 No


No                                  No


No                                  No


Yes                                 Yes

                                4                                   1

                                4                                   6

                                3                                   3
                                3                                   5
Yes       Yes

Yes       Yes

      1         3

      3         6

      2         6




      2         6


      3         5


      2         7

      5         6


      3         7
      4         5


      6         6
2   4




1   7


4   7


3   5


5   4




4   6
2   4


1   2
OpenNI, PrimeSense NITE       OpenNI, PrimeSense NITE




                          3                             6
                          6                             6
                          7                             7
7   7
7   6
4   5
6   6
7   7
2   3
3   4

1   5

3   6




3   7

1   6




3   6

7   7
Visuals             Visuals


Visuals             Visuals


1 Not important     5 Very important


1 Not important     5 Very important


                  4 5 Very important


1 Not important                        4


1 Not important                        3
                  2                     3


                  2                     2


                  2                     2

1 Not important       1 Not important

1 Not important       1 Not important

                  0                     0

200-1,000                               1
                  5                     3
            8/1/2011 20:10:10                   8/2/2011 11:29:04
USA                             Egypt
Male                            Male
                          26                                  19
                           3                                   5

Hobbyist                        Hobbyist

0-1 years                       1-3 years


                           0                                   1

                           1                                   1

                           0                                   1
                           7                                   7

                           7                                   7

                           7                                   7

                           7                                   7
                           7                                   7
                           4                                   6




Education                       Entertainment
Kinect                                           Kinect, Keyboard, 2D Mouse




Surround-screen displays (e.g. CAVE, ...)        Monitor (or TV)




A 3-dimensional panorama viewer streamed
onto a 9-screen video wall using the Kinect
for user input for panorama navigation.
Application is incomplete and it is developed Application is complete and it is NOT
further                                       developed further




Too much responsibility on one person. The
project should be finished within the next two
weeks.
C#                                               Python


No one else                                      2-3 people
Research                            Hobby

Not present in my application       Not present in my application


Not present in my application       Not present in my application

Inherited from 3DUI platform        Not present in my application

Inherited from 3DUI platform        Not present in my application

Not present in my application       Not present in my application

Implemented by us                   Inherited from 3DUI platform

Implemented by us                   Not present in my application


Implemented by us                   Not present in my application

Not present in my application       Not present in my application

Implemented by us                   Not present in my application

No                                  Yes


No                                  Yes


No                                  No


Yes                                 No

                                5                                   3

                                7                                   4

                                6                                   5
                                6                                   3
Yes       Yes

Yes       Yes

      4         5

      4         1

      4         5




      4         6


      1         6


      6         7

      6         4


      4         5
      6         3


      7         2
The biggest problem was defunct meshes
that had been removed and were no longer
useful for the project, requiring finding new
ones. The next problem was discovering how
to handle rotation in DirectX. There were a
million tutorials on it and none of them said
the same things the same way.
                                           2    3




                                           2    2


                                           6    6


                                           3    7


                                           5    7




                                           5    5
                                           4    4


                                           7    2
Official Microsoft Kinect SDK                    OpenNI




This project originally started in Flash using
OpenExhibit's panorama viewer with CCV
interpreting Kinect data. Trying to translate
"touch" style navigation to free handed,
motion navigation was frustrating and
commonly caused Gimbal lock, so the
project was moved to Visual Studio to work
with the Microsoft Kinect SDK itself as soon
as that was released, and originally Axiom
3D was examined to create a Skybox viewer
to project panoramic surfaces onto, then this
was simplified directly to Direct3D.
                                             4            7
                                             1            7
                                             7            7
7   2
5   3
7   3
7   7
7   4
4   6
7   5

7   7

4   6




7   7

5   7




7   6

7   7
Visuals              Visuals


Visuals              Visuals


1 Not important                         3


1 Not important                         4


                   4 5 Very important


5 Very important                        2


1 Not important      1 Not important
5 Very important                          4


5 Very important       5 Very important


5 Very important                          3

1 Not important                           2

                   3 1 Not important

                   0                      1

                   1 50-200
                   5                      5
                              8/2/2011 12:29:46                             8/2/2011 14:13:04
USA                                               Portugal
Male                                              Male
                                            26                                              29
                                             7                                               5

Professional                                      Professional

0-1 years                                         0-1 years


                                             0                                               0

                                             4                                               1

                                             3                                               1
                                             7                                               7

                                             7                                               6

                                             4                                               6

                                             7                                               7
                                             7                                               7
                                             7                                               6




                                                  I had a good opportunity to do Master Thesis
I like to play motion games                       in a field that I enjoyed.
Entertainment                                     Education
Kinect                                        Kinect, WiiMote, Keyboard, 2D Mouse




Monitor (or TV), Projector                    Humanoid Robot




                                              My application allowed the user to control the
                                              iCub humanoid robot through the use of a
                                              Wiimote or a Kinect.
Application is incomplete and it is developed Application is complete and it is NOT
further                                       developed further




C#                                            C/C++


2-3 people                                    No one else
Commercial                          Research

Not present in my application       Inherited from 3DUI platform


Implemented by us                   Not present in my application

Inherited from 3DUI platform        Inherited from 3DUI platform

Inherited from 3DUI platform        Not present in my application

Not present in my application       Inherited from 3DUI platform

Inherited from 3DUI platform        Implemented by us

Inherited from 3DUI platform        Implemented by us


Inherited from 3DUI platform        Not present in my application

Inherited from 3DUI platform        Not present in my application

Inherited from 3DUI platform        Not present in my application

Yes                                 Yes


No                                  Yes


No                                  No


No                                  Yes

                                4                                   3

                                5                                   4

                                5                                   5
                                5                                   5
          Although the goals of the work were
          achieved. I have understood there is much
          more that can be done in terms of
          interaction.

Yes       Yes

Yes       Yes

      3                                               1

      3                                               6

      3                                               5




      3                                               4


      3                                               4


      6                                               7

      4                                               6


      3                                               4
      4                                               5


      2                                               6
    No standards. 7
3                     3




4                     3


6                     5


3                     5


6                     6




7                     6
4                     1


3                     5
OpenNI, PrimeSense NITE, Official       OpenNI, PrimeSense NITE, Unofficial
Microsoft Kinect SDK, Unity3D           Wiimote programming library




                                        For the developement I used a Windows XP
using Unity3d                           machine with Visual Studio.
                                    1                                          7
                                    5                                          7
                                    7                                          7
7   7
4   7
7   4
7   4
6   7
7   4
4   7

7   6

3   7




7   7

7   4




7   7

5   7
Give us like 3 months to finish our work :)




                                                I would like to know what are you doing?
                                                It seems that you are very interested in the
                                                Interaction theme, I am also but just started
                                                to get to know this field.

too long!                                       Thank you

Visuals                                         Movement


Visuals                                         Movement


1 Not important                                 5 Very important


                                              2 1 Not important


                                              4 5 Very important


                                              4 1 Not important


                                              4 5 Very important
                   4 5 Very important


5 Very important       5 Very important


                   4 1 Not important

                   4 1 Not important

                   2 1 Not important

                   1                      0

50-200                 6-15
                   4                      3
                           8/8/2011 17:32:03                             8/8/2011 18:11:36
USA                                            Austria
Male                                           Male
                                          56                                           37
                                           7                                            7

Professional                                   Professional

over 15 years                                  7-15 years


                                           0                                            1

                                           3                                           10

                                           3                                            5
                                           7                                            7

                                           6                                            5

                                           7                                            4

                                           7                                            7
                                           7                                            6
                                           5                                            5




A belief that more (visually) immersive
information applications will enhance
personal productivity and creativity.
Communication and Collaboration                Science and Engineering
                                              Camera(s), 6DOF device or 3D mouse,
Camera(s), 6DOF device or 3D mouse,           Inertial sensor(s) (accelerometers and/or
Keyboard, 2D Mouse                            gyroscopes), Pen-based tablet

 Monitor (or TV), Head-mounted display,
Headphones (audio), External speakers
(audio)                                       Mobile display (e.g. tablet; mobile phone; ...)




Application is complete and it is developed   Application is incomplete and it is developed
further                                       further




Java                                          C/C++


4-7 people                                    2-3 people
Research                            Research

Inherited from 3DUI platform        Not present in my application


Implemented by us                   Implemented by us

Inherited from 3DUI platform        Not present in my application

Not present in my application       Not present in my application

Not present in my application       Not present in my application

Not present in my application       Not present in my application

Implemented by us                   Implemented by us


Implemented by us                   Inherited from 3DUI platform

Not present in my application       Not present in my application

Not present in my application       Not present in my application

Yes                                 No


Yes                                 No


Yes                                 No


Yes                                 Yes

                                2                                   6

                                7                                   5

                                5                                   6
                                3                                   5
Yes       Yes

Yes       Yes

      6         6

      6         5

      7         5




      7         7


      5         6


      6         3

      5         2


      5         2
      4         2


      6         1
2   6




4   5


6   6


6   7


6   6




4   5
6   4


2   1
JSR184                                       Studierstube




implemented most components from scratch.
Collaborated with "Motion Reality, Inc" in
Atlanta GA for motion tracking. also used
Intersense 3DoF devices and libraries plus
Ascension Bird 6DoF.
                                        5                   6
                                        7                   7
                                        5                   4
6   5
5   6
7   7
5   7
4   6
7   4
6   2

5   7

4   7




5   7

6   6




6   7

6   7
Visuals              Visuals


Visuals              Visuals


                   3 1 Not important


5 Very important     5 Very important


5 Very important     1 Not important


                   4 1 Not important


                   3 1 Not important
1 Not important       1 Not important


                  3                     4


                  4                     4

                  2 1 Not important

                  2 1 Not important

                  6                     2

15-50                 6-15
                  6                     5
                             8/8/2011 19:26:52                       8/8/2011 19:34:36
Germany                                              Canada
Male                                                 Male
                                                26                                 26
                                                 5                                  6

Hobbyist                                             Professional

0-1 years                                            1-3 years


                                                 0                                  1

                                                 1                                  2

                                                 0                                  1
                                                 5                                  6

                                                 7                                  6

                                                 6                                  4

                                                 4                                  4
                                                 5                                  6
                                                 5                                  3




the possibility for "normal" user to interact
not only via mouse and keyboard but also
using the kinect
Visualization                                        Visualization
Kinect, Eye tracker, Head Tracking                 Data gloves




Projector                                          Surround-screen displays (e.g. CAVE; ...)




The user physically moves his body in front
of the kinect to travel in the virtual 3D-Scene.
Selection and manipulation of virtual objects
are made using the gaze and bare hand              Immersive application for simulation and
gestures.                                          visualization of problems
Application is incomplete and it is developed      Application is complete and it is NOT
further                                            developed further




I just started with the concept and
implementation.
C#                                                 C/C++


No one else                                        4-7 people
Research                            Research

Not present in my application       Inherited from 3DUI platform


Not present in my application       Implemented by us

Inherited from 3DUI platform        Not present in my application

Implemented by us                   Implemented by us

Not present in my application       Not present in my application

Implemented by us                   Implemented by us

Implemented by us                   Not present in my application


Implemented by us                   Implemented by us

Not present in my application       Not present in my application

Not present in my application       Not present in my application

No                                  No


Yes                                 Yes


No                                  Yes


Yes                                 Yes

                                3                                   4

                                5                                   5

                                6                                   6
                                5                                   6
                           Developing 3DUIs takes a lot of time, testing
Still in development       them is even worse.

Yes                        Yes

Yes                        Yes

                       4                                               5

                       2                                               5

                       1                                               3




                       1                                               3


                       2                                               5


                       6                                               1

                       5                                               2


                       5                                               1
                       2                                               6


                       3                                               2
how to get the "right" needed data
interplay within a framework
                                     5   7




                                     1   3


                                     2   2


                                     5   5


                                     3   6




                                     3   5
                                     4   4


                                     1   1
Official Microsoft Kinect SDK, Unofficial
Kinect ToolKit, XNA                             OpenSceneGraph




                                            3                    7
                                            4                    7
                                            6                    2
                                  7   7
                                  7   5
                                  7   7
                                  7   7
                                  7   7
                                  6   4
                                  5   4

                                  5   1

                                  3   6




                                  6   6

                                  6   4




                                  6   5

                                  4   7




support different input devices
good documentation
low-level examples




Visuals                  Visuals


Visuals                  Visuals


1 Not important          5 Very important


1 Not important                             4


                     4 1 Not important


5 Very important         5 Very important


                     2                      3
5 Very important       5 Very important


5 Very important       1 Not important


                   4 5 Very important

                   2 1 Not important

1 Not important        1 Not important

                   0                      1

                   1 15-50
                   5                      2
                        8/8/2011 19:35:02                            8/8/2011 20:36:15
USA                                         Belgium
Male                                        Male
                                      28                                           27
                                       7                                            7

Professional                                Professional

3-7 years                                   3-7 years


                                       1                                            0

                                       5                                           10

                                       2                                           10
                                       7                                            7

                                       7                                            7

                                       6                                            7

                                       7                                            5
                                       7                                            7
                                       4                                            3




                                            I used to play MMORPGs which triggered an
                                            interest in VR and so forth ;).
Communication and Collaboration             Simulator and Training
                                              6DOF device or 3D mouse, Inertial sensor(s)
WiiMote, Inertial sensor(s) (accelerometers   (accelerometers and/or gyroscopes), Data
and/or gyroscopes)                            gloves, HapticMaster


                                              Projector, Ground-referenced haptic device
Monitor (or TV), External speakers (audio)    (eg. Novint Falcon; ...)




                                              The application I took in mind, was the one
                                              we developed for the first 3DUI Grand Prize
                                              (video submission winner, so hence it is
                                              easiest for me to refer you to the video:
                                              http://www.youtube.com/watch?v=3jr2R2_1C
                                              eQ )
Application is complete and it is NOT         Application is complete and it is NOT
developed further                             developed further




C#                                            C/C++


1 person                                      4-7 people
Research                            Research

Not present in my application       Implemented by us


Not present in my application       Not present in my application

Not present in my application       Not present in my application

Not present in my application       Implemented by us

Inherited from 3DUI platform        Not present in my application

Implemented by us                   Not present in my application

Not present in my application       Implemented by us


Not present in my application       Implemented by us

Not present in my application       Implemented by us

Not present in my application       Not present in my application

No                                  No


No                                  Yes


No                                  Yes


Yes                                 Yes

                                2                                   6

                                4                                   3

                                5                                   6
                                5                                   6
Yes       Yes

Yes       Yes

      2         6

      2         6

      5         2




      6         2


      2         5


      4         1

      3         4


      2         1
      1         1


      2         1
5   6




4   1


6   3


4   5


4   6




7   3
4   3


4   5
Bespoke 3DUI XNA Framework       VRPN, Ogre3D, H3D, Custom platform




                                 Home-made framework assembled
                                 specifically for this application based on
                                 VRPN and Ogre and H3D.

                                 And we used 3DS max studio for modelling.
                                 [this guy helped develope NIMMIT, a high
                                 level 3DUI description language]
                             5                                                7
                             6                                                7
                             3                                                5
3   7
3   5
7   7
7   7
7   5
3   5
3   6

3   6

7   5




6   6

6   6




6   6

7   6
                   A bigger community would be needed to
                   make development easier.
                   Trying to avoid the need or understandig of
                   complex mathematical principles might as
                   well be a huge improvement, even though
                   this won't be easy. Several description
                   languages do succeed in this, up to a certain
                   level.




Touch              Touch


Visuals            Touch


1 Not important    5 Very important


1 Not important                                                4


1 Not important                                                3


1 Not important                                                4


5 Very important   1 Not important
5 Very important       1 Not important


1 Not important        5 Very important


1 Not important        5 Very important

1 Not important        1 Not important

1 Not important        1 Not important

                   2                      2

15-50                  6-15
                   6                      6
            8/8/2011 20:56:08                             8/8/2011 20:56:43
Brazil                          USA
Male                            Male
                          32                                                37
                           7                                                 7

Hobbyist                        Professional

1-3 years                       7-15 years


                           2                                                 0

                           2                                                30

                           2                                                20
                           7                                                 7

                           7                                                 6

                           4                                                 7

                           7                                                 5
                           7                                                 7
                           7                                                 5




                                The personal feeling of being immersed in
                                an artificial world
Education                       Visualization
Camera(s), Pen-based tablet, Game
controller or joystick (without motion sensing) 6DOF device or 3D mouse




Mobile display (e.g. tablet; mobile phone; ...)   Monitor (or TV), Projector



                                                  Two-handed interaction for arbitrary data
                                                  (works best for 3d datasets, but also works
                                                  with googlemap-like applications). It works
                                                  exceptionally well for volumetric data, which
                                                  is difficult to do with a mouse and keyboard
                                                  because there are no surfaces to project the
                                                  mouse onto. If you are at SIGGRAPH check
                                                  out my talk at Real-Time Live on Monday
                                                  focusing on medical volume visualization
                                                  Monday, Tuesday, and Wednesday. I would
                                                  love to talk with you.
Application is complete and it is NOT             Application is complete and it is developed
developed further                                 further




C/C++                                             C/C++


2-3 people                                        2-3 people
Research                            Research

Not present in my application       Implemented by us


Inherited from 3DUI platform        Implemented by us

Implemented by us                   Implemented by us

Implemented by us                   Implemented by us

Implemented by us                   Not present in my application

Not present in my application       Implemented by us

Implemented by us                   Implemented by us


Not present in my application       Implemented by us

Not present in my application       Not present in my application

Not present in my application       Not present in my application

No                                  No


Yes                                 No


No                                  Yes


Yes                                 Yes

                                1                                   3

                                7                                   5

                                1                                   6
                                1                                   7
Devices did not exist to test hiphotesis, they       It is the best system I have worked on myself
were too heavy at the time.                          or used for navigation purposes.

No                                                   Yes

Yes                                                  Yes

                                                 7                                               5

                                                 7                                               5

                                                 7                                               2




                                                 7                                               2


                                                 7                                               2


                                                 7                                               6

                                                 7                                               6


                                                 4                                               4
                                                 4                                               4


                                                 1                                               3
                                             by 3DUI platform, I mean my company's own
Unknown/unclear limitations of input devices software libraries that had no documentation
devices, bad documentation/samples for       and the lead developer was only
devices, small/no driver support             occasionally available for questions.
                                           7                                            2




                                           1                                            3


                                           7                                            2


                                           7                                            5


                                           7                                            3




                                           1                                            5
                                           7                                            3


                                           7                                            2
                                             Using callbacks reduces problems of adding
                                             features/interactions making the system
                                             more complex.




OpenNI, ARToolKit, Ogre3D                    OpenSceneGraph, Custom platform




                                             XML




                                             By finger interaction above, I simply mean
AR-Toolkit aborted (due to technical         button presses. The greatest advantage of
limitations) and replaced by the BRA-TRACK   our system over other system is that you can
(not sure about the name), Tablet with       perform scale, rotation, and translation
custom buttons. Optional stereo to           simultaneously with a single gesture to
developed                                    intuitively view a point from any angle/scale.
                                         6                                                6
                                         7                                                5
                                         7                                                5
                                          7                                               7
                                          7                                               7
                                          1                                               7
                                          7                                               7
                                          1                                               6
                                          1                                               4
                                          1                                               4

                                          7                                               3

                                          7                                               4




                                          1                                               7

                                          1                                               5




                                          7                                               6

                                          5                                               4




                                              Good documentation! Seperability of
                                              components--e.g., seperate rendering from
                                              interaction techniques.

Very clear demos, very clear interface      By finger interaction above I mean button
control, very good documentation, very good presses (although Kinect did surprise me
drivers with multi-platform support         with what they can do without buttons).
Please, we need a standard for 3DUI design
or something similar to make things easier
for developers/researchers




Interesting.                                 Great questions!

Visuals                                      Visuals


Touch                                        Visuals


                                         2                      4


5 Very important                                                2


                                         4                      3


5 Very important                             5 Very important


5 Very important                             5 Very important
1 Not important        5 Very important


5 Very important       5 Very important


1 Not important        5 Very important

1 Not important                           3

1 Not important                           3

                   1                      7

6-15                   6-15
                   5                      7
                          8/8/2011 21:06:53                   8/9/2011 20:50:04
Brazil                                        France
Male                                          Male
                                        28                                  33
                                         7                                   7

Professional                                  Professional

1-3 years                                     3-7 years


                                         1                                   0

                                         4                                   5

                                         1                                   5
                                         7                                   7

                                         7                                   7

                                         7                                   7

                                         5                                   7
                                         7                                   7
                                         4                                   4




Science and Engineering                       Entertainment
WiiMote, Camera(s), Data gloves, Multitouch WiiMote, Inertial sensor(s) (accelerometers
surface                                     and/or gyroscopes)


Projector, Tactile device (eg. rumble device; Monitor (or TV), Projector, Head-mounted
...)                                          display




It is a glove with tactlite feedback for
imersive virtual reality applications. We built
the glove using lilypad arduino hardware and
wii remotes to track finger position through      http://www.vrgeeks.org/vr-
the IR camera.                                    experiences/vrescape
Application is complete and it is developed       Application is complete and it is NOT
further                                           developed further




Java                                              C#


2-3 people                                        4-7 people
Research                            Hobby

Inherited from 3DUI platform        Not present in my application


Not present in my application       Implemented by us

Not present in my application       Not present in my application

Not present in my application       Not present in my application

Implemented by us                   Not present in my application

Not present in my application       Not present in my application

Inherited from 3DUI platform        Implemented by us


Implemented by us                   Implemented by us

Inherited from 3DUI platform        Not present in my application

Not present in my application       Inherited from 3DUI platform

Yes                                 No


Yes                                 Yes


No                                  No


Yes                                 Yes

                                4                                   7

                                1                                   1

                                5                                   7
                                5                                   7
I expect to reach a better user experience
when comparing my device to a commercial
solution like a 3D mouse.

No                                               Yes

Yes                                              Yes

                                             6         1

                                             4         3

                                             7         3




                                             6         4


                                             1         1


                                             5         1

                                             5         1


                                             2         1
                                             1         1


                                             6         1
    Wires :)
4              3




4              1


7              5


5              3


5              3




2              3
4              3


6              7
Unofficial Wiimote programming library       VRPN, MiddleVR, Unity3D




                                             Unity + MiddleVR
                                         7                             7
                                         4                             7
                                         4                             6
7   6
7   6
7   7
7   7
7   4
6   5
3   6

7   7

7   6




7   6

6   4




5   4

4   1
Touch                Visuals


Touch                Visuals


                   4 5 Very important


1 Not important      5 Very important


1 Not important                         3


1 Not important                         2


5 Very important                        2
                   2                      2


5 Very important       5 Very important


5 Very important       5 Very important

                   3                      3

1 Not important        5 Very important

                   0                      0

2-5                    50-200
                   2                      5
                   8/11/2011 14:37:18                            8/11/2011 20:31:57
Sweden                                  Canada
Male                                    Male
                                  37                                            25
                                   4                                             5

Professional                            Hobbyist

3-7 years                               0-1 years


                                   4                                             0

                                   3                                             1

                                   2                                             0
                                   4                                             7

                                   7                                             7

                                   7                                             7

                                   6                                             6
                                   7                                             7
                                   5                                             5




Virtual Heritage                        Simulator and Training
WiiMote                                         Kinect, Keyboard, 2D Mouse


 Monitor (or TV), Surround-screen displays
(e.g. CAVE; ...)                                Monitor (or TV), Projector




A virtual museum in which the user could        My 3DUI application is a component-driven
navigate and interact with artifacts using a    framework for developing agent-based
Wii-mote + nunchuck.                            simulations of biological systems.
Application is incomplete and it is NOT         Application is incomplete and it is developed
developed further                               further




I proved too difficult to implement intuitive
and fluent interaction using GlovePie and the
VR suite EON Professional.
Javascript                                      Objective-C


1 person                                        More than 15
Research                            Research

Inherited from 3DUI platform        Not present in my application


Not present in my application       Implemented by us

Not present in my application       Not present in my application

Not present in my application       Implemented by us

Not present in my application       Not present in my application

Not present in my application       Inherited from 3DUI platform

Implemented by us                   Implemented by us


Implemented by us                   Implemented by us

Not present in my application       Implemented by us

Inherited from 3DUI platform        Not present in my application

No                                  No


No                                  Yes


No                                  No


No                                  No

                                4                                   5

                                6                                   4

                                2                                   5
                                3                                   6
                                              My system allows a subset of useful
                                              gestures needed for interacting with existing
I proved too difficult to implement intuitive simulations (though not constructing new
and fluent interaction using GlovePie and the ones from scratch), and this was my
VR suite EON Professional.                    intended goal.

No                                              Yes

Yes                                             Yes

                                            1                                             2

                                            1                                             2

                                            5                                             2




                                            6                                             2


                                            2                                             5


                                            6                                             6

                                            4                                             5


                                            4                                             5
                                            2                                             4


                                            4                                             7
The Windows XP built-in Bluetooth driver         Figuring out whether the user's hand was
worked very poorly. Things got much better       open or closed was quite arduous. Custom
when we changed to the Soleil driver.            gesture recognition was also difficult.
                                             2                                              5




                                             2                                              4


                                             5                                              6


                                             5                                              4


                                             4                                              5




                                             6                                              2
                                             4                                              1


                                             7                                              1
GlovePIE, EON SDK       OpenNI, PrimeSense NITE, Ogre3D




                        My app was written on OS X with Xcode and
                        Vim. It uses the OGRE graphics engine and
                        Bullet physics library.
                    5                                           5
                    7                                           6
                    3                                           6
7                                                   7
6                                                   7
7                                                   5
7                                                   5
7                                                   7
5                                                   1
5                                                   1

6                                                   5

5                                                   1




7                                                   6

6                                                   1




7                                                   6

2                                                   7




    At a minimum, I would like to see skeleton
    tracking (with no calibration pose required),
    easy custom gesture recognition, finger
    tracking, and hand open/closed detection.
Visuals               Visuals


Visuals               Visuals


                  4 1 Not important


                  2                   4


1 Not important                       4


1 Not important                       4


1 Not important                       4
1 Not important                         4


5 Very important                        4


5 Very important                        4

                   3 5 Very important

                   3 1 Not important

                   2                    2

                   1 15-50
                   6                    2
                         8/11/2011 20:42:40                    8/16/2011 6:24:01
India                                          New Zealand
Male                                           Male
                                          41                                 27
                                           7                                  6

Professional                                   Professional

3-7 years                                      1-3 years


                                           1                                  0

                                           2                                  5

                                           2                                  5
                                           7                                  7

                                           7                                  7

                                           7                                  6

                                           6                                  7
                                           7                                  6
                                           4                                  7




My research interests are in Assistive
technology and virtual environment.
Empowering visually impaired persons by
providing assistance and enhancement to
enhance their mobility.
Simulator and Training                         Entertainment
Locomotion interface                             Kinect

 Monitor (or TV), Headphones (audio),
External speakers (audio), Tactile device
(eg. rumble device; ...)                         Projector, External speakers (audio)




I am developing and evaluating new
locomotion interface as VE interaction
techniques for visually impaired persons to
explore large virtual spaces to create
cognitive maps which help them in real           Interactive wall to welcome guests into foyer.
navigation. This results in enhancing mobility   Includes 3 modules; Flying game, video
of them.                                         browser and virtual bubble grabbing game.
Application is complete and it is developed      Application is complete and it is developed
further                                          further




Java                                             Python


1 person                                         1 person
Research                            Commercial

Not present in my application       Not present in my application


Not present in my application       Not present in my application

Implemented by us                   Inherited from 3DUI platform

Not present in my application       Implemented by us

Not present in my application       Not present in my application

Not present in my application       Implemented by us

Implemented by us                   Implemented by us


Not present in my application       Not present in my application

Not present in my application       Implemented by us

Implemented by us                   Not present in my application

No                                  No


No                                  No


No                                  Yes


Yes                                 Yes

                                1                                   6

                                2                                   3

                                1                                   5
                                7                                   6
Results and analysis of our experimental
studies.

No                                             Yes

Yes                                            Yes

                                           6         2

                                           2         4

                                           6         3




                                           2         3


                                           2         2


                                           4         3

                                           6         3


                                           6         3
                                           6         2


                                           7         2
To motivate participants for experimental
studies.
To get financial and technical supports.
                                            2   2




                                            2   6


                                            2   4


                                            7   4


                                            7   6




                                            7   6
                                            2   3


                                            6   6
Requirement of knowledge of both hardware
and software.




Java 2D Graphics                            OpenNI, PrimeSense NITE, Ogre3D




                                            Ogre 3D, Python, C++
                                        6                                     3
                                        6                                     4
                                        7                                     7
5   5
5   5
7   2
7   4
6   6
6   2
7   2

6   4

1   2




7   4

7   1




7   4

7   5
This is very informative and useful survey for
3DUI application developer. I appreciate the
efforts of surveyor.
Please send me outcomes and collected
data to us at kkpatel7@gmail.com.

Audio                                            Visuals


Touch                                            Visuals


                                             3 1 Not important


                                             4 1 Not important


5 Very important                                                 4


                                             4                   4


                                             4                   2
5 Very important       5 Very important


5 Very important                          4


5 Very important       1 Not important

                   4                      2

5 Very important       1 Not important

                   1                      0

15-50                  1,000-10,000
                   6                      5
                         8/16/2011 17:01:40                            8/16/2011 17:31:36
USA                                           USA
Male                                          Male
                                        31                                            25
                                         5                                             5

Professional                                  Professional

3-7 years                                     0-1 years


                                         0                                             0

                                         7                                             4

                                         5                                             3
                                         4                                             5

                                         7                                             7

                                         7                                             7

                                         5                                             6
                                         7                                             6
                                         3                                             7




Simulator and Training                        Simulator and Training
                                                WiiMote, Camera(s), 6DOF device or 3D
Motion tracked suit (e.g. with Vicon;           mouse, Inertial sensor(s) (accelerometers
NaturalPoint; ...), Game controller or joystick and/or gyroscopes), Data gloves, Multitouch
(without motion sensing)                        surface, 2D Mouse

 Monitor (or TV), Head-mounted display,           Monitor (or TV), Projector, Surround-screen
Headphones (audio), External speakers            displays (e.g. CAVE; ...), External speakers
(audio), Tactile device (eg. rumble device; ...) (audio)




A simulation of a reconfigurable interface for
robot teleoperation in urban search-and-
rescue
Application is incomplete and it is developed Application is incomplete and it is developed
further                                        further




C/C++                                          C/C++


No one else                                    2-3 people
Research                            Research

Not present in my application       Inherited from 3DUI platform


Inherited from 3DUI platform        Inherited from 3DUI platform

Not present in my application       Not present in my application

Not present in my application       Implemented by us

Implemented by us                   Not present in my application

Not present in my application       Not present in my application

Implemented by us                   Implemented by us


Not present in my application       Implemented by us

Inherited from 3DUI platform        Inherited from 3DUI platform

Inherited from 3DUI platform        Not present in my application

Yes                                 Yes


Yes                                 Yes


No                                  No


Yes                                 Yes

                                3                                   3

                                4                                   5

                                2                                   3
                                3                                   3
Still much to be done before I can say
anything

Yes                                          Yes

Yes                                          Yes

                                         1         4

                                         1         5

                                         5         6




                                         6         5


                                         6         4


                                         4         5

                                         6         5


                                         2         5
                                         1         5


                                         1         4
1   3




6   4


1   4


1   3


1   4




1   4
1   5


1   3
C4 engine


                                     Unofficial Wiimote programming library, VR
C4 engine and TactaBox library       Juggler, VRPN




                                 7                                                7
                                 7                                                7
                                 7                                                4
7   6
7   3
7   6
7   6
5   3
7   7
7   4

3   3

4   5




7   3

5   5




7   3

7   6
I had 7 years of experience on DUI and did
not know which option to check on the
"Years of experience in _developing_ 3DUIs
*" question

Touch                                        Visuals


Visuals                                      Touch


                                         4             4


                                         3             4


1 Not important                                        2


                                         2             4


                                         4             2
1 Not important                           2


5 Very important       5 Very important


1 Not important                           4

5 Very important       5 Very important

                   4                      3

                   0                      1

                   1 6-15
                   5                      5
                         8/19/2011 17:12:30                    8/24/2011 10:30:46
Finland                                         Unknown
Male                                            Male
                                           35                                 37
                                            7                                  7

Professional                                    Professional

3-7 years                                       0-1 years


                                            6                                  1

                                            6                                  5

                                            6                                  2
                                            5                                  7

                                            6                                  6

                                            5                                  7

                                            7                                  7
                                            6                                  7
                                            3                                  3




The content that is to be created/viewed
using them
Virtual Heritage                                Education
                                                  Multitouch surface, Pen-based tablet,
Kinect                                            Keyboard, 2D Mouse


                                                   Monitor (or TV), Projector, Mobile display
Projector, External speakers (audio)              (e.g. tablet; mobile phone; ...)




A digital cultural history project: interactive
reconstruction of a shipwreck
Application is complete and it is developed       Application is complete and it is developed
further                                           further




Unity                                             C#


4-7 people                                        4-7 people
Research                            Commercial

Implemented by us                   Implemented by us


Not present in my application       Not present in my application

Implemented by us                   Not present in my application

Not present in my application       Not present in my application

Not present in my application       Inherited from 3DUI platform

Implemented by us                   Inherited from 3DUI platform

Inherited from 3DUI platform        Implemented by us


Implemented by us                   Implemented by us

Inherited from 3DUI platform        Inherited from 3DUI platform

Inherited from 3DUI platform        Inherited from 3DUI platform

Yes                                 Yes


Yes                                 No


Yes                                 Yes


Yes                                 No

                                4                                   3

                                5                                   1

                                5                                   4
                                4                                   3
There is a huge gap between great ideas
and practical implementation when dealing
with gesture recognition and Kinect

Yes                                             Yes

Yes                                             Yes

                                            2         1

                                            5         5

                                            5         2




                                            5         3


                                            3         4


                                            5         7

                                            3         2


                                            2         3
                                            4         1


                                            7         6
Serious: developing natural navigation
metaphors and gestures
                                         6   5




                                         2   3


                                         5   6


                                         5   4


                                         7   6




                                         5   5
                                         6   6


                                         2   4
Calibration for different users, scaling
speeds etc. to match different body sizes,
personal preferences




Official Microsoft Kinect SDK, Unity3d           Unity3d




Unity + 3ds Max + Kinect toolkit
                                             7             7
                                             6             5
                                             6             4
                                           5   6
                                           2   7
                                           6   7
                                           7   7
                                           7   7
                                           4   7
                                           6   4

                                           3   7

                                           6   5




                                           7   7

                                           5   7




                                           5   4

                                           6   6




Clear examples. Scalability to different
display systems. Good performance.
Robustness. Multiplatform.
Best practice guidelines: a problem and
typical solutions to it




Rather technical questions in general: 3DUI
is a lot about metaphors, mental models,
ergonomy and mappings, too.

Visuals                                           Touch


Visuals                                           Touch


                                              4 5 Very important


                                              2                      3


                                              4                      2


                                              2                      2


1 Not important                                   5 Very important
5 Very important       5 Very important


5 Very important       5 Very important


                   3 5 Very important

                   4 5 Very important

5 Very important                          3

                   0                      0

                   1                      1
                   5                      4
                        8/24/2011 22:18:28                             8/29/2011 9:28:21
USA                                           Finland
Male                                          Male
                                         54                                          26
                                          7                                           5

Professional                                  Professional

1-3 years                                     1-3 years


                                          0                                           0

                                          2                                           1

                                          1                                           0
                                          5                                           4

                                          7                                           6

                                          4                                           3

                                          7                                           6
                                          7                                           5
                                          5                                           3




Seamless, immersive interactivity. The
invisible interface.
Art                                           Simulator and Training
Kinect, Camera(s)                             Kinect, Camera(s)




Surround-screen displays (e.g. CAVE; ...)     Monitor (or TV), Projector




Dancing with light                            A virtual human.
Application is incomplete and it is developed Application is incomplete and it is developed
further                                       further




vvvv                                          C/C++


No one else                                   1 person
Commercial                          Research

Inherited from 3DUI platform        Not present in my application


Not present in my application       Not present in my application

Inherited from 3DUI platform        Implemented by us

Implemented by us                   Not present in my application

Not present in my application       Not present in my application

Implemented by us                   Not present in my application

Implemented by us                   Not present in my application


Not present in my application       Not present in my application

Not present in my application       Not present in my application

Not present in my application       Not present in my application

No                                  Yes


No                                  No


Yes                                 No


No                                  Yes

                                2                                   3

                                6                                   3

                                3                                   5
                                2                                   4
Still in process.

Yes                     Yes

Yes                     Yes

                    6         5

                    2         2

                    2         3




                    2         5


                    5         2


                    5         2

                    4         3


                    3         4
                    3         5


                    4         6
BUGGY SOFTWARE! Learning the
idiosyncracies.
                               4   3




                               6   3


                               5   3


                               4   5


                               3   4




                               6   6
                               3   2


                               5   4
Usability testing is difficult; getting exposure
with naive users.

Also, development testing requires full
interaction, making it hard for one person to
rapidly test and tweak at the same time.

Mouse and keyboard input for testing is of no
real use; if you can do what you want with M
& KB, then you are not exploiting the real
capabilities.

Recording and playback, however, is
CRITICAL.




OpenNI, PrimeSense NITE, Official                      OpenNI, Optitrack Arena library,
Microsoft Kinect SDK, vvvv, OpenCV                     OpenSceneGraph




Windows XP and Win7, VS2010                            C++ and OpenSceneGraph
                                                   7                                      3
                                                   1                                      3
                                                   7                                      6
                                 4   6
                                 4   5
                                 4   3
                                 5   3
                                 7   3
                                 4   3
                                 4   3

                                 4   6

                                 4   6




                                 4   5

                                 4   3




                                 7   3

                                 4   6




COMPLETE INPUT RECORDING, AND
PLAYBACK THAT'S 100% LIKE LIVE
INPUT.
Life-size marionettes/robots to use as
subjects that won't complain about repetitive
motions...




                                                My program supports both Kinect and
                                                Optitrack Motions Capture System, so
The question "Was your 3DUI application         answering if hardware was expensive has
developed as a commercial, research, or         two answers. Kinect was cheap and
hobby project?" should have "Art                Optitrack was expensive. Other people might
Piece/Installation" as an option.               also have this kind of issues if they used
                                                several types of hardware is their program.

Visuals                                         Visuals


Visuals                                         Visuals


5 Very important                                1 Not important


1 Not important                                 1 Not important


5 Very important                                5 Very important


                                            3 1 Not important


1 Not important                                 1 Not important
                  4 1 Not important


                  3 1 Not important


1 Not important       1 Not important

1 Not important       1 Not important

                  3 1 Not important

                  1                     0

200-1,000             2-5
                  7                     4
                9/5/2011 16:00:11                      9/5/2011 18:53:42
Finland                             Finland
Male                                Male
                              31                                     27
                               5                                      7

Professional                        Professional

1-3 years                           1-3 years


                               0                                      0

                               3                                      8

                               3                                      2
                               3                                      7

                               6                                      7

                               6                                      7

                               4                                      4
                               6                                      7
                               3                                      3




Entertainment                       Virtual Heritage
WiiMote, 6DOF device or 3D mouse        Kinect




Projector, External speakers (audio)    Projector, External speakers (audio)




                                        A 3d stereoscopic interactive simulation of
                                        an underwater cultural heritage site including
                                        a shipwreck and its surrounding underwater
                                        lanscape using a gesture based interface
                                        with kinect
Application is complete and it is NOT   Application is complete and it is developed
developed further                       further




Java                                    C#


1 person                                2-3 people
Research                            Research

Inherited from 3DUI platform        Implemented by us


Inherited from 3DUI platform        Not present in my application

Not present in my application       Not present in my application

Inherited from 3DUI platform        Inherited from 3DUI platform

Not present in my application       Not present in my application

Not present in my application       Inherited from 3DUI platform

Inherited from 3DUI platform        Implemented by us


Inherited from 3DUI platform        Not present in my application

Inherited from 3DUI platform        Inherited from 3DUI platform

Implemented by us                   Implemented by us

Yes                                 Yes


Yes                                 No


Yes                                 No


Yes                                 Yes

                                3                                   5

                                5                                   3

                                5                                   5
                                5                                   4
Yes       Yes

Yes       Yes

      2         1

      4         7

      6         2




      6         6


      5         1


      4         4

      5         3


      4         2
      6         3


      6         3
5   1




6   3


6   5


5   6


6   7




6   7
3   4


2   7
Unofficial Wiimote programming library,
GlovePIE, Custom platform                     OpenNI, PrimeSense NITE, Unity3D




                                              Unity as the programming environment, c#
                                              as thr programming language. OpenNi/Nite
                                              as the gesture recognition framework and
i used max/msp for the audio part             kinect as the depth sensing device
                                          5                                              7
                                          5                                              6
                                          7                                              7
                                             7   7
                                             6   2
                                             6   7
                                             4   7
                                             7   7
                                             6   7
                                             7   7

                                             5   7

                                             6   6




                                             6   6

                                             6   7




                                             7   7

                                             7   4




possibility to import 3d models
possibility to integrate audio blocks and
audio behaviors associated with the visual
objects
have:
1 person just coding
1 person only designing
1 person good at hw




                               Really nice survey, covering many major
this survey was awesome!       issues that we have faces and thought onto

Audio                          Visuals


Audio                          Visuals


                           3 5 Very important


                           2                                                3


5 Very important                                                            3


5 Very important               5 Very important


                           4 1 Not important
                   3 5 Very important


                   2 5 Very important


                   4 1 Not important

5 Very important                        3

5 Very important                        4

                   1                    0

15-50                  6-15
                   5                    7
                9/5/2011 22:36:06                             9/5/2011 23:08:05
USA                                 Finland
Male                                Male
                              24                                            35
                               4                                             6

Hobbyist                            Professional

0-1 years                           3-7 years


                               0                                             0

                               1                                            10

                               0                                            10
                               6                                             7

                               4                                             7

                               5                                             7

                               5                                             6
                               5                                             7
                               2                                             5




Entertainment                       Design and Architecture
Kinect                                          Camera(s), 6DOF device or 3D mouse




Monitor (or TV)                                 Surround-screen displays (e.g. CAVE; ...)




Motions mapped to a stick figure in a 2d        3D user interface for a modeling and
physics simulation. Various gesture driven      animation software. Interface was built for a
actions.                                        two-walled CAVE system.
Application is incomplete and it is developed   Application is complete and it is NOT
further                                         developed further




Low motivation, and already finished with the
interesting 3dui aspects.
C#                                              C/C++


No one else                                     2-3 people
Hobby                               Research

Not present in my application       Implemented by us


Not present in my application       Implemented by us

Inherited from 3DUI platform        Not present in my application

Not present in my application       Implemented by us

Not present in my application       Implemented by us

Implemented by us                   Implemented by us

Not present in my application       Implemented by us


Implemented by us                   Implemented by us

Inherited from 3DUI platform        Not present in my application

Not present in my application       Not present in my application

No                                  Yes


No                                  Yes


No                                  No


No                                  Yes

                                7                                   2

                                1                                   5

                                7                                   3
                                7                                   3
The kinect API makes things extremely easy.

Yes                                           Yes

Yes                                           Yes

                                          1         6

                                          1         5

                                          4         6




                                          1         6


                                          1         5


                                          1         4

                                          1         4


                                          1         4
                                          1         6


                                          3         6
2   7




1   4


1   5


5   7


3   6




5   6
4   3


1   2
Official Microsoft Kinect SDK       Custom platform




                                    Stereoscopic rendering of an existing 3D
                                    modeling and animation software (Blender)
                                    was implemented using Chromium for
                                    applications OpenGL stream capturing and
                                    processing.
                                3                                               5
                                6                                               6
                                2                                               6
6   7
4   7
5   5
6   5
6   6
3   5
2   3

6   4

3   6




4   5

1   3




7   6

4   5
Visuals            Visuals


Visuals            Visuals


1 Not important                       3


1 Not important    5 Very important


5 Very important   1 Not important


1 Not important                       4


1 Not important                       4
                   4                     4


1 Not important                          3


                   3 5 Very important

5 Very important                         2

1 Not important        1 Not important

                   0                     4

2-5                    50-200
                   2                     6
                         9/7/2011 16:53:42                              9/7/2011 19:21:05
France                                       Spain
Male                                         Male
                                       26                                               28
                                        5                                                7

Professional                                 Professional

3-7 years                                    3-7 years


                                        0                                                0

                                        3                                                4

                                        3                                                2
                                        7                                                6

                                        7                                                6

                                        7                                                6

                                        6                                                7
                                        7                                                7
                                        4                                                5




                                             The feeling that we are limiting ourselves to
                                             a screen-based HCI paradigm, when real
                                             user interfaces should be integrated into the
                                             real world.
Simulator and Training                       Art
Kinect, Camera(s), Data gloves, 3D Cam
SwissRanger SR4000                                WiiMote, Camera(s), AR tags




Monitor (or TV), Projector                        Projector




Markerless hand motion capture with a
kinect for interaction in virtual environments.
The user can move, rescale and rotate any
objects. He also can navigate in the virtual
environment only using his hands. The             3D exploration of landmark buildings using a
moving, rescaling and rotation are done           "magic mirror" AR system and Wiimotes, as
according the 3 axes at the same time.            part of an art exhibit.
Application is complete and it is developed       Application is complete and it is NOT
further                                           developed further




C/C++                                             Java


No one else                                       2-3 people
Research                            Research

Implemented by us                   Not present in my application


Not present in my application       Not present in my application

Not present in my application       Not present in my application

Implemented by us                   Not present in my application

Implemented by us                   Not present in my application

Implemented by us                   Inherited from 3DUI platform

Implemented by us                   Not present in my application


Implemented by us                   Implemented by us

Inherited from 3DUI platform        Not present in my application

Not present in my application       Not present in my application

No                                  Yes


No                                  No


Yes                                 Yes


Yes                                 Yes

                                2                                   2

                                2                                   6

                                5                                   3
                                5                                   4
                                                   The users find the interaction satisfactory
                                                   but, due to time constraints, the number of
Didn't have time to implement all th stuff I       buildings to explore had to be greatly
wanted and with the precision I wanted             reduced.

Yes                                                Yes

Yes                                                Yes

                                               6                                                 6

                                               3                                                 6

                                               4                                                 5




                                               3                                                 7


                                               3                                                 6


                                               4                                                 6

                                               3                                                 3


                                               3                                                 3
                                               3                                                 4


                                               6                                                 5
Working with points clouds is quite new, so
few algorithms exist. Everything has to be
done in this domain.
                                              4   6




                                              3   6


                                              3   6


                                              3   7


                                              5   6




                                              5   3
                                              4   3


                                              5   4
                                        Unofficial Wiimote programming library,
OpenNI, PrimeSense NITE, GlovePIE       ARToolKit




                                        The project was developed using several
                                        Java libraries and was mainly developed on
                                        a Windows platform, although the final
                                        software ran on a GNU/Linux machine. As
                                        for the content we used models created with
                                        SketchUp and, later, recreated with Blender.
                                    7                                              7
                                    7                                              7
                                    6                                              7
7                            7
7                            7
7                            6
7                            6
7                            6
7                            7
7                            5

7                            7

1                            7




7                            7

3                            7




7                            7

6                            6




    Real-world Integration
                     There must be more affordable and
                     ergonomic HMDs. Tablets and other
                     handheld devices have became
                     "mainstream" enough, but it's difficult to
                     design an AR-based 3DUI on them.




                     A really complete survey. It served me to
                     evaluate my project (and to provide me with
                     a good enumeration of features/possibilities
                     for my next projects).

Visuals              Visuals


Visuals              Visuals


5 Very important     1 Not important


                   4 1 Not important


                   3 1 Not important


5 Very important     1 Not important


5 Very important     1 Not important
5 Very important                          3


5 Very important       1 Not important


5 Very important       5 Very important

                   4 1 Not important

                   3 1 Not important

                   0                      0

50-200                 15-50
                   5                      6
                            9/9/2011 16:18:51                             9/9/2011 19:03:05
UK                                                USA
Male                                              Male
                                             28                                         37
                                              6                                          5

Professional                                      Professional

0-1 years                                         3-7 years


                                              0                                          0

                                              2                                          2

                                              2                                          0
                                              7                                          7

                                              7                                          7

                                              6                                          5

                                              5                                          6
                                              6                                          7
                                              4                                          5




Kinect work has a certain magic to it
particularly that the response time is so
good. I simply find it amazing to wave my
hand around and see something happen on
screen. I'm sure the novelty will wear off, but
at the moment i'm still keen.                   It's cool and fun.
Advertising                                       Communication and Collaboration
Kinect                                        Multitouch surface, 2D Mouse




Projector                                     Monitor (or TV)




A small demonstration app for a showroom.
Two parts to it, one was a map navigation
interface using your hands and second was
a bit like a 3d punch bag to enable you to
"break through" the image.
Application is complete and it is developed   Application is incomplete and it is developed
further                                       further




C/C++                                         C#


No one else                                   No one else
Commercial                          Research

Not present in my application       Not present in my application


Not present in my application       Not present in my application

Inherited from 3DUI platform        Not present in my application

Inherited from 3DUI platform        Implemented by us

Not present in my application       Inherited from 3DUI platform

Implemented by us                   Implemented by us

Implemented by us                   Implemented by us


Implemented by us                   Implemented by us

Implemented by us                   Inherited from 3DUI platform

Not present in my application       Not present in my application

No                                  No


No                                  No


Yes                                 No


No                                  Yes

                                4                                   6

                                5                                   6

                                6                                   2
                                5                                   4
Early stage technology with a fair few bugs
and little documentation, but that is what you
get when using cutting edge stuff.

Yes                                              Yes

Yes                                              Yes

                                             2         1

                                             2         1

                                             5         2




                                             5         2


                                             4         2


                                             7         5

                                             6         4


                                             4         4
                                             3         5


                                             4         6
Understanding the quirks of the data was
very important and creating debug
applications to visualise the data and tune all
the variaous parameters.
                                              4   6




                                              6   4


                                              6   5


                                              4   5


                                              5   5




                                              4   5
                                              4   4


                                              7   4
Tuning parameters for one environment
which might not be quite right when the
sensor position and room layout is changed.
Apps need testing in a variety of
environments it seems.

Also had hardware issues trying to run the
sensor over long cables.


OpenNI, Official Microsoft Kinect SDK,
OpenFrameworks                                   Win7 Touch Screen




Would have liked to use the MS kinect SDK
more but the license is currently too
restrictive.

Applications were developed using
openframeworks and MS visual studio 2010
c++. Graphics were all openGL.
                                             5                       5
                                             5                       6
                                             7                       5
                                                 7   6
                                                 6   6
                                                 5   5
                                                 7   5
                                                 7   7
                                                 7   5
                                                 4   5

                                                 6   6

                                                 3   6




                                                 6   6

                                                 5   6




                                                 5   6

                                                 5   6




Clear and simple licensing terms for
commerical and home use. Very Important.

Closed gesture libraries were of little use to
me, eg NITE. Given that those bits are not
open source I had to just write my own
gesture recognition algorithms.
As with anything, good documentation and
lots of examples.




Bit long but well designed, but I'd very
interested to know what conclusions you
make.

Visuals                                    Visuals


Visuals                                    Visuals


1 Not important                            1 Not important


1 Not important                            1 Not important


5 Very important                           1 Not important


5 Very important                           5 Very important


1 Not important                            5 Very important
5 Very important       5 Very important


                   4                      3


                   4                      4

                   4 1 Not important

1 Not important        1 Not important

                   0                      0

2-5                                       1
                   4                      5
                          9/12/2011 17:26:23                   9/13/2011 6:03:54
France                                         France
Male                                           Male
                                         31                                  25
                                          6                                   3

Professional                                   Professional

7-15 years                                     3-7 years


                                          0                                   0

                                          3                                   3

                                          3                                   3
                                          7                                   7

                                          7                                   5

                                          6                                   7

                                          6                                   7
                                          7                                   7
                                          4                                   7




Design and Architecture                        Entertainment
Kinect, WiiMote, Camera(s), Data gloves,
Speech input, Biological input (e.g. heart
rate; brain input; ...), Game controller or
joystick (without motion sensing), Keyboard,
2D Mouse                                     Camera(s)


 Monitor (or TV), Projector, Headphones      Head-mounted display, External speakers
(audio), External speakers (audio)           (audio)




                                              SCOPE is an augmented reality game using
                                              physical toys to battle. Toys are augmented
                                              with weapons and special effects. An AR
OpenSpace3D is a visual and easy to use       interactive menu around the base of the toy
high level editor for making virtual reality  allows you to select different attacks and
applications, 3D showroom, 3D prototypes, items. All the interactions are based on
games ...                                     vision and clock type selection.
Application is incomplete and it is developed Application is complete and it is NOT
further                                       developed further




C/C++                                        Virtools visual scripting


2-3 people                                   No one else
Research                            Research

Inherited from 3DUI platform        Not present in my application


Not present in my application       Not present in my application

Inherited from 3DUI platform        Not present in my application

Inherited from 3DUI platform        Not present in my application

Implemented by us                   Not present in my application

Not present in my application       Not present in my application

Implemented by us                   Inherited from 3DUI platform


Implemented by us                   Inherited from 3DUI platform

Inherited from 3DUI platform        Inherited from 3DUI platform

Inherited from 3DUI platform        Not present in my application

No                                  No


Yes                                 Yes


Yes                                 Yes


No                                  No

                                4                                   6

                                4                                   1

                                5                                   7
                                5                                   7
No        Yes

Yes       Yes

      4         2

      4         7

      5         1




      6         2


      3         1


      6         1

      5         1


      4         1
      3         1


      3         1
4   1




5   1


4   1


3   1


5   6




4   6
4   1


6   1
Unofficial Wiimote programming library,
OpenNI, ArUco, OpenSpace3D                    ARToolKit, Studierstube




                                          6                             7
                                          6                             7
                                          6                             7
6   7
6   7
5   7
5   7
6   7
6   7
6   7

6   7

5   7




4   7

4   7




6   7

7   7
Visuals       Visuals


Visuals       Visuals


          3                    3


          2                    3


          4 1 Not important


          4                    3


          3 5 Very important
                   3 1 Not important


5 Very important       1 Not important


5 Very important       1 Not important

5 Very important       1 Not important

5 Very important       1 Not important

                   3                     2

1,000-10,000           200-1,000
                   6                     7
                          9/15/2011 17:18:03                             9/16/2011 15:07:17
Italy                                          UK
Male                                           Male
                                         35                                                38
                                          6                                                    7

Professional                                   Hobbyist

3-7 years                                      0-1 years


                                          0                                                    0

                                          3                                                    1

                                          3                                                    1
                                          7                                                    7

                                          7                                                    7

                                          5                                                    7

                                          7                                                    5
                                          4                                                    5
                                          2                                                    2




                                               Primarily that it presents an interesting new
                                               challenge and an opportunity for a more
                                               naturalistic augmented reality interface.
Medicine and Psychiatry                        Entertainment
Kinect, WiiMote, Data gloves, Eye tracker,
Keyboard, 2D Mouse                            Kinect


Monitor (or TV), Projector, Head-mounted
display                                       Monitor (or TV), External speakers (audio)




                                              A basic single octave kinect synthesiser
                                              keyboard, designed to be appealing and
                                              used by non-musicians. (I am not a
                                              musician)
Application is complete and it is developed   Application is incomplete and it is developed
further                                       further




C/C++                                         C#


1 person                                      No one else
Research                            Hobby

Implemented by us                   Not present in my application


Not present in my application       Not present in my application

Implemented by us                   Inherited from 3DUI platform

Implemented by us                   Implemented by us

Not present in my application       Not present in my application

Implemented by us                   Inherited from 3DUI platform

Implemented by us                   Not present in my application


Implemented by us                   Not present in my application

Inherited from 3DUI platform        Not present in my application

Not present in my application       Not present in my application

Yes                                 No


No                                  No


No                                  Yes


Yes                                 No

                                1                                   6

                                4                                   3

                                4                                   7
                                5                                   6
          THis was an exploratory prototype to assess
          how I would write an application for the
          kinect. Including the voice recognition bits
          meant that it exceeded my original aims in
          some ways, although I would like to make
          the use of the generated music more
          controllable through the interface this will be
          a part of future development.

Yes       Yes

Yes       Yes

      2                                                 2

      7                                                 2

      7                                                 2




      5                                                 2


      5                                                 2


      3                                                 2

      5                                                 2


      2                                                 3
      6                                                 2


      7                                                 2
    I found OpenNI difficult to get working but it
    was not as difficult as anticipated. There are
    plenty of code samples to get you going. The
    Kinect SDK was very easy to get going. Both
    offer plenty of support for someone with
    reasonable programming skills.
4                                                1




5                                                1


6                                                4


5                                                3


3                                                7




3                                                7
2                                                5


7                                                2
Unofficial Wiimote programming library,       OpenNI, PrimeSense NITE, Official
OpenNI, PrimeSense NITE                       Microsoft Kinect SDK




                                              Visual Studio 2010
                                          7                                       7
                                          4                                       5
                                          5                                       7
4   7
5   6
6   7
6   5
5   6
3   4
2   4

7   4

5   6




7   7

7   4




7   7

7   3
Visuals              Audio


Visuals              Audio


5 Very important     1 Not important


                   2 1 Not important


                   4 1 Not important


                   3 5 Very important


                   3 1 Not important
        3 1 Not important


        4 1 Not important


        4 1 Not important

        2 1 Not important

        2 1 Not important

        1                   0

15-50                       1
        6                   6
                          9/26/2011 10:08:23                          9/26/2011 19:32:41
Finland                                        Ukraine
Male                                           Male
                                         32                                               26
                                           5                                               7

Professional                                   Professional

3-7 years                                      3-7 years


                                           1                                               1

                                           5                                              10

                                           5                                               5
                                           6                                               7

                                           5                                               7

                                           3                                               7

                                           4                                               5
                                           5                                               7
                                           2                                               5




Technology; applying computer vision to
replace conventional input devices. Also fun;
I have been involved in art projects just for Design and develop approach to work with
fun.                                          abstract data in a natural way using 3DUI
Design and Architecture                        Visualization
Camera(s), Multitouch surface                 6DOF device or 3D mouse, Data gloves


 Monitor (or TV), Surround-screen displays
(e.g. CAVE; ...)                              Monitor (or TV), Head-mounted display




Application is complete and it is developed   Application is complete and it is NOT
further                                       developed further




C/C++                                         C/C++


2-3 people                                    1 person
Research                            Commercial

Not present in my application       Inherited from 3DUI platform


Not present in my application       Implemented by us

Not present in my application       Not present in my application

Implemented by us                   Not present in my application

Implemented by us                   Implemented by us

Implemented by us                   Implemented by us

Implemented by us                   Implemented by us


Implemented by us                   Implemented by us

Not present in my application       Not present in my application

Not present in my application       Not present in my application

No                                  No


No                                  Yes


No                                  Yes


Yes                                 Yes

                                4                                   4

                                3                                   1

                                5                                   5
                                6                                   7
Yes       Yes

Yes       Yes

      4         4

      4         7

      6         1




      5         4


      5         1


      4         1

      4         2


      4         1
      2         1


      6         1
We did not use any 3DUI platform, so it was
hard to answer. Basically everything built
and implemented by ourselves.
                                          1   3




                                          4   3


                                          4   2


                                          2   1


                                          5   1




                                          5   1
                                          3   1


                                          4   1
Custom platform       VRPN, GlovePIE, Vuzix SDK




                      Quest3D engine was used for quick
                      prototyping.
                  2                                       6
                  2                                       7
                  5                                       5
                                             6   7
                                             5   7
                                             5   7
                                             5   7
                                             5   7
                                             6   4
                                             2   5

                                             2   4

                                             7   7




                                             5   7

                                             5   6




                                             5   5

                                             6   1




Simple interfaces for input devices. New
equipment should be easy to connect to the
system using the same interfaces.
Although I've been developing many 3DUI's,
I'm more into input devices. In this survey it
was assumed that the respondent has
developed the app not the technology, so it
was bit difficult to answer.                   Great survey!

Visuals                                         Visuals


Visuals                                         Visuals


                                            2                     2


                                            3                     4


1 Not important                                 1 Not important


5 Very important                                                  3


                                            4                     4
                   4 5 Very important


5 Very important       5 Very important


                   4 5 Very important

                   2 1 Not important

1 Not important        1 Not important

                   2                      3

200-1,000              50-200
                   5                      7
                          9/26/2011 19:32:47                             9/26/2011 19:47:23
Canada                                         Canada
Male                                           Female
                                          26                                            26
                                           6                                             7

Professional                                   Professional

3-7 years                                      1-3 years


                                           0                                             0

                                           7                                             5

                                           2                                             5
                                           7                                             7

                                           6                                             7

                                           4                                             5

                                           7                                             7
                                           6                                             7
                                           3                                             3




Unique opportunities, strong potential.
Medicine and Psychiatry                        Medicine and Psychiatry
                                                 WiiMote, Camera(s), 6DOF device or 3D
WiiMote                                          mouse


                                                 Surround-screen displays (e.g. CAVE; ...),
Projector                                        Head-mounted display




Interactive floor for rehabilitation purposes.
(wall and floor projectors)
Application is complete and it is NOT            Application is complete and it is NOT
developed further                                developed further




Adobe Flex                                       C#


1 person                                         1 person
Research                            Research

Not present in my application       Inherited from 3DUI platform


Not present in my application       Inherited from 3DUI platform

Implemented by us                   Not present in my application

Not present in my application       Not present in my application

Not present in my application       Not present in my application

Not present in my application       Implemented by us

Not present in my application       Implemented by us


Not present in my application       Implemented by us

Not present in my application       Inherited from 3DUI platform

Not present in my application       Inherited from 3DUI platform

No                                  No


Yes                                 Yes


Yes                                 No


No                                  Yes

                                5                                   3

                                3                                   6

                                6                                   7
                                5                                   7
More robust tracking would have been
better. Currently, the tracking is done with
multiple wiimotes acting as a basic motion
capture system.

Yes                                                Yes

Yes                                                Yes

                                               1         1

                                               2         6

                                               3         5




                                               3         1


                                               1         1


                                               2         5

                                               2         6


                                               1         6
                                               1         1


                                               3         1
Physical configuration of the hardware. E.g.,
making sure the wiimotes/cameras were
securely mounted, yet still accessible, etc.
                                            5   1




                                            1   1


                                            1   6


                                            1   6


                                            1   6




                                            1   4
                                            1   1


                                            1   1
Development was not difficult, but large-
scale adoption of the interface was held back
because it was too difficult/time consuming
for the target population (therapists) to sync
up the wiimotes and make sure everything
was calibrated before each use.




Unofficial Wiimote programming library           Unofficial Wiimote programming library




                                                 Virtools / Vizard




Visual studio, Adobe Flex Builder
                                            3                                             6
                                            2                                             6
                                            5                                             6
                                             2   6
                                             2   6
                                             5   6
                                             3   6
                                             2   6
                                             4   2
                                             2   2

                                             6   5

                                             4   7




                                             6   5

                                             3   5




                                             5   5

                                             3   1




7 - Drivers/support for a wide array of
devices
7 - A simple front-end scripting language like
Python, but access to the libraries/backend
in C++ for interoperability with custom
devices etc.
                                             You have to realize that there will never be
                                             one solution that will satisfy every research
                                             project. Many packages and solutions have
                                             been proposed, but you always have to
                                             customize them/write your own hacks. When
                                             the final application is for non-programmers,
                                             everything needs to be abstracted away so
Support rapid development/prototyping. E.g., these novices can use the application, but
allow for quick compiles, and                with abstract comes a lack of customization.
visualization/interaction on the development There have been a number of great papes in
hardware                                     Presence about this very issue.




Good luck.

Movement                                     Visuals


Movement                                     Touch


1 Not important                                                                          4


1 Not important                                                                          4


5 Very important                             1 Not important


1 Not important                              1 Not important


1 Not important                              1 Not important
1 Not important               4


1 Not important               4


1 Not important               4

1 Not important               3

1 Not important               4

                  1           1

6-15                  15-50
                  4           7
               9/26/2011 19:47:46                             9/26/2011 21:21:25
Austria                             UK
Male                                Male
                              29                                             27
                               7                                              7

Professional                        Professional

3-7 years                           1-3 years


                               0                                              0

                               6                                             10

                               6                                             10
                               7                                              6

                               7                                              5

                               7                                              5

                               2                                              7
                               6                                              6
                               7                                              6




Navigation                          Design and Architecture
                                              6DOF device or 3D mouse, Inertial sensor(s)
6DOF device or 3D mouse                       (accelerometers and/or gyroscopes)


                                                Projector, Surround-screen displays (e.g.
Mobile display (e.g. tablet; mobile phone; ...) CAVE; ...), Head-mounted display




Indoor navigation system based on
augmented reality and virtual reality views
Application is complete and it is developed   Application is complete and it is developed
further                                       further




C/C++                                         C/C++


No one else                                   1 person
Research                            Research

Not present in my application       Implemented by us


Not present in my application       Implemented by us

Not present in my application       Not present in my application

Not present in my application       Not present in my application

Implemented by us                   Not present in my application

Implemented by us                   Not present in my application

Implemented by us                   Implemented by us


Implemented by us                   Implemented by us

Not present in my application       Inherited from 3DUI platform

Not present in my application       Implemented by us

No                                  Yes


No                                  Yes


No                                  No


Yes                                 Yes

                                7                                   5

                                2                                   3

                                6                                   6
                                6                                   5
The application succeeds in navigating
people indoors, after a number of design
iterations.

Yes                                            Yes

Yes                                            Yes

                                           1         4

                                           1         4

                                           1         2




                                           1         2


                                           5         2


                                           3         4

                                           1         4


                                           1         4
                                           1         2


                                           5         6
High quality vision and sensor tracking are
tough to implement but fundamental for the
usability of an augmented reality application.
                                             1   2




                                             1   3


                                             1   4


                                             1   6


                                             2   4




                                             3   3
                                             1   1


                                             1   1
Custom platform, Studierstube                VRPN, Custom platform




                                             XML




Own framework in C++ with a hardware
abstraction layer in ObjC, using XCode
                                         5                           6
                                         5                           7
                                         4                           2
6   7
7   7
7   7
6   6
7   3
5   4
5   4

7   3

4   4




5   5

3   5




7   7

2   7
Visuals            Visuals


Visuals            Visuals


1 Not important                       4


1 Not important    5 Very important


1 Not important    1 Not important


1 Not important                       4


5 Very important                      4
                   4                      2


5 Very important       5 Very important


                   4 5 Very important

1 Not important                           2

1 Not important                           3

                   0                      0

15-50                  2-5
                   6                      5
                9/27/2011 4:59:25                           9/28/2011 12:55:15
UK                                  France
Male                                Male
                              28                                            29
                               4                                                6

Hobbyist                            Professional

0-1 years                           3-7 years


                               1                                                0

                               1                                                2

                               1                                                1
                               7                                                6

                               7                                                7

                               5                                                6

                               4                                                7
                               6                                                6
                               7                                                6




                                    Interacting in a natural way.
                                    Technology is more and more complex so it
                                    should be more and more integrated and
                                    invisible.
Visualization                       Art
                                               Motion tracked suit (e.g. with Vicon;
WiiMote                                        NaturalPoint; ...), Data gloves




Monitor (or TV)                                Projector




                                               Motion capture data frmo a dancer is
                                               analyzed in real-time to interpret the emotion
                                               he expresses. Those emotions are used to
                                               generate and modulate 3D elements
                                               projected on stage.

                                               http://www.youtube.com/watch?v=Bbl0CxFc
a way to look at GUi with regard to internet   UZw
shopping much like kaon which is already on
the market but not popular                     for more info/ visuals
Application is complete and it is developed    Application is complete and it is developed
further                                        further




Java                                           C++, Qt


No one else                                    4-7 people
Hobby                               Research

Implemented by us                   Inherited from 3DUI platform


Implemented by us                   Not present in my application

Implemented by us                   Implemented by us

Not present in my application       Implemented by us

Inherited from 3DUI platform        Implemented by us

Implemented by us                   Implemented by us

Implemented by us                   Not present in my application


Implemented by us                   Implemented by us

Not present in my application       Inherited from 3DUI platform

Inherited from 3DUI platform        Not present in my application

No                                  Yes


Yes                                 No


No                                  No


Yes                                 Yes

                                4                                   4

                                2                                   4

                                4                                   5
                                7                                   6
linear is better, but the world is growing to
more content so why not have more DOf an
old argument however :-/

Yes                                                 Yes

Yes                                                 Yes

                                                4         7

                                                3         7

                                                5         6




                                                5         5


                                                7         6


                                                5         3

                                                6         4


                                                7         4
                                                5         3


                                                4         4
    about the device input data ; motion capture
    device was great and feature an UDP
    connection to send the data in real-time -->
    no need to even use the sdk on this one.
    we also use data gloves that give only low
    level information --> extremely difficult to use
    as we need phalanxes angles and so on.
4                                                  2




4                                                  4


5                                                  4


3                                                  3


1                                                  4




5                                                  5
7                                                  2


6                                                  4
                                              When I put 4 above, it's because it is not
                                              relevant to me.


Unofficial Wiimote programming library,
GlovePIE                                      Virtools




                                              We bought the motion capture device and
                                              software
                                              emotion recognition program was developed
                                              by us
                                              Virtual stage and interactions were
                                              developed using virtools
                                          4                                                7
                                          2                                                7
                                          5                                                7
1   7
3   7
7   5
6   5
5   5
3   7
1   7

4   6

4   6




5   6

6   7




7   7

7   5
                               sometime a "Not applicable" may be
very well put together!!       relevant.

Visuals                        Visuals


Visuals                        Movement


                           2                                        3


                           3 1 Not important


                           3 5 Very important


                           2 5 Very important


                           2 5 Very important
1 Not important       5 Very important


1 Not important                          2


1 Not important                          3

                  2                      2

                  3 1 Not important

                  2                      2

                  1 6-15
                  6                      6
                          9/28/2011 16:39:37                             9/29/2011 6:11:16
Netherlands                                    Colombia
Male                                           Male
                                         42                                              41
                                          7                                               6

Professional                                   Professional

7-15 years                                     7-15 years


                                          0                                               3

                                         10                                               5

                                          5                                               5
                                          7                                               6

                                          7                                               7

                                          6                                               6

                                          7                                               7
                                          7                                               7
                                          5                                               4




                                               research on how useful these interfaces
Research challenges.                           might be
Medicine and Psychiatry                        Virtual Heritage
6DOF device or 3D mouse, Speech input       Phantom Omni


                                            Monitor (or TV), Ground-referenced haptic
Surround-screen displays (e.g. CAVE; ...)   device (eg. Novint Falcon; ...)




A virtual "operating theatre" for the
simulation of vascular reconstruction       An exploration of 6 replicas from a Museum,
procedures using simulated bloodflow.       through 3D display, touch, and audio
Application is complete and it is NOT       Application is complete and it is NOT
developed further                           developed further




C/C++                                       Python


2-3 people                                  2-3 people
Research                            Research

Inherited from 3DUI platform        Inherited from 3DUI platform


Inherited from 3DUI platform        Not present in my application

Not present in my application       Not present in my application

Inherited from 3DUI platform        Not present in my application

Not present in my application       Inherited from 3DUI platform

Not present in my application       Implemented by us

Inherited from 3DUI platform        Implemented by us


Implemented by us                   Implemented by us

Not present in my application       Inherited from 3DUI platform

Not present in my application       Not present in my application

Yes                                 No


Yes                                 No


Yes                                 No


Yes                                 Yes

                                3                                   5

                                6                                   3

                                6                                   4
                                2                                   4
The application had a learning curve,
especially in its use of the 3DUI/input
devices. As such, there was always an
experienced user "at the wheel" while the
domain expert was directing what should be It is not easy to use for novices, due to
done.                                      novelty of the devices.

Yes                                            Yes

Yes                                            Yes

                                           7                                           6

                                           7                                           3

                                           4                                           5




                                           5                                           5


                                           6                                           2


                                           2                                           4

                                           6                                           3


                                           6                                           3
                                           5                                           5


                                           6                                           3
There was the constant feeling the 3DUI
devices should be capable of more, but it
was hard to squeeze out with the primitive       The size of the application and 3D data is
API that was available.                          limiting
                                             5                                                2




                                             3                                                4


                                             6                                                6


                                             6                                                5


                                             6                                                3




                                             6                                                6
                                             4                                                6


                                             2                                                2
The 3D platform (CAVE) was often
unavailable for development. Most
development took place using simulators on
desktop PCs.

After some time, the developers settled for
interaction that gets the job done, but that
was either clumsy or only usable by
experienced users, i.e. the developers.            Sturdiness of the input device is an issue.
                                                   We broke several.




VRPN, CAVElib                                      H3D




                                                   InTml




Developed on Linux/Irix, using gcc compilers
and standard build tools (make, sed, awk,
etc.). Additional software used: VTK,
ViaVoice, SGI|Volumizer. All graphics in
OpenGL.                                      Development in Python for certain features
                                               7                                                 6
                                               7                                                 4
                                               4                                                 2
                                            6                                    5
                                            5                                    4
                                            7                                    7
                                            7                                    6
                                            4                                    5
                                            6                                    6
                                            5                                    3

                                            6                                    6

                                            6                                    6




                                            7                                    7

                                            5                                    6




                                            6                                    6

                                            7                                    7




Cross platform (Linux/Windows/Mac): 7
Cross device (fishtank, CAVE, HMD, etc.): 7
Large user base: 6
Quick response support: 6                   Easy to install, reliable, sturdy.
There is no to little fundamental research on
3DUI design. Maybe the whole subject is too
close to human factors to allow for the
design of a formal methodology around 3DUI
design, but more direction is needed in the
3DUI research field. Most publications are
about interaction designs that use stuff that
just happened to be lying around.             Easy configuration and personalization




Thanks for the initiative. Looking forward to
reading the paper!                                  Maybe too long? ;)

Visuals                                             Touch


Visuals                                             Visuals


                                                4 5 Very important


5 Very important                                    1 Not important


1 Not important                                     1 Not important


                                                3                                      3


1 Not important                                                                        3
1 Not important                           3


5 Very important                          4


5 Very important                          4

1 Not important        5 Very important

1 Not important                           2

                   8                      2

2-5                    50-200
                   7                      5
               9/30/2011 18:04:04                   10/3/2011 16:42:23
France                              Finland
Female                              Female
                              32                                   28
                               7                                    5

Professional                        Professional

0-1 years                           1-3 years


                               1                                    0

                               1                                    3

                               0                                    2
                               5                                    6

                               7                                    7

                               7                                    3

                               7                                    6
                               7                                    7
                               6                                    3




Education                           Visualization
6DOF device or 3D mouse                             Camera(s), Keyboard, 2D Mouse




Monitor (or TV)                                     Monitor (or TV)




                                              Gesture controlled visuals on screen.
Application is incomplete and it is developed Application is complete and it is NOT
further                                       developed further




Our 3DUI application is under development,
several features have to be integrated before
it is fully Operational. The difficulty, inherent
in the metaphor of the tangible interaction, is
linked to the choice of the possible
interaction modes between the user and tthe
6DOF input device and their mapping to
virtual interactions.

C/C++                                               C/C++


4-7 people                                          No one else
Research                            Hobby

Not present in my application       Not present in my application


Not present in my application       Not present in my application

Not present in my application       Implemented by us

Implemented by us                   Not present in my application

Implemented by us                   Not present in my application

Implemented by us                   Implemented by us

Not present in my application       Not present in my application


Implemented by us                   Not present in my application

Implemented by us                   Not present in my application

Not present in my application       Not present in my application

No                                  Yes


No                                  Yes


No                                  No


Yes                                 Yes

                                3                                   2

                                3                                   6

                                3                                   6
                                3                                   5
Our current 3DUI application is still
incomplete, it meets only 20% of the initial
goals.

Yes                                                Yes

Yes                                                Yes

                                               6         1

                                               1         1

                                               1         5




                                               7         6


                                               4         1


                                               5         5

                                               4         5


                                               5         2
                                               1         2


                                               6         6
1   2




4   1


1   5


7   5


5   3




7   3
1   1


1   1
OpenSceneGraph, QT        ARToolKit




OpenSG, QT4, Socket
                      1               5
                      7               5
                      4               5
7   7
7   6
7   7
4   7
7   7
7   6
3   2

5   5

1   7




7   7

7   6




7   3

5   4
Touch                Visuals


Touch                Visuals


1 Not important      1 Not important


                   3 1 Not important


1 Not important      5 Very important


5 Very important                        4


5 Very important                        3
5 Very important       5 Very important


1 Not important                           4


5 Very important                          4

5 Very important                          3

1 Not important        1 Not important

                   0                      1

                   1 2-5
                   2                      3
                10/5/2011 0:52:30                             10/18/2011 15:56:28
Slovenia                            Finland
Male                                Male
                              36                                                     58
                               6                                                      7

Professional                        Professional

3-7 years                           7-15 years


                               0                                                      2

                              10                                                      5

                               8                                                      4
                               7                                                      7

                               7                                                      7

                               7                                                      6

                               5                                                      7
                               7                                                      6
                               4                                                      5




                                    Curiosity, scientific visions, playfulness/fun
Entertainment                       Entertainment
Kinect, Camera(s)                           6DOF device or 3D mouse, Data gloves




Projector                                   Surround-screen displays (e.g. CAVE; ...)




                                             Virtual aquarium: immersive simulated
                                             underwater environment where the
                                             participant feels diving among plants,
Full-body augmented reality = live camera + schools of fish, and oceanic soundscape.
visuals reactive to user position, gestures, The interaction is based on imitated
actions                                      swimming by motion of the hands.
Application is complete and it is developed  Application is complete and it is NOT
further                                      developed further




C/C++                                       C/C++


1 person                                    2-3 people
Commercial                          Research

Not present in my application       Inherited from 3DUI platform


Not present in my application       Inherited from 3DUI platform

Inherited from 3DUI platform        Implemented by us

Not present in my application       Implemented by us

Not present in my application       Not present in my application

Implemented by us                   Implemented by us

Implemented by us                   Implemented by us


Not present in my application       Not present in my application

Implemented by us                   Not present in my application

Not present in my application       Implemented by us

Yes                                 No


No                                  No


Yes                                 No


No                                  No

                                3                                   5

                                2                                   2

                                5                                   5
                                7                                   6
Users like to use it and they do it quite
intuitively. At the beginning the host was
present to help, now it works without host       Some featured ideas were not implemented
most of the time.                                due to lack of time.

Yes                                              Yes

Yes                                              Yes

                                             1                                              6

                                             1                                              7

                                             2                                              4




                                             2                                              4


                                             1                                              1


                                             5                                              2

                                             3                                              2


                                             1                                              2
                                             2                                              1


                                             4                                              1
3   5




2   3


1   4


3   2


4   2




6   6
1   1


7   4
There is lack of good practice deployment       The application was never made
examples.                                       commercial, but was a research demo.


OpenNI, PrimeSense NITE,
OpenFrameworks                                  VR Juggler, Custom platform




Important is to be able of cross-platform       The platform was based on VR Juggler, but
development, I use openFrameworks C++           also included an application template (stub)
foundation, XCode IDE on Mac and                prepared by our staff, which helped a lot to
VisualStudio Express IDE on Windows.            get started.
                                            2                                                  5
                                            3                                                  7
                                            7                                                  7
5                                                7
4                                                6
5                                                7
7                                                7
7                                                5
6                                                6
5                                                5

6                                                6

4                                                6




5                                                6

3                                                6




5                                                6

5                                                5




    "physical programming", ie. building 3D
    objects and their functions by selecting basic
    blocks and connecting them, analogously to
    visual programming in e.g. Pure Data. Also
    defining movements (e.g. animation paths)
    by example, showing them with your own
    body/hands.
More than a single platform what is needed
is a standardized set of actions, navigation
techniques, gestures, etc., somewhat similar
to what TUIO is for touch.




Visuals                                        Visuals


Visuals                                        Visuals


1 Not important                                5 Very important


1 Not important                                5 Very important


5 Very important                                                  4


                                           2 5 Very important


                                           3 1 Not important
5 Very important       5 Very important


5 Very important       5 Very important


                   2 1 Not important

                   4                      3

                   2 5 Very important

                   1                      6

1,000-10,000           15-50
                   5                      7
                      10/19/2011 11:56:26                   6/16/2011 12:12:38
Unknown                                     Finland
Male                                        Male
                                      24                                   29
                                       2                                    2

Hobbyist                                    Professional

0-1 years                                   3-7 years


                                       0                                    0

                                       1                                    4

                                       0                                    3
                                       7                                    7

                                       7                                    7

                                       7                                    6

                                       7                                    6
                                       7                                    6
                                       7                                    3




Science and Engineering                     Entertainment
Camera(s)                                         6DOF device or 3D mouse, Head tracking


Monitor (or TV), Mobile display (e.g. tablet;
mobile phone; ...)                                Surround-screen displays (e.g. CAVE, ...)




Develop a new modeling method based on
augmented reality                                 Coolest app
Application is incomplete and it is NOT           Application is complete and I keep upgrading
developed further                                 it




I developed this application in my training job
and I could not go to the end of our idea
C/C++                                             processing


1 person                                          1 person
Research                            Research

Not present in my application       Inherited from 3DUI platform


Implemented by us                   Inherited from 3DUI platform

Not present in my application       Not present in my application

Not present in my application       Inherited from 3DUI platform

Not present in my application       Not present in my application

Not present in my application       Not present in my application

Not present in my application       Inherited from 3DUI platform


Implemented by us                   Implemented by us

Not present in my application       Inherited from 3DUI platform

Not present in my application       Not present in my application

No                                  Yes


No                                  Yes


No                                  No


No                                  Yes

                                4                                   3

                                4                                   6

                                7                                   6
                                4                                   6
good advancement, but no finish

No                                    Yes

Yes                                   Yes

                                  3         2

                                  3         5

                                  5         6




                                  1         7


                                  2         7


                                  3         5

                                  4         5


                                  3         5
                                  3         6


                                  3         7
use a specific engine that has not facilitated
the development
                                                 1   3




                                                 3   6


                                                 2   6


                                                 2   7


                                                 4   7




                                                 2   2
                                                 1   5


                                                 7   1
                                          Unofficial Wiimote programming library,
Custom platform                           GlovePIE, Custom platform




Confidential toolkit of AR was used
                                      4                                             7
                                      4                                             7
                                      3                                             4
4   6
6   2
4   5
4   5
6   2
5   7
4   5

5   6

5   5




6   6

5   4




4   5

4   2
                    Testtt

Visuals             Visuals


Visuals             Visuals


                  2 5 Very important


                  3 5 Very important


1 Not important     5 Very important


1 Not important                        4


1 Not important                        2
1 Not important        1 Not important


1 Not important                           4


5 Very important       5 Very important

1 Not important        5 Very important

1 Not important                           3

                   1                      1

                   1 15-50
                   2                      5

				
DOCUMENT INFO
Shared By:
Categories:
Tags:
Stats:
views:9
posted:9/19/2012
language:Latin
pages:324