Alexandre SCHILDKNECHT by wuzhenguang


									GAUTIER Ronan
Placement at the university of
From the 10/04 to the 13/07/2006

                           Placement report

                    Interaction with 3D model
                            augmented reality

                                                                IUT of Reims
                                         Licence Professionnelle Ingénierie de
                                                        l’Imagerie Numérique
                                                      School year 2005-2006

English abstract
      My training course consists in developing a generic interface
to import and play some complex animations within ARToolKit. This
work represents an investigation and the first construction of a
platform which will allow us to interact with our objects in
augmented reality.

[Interaction], [3D model], [Augmented Reality], [API], [ARToolkit].


      It appears essential to thank Mr. Marc Cavazza, the master of
my training course in the University of Teesside, to have proposed
me a very interesting subject and to have integrated me in his
research group.

      I want to thank Mrs Deroche-Miles for giving me the
possibility of doing a placement at the University of Teesside and for
helping me to make the different files for an abroad placement.

      I would like to thank Mr. Eudes Diemoz the international
coordinator in the University of Teesside for his cordial reception.

      Lastly, I would like to thank Mr. David Pizzi searcher in the
laboratory, who was always ready to help me.


INTRODUCTION                             page 6

1. The city of Middlesbrough             page 7
     1.1. Going to Middlesbrough         page 7
     1.2. Geographical position          page 7
     1.3. Living in Middlesbrough        page 8

2. Tourism and relaxation                page 10
     2.2. What to do in Middlesbrough?   page 10
     2.1. Walking near Middlesbrough     page 11

3. The Placement                         page 14
     3.1. The university of Teesside     page 14
     3.2. The laboratory of research     page 15
     3.3 My project                      page 15

CONCLUSION                               page 18

INTERNET LINKS                           page 19


      Since the beginning of my licence Digital imaging, the
possibility of carrying out my final training course in a foreign
country has particularly interested me: it’s an advantage on the
professional level and an interesting cultural experiment. Mrs
Deroche-Miles offered me the chance to carry out my training
course at the University of Teesside, in England, corresponding at
best to my option of licence digital imaging.

       During my placement I worked on an interesting subject: the
augmented reality. Augmented reality combines the virtual and the
reality: the principle is to add to a real perception (the image of a
webcam for example), objects of synthesis.

      First, I will present the town of Middlesbrough. Then I will
more particularly show you what interesting things to do in the city
of Middlesbrough. Finally I will explain the environment in which I
carried out my project, and I will talk to you about my project.

1. The city of Middlesbrough

      The University of Teesside is located in the down town of
Middlesbrough. Middlesbrough, home to the famous eighteenth-
century maritime explorer, Captain James Cook, is a significant pole
of the North of England for the high level education more particular
in computer Science.

     1.1 Going to Middlesbrough

       From France, the easiest and cheapest way to go to
Middlesbrough is to flight to the International airport of Durham
Tees Valley.
        Durham Tees Valley International Airport has 30 different
airlines, including BMI baby, Ryan Air, KLM, Eastern Airways serving
80 internal and European destinations. The airline BMI Baby
( ) proposes cheap flight from Paris,
Charles de Gaulle Airport to Middlesbrough.

      From the airport it takes around 20 minutes to reach
Middlesbrough by car. When arrived at Middlesbrough, the bus 20
leaves from the airport every 10 minutes and go to the city centre.
The first one leaves the Airport at 7h19 and the last one is at

      Otherwise you can take the cab and it will cost you 20£
(around 30 euros) to go to the centre of Middlesbrough.
      You will meet your first trouble in English if you try to speak
with the taxi driver, as the northern accent is different from the
accent that we are used to hear during the English lesson in France.
Sometimes it’s difficult to understand a person who speaks with this
strong accent.

     1.2. Geographical position

      Middlesbrough is located in the North-East of England close to
the North Sea (Figure1), what implies a very hard weather due to
the cold and strong wind. But the wind generates a changing
weather, as during the day the weather can be sunny then rainy in
the interval of a few hours.
      You could meet some seals if you walk around the Tees
Barrage which shows you the freshness of the climate.
Middlesbrough has an average temperature of 11 °C.

                      Fig. 1: Map of England

      During the summer the days are very long. The sun grows up
at 4 o’clock at the morning and goes down at 10 PM and conversely
during the winter the nights are longer.
      Because of its geographical position, environment of
Middlesbrough remains not very friendly but have you ever heard of
Northern hospitality? You will find it here, in the heart of

     1.3. Living in Middlesbrough

       It’s simple to find a place to live in Middlesbrough: you can
live in a student residence thanks to the accommodation office of
Teesside or in a private house.

The Accommodation office of Teesside

      For students who want to do their placement at the University
of Teesside, the accommodation office offers you the possibility to
choose where you will live during your project. You don’t have to
move to Middlesbrough to choose your house and they offer three
choices of house.

King Edward's Square (KES)

                                Next to the University
                                131 places
                                Houses vary in size, but are
                                 similarly equipped with study
                                 bedrooms, communal kitchen/diner,
                                 shower rooms and toilets
                                Laundry facilities
                                Rent x 37 weeks: Single £48.79
                                 including heating and lighting

      This place is the best ratio quality/price between the 3 choices
of accommodation.

Parkside Halls

                                133 places
                                Mainly shared study bedrooms,
                                 each with a hand basin
                                Bathrooms, shower rooms, toilets
                                Laundry facilities
                                Rent x 37 weeks: Single £48.79
                                 (£1,805.23pa), Double £33.74
                                 (£1,248.38pa) including heating
                                 and lighting

      The Bedrooms in Park side Halls look like and are as big as
the French university accommodation delivered by the CROUS.

Parkside Houses and Flats

                                     213 places
                                     Laundry facilities
                                     Each unit has six single study
                                      bedrooms, a communal
                                      kitchen/diner, two shower
                                      rooms and a wash room
                                     Rent x 37 weeks: £57.05
                                      (£2,110.85pa) including heating
                                      and lighting

      For my placement I choose this place to live. I shared the
house with three housemates, one Bulgarian and two English guys.
I was the only French people in the house and it’s the best way to
improve your English as you have to force yourself to speak English
to participate to the life of the house.

       The house is close to Albert Park, a big park which covers
over 100 acres in the centre of Middlesbrough. So the place is very
peaceful, but the furniture inside the houses is not as comfortable
as I thought and compare to the price we paid it was disappointing

      You can arrive at any hours to recover your key at the
parkside halls and Bedding packs are available to international
students, so they give you some cloths and covers for your bed at
your arrival. Every bedroom has got an internet connection but you
need a password to surf on the web as the network is the property
of the University.

Find a private house

      If you have the advisability of going to Middlesbrough to find
a private house, there is many accommodation office on the
borough road in the centre of Middlesbrough, it’ s a big street close
to the University. The studios are rare and expensive so the best
way is to share a house with housemates. You could find a good
house with furniture like sofa, washing machine, fridge, oven, and
bed for 40£ per week, bills not include.

2. Tourism and relaxation

     In this part I will show you the cultural side of my placement.
Where going to do some tourism and what to do in Middlesbrough.

      2.1. Walking near Middlesbrough

       The tees valley (Figure 2) offers to the tourists some beautiful
site to visit. I will show you two towns, one that I visited (Whitby)
and another one that someone advised me (Saltburn) but I don’t
have the time to visit it.

            Fig 2: map of the city around Middlesbrough


      Whitby is a historic town in North-Yorkshire on the north-east
coast of England. Nowadays it is a fishing port and tourist
destination. It is situated at the mouth of the River Esk and spreads
up the steep sides of the narrow valley carved out by the river's

      Over the centuries, the town has spread both inland and onto
the west cliff, whilst the east cliff (fig.3 and fig.4) remains
dominated by the ruins of Whitby abbey (fig.3) and by Saint Mary's
Church. It is quite a distance to reach the east cliff by road, the
alternative being to climb the 199 steps, which are famed enough
that many who make the climb can be heard counting on the way
up. The west cliff has its own landmarks - a statue of Captain James
Cook, who sailed from the town, and an arch of whalebone, in

commemoration of the once large whaling industry. The whalebone
arch is the second to stand on this spot, the original (a larger
version) is now preserved in Whitby Archives Heritage Centre.

       The coast of Whitby             Fig 3 : The Ruins of St. Hilda's

        Fig 3: the east cliff               Fig 4 : the west cliff

      Whitby is the place where you can find the best fish and ships
in England. You ca go there by bus, it takes one hour and half and it
costs only 5£ go and back. You will find all the information about
how go to Whitby at the bus station.


      Saltburn-By-The-Sea is a seaside resort in the borough of
Redcar and Cleveland and the ceremonial county of North-Yorkshire
in northern England. The town is around 12 km east of

      Its attractions include a recently renovated pier (fig 5), plenty
of Victorian buildings, a valley garden and a smugglers museum, as
well as the world's oldest water-powered cliff lift (fig6). The
Saltburn tramway, as it is known, replaced a vertical lift, which was

closed on safety grounds in 1883. The railway opened a year later
and provided transport between the pier and the town.

                          Fig 5 : Victorian pier

           Fig 6 : cliff lift            London & North
                                      Eastern Railways (LNER)

      And there are some others beautiful seaside towns to visit like
Hartlepool or Redcar and the easiest way to go there is by bus.

     2.2 What to do in Middlesbrough?

      If you need to eat quickly, there are many places in the
centre of Middlesbrough where you could find varied sandwich like
in Greg and in fatso, both delivered the cheapest sandwich in
Middlesbrough. There is also the café Sorelle where they do some
sandwich with French baguette, and some famous American fast-
      If you want a pub meal, try the Lloyds where the food is
expensive but very tasty, there is also the walk about, an Australian
pub where you can eat kangaroo.
      For Specialty meal try Thai food with the Oodles restaurant,
where you could eat noodles with some good meat and spicy sauce.

There are also many pizzerias where I advise you to test the
speciality of Middlesbrough the Chicken Parmesan (“a parmo”). A
classic parmo is a chicken or pork fillet, then béchamel sauce and a
layer of cheese (strangely not parmesan) is added and it’s grilled.
Then it’s served with chips and salad (that’s the healthy part) and
some people swear that a layer of garlic sauce.
       If you prefer cooking your own food there is some
supermarket in the centre of Middlesbrough like the Kwik Save or
the Sainsbury’s. But there is not the same choice of food like in
France in this supermarket and it’s a bit expensive. You will
encounter difficulties to find fresh food and good meat in these
trades as English people are used to eat frozen food; this is seen in
their kitchen where the freezers are larger than the fridges.

Night life
      The hub of student night life is the award-winning Students'
Union with rock nights, cheesy pop, 60s, 70s and 80s nights, R&B
and much more including value meals and its own nightclub. The
Students’ Union is located in the heart of the Campus.
      Southfield Road runs through the campus and here you will
find a variety of student oriented bars and pubs like the Dickens
inn, where the interlink party (party which link international
students) takes place.
      In the pub, during the football match the environment is
amazing it’s the same atmosphere as in a stadium. I watched some
match of England during the world cup and it was great, when
England were victorious.
      The football in Middlesbrough is like a religion and
premiership Middlesbrough Football Club offers regular action at the
Riverside stadium to lovers of the beautiful game - die hard fans
can get a glimpse behind the scenes on a stadium tour.

      The town centre plays a key role in shaping Middlesbrough's
economic prospects.
      During the day, Middlesbrough is alive with activity and
shopping are opened seven days a week. Four shopping malls
existed in the centre of Middlesbrough like the Cleveland Center,
the Hill Street Center, Dundas Mall and the Captain Cook Square.
      It’s very compact and pedestrian area. Each of the shopping
areas is just minutes walk from the others.
      But every stores are closed from 17h, so if you need to make
some shopping it’s preferable to do it during your lunch break of

3. My placement

      My placement took place in a laboratory of the University of
Teesside so I will introduce you where I did it, before talking about
my project.

      3.1 The University of Teesside

History of the University

      1930   - Official Opening of Constantine Technical College
      1969   - Constantine becomes Teesside Polytechnic
      1989   - Leaves local authority control
      1992   - Becomes the University of Teesside

        From the 'garden party' in King Edward's Square - to Dr
Michael Longfield's 100 days as the first Vice-Chancellor before his
retirement and succession by Professor Derek Fraser - the whirlwind
first few months came to a climax with the ceremonial installation of
European Commissioner, Sir Leon Brittan, as the first Chancellor, on
30 April 1993.

      Professor Fraser set the scene for expansion saying: "I want
the University of Teesside to play a strong and proactive role - one
that demonstrates commitment to the regeneration of the North
East and widens opportunities for the people of the Teesside area."

      Today, a commitment to social inclusion is almost compulsory
but in 1992, Teesside's philosophy of widening participation and
'spearheading moves away from an elitist system of higher
education' were quite revolutionary.

      As time has shown, Teesside was ahead of government
thinking. Its pioneering and novel schemes - such as the award-
winning    Meteor    programme,     targeted at  local  primary
schoolchildren - have now become models of good practice in
getting young people from disadvantaged backgrounds to think
seriously about going into higher education.

   The development of the University has had many high points,

     five staff winning    National   Teaching   Fellowships      worth
      £50,000 each

     an 'Excellent' teaching grading for Computing in 1994 and
      more recently similar quality ratings for Health and Design
     developing pioneering degrees in exciting new areas like
      computer graphics, criminology, sport science and forensic
     merging with the Durham and Teesside College of Health in
     opening showpiece new campus buildings
     being recognised in the Funding Council's Performance
      Indicators as one of the top two universities in England for
      attracting young students from neighbourhoods where
      traditionally people have not entered higher education
     history gaining a '5' in the 2001 Research Assessment
     Tony Blair praising the way the campus was developing when
      he officially opened the Olympia Building in 2004.
     The announcement in 2005 of £18 million of investment to
      make Teesside a centre of excellence for digital media and

Presentation of the University

             Main entry of the University of Teesside

      Located on one compact campus in the heart of
Middlesbrough, the University of Teesside is a modern, forward
looking university.
      Over 20,000 students currently study on a range of
programmes, from diplomas and foundation degrees to first degrees
and postgraduate qualifications.

       It is the highest ranked modern university in the North of
England for student satisfaction and topped the five regional
universities for Personal Development (National Student Survey
September 2005). The campus blends traditional buildings with eye-
catching new facilities like the Olympia Building for sporting
excellence - part of a recent £70 million investment. It's an exciting
time, with two ultra modern campus developments worth over £18
million - the Institute of Digital Innovation and the Centre for
Creative Technologies - due to open in autumn 2007.

       All new students from the UK and EU who are required to pay
tuition fees are eligible for some financial assistance from the
University. The level of this non repayable bursary is based on
family income. The University also offers generous scholarships to
reward academic excellence. For two out of the last three years of
published data, Teesside was the top modern English university for
graduate employment and/or graduate-level further study or
training. Professionalism and workplace relevance are key elements
of many courses – and there’s the opportunity to gain valuable
experience through work placements with business and industry in
the UK or overseas.

      3.2. The laboratory of research

      During my placement I worked with the virtual Environments
research group in the University of Teesside.

Virtual Environments Research Group
    The group has strong links with researchers
from other Schools within the University as well as
national and international groups. Members have
been involved in exchanges with universities in
America, Europe and Japan and have been invited
to speak at international conferences.

      A significant part of the research deals with
the notion of virtual actors. This includes several
aspects, from motion control and behavioural
animation to conversational characters, 'talking
heads'. Most research involves the combination of
computer graphics, virtual reality, artificial
intelligence, usability and human factors.

      After a guided tour of the university made by the international
coordinator Mr Eudes Diemoz, we finally installed in the research
laboratory named "Tangram House". These offices give a real

feeling of immersion into an Artificial Intelligence domain and virtual
reality centre.
The actual work of the three researchers responsible of our
supervising was concerning several different fields:
       - AI based simulation
       - Interactive storytelling
       - alternative reality
       - immersive systems
       - Augmented Reality

     Their researches are made under the supervising of the Mr
Marc Cavazza.

      Mr Marc Cavazza, who was our supervisor during the
placement, is "Professor of virtual Environments" in the University
of Teesside. His researches are mainly focused on the integration
and using of the Artificial Intelligence with a virtual reality
He has published more than 160 research papers concerning the
human-machine interactions and intelligent interfaces.
      The different research works made in this laboratory is
sometimes integrated within industrial products, essentially in the
video games industry. One of their research subjects
is actually made in partnership with Eidos, which is an important
video game developer. In order to test their research for a general
public use purpose, the researchers often make tests with novice
and non expert people.
      I have had the privilege to participate to one of that
experiment during my placement.
We needed to move a pint of beer using the mouse and release it
above a table, where there were several elements. Once the pint
was released, certain effects were applied to those elements, which
often was the consequence of a process calls "the causality".
      Once the experiment was ended, we got to answer to several
questions, where we got to rank several aspects such as the
animation fluidity, the realism of the scene, etc... The answers were
after analysed and studied under a statistical form. The aim of those
experiments was to show that novice people have the ability or not
to use that system and to understand the impact of the research.

      3.3 My project

            The aim of our placement was the study and the
implementation of an API that will allow human-machine
interactions in order to manipulate 3D models within an Augmented

Reality (AR) environment. We used the Augmented Reality Toolkit
(ARToolkit) to develop our project in Augmented Reality.

      Principles of ARtoolkit
      One of the main issues we had to face off during the
implementation of the AR API was to make accurate measure in
order to synchronize virtual and real objects.
      ARtoolkit avoid this issue by computing the position,
orientation of the webcam using real symbols, also called markers
or patterns, These patterns are in fact squares with black edges and
containing a symbol in the middle.(Figure 7)

                      FIG 7: example of pattern

       The symbols inside the square are store in memory, it s thus
possible several patterns at the same time within the same API.
       The video input coming from the video camera is analysed by
ARtoolkit which apply a pattern recognition algorithm.
Depending on the shape of the found pattern, AR toolkit is able to
compute their position from the camera, using their orientation, and
cerate projection matrices directly useable by the Open GL graphical
       This library then creates a virtual environment in which the
virtual camera has the same properties than the real one
The virtual and real cameras are thus aligned. Finally we have the
illusion that this object is really present in the environment collected
by the webcam (see fig.8).

             Fig. 8: Screen from an ARToolkit program

      Here a summary diagram of the principle of ARToolKit.

         Figure9: diagram of the principle of ARToolKit.

      After a good comprehension of the System of ARToolkit, we
made research about the best format for our 3D models. After
founding it, we were able to make some interaction with our 3D
models animated thanks to our API.
      Here is an example of the kind of program I’ developed during
my placement. Two 3d models are animated and are superposed to
the real world thanks to the Webcam. (Fig10)

               Figure10: Two 3D models animated


     This training course was a very enriching experiment; as well
on the professional level that on the human level. I have had the
chance to work on a really interesting subject, which obliged me to
adopt a more rigorous step.

      It is true that this training course did not give me the
possibility of apprehending work in company; however, it enabled
me to discover the organization of a foreign university but also to
discover how works a research laboratory. I’ve also learned how
work on my own and by basing only on documentations. It’s this
work of research which makes succeed our project.

      I noted that my English were not as good as I thought but
when you have to speak with people who don’t understand a word
in french you improve your English quickly. The first week you get
headache at the end of the day, as you think a lot about your
English when you speak, but after it becomes easier.

     I enjoy my placement in Middlesbrough and it gave me the
opportunity to prepare my next school year over there, as I decided
to continue my studies in the University of Teesside in the Msc

                     Internet links

City of Middlesbrough

University of Teesside

OpenGL library

ARToolkit library


To top