PowerPoint Presentation - Amazon Web Services by gegeshandong

VIEWS: 11 PAGES: 22

									 Is Europe Making a difference:
Assessing Impact in Information
       Society Technologies

         Isabelle Collins
         Technopolis Ltd




                                  1
European Research Landscape




                          2
3
            History of IST Research Programmes




   FP1             FP2            FP3              FP4        FP5
  1984 …                                                     … 2002

 ESPRIT          ESPRIT II     ESPRIT III       ESPRIT IV

                 RACE I         RACE II           ACT S




                                                              IST
                 DELT A

                  DRIVE           T AP           T AP (II)

                   AIM

                                                               DG
IT T ask Force                     DG XIII
                                                             INFSO

                 In parallel: Eureka Clusters



                                                                      4
                                                   FP5 IST Structure


Society
                                      KA 1
                             Sy stemsand serv ices
                                  f or Citizens
                                            KA 2
                                  New methods of work
                                     and e-commerce
  Application




                            CPA                 KA 3
                           Cross        Multi-media content
                        Program me            and tools
                          Actions                               FET
                                               KA 4          Future and
                                       Essential technologiesEmerging
                                        and inf rastructuresTechnologies
Research




                Short Term            Medium Term             Long Term




                                                                           5
                  The IST programme




• €1 billion per annum
• 23 Operational domains
• Basic Research,
  Components, Systems,
  Applications
• Health, Public Services,
  Inclusion, Business,
  Learning, etc


                                  6
                                         Evolution of the IST programme


                                                                                    6th Framewor k P rogramme
                                          RTD
            5th Framewor k P rogramme IS T-                                            IS T Thematic Pr iority
KA1 - Systems & Serv ices for the Citiz en - Applications for:               1) Applied IST Research addressing
  ¥             (
   Healthcare eHealth   )                                                     maj or societal and economic
  ¥Spec ial needs groups (E lderly-Di sabled)                                ¥T ec hnol ogi es for T rus t Securi ty
                                                                                                       and
  ¥Safer, more effic ient transport s ystems (inc l udi ng touris m)         ¥Research address i ng Soci etal Chall enges
  (eT rans port
              )                                                              ¥Res earc h Addres s ing work and bus ines s
                              Ê
  ¥ eaner envi ronment and providing (eEnvi ronment)
   Cl                          for                                            c hal lenges
  ¥Better ac c ess to adminis trati ons (
                                       eGovernment    )                      ¥Compl ex Probl em Sol ving in Sc ience,
                                                                              Engineeri ng, Bus ines ses and Soc iety
KA2 - New Methods of W ork & E lectronic Commerce
¥ Flexibl e, mobil e and remote working methods and tools
¥ Managem ent s ystems for s uppli ers ( ines s
                                    eBus       )
¥ Managem ent s ystems for c ons umers (eCommerc e)
¥ Information and network s ecurity - confi denc e building                  2) Communication, Computing and
  tec hnol ogi es                                                             Software Technologies
                                                                             ¥Comm uni cati on and Network
KA3 - Multimedia, Content, Tools,eContent and Internet                        T ec hnol ogi es
¥ Information ac c es s , fi ltering, analys is and handl ing (new model s   ¥Software T ec hnol ogies , embedded
  and s tandar )
               ds                                                             s ys tems and dis tributed s ystems
¥ Interac tive publis hing, di gital c ontent & Cultural heri tage
¥ Human l anguage technologies
¥ Educ ation and training
                                                                             3) Components and Micro-Systems
KA4 - Essential Technologies and Infrastructures                             ¥ Mi c ro-, nano- and opto-el ec troni c s
¥Peripherals , s ub-s ys tems and mi cro-s ys tems                           ¥ Mi c ro-, andnano-tec hnol ogies, mic ro-
¥Real-ti me and large-s c al e s imulation and vis ual is ati on               s ystems, displ ays
 tec hnol ogi es
¥Mobil e and personal c ommunic ati ons and s ys tems , inc ludi ng
 s atelli te-related s ys tems and s ervic es
¥Information proc es si ng, c ommunic ations and networks
¥Mi croelec tronics Ğ Optoelec tronic s                                      4) Knowledge and Inter f  ace
¥Interfac es making use of vari ous sens es                                   Technologies
¥T ec hnol ogi es and engineering for s oftware, sys tems and                ¥Knowl edge T echnologies and Di gi tal
 s er ces
     vi                                                                       Content
                                                                             ¥Intel ligent Interfac es and Surfaces
FET Ğ Future Emerging Technologies ( longer -term, higher -
  risk resear ch)
¥ Quantum computi ng and c ommunic ations                                    5) IST Future and Emerging
¥ Uni vers al i nformati on ec os ys tems                                    Technologies
¥ Nano-technology res earc h devic es
                                                                             6) Research Networking
Research Networ king




                                                                                                                            7
               Methodological Development




• Key performance indicators
• Logic models and causality
• Impact Assessment




                                        8
                 Key performance indicators

• Main tool - objectives hierarchy




                                          9
                     Main issues and outcomes

• Confusion between data and
  indicators
• Connecting indicators to objectives

• Outcome - set of data being
  collected on 4 factors:
  –   Patents
  –   Publications
  –   Thingy
  –   Whatnot




                                            10
                         Assessing causality




• Taking the objectives hierarchy one
  step further
• Constructing multi-level logic
  models
• Looking for causality chains




                                           11
                    Key problems and results




•   Missing middle
•   Evaluation as archaeology
•   No involvement or buy-in
•   Aggregation




                                           12
                                              WING


• Assessing Impact
  –   IST FP5 and increasingly FP6
  –   23 Domains and overall Programme
  –   3 year rolling plan of work
  –   More than 12 organisations in special
      domain teams




                                                 13
                                  Levels of analysis


• Domain – This is where the brunt of the
  empirical work is located. Includes, if
  necessary or required, examination of
  specific work areas / sub-domain areas,
  especially if these have very different
  technological, market or social
  characteristics
• Horizontal – A much more limited proportion
  of the overall effort is dedicated to the
  exploration of methodological approaches
  designed to tackle cross cutting issues
• Aggregated – This includes the aggregation
  of domain level results and, if available, the
  results emerging from the horizontal studies



                                                   14
                                                             Study process



                      Exploratory Horizontal Approaches




 First Wave of       Second Wave of          Third Wave of
Domain Studies       Domain Studies          Domain Studies




          First Interim         Second Interim            Final Aggregated
        Aggregated Report      Aggregated Report               Report


                                                                             15
                                                               Methodology

                                               Composition
                                                analysis

                                                                 CENTRAL
             FINAL DOMAIN
                                                                Survey team
                REPORT                         Questionnaire



                                                                  Domain
                                                 “TIMES”
                                                                  Experts
                                                 analysis



AGGREGATED                                     Interviews &
  REPORT                                        other data
                                                 collection


                                    Report
                                   Synthesis     final draft
                                   Analysis
                                     Work                         Quality
                                                                  Domain
                                                                  expert
              HORIZONTAL ISSUES
                                                                 WING Mgt
             • Media
             • macro-economic
             impacts
             • other horizontal themes
             etc as required                                                  16
                                Key steps



• Clarify the objectives
• Analyse key changes in the domain
  technological environment
• Analyse changes in the domain
  socio-economic environment
• Identify, as far as possible, the
  links between the domain activity
  and these changes (attribute
  impact)




                                        17
                       Clarify the objectives



• Make explicit the programme
  objectives from the strategic
  objectives of the Lisbon agenda,
  through the objectives of the FP to
  the specific objectives of the
  domain
• Put together hierarchy of
  objectives
• Identify the key planned impacts
• Identify the main external factors




                                           18
                    Technology environment




• Describe state of the art at
  beginning of period (start of FP5)
• Describe state of the art today
• Identify likely key future
  developments
• Map domain research activities
  against this landscape




                                         19
            Economic and social environment



• Describe economic environment at
  beginning of period
  – Size, nature, structure, regulatory
    environment etc
  – Position of EU in world market
• Describe environment today
• Identify likely key future
  developments
• Map domain research activities and
  key players against this landscape



                                          20
                                     Impacts



• Scientific and technological impacts

• Economic impacts

• Policy and regulation impacts

• Social impacts

• Environmental impacts and
  Sustainability




                                           21
                      Key methodological issues

• Programme related
   – Lack of clear objectives
   – Complexity
• Timing
   – Domain studies
   – Aggregate studies
• Management related
   – Client study management
   – Managing dispersed teams
   – Scientists v evaluators
• Aggregation
   – Indicators
• Attribution

                                              22

								
To top