ELDDA-2pt1-beta3b-wbl

Document Sample
ELDDA-2pt1-beta3b-wbl Powered By Docstoc
					                                                                                                                     Page 1                                                                        ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




                                                                             MIT90s
No.         Criterion name      Code        Best practice statement                           Level 1 statement               Level 2 statement           Level 3 statement             Level 4 statement               level 5 statement
                                                                             category
                                       All taken it up except some                        Innovators only.              Early adopters taking it up. Early majority taking it up. Late majority taking it up.      All taken it up except some
                                                                            Individuals
      1 Adoption                ADO laggards.                                 (Staff)
                                                                                                                                                                                                                   laggards.

                                       One VLE.                                           No VLE.                       Different VLEs across         VLEs reducing in number      One VLE chosen for future One VLE.
                                                                                                                        diferent departments.         to around two.               but not yet replaced former
      2 VLE stage               VLE                                         Technology                                                                                             VLEs.


                                       Institution-wide use of several                    No use of tools beyond        Some use of tools.            Widespread use of at least Institution-wide use of at        Institution-wide use of
                                       tools.                                             email, Web and the VLE                                      one specific tool, e.g.    least one tool.                   several tools.
      3 Tools                   TLS                                         Technology
                                                                                          minimum set.                                                assignment handling, CBA.

                                       All services usable, with internal                 No usability testing, no      Key IT staff understand the   Explicit usability testing of Most services usable, with     All services usable, with
      4 Usability               USA evidence to back this up.               Technology    grasp of the concept.         concept, test some            all key systems.              some internal evidence to      internal evidence to back
                                                                                                                        systems.                                                    back this up.                  this up.
                                    All e-learning material and                           Some e-learning material      Much e-learning material      Almost all e-learning         All e-learning material and    All e-learning material and
                                    services are accessible, and key                      and services is not           and most services conform     material and services         services conform to at least   services are accessible, and
      5 Accessibility           ACC components validated by external        Technology
                                                                                          accessible.                   to minimum standards of       conform to minimum            minimum standards of           key components validated
                                    agencies.                                                                           accessibility.                standards of accessibility. accessibility, much to           by external agencies.
                                                                                                                                                                                    higher standards.

                                    Regularly updated e-Learning                          No e-Learning Strategy.       Some mention of e-            e-Learning Strategy          Frequently updated e-      Regularly updated e-
                                    Strategy, integrated with Learning                    No recent Learning and        learning within the           produced from time to        Learning Strategy,         Learning Strategy,
                                    and Teaching Strategy and all                         Teaching Strategy.            Learning and Teaching         time, e.g. under pressure    integrated with Learning   integrated with Learning
      6 e-Learning Strategy     ELS related strategies (e.g. Distance        Strategy                                   Strategy.                     from Funding Council or      and Teaching Strategy and  and Teaching Strategy and
                                    Learning, if relevant).                                                                                           for particular grants.       perhaps some others.       all related strategies (e.g.
                                                                                                                                                                                                              Distance Learning, if
                                                                                                                                                                                                              relevant).
                                    Effective decision-making for e-                      No decision making           Decision-making at meso E-learning decisions (e.g.          Effective decision-making Effective decision-making
                                    learning across the whole                             regarding e-learning –       level (School, department, for VLEs) get taken but          for e-learning across most for e-learning across the
      7 Decisions on Projects   DPR institution, including variations       Processes     "each project is different". faculty, etc).             take a long time and are         of the institution.        whole institution, including
                                    when justified.                                                                                               contested even after the                                    variations when justified.
                                                                                                                                                  decision is taken.
                                       Pedagogic guidelines for the                       Terms not understood in      Terms understood within Terms well understood               Terms well understood     Pedagogic guidelines for
                                       whole institution and acted on.                    the Institution.             the learning and teaching within the learning and           within the learning and   the whole institution and
                                                                            Individuals                                centre and among a few     teaching centre and among        teaching centre and among acted on.
      8 Pedagogy                PED                                           (Staff)                                  academic staff.            some academic staff.             most academic staff.




                                                                                                 Prepared by Paul Bacsich 3/30/2012                                                                                                               Page 1
                                                                                                              Page 2                                                                           ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




                                                                         MIT90s
No.         Criterion name   Code        Best practice statement                          Level 1 statement             Level 2 statement            Level 3 statement              Level 4 statement             level 5 statement
                                                                         category

                                 Institution-wide standards for                       Little conformance of          Some guidelines on house    Most learning material         All learning material        Institution-wide standards
                                 learning material, which are                         learning material to house styles, little conformance      conforms to explicit           conforms to explicit         for learning material, which
                                 adhered to and embedded at an                        styles (if any) for editing or to any guidelines.          editorial and layout           editorial and layout         are adhered to and
      9 Learning Material    LMA early stage, e.g. by style sheets.      Processes    layout.                                                    guidelines.                    guidelines - but little      embedded at an early
                                                                                                                                                                                embedding in the process.    stage, e.g. by style sheets.


                                    All staff trained in VLE use,                     No systematic training for    Some systematic training Institution-wide training          Institution-wide training    All staff trained in VLE
                                    appropriate to job type - and                     e-learning.                   for e-learning, e.g. in some programme set up but little    programme set up with        use, appropriate to job type
                                    retrained when needed.                                                          departments.                 monitoring of attendance       monitoring of attendance     - and retrained when
                                                                        Individuals
 10 Training                 TRG                                          (Staff)
                                                                                                                                                 or encouragement to go.        and strong encouragement     needed.
                                                                                                                                                                                to go.


                                 Work planning system which                           No allowance given for the Some allowance given, but       A work planning system         A work planning system       Work planning system
                                 recognises the main differences                      different workload pattern distortions in the system as    which makes some attempt       which makes a reasonable     which recognises the main
 11 Academic Workload        AWK that e-learning courses have from       Processes
                                                                                      of e-learning courses.     e.g. shrewder staff avoid       to cope, however crudely,      attempt to cope with e-      differences that e-learning
                                 traditional.                                                                    the areas of overload.          with e-learning courses.       learning courses.            courses have from
                                                                                                                                                                                                             traditional.

                                 Activity-Based Costing or a                          No understanding of costs. Understanding of costs in       Understanding of costs in      Good understanding of        Activity-Based Costing or
                                 system with equivalent                                                          some departments e.g.           most departments e.g.          costs in most departments. a system with equivalent
 12 Costs                    CNL functionality being used to some        Processes                               business school.                business school.                                            functionality being used to
                                 extent in all departments.                                                                                                                                                  some extent in all
                                                                                                                                                                                                             departments.
                                    Integrated annual planning                        Annual plans do not           Annual plans in some         Annual plans correlate with    Annual plans correlated      Integrated annual planning
                                    process for e-learning integrated                 mention e-learning at all.    departments mention e-       major e-learning initiatives   with most e-learning         process for e-learning
 13 Planning Annually        PLA                                         Processes
                                    with overall course planning.                                                   learning.                    in most departments.           initiative in most           integrated with overall
                                                                                                                                                                                departments.                 course planning.
                                 Regular evaluation of all courses                    No evaluation of courses      Some evaluation of courses   Evaluation of key courses      In addition, some external Regular evaluation of all
                                 using a variety of measurement                       take place that is done by    takes place, either by       is done from time to time,     evaluations are done of      courses using a variety of
 14 Evaluation               EVA techniques and involving outside        Processes
                                                                                      evaluation professionals or   professionals or internal    by professionals or internal   courses.                     measurement techniques
                                 agencies where appropriate.                          internal staff advised by     staff advised by             staff advised by                                            and involving outside
                                                                                      professionals.                professionals.               professionals.                                              agencies where
                                                                                                                                                                                                             appropriate.
                                 Central unit has Director-level                      No appointments of e-   Appointments of e-learning         Central unit or sub-unit set   Central unit has some        Central unit has Director-
                                 instititution manager in charge                      learning staff          staff in at least some             up to support e-learning       autonomy from IT or          level instititution manager
 15 Organisation             ORG and links to support teams in          Organisation                          departments but no                 developments.                  resources function.          in charge and links to
                                 departments.                                                                 specialist managers of                                                                         support teams in
                                                                                                              these staff.                                                                                   departments.
                                 All staff engaged in the e-learning                 No specific technical    A few staff engaged in the         Key staff engaged in the       Most staff engaged in the e- All staff engaged in the e-
    Technical Support to         process have "nearby" fast-                         support for the typical  main e-learning projects           main e-learning projects       learning process have        learning process have
 16                          TSS response tech support.                 Individuals (unfunded) person engaged are supported by technical         are well supported by          "nearby" technical support. "nearby" fast-response
    Staff                                                                            in e-learning.           staff.                             technical staff.                                            technical support.




                                                                                             Prepared by Paul Bacsich 3/30/2012                                                                                                             Page 2
                                                                                                             Page 3                                                                     ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




                                                                         MIT90s
No.       Criterion name      Code        Best practice statement                        Level 1 statement            Level 2 statement           Level 3 statement           Level 4 statement             level 5 statement
                                                                         category

                                  Conformance to external quality                    Conformance to external     An internal function which Conformance to external      Conformance to external       Conformance to external
                                  agency precepts and local                          quality agency in a         begins to focus on e-      quality agency precepts      quality agency precepts       quality agency precepts
                                  guidelines for e-learning within an                minimalist way as regards   learning aspects.          including those that         and local guidelines for e-   and local guidelines for e-
 17 Quality Assurance         QAS overarching methodology                Processes   e-learning.                                            impinge on e-learning.       learning.                     learning within an
                                  (EFQM, etc).                                                                                                                                                         overarching methodology
                                                                                                                                                                                                       (EFQM, etc).

                                     All informally recognised e-                    No recognition for staff,   Formal structure for        There is some recognition   Most informally recognised All informally recognised e-
                              learning experts have been            Individuals explicit pressure against        recognition (e.g. Teaching (including financial         e-learning experts have     learning experts have been
    Staff Recognition and
 18                       SRR explicitly recognised in a financial (Staff) (NOT (e.g. due to research            Fellows), no real progress. recognition or "better      been explicitly recognised. explicitly recognised in a
    Reward                    way.                                 Technology) assessment).                                                  jobs").                                                 financial way.

                                  Effective decision-making for e-                   No decision making          Decision-making at meso      Decisions on e-learning    Effective decision-making     Effective decision-making
    Decisions on                  learning across the whole                          regarding e-learning        level (school, department,   programmes get taken but   for e-learning programmes     for e-learning across the
 19                           DPG institution, including variations      Processes   programmes.                 faculty, etc) for most e-    there.                     across most of the            whole institution, including
    Programmes                    when justified.                                                                learning programmes.                                    institution.                  variations when justified.

                                     Total integration of such work                  No integration of work    Partial integration of such    Moderate integration of    Substantial integration of Total integration of such
                                     with e-learning.                                under a national teaching work with e-learning.          such work with e-learning. such work with e-learning. work with e-learning.
                                                                                     enhancement scheme with
 20 Quality Enhancement QEN                                              Processes   e-learning.



                                     All staff except laggards are                                                                                                                                     All staff except laggards
    Adoption by Staff of             delivering "enhanced learning"                                                                                                                                    are delivering "enhanced
 21                                  via appropriate use of e-learning                                                                                                                                 learning" via appropriate
    Enhanced Learning                and can evidence their claims.                                                                                                                                    use of e-learning and can
                                                                                                                                                                                                       evidence their claims.
                                     The capability of leaders to make                                                                                                                                 The capability of leaders to
      Leadership in e-               decisions regarding e-learning is                                                                                                                                 make decisions regarding e-
 22
      Learning                       fully developed.                                                                                                                                                  learning is fully developed.

                                     The institution is fully                                                                                                                                          The institution is fully
                                     comfortable using web 2.0 tools                                                                                                                                   comfortable using web 2.0
 23 Teaching 2.0
                                     where appropriate.                                                                                                                                                tools where appropriate.

                                     The institution has a reasoned                                                                                                                                    The institution has a
                                     approach to collaboration at                                                                                                                                      reasoned approach to
                                     various levels to gain additional                                                                                                                                 collaboration at various
      Collaboration for e-           benefit from sharing e-learning                                                                                                                                   levels to gain additional
 24
      Learning                       material, methodologies and                                                                                                                                       benefit from sharing e-
                                     systems.                                                                                                                                                          learning material,
                                                                                                                                                                                                       methodologies and
                                                                                                                                                                                                       systems.




                                                                                            Prepared by Paul Bacsich 3/30/2012                                                                                                        Page 3
                                                                                           Page 4                                                    ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




                                                            MIT90s
No.      Criterion name    Code   Best practice statement              Level 1 statement            Level 2 statement   Level 3 statement   Level 4 statement      level 5 statement
                                                            category

 25 (for local criteria)
 29 (for local criteria)
    (for national
 30 indicators-derived
    criteria)
    (for national
 31 indicators-derived
    criteria)
    (for national
 32 indicators-derived
    criteria)
    (for national
 33 indicators-derived
    criteria)
    (for national
 34 indicators-derived
    criteria)
    (for national
 35 indicators-derived
    criteria)
    (for national
 36 indicators-derived
    criteria)
    (for national
 37 indicators-derived
    criteria)
    (for national
 38 indicators-derived
    criteria)
    (for national
 39 indicators-derived
    criteria)
    (for national
 40 indicators-derived
    criteria)




                                                                         Prepared by Paul Bacsich 3/30/2012                                                                            Page 4
                                                                                                            Page 5                                                                          ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




                                                                       MIT90s
No.     Criterion name   Code       Best practice statement                             Level 1 statement              Level 2 statement             Level 3 statement           Level 4 statement              level 5 statement
                                                                       category

    (for national
 49 indicators-derived
    criteria)
                             Learning outcomes across all                           No analysis of how             Some analysis of how          A general but informal      Beginnings of a research- Learning outcomes across
                             courses are provably unaffected                        learning outcomes differ       learning outcomes differ      understanding of how        led and systematic          all courses are provably
                                                                      Individuals
 50 Learning Outcomes    LOU by the extent to which e-learning         (Students)
                                                                                    across modes of study.         across modes of study, e.g.   learning outcomes differ    approach to this challenge. unaffected by the extent to
                             is a component of each course.                                                        in a few distance learning    across modes of study.                                  which e-learning is a
                                                                                                                   courses.                                                                              component of each course.

                             Institution offers the same service                    Institution offers markedly    Institution offers all        Instititution offers all    Institution offers all        Institution offers the same
                             level (pedagogic and                                   inferior service to off-       services to off-campus        services to off-campus      services to off-campus        service level (pedagogic
                             administrative) to all students                        campus users (e.g. some        users but at considerably     users but at somewhat       users but at slightly         and administrative) to all
 51 Uniformity           UNI irrespective of mode or location         Technology    systems not available).        reduced functionality and     reduced functionality and   reduced functionality and     students irrespective of
                             of study (including DL and                                                            service levels.               service levels.             service levels.               mode or location of study
                             WBL).                                                                                                                                                                         (including DL and WBL).


                                Institution offers a pervasive                      Institution does not deliver   Institution delivers the      Institution delivers the    Institution delivers the      Institution offers a
                                seamless network/service to all its                 the same grade of service      same grade of service         same grade of service       same grade of service         pervasive seamless
                                students, on- and off-campus and                    even to all points on          across campus and has         across campus and has       across campus, has            network/service to all its
                                via wireless on campus also.                        campus.                        some wireless networking      substantial wireless        substantial wireless          students, on- and off-
                                                                                                                   also.                         networking also.            networking and makes          campus and via wireless on
 52 Ubiquity             UBI                                          Technology
                                                                                                                                                                             considerable effort to        campus also.
                                                                                                                                                                             supply good service to off-
                                                                                                                                                                             site users (including WBL
                                                                                                                                                                             locations and homes).




 53 Reliability          REL                  0.999                   Technology                0.95                          0.97                           0.99                       0.995                         0.999



                             All e-learning systems operate in                      No documentation of            Key e-learning systems        Many e-learning systems     Most e-learning systems       All e-learning systems
                             all uptime within documented and                       response times required for    operate in much uptime        operate in much uptime      operate in most uptime        operate in all uptime within
 54 Performance          PER accepted response guidelines.            Technology    e-learning systems; poor       within accepted response      within accepted response    within accepted response      documented and accepted
                                                                                    performance.                   guidelines.                   guidelines.                 guidelines.                   response guidelines.

                             Both look-ahead and lab, working                       No look-ahead function; no Some attempt at look-             Look-ahead (with           Both look-ahead and lab,       Both look-ahead and lab,
                             in concert; at least one of these          External    R&D lab.                   ahead.                            subscription to central    working in concert.            working in concert; at least
 55 Foresight            FOR
                             should be a sector leader.               environment                                                                agencies doing foresight –                                one of these should be a
                                                                                                                                                 OBHE, etc) or lab.                                        sector leader.




                                                                                           Prepared by Paul Bacsich 3/30/2012                                                                                                             Page 5
                                                                                                               Page 6                                                                         ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




                                                                       MIT90s
No.       Criterion name   Code        Best practice statement                          Level 1 statement               Level 2 statement          Level 3 statement               Level 4 statement               level 5 statement
                                                                       category

                               Widespread skill in selling e-                       No understanding of how        A few departments (e.g.     Some departments have           Most departments have         Widespread skill in selling
                               learning and the theory to support                   selling courses is different   business school)            considerable (practical)        considerable skill in selling e-learning and the theory to
 56 Selling                SEL the skills.                             Processes    when they include "visible"    understand the issues of    skill in selling e-learning     e-learning and the theory support the skills.
                                                                                    amounts of e-learning.         selling e-learning.         but without the theory to       supporting that.
                                                                                                                                               support the skills.
                               IPR embedded and enforced in                         No IPR items in contracts      No IPR in staff contracts   IPR in staff contracts but      IPR in staff, consultant and IPR embedded and
                               staff, consultant and supplier                       for staff or consultants       (only for consultants).     only partially enforced         supplier contracts but only enforced in staff,
 57 IPR                    IPR contracts.                              Processes    (only for suppliers).                                      (e.g. avoiding senior staff).   partially enforced.          consultant and supplier
                                                                                                                                                                                                            contracts.

                               Market research done centrally                       No market research done        Market research done        Market research done            Market research done           Market research done
                               and in or on behalf of all                           except centrally for the       centrally and in or on      centrally and in or on          centrally and in or on         centrally and in or on
                               departments, and aware of e-                         institution, with no           behalf of a few             behalf of some                  behalf of most                 behalf of all departments,
                                                                        External
 58 Market Research        MRE learning aspects; updated              environment
                                                                                    reference to e-learning.       departments, and aware of   departments, and aware of       departments, and aware of      and aware of e-learning
                               annually or prior to major                                                          a few e-learning aspects.   some e-learning aspects         many e-learning aspects.       aspects; updated annually
                               programme planning.                                                                                             e.g. on major programmes;                                      or prior to major
                                                                                                                                               updated from time to time.                                     programme planning.

                               Competitor research done                             No competitor research         Competitor research done    Competitor research done        Competitor research done       Competitor research done
                               centrally and in or on behalf of all                 done except centrally for      centrally and in or on      centrally and in or on          centrally and in or on         centrally and in or on
                               departments, and fully aware of e-                   the institution, with no       behalf of a few             behalf of several               behalf of most                 behalf of all departments,
                                                                        External
 59 Competitor Research    CRE learning aspects.                      environment
                                                                                    reference to e-learning.       departments, and aware of   departments, and aware of       departments, and aware of      and fully aware of e-
                                                                                                                   a few e-learning aspects.   some e-learning aspects         many e-learning aspects.       learning aspects.
                                                                                                                                               e.g. on major programmes.

                               A system where security breaches                     System of user codes and       System of user codes and    System of user codes and        A system where security        A system where security
                               are known not to occur yet which                     passwords but little           passwords and some          passwords with monitoring       breaches rarely occur and      breaches are known not to
                               allows staff and students to carry                   monitoring of how or           monitoring of how or        of how or whether they are      are fixed fast yet which       occur yet which allows
                               out their authorised duties easily                   whether they are misused.      whether they are misused.   misused and issues              allows staff and students to   staff and students to carry
 60 Security               SEC                                        Technology
                               and efficiently.                                                                                                resolved in time.               carry out their authorised     out their authorised duties
                                                                                                                                                                               duties easily and              easily and efficiently.
                                                                                                                                                                               efficiently.

                                  The institution is fully aware of                                                                                                                                           The institution is fully
                                  outcomes of research which will                                                                                                                                             aware of outcomes of
                                  enhance the experience of its                                                                                                                                               research which will
 61 Pedagogy Research             students by suitable use of e-                                                                                                                                              enhance the experience of
                                  learning.                                                                                                                                                                   its students by suitable use
                                                                                                                                                                                                              of e-learning.

                               Seamless integration with total                      VLE and tools run              Some integration with       Considerable integration        Almost seamless                Seamless integration with
                               uniformity of data formats,                          separately from                some uniformity of data     with some uniformity of         integration with almost        total uniformity of data
 62 Integration            INT interface and response time.           Technology    administrative systems         formats, interface and      data formats, interface and     total uniformity of data       formats, interface and
                                                                                    (fees, admissions, etc);       response time.              response time                   formats, interface and         response time.
                                                                                    manual transfers occur.                                                                    response time.




                                                                                           Prepared by Paul Bacsich 3/30/2012                                                                                                                Page 6
                                                                                                               Page 7                                                                           ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




                                                                         MIT90s
No.     Criterion name      Code        Best practice statement                            Level 1 statement              Level 2 statement           Level 3 statement              Level 4 statement               level 5 statement
                                                                         category

                                Annual student surveys and focus                       No real understanding of       Some understanding of       Student surveys or focus       One but not both of: annual    Annual student surveys and
                                groups are used to determine skill                     how to apply knowledge of      students and their          groups from time to time       student surveys and focus      focus groups are used to
                                levels and this is taken into                          students and their             behaviour, some general     address this issue; but not    groups are used to             determine skill levels and
                                                                         Individuals
 63 Leverage                LEV account for programme proposals           (Students)
                                                                                       behaviour, perhaps even no     knowledge of which          always taken into account      determine skill levels; and    this is taken into account
                                and e-learning support.                                detailed knowledge of          students own PCs and        for programme proposals        this is taken into account     for programme proposals
                                                                                       which students own PCs         why.                        and e-learning support.        for programme proposals        and e-learning support.
                                                                                       and why.                                                                                  and e-learning support.

                             Sustained universal campaign to                           No attempt to brief         Some attempts in some          Many departments brief         Most departments brief         Sustained universal
                             brief students against plagiarism                         students against plagiarism departments to brief           students against plagiarism    students against plagiarism    campaign to brief students
                             in the e-learning context and to                          in the e-learning context. students against plagiarism     in the e-learning context      in the e-learning context      against plagiarism in the e-
                                                                         Individuals
 64 Plagiarism Avoidance PAV set more suitable assignments.               (Students)
                                                                                                                   in the e-learning context      and set more suitable          and set more suitable          learning context and to set
                                                                                                                   and to set more suitable       assignments.                   assignments.                   more suitable assignments.
                                                                                                                   assignments.

                                All departments operate an                             There is no electronic      Some departments operate       Many departments operate       Most departments operate       All departments operate an
                                electronic system for the                              system for the detection of an electronic system for the   an electronic system for the   an electronic system for the   electronic system for the
                                detection of plagiarism and an                         plagiarism.                 detection of plagiarism and    detection of plagiarism and    detection of plagiarism and    detection of plagiarism and
                                                                         Individuals
 65 Plagiarism Detection    PDT associated human process to               (Students)
                                                                                                                   an associated human            an associated human            an associated human            an associated human
                                confirm diagnoses and take                                                         process to confirm             process to confirm             process to confirm             process to confirm
                                corrective action.                                                                 diagnoses and take             diagnoses and take             diagnoses and take             diagnoses and take
                                                                                                                   corrective action.             corrective action.             corrective action.             corrective action.

                                   Integration of e-learning strategy,                 No integration of estates      Understanding in general    Understanding in general       Understanding in general       Integration of e-learning
                                   plans and decisions with the                        decisions with e-learning      terms of the issues, no     terms of the issues, little    terms of the issues, good      strategy, plans and
 66 Physical                PHY                                           Strategy
                                   space management processes.                         decisions.                     attempt made to base        attempt made to base           attempts made to base          decisions with the space
                                                                                                                      decisions on data.          decisions on data              decisions on data              management processes.
                                   Projects and programmes                             No consideration of risks      Some consideration of       Consideration of risks in      Most e-learning projects       Projects and programmes
                                   integrate pro-active risk                           even in large e-learning       risks in some large e-      large e-learning projects      and programmes integrate       integrate pro-active risk
                                   management at all levels.                           projects and programmes.       learning projects and       and programmes, even in        pro-active risk                management at all levels.
 67 Risks                   RSK                                          Processes
                                                                                                                      programmes, e.g. if JISC    projects where external        management at various
                                                                                                                      projects.                   sponsors do not require it.    levels.

                                   Essentially RAE 4*.                                 Essentially RAE                Essentially RAE 1*.         Essentially RAE 2*.            Essentially RAE 3*.            Essentially RAE 4*.
                                                                                       unclassified.
                                                                         Individuals
 68 Research Out            ROU                                            (Staff)


                                Programme offerings via e-                             The leading researchers in     Some of the institution’s   Many of the institution’s      Most of the institution’s      Programme offerings via e-
                                learning as equally as informed by                     the institution do not teach   leading researchers do      leading researchers do         leading researchers do         learning as equally as
                                                                     External
 69 Research In             RIN research as offerings of a more    environment
                                                                                       on courses with substantial    teach on courses with       teach on courses with          teach on courses with          informed by research as
                                traditional nature.                                    e-learning components.         substantial e-learning      substantial e-learning         substantial e-learning         offerings of a more
                                                                                                                      components.                 components.                    components.                    traditional nature.




                                                                                              Prepared by Paul Bacsich 3/30/2012                                                                                                               Page 7
                                                                                                           Page 8                                                                              ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




                                                                      MIT90s
No.       Criterion name   Code       Best practice statement                          Level 1 statement              Level 2 statement              Level 3 statement              Level 4 statement               level 5 statement
                                                                      category

                               Integration of e-learning strategy,                 No integration; erroneous      No integration but at least    Some systematic efforts        Substantial efforts made to    Integration of e-learning
                               plans and decisions with                            belief systems or unwise       no negative spill-over into    made to look at the            look at the negative, and      strategy, plans and
      Widening                 Widening Participation processes,                   extrapolation from minimal     e-learning strategy and        negative, and positive,        positive, implications of e-   decisions with Widening
 70                        WPR within a framework of cost- and        Strategy     anecdotal situations.          operations.                    implications of e-learning     learning for WP.               Participation processes,
      Participation            income-awareness.                                                                                                 for WP.                                                       within a framework of cost-
                                                                                                                                                                                                               and income-awareness.

                               Full integration of e-learning                      No integration of e-           Some integration of e-         Moderate integration of e-     Almost complete                Full integration of e-
                               strategy, plans and decisions with                  learning strategy, plans and   learning strategy, plans and   learning strategy, plans and   integration of e-learning      learning strategy, plans and
                               support for disadvantaged                           decisions with support for     decisions with support for     decisions with support for     strategy, plans and            decisions with support for
 71 Disadvantaged          DSA students (other than disabled - see    Strategy
                                                                                   disadvantaged students         disadvantaged students         disadvantaged students         decisions with support for     disadvantaged students
                               05 - and WP - see 70).                              (other than disabled - see     (other than disabled - see     (other than disabled - see     disadvantaged students         (other than disabled - see
                                                                                   05 - and WP - see 70).         05 - and WP - see 70).         05 - and WP - see 70).         (other than disabled - see     05 - and WP - see 70).
                                                                                                                                                                                05 - and WP - see 70).

                               An approach to personalisation in                   No attempt to engage with Informal engagement with            An institution-wide            An approach to                 An approach to
                               e-learning which balances                           the personalisation agenda. the personalisation agenda,       approach to personalisation    personalisation in e-          personalisation in e-
                               pedagogy, access and government                                                 most probably within              in e-learning which makes      learning which goes a long     learning which balances
                               desires within an agenda of cost-                                               central departments and           an attempt to balance          way to balance pedagogy,       pedagogy, access and
                               effectiveness, quality assurance      Individuals                               some academic                     pedagogy, access and           access and government          government desires within
 72 Personalisation        PRS and the grounded research              (Students)                               departments, but                  government desires.            desires within an agenda of    an agenda of cost-
                               literature.                                                                     uncorrelated.                                                    cost-effectiveness, quality    effectiveness, quality
                                                                                                                                                                                assurance and the              assurance and the
                                                                                                                                                                                grounded research              grounded research
                                                                                                                                                                                literature.                    literature.

                               A culture where sustainability is                   No interest in the             No activity beyond those       Some projects beyond           Several large-scale            A culture where
                               built into decision-making and                      sustainability agenda,         earmarked and funded by        those earmarked and            sustainability initiatives     sustainability is built into
 73 Eco-Sustainability     ESU operation of large e-learning          Processes
                                                                                   and/or possible negative       external agencies.             funded by external             where e-learning is a major    decision-making and
                               projects.                                           effects of e-learning on                                      agencies.                      component.                     operation of large e-
                                                                                   sustainability.                                                                                                             learning projects.

                               The roles and responsibilities of                   There are collaborations in All collaborations with e-        The roles and                  The roles and                  The roles and
                               each collaborative partner are                      e-learning occurring        learning aspects have             responsibilities of each       responsibilities of each       responsibilities of each
                                                                       External
 79 Collaboration          COL clearly defined and the               environment
                                                                                   without agreements.         collaboration agreements,         collaborative partner are      collaborative partner are      collaborative partner are
                               procedures always followed.                                                     but the procedures are not        defined and the procedures     defined and the procedures     clearly defined and the
                                                                                                               often followed.                   often followed.                usually followed.              procedures always
                                                                                                                                                                                                               followed.
                               A systematic managed process of                     No use of computer based Some use of computer                 Use of computer based          Use of computer based          A systematic managed
    Computer Based             using CBA across the institution                    assessment.              based assessment e.g.                assessment in some way         assessment in some way         process of using CBA
 80                        CBA in ways appropriate to each           Technology                             within some departments              across the institution.        across the institution with    across the institution in
    Assessment                 programme.                                                                   or for some types of                                                pockets of thoroughgoing       ways appropriate to each
                                                                                                            students.                                                           use.                           programme.




                                                                                          Prepared by Paul Bacsich 3/30/2012                                                                                                                  Page 8
                                                                                                               Page 9                                                                         ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




                                                                          MIT90s
No.      Criterion name     Code        Best practice statement                            Level 1 statement             Level 2 statement          Level 3 statement              Level 4 statement              level 5 statement
                                                                          category

                                   A systematic managed process of                     No use of computer            Some use of computer       Use of computer managed Use of computer managed              A systematic managed
                                   using Computer Managed                              managed assessment.           managed assessment e.g.    assessment in some way  assessment in some way               process of using CMA
      Computer Managed             Assessment and feedback of                                                        within some departments    across the institution. across the institution with          across the institution in
 81                                assignments (including                Technology                                  or for some types of                               pockets of thoroughgoing             ways appropriate to each
      Assessment                   dissertations) across the                                                         students.                                          use.                                 programme.
                                   institution in ways appropriate to
                                   each programme.
 82 (unallocated)
 83 (unallocated)
 84 (unallocated)
                                   A managed approach to                               No attempt to gain         Some attempt to gain          Involvement of employers       Involvement of employers      A managed approach to
                                   involvement of employers of                         involvement of employers   involvement of employers      in creating or updating the    in creating or updating the   involvement of employers
      Employer                     students in creating or updating                    in creating or updating thein designing or updating      design of courses that         design of courses that        of students in creating or
 85                                WBL courses to include                              design of WBL courses      the design of WBL courses     might use e-learning,          might use e-learning,         updating WBL courses to
      Engagement                   appropriate amounts of e-                           that might use e-learning. that might use e-learning,    across a limited range of      across a wide range of        include appropriate
                                   learning.                                                                      but only in specialist        courses.                       courses.                      amounts of e-learning.
                                                                                                                  courses.
                                   All WBL courses using                               No attempt to measure the Some attempt but limited       Attention is paid to this      Most WBL courses using        All courses using
                                   significant e-learning measure the                  experience of employers of to certain types of courses   across courses but only at a   significant e-learning        significant e-learning
 86 Employer Experience            employer experience aspects of                      students engaged in WBL (e.g. distance WBL)              basic level e.g. in            measure the employer          measure the employer
                                   this.                                               using e-learning.                                        module/course evaluation.      experience aspects of this.   experience aspects of this.

                              Annual Employer Satisfaction                             No attempt made to            Survey done occasionally   Survey done every few          Survey done every year        Annual Employer
                              survey which explicitly addresses                        measure this.                 which contains some        years which contains some      which contains many of the    Satisfaction survey which
                              the main e-learning issues of              Individuals                                 questions relevant to e-   questions relevant to e-       most relevant e-learning      explicitly addresses the
 87 Employer Satisfaction SAT relevance to employers of                   (Students)                                 learning.                  learning.                      questions.                    main e-learning issues of
                              students on WBL courses.                                                                                                                                                       relevance to employers of
                                                                                                                                                                                                             students on WBL courses.
    (reserved for
 88 employer/WBL
    criteria)
                                   The institution takes care to                       The institution has no                                                                                                The institution takes care
                                   ensure that e-learning is used in a                 approach to using e-                                                                                                  to ensure that e-learning is
                                   reasoned way to enhance the                         learning to enhance the                                                                                               used in a reasoned way to
 89 Employability                  employability of students                           employability of students                                                                                             enhance the employability
                                   including in their own businesses.                  including in their own                                                                                                of students including in
                                                                                       businesses.                                                                                                           their own businesses.




                                                                                              Prepared by Paul Bacsich 3/30/2012                                                                                                            Page 9
                                                                                                           Page 10                                                                             ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




                                                                    MIT90s
No.      Criterion name    Code       Best practice statement                        Level 1 statement                Level 2 statement              Level 3 statement              Level 4 statement              level 5 statement
                                                                    category

                               A managed approach to                             No attempt to gain               Some attempt to gain           involvement of students in     Involvement of students in    A managed approach to
                               involvement of students in                        involvement of students in       involvement of students in     updating the design of e-      updating the design of e-     involvement of students in
      Student Engagement       updating the design of e-learning                 updating the design of e-        updating the design of e-      learning courses across a      learning courses across a     updating the design of e-
                                                                   Individuals
 90                        SED courses across many courses.         (Students)   learning courses.                learning courses but only in   limited range of courses.      wide range of courses.        learning courses across
      in Design                                                                                                   specialist courses e.g.                                                                     many courses.
                                                                                                                  courses about e-learning.

                               Students have good understanding                  Students have little             Students have some             Students have reasonable       One but not both of:          Students have good
                               of the rules governing assignment                 understanding of the rules       understanding of the rules     understanding of the rules     Students have good            understanding of the rules
    Student                    submission, feedback, plagiarism,                 governing assignment             governing assignment           governing assignment           understanding of the rules    governing assignment
                                                                   Individuals
 91 Understanding of       SUS costs, attendance, etc and always    (Students)
                                                                                 submission, feedback,            submission, feedback,          submission, feedback,          governing assignment          submission, feedback,
                               act on them.                                      plagiarism, etc etc -            plagiarism, etc etc and        plagiarism, etc etc and        submission, feedback,         plagiarism, costs,
    System                                                                       perhaps because the rules        usually act on them.           usually act on them.           plagiarism, etc etc; and      attendance, etc and always
                                                                                 are not clear or clear but                                                                     always act on them.           act on them.
                                                                                 not enforced.
                                  Help Desk is deemed as best                    Help Desk is not functional      Help Desk exists for all   Help Desk is adequate but Help Desk is deemed as                 Help Desk is deemed as
                                  practice.                                      for all students, or is but is   students, with many lapses has some lapses.          good practice.                         best practice.
                                                                   Individuals
 92 Student Help Desk      SHD                                      (Students)
                                                                                 widely viewed as                 from service levels.
                                                                                 unhelpful.

                               All courses using significant e-                  No attempt to measure the Some attempt but limited              Attention is paid to this      Most courses using            All courses using
                               learning measure the student                      experience of students in e- to certain types of courses        across courses but only at a   significant e-learning        significant e-learning
                                                                   Individuals
 93 Student Experience     SEP experience aspects of this.          (Students)
                                                                                 learning.                    (e.g. distance learning,           basic level e.g. in            measure the student           measure the student
                                                                                                              WBL).                              module/course evaluation.      experience aspects of this.   experience aspects of this.

                               Annual Student Satisfaction                       No attempt made to               Survey done occasionally       Survey done every few          Survey done every year        Annual Student
                               survey which explicitly addresses                 measure this.                    which contains some            years which contains some      which contains many of the    Satisfaction survey which
                                                                   Individuals
 94 Student Satisfaction   SAT the main e-learning issues of        (Students)
                                                                                                                  relevant e-learning            relevant e-learning            most relevant e-learning      explicitly addresses the
                               relevance to students.                                                             questions.                     questions.                     questions.                    main e-learning issues of
                                                                                                                                                                                                              relevance to students.

                               Use of e-portfolios in all                        No use of e-portfolios.                                Use of e-portfolios in many
                                                                                                                  Some use of e-portfolios.                                     Use of e-portfolios in most   Use of e-portfolios in all
 95 e-Portfolios           EPO                                     Processes
                               departments.                                                                                             departments.                            departments.                  departments.
                               An approach to use of learning                    No use of learning objects. Some use of learning       Some use of learning                    Considerable use of           An approach to use of
                               objects which balances pedagogy                                               objects but no recognition objects and some                        learning objects when         learning objects which
                               and technology within an agenda                                               of the problems they cause recognition of the problems             appropriate but not a good    balances pedagogy and
                               of cost-effectiveness, quality                                                and how to overcome        they cause and how to                   understanding of the          technology within an
 96 Learning Objects       LOB assurance and the grounded          Technology                                them.                      overcome them.                          literature on them.           agenda of cost-
                               research literature.                                                                                                                                                           effectiveness, quality
                                                                                                                                                                                                              assurance and the
                                                                                                                                                                                                              grounded research
                                                                                                                                                                                                              literature.




                                                                                        Prepared by Paul Bacsich 3/30/2012                                                                                                                  Page 10
                                                                                                          Page 11                                                                       ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




                                                                      MIT90s
No.       Criterion name   Code        Best practice statement                        Level 1 statement             Level 2 statement           Level 3 statement            Level 4 statement              level 5 statement
                                                                      category

                                  The institution has a reasoned                  The institution makes no     The institution makes     The institution makes use     The institution has an          The institution has a
                                  approach to the use of OER and                  use of OER and has no        minimal use of OER - e.g. of OER in a reasoned way      overall policy for the use of   reasoned approach to the
    Open Educational
 97                               is using them across the                        plans to do so.              via some individual       in some programmes.           OER and makes use of            use of OER and is using
    Resources                     institution.                                                                 academic initiatives.                                   OER in a reasoned way in        them across the institution.
                                                                                                                                                                       many programmes.
                                  The institution has recently                    The institution has not     The institution is planning   The institution is in the  The institution is in the       The institution has recently
                                  benchmarked its e-learning and is               recently undertaken a       its benchmarked its e-        active phase of its        reflection phase of its         benchmarked its e-learning
                                  working through the implications                benchmarking e-learning     learning project.             benchmarked its e-learning benchmarked its e-learning      and is working through the
 98 Benchmarking                  of the results.                                 project and has no plans to                               project.                   project.                        implications of the results.
                                                                                  do so in the near future.


                                  Institution is a learning                       No evidence of               Organisational learning in   Organisational learning in   Organisational learning in Institution is a learning
      Organisational
 99                        OLG organisation on all core aspects of    Processes   organisational learning in   the e-learning area on a     the e-learning area on       the e-learning area on most organisation on all core
      Learning                    e-learning.                                     the e-learning area.         few aspects.                 several aspects.             aspects.                    aspects of e-learning.




                                                                                         Prepared by Paul Bacsich 3/30/2012                                                                                                           Page 11
                                                                                       Page 12                                                    ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




                                                        MIT90s
No.   Criterion name   Code   Best practice statement              Level 1 statement             Level 2 statement   Level 3 statement   Level 4 statement      level 5 statement
                                                        category




                                                                     Prepared by Paul Bacsich 3/30/2012                                                                             Page 12
                                                                                       Page 13                                                    ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




                                                        MIT90s
No.   Criterion name   Code   Best practice statement              Level 1 statement             Level 2 statement   Level 3 statement   Level 4 statement      level 5 statement
                                                        category




                                                                     Prepared by Paul Bacsich 3/30/2012                                                                             Page 13
                                                                                       Page 14                                                    ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




                                                        MIT90s
No.   Criterion name   Code   Best practice statement              Level 1 statement             Level 2 statement   Level 3 statement   Level 4 statement      level 5 statement
                                                        category




                                                                     Prepared by Paul Bacsich 3/30/2012                                                                             Page 14
                                                                                       Page 15                                                    ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




                                                        MIT90s
No.   Criterion name   Code   Best practice statement              Level 1 statement             Level 2 statement   Level 3 statement   Level 4 statement      level 5 statement
                                                        category




                                                                     Prepared by Paul Bacsich 3/30/2012                                                                             Page 15
                                                                                       Page 16                                                    ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




                                                        MIT90s
No.   Criterion name   Code   Best practice statement              Level 1 statement             Level 2 statement   Level 3 statement   Level 4 statement      level 5 statement
                                                        category




                                                                     Prepared by Paul Bacsich 3/30/2012                                                                             Page 16
                                                                                       Page 17                                                    ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




                                                        MIT90s
No.   Criterion name   Code   Best practice statement              Level 1 statement             Level 2 statement   Level 3 statement   Level 4 statement      level 5 statement
                                                        category




                                                                     Prepared by Paul Bacsich 3/30/2012                                                                             Page 17
                                                                                       Page 18                                                    ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




                                                        MIT90s
No.   Criterion name   Code   Best practice statement              Level 1 statement             Level 2 statement   Level 3 statement   Level 4 statement      level 5 statement
                                                        category




                                                                     Prepared by Paul Bacsich 3/30/2012                                                                             Page 18
                                                                                       Page 19                                                    ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




                                                        MIT90s
No.   Criterion name   Code   Best practice statement              Level 1 statement             Level 2 statement   Level 3 statement   Level 4 statement      level 5 statement
                                                        category




                                                                     Prepared by Paul Bacsich 3/30/2012                                                                             Page 19
                                                                                       Page 20                                                    ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




                                                        MIT90s
No.   Criterion name   Code   Best practice statement              Level 1 statement             Level 2 statement   Level 3 statement   Level 4 statement      level 5 statement
                                                        category




                                                                     Prepared by Paul Bacsich 3/30/2012                                                                             Page 20
                                                                                       Page 21                                                    ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




                                                        MIT90s
No.   Criterion name   Code   Best practice statement              Level 1 statement             Level 2 statement   Level 3 statement   Level 4 statement      level 5 statement
                                                        category




                                                                     Prepared by Paul Bacsich 3/30/2012                                                                             Page 21
                                                                                       Page 22                                                    ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




                                                        MIT90s
No.   Criterion name   Code   Best practice statement              Level 1 statement             Level 2 statement   Level 3 statement   Level 4 statement      level 5 statement
                                                        category




                                                                     Prepared by Paul Bacsich 3/30/2012                                                                             Page 22
                                                                                       Page 23                                                    ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




                                                        MIT90s
No.   Criterion name   Code   Best practice statement              Level 1 statement             Level 2 statement   Level 3 statement   Level 4 statement      level 5 statement
                                                        category




                                                                     Prepared by Paul Bacsich 3/30/2012                                                                             Page 23
                                                                                       Page 24                                                    ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




                                                        MIT90s
No.   Criterion name   Code   Best practice statement              Level 1 statement             Level 2 statement   Level 3 statement   Level 4 statement      level 5 statement
                                                        category




                                                                     Prepared by Paul Bacsich 3/30/2012                                                                             Page 24
                                                                                       Page 25                                                    ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




                                                        MIT90s
No.   Criterion name   Code   Best practice statement              Level 1 statement             Level 2 statement   Level 3 statement   Level 4 statement      level 5 statement
                                                        category




                                                                     Prepared by Paul Bacsich 3/30/2012                                                                             Page 25
                                                                                       Page 26                                                    ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




                                                        MIT90s
No.   Criterion name   Code   Best practice statement              Level 1 statement             Level 2 statement   Level 3 statement   Level 4 statement      level 5 statement
                                                        category




                                                                     Prepared by Paul Bacsich 3/30/2012                                                                             Page 26
                                                                                                                       Page 27                                                    ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




                                                                                            Local tag                        MIT90s   ELDAA tag                                                           HEFCW
                                     Process notes and                                                      Local view of                                                       HEFCE tag   HEFCW tag
    Level 6 statement                                             Evidence areas           institution                        tag/     (balanced     OBHE tag       OBHE code                            short-term
                                       commentary                                                           central or not                                                        2005        2007
                                                                                            specific)                        subtag     MIT90s)                                                           tag 2008
First wave embedded and          How many segments of the    Interviews, surveys,
universal, second wave           Rogers model are            documentation in IT                                  C            I      Coherence       Delivery        OBDL         HA1        WS6          WN04
starting.                        engaged?                    reports, etc.
One VLE but with local           Degree of coherence         Observation, purchase
variants when strong             across institution.         orders.
business case, and activity                                                                                       C            T        Value         Delivery        OBDL         HB1        WS1          WN01
of a post-VLE nature.

Use of locally developed         Scale, sophistication and   Interviews, cross-checking
tools also.                      depth of tools use.         with JISC and CETIS, HE
                                                                                                                  D            T      Coherence       Delivery        OBDL         HD1        WS5          WN04
                                                             Academy, Becta, as
                                                             relevant.
Evidence of usability            Level of provable usability Standard HCI usability
involving external               of e-learning systems.      testing and reports.                                 C            T       Students       Delivery        OBDL         HC1        WS5          WN06
verification.
Strong evidence of               Level of conformance to     Test reports, user
conformance with letter          accessibility guidelines.   complaints, etc.
and spirit of accessibility in   (Split off separately for
                                                                                                                  C            T       Students       Delivery        OBDL         HC1        WL5          WN07
all jurisdictions where          legal reasons.)
students study.

Coherent regularly updated Degree of strategic               Review of documents
Strategy allowing           engagement..                     produced by the institution
adaptations to local needs,                                  for Funding Council and
                                                                                                                                                      Strategy
made public, etc.                                            Quality Agency. Interviews                           C            S       Strategy                       OBSD         n/a        WS1          WN09
                                                                                                                                                    development
                                                             with senior staff
                                                             responsible.

Decisions taken in an            Robustness, sophistication Observation and perusal of
organic way and efficient        and subtlety of decision-  relevant committee papers.
                                                                                                                                                   Management and
way, e.g. Round Table.           making.                                                                          C            P       Strategy                       OBML         HB1        WS2          WN01
                                                                                                                                                     leadership


A culture where techno-          Level of practical but   Interviews, focus groups,
pedagogic decisions are          evidence-based knowledge staff survey
made naturally.                  and application of
                                                                                                                  D            I        Quality         Staff         OBSF         HH1        WS4          WN04
                                 instructional design and
                                 pedagogic principles




                                                                                                         Prepared by Paul Bacsich 3/30/2012                                                                           Page 27
                                                                                                                       Page 28                                                     ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




                                                                                            Local tag                        MIT90s   ELDAA tag                                                            HEFCW
                                   Process notes and                                                        Local view of                                                        HEFCE tag   HEFCW tag
    Level 6 statement                                            Evidence areas            institution                        tag/     (balanced     OBHE tag        OBHE code                            short-term
                                     commentary                                                             central or not                                                         2005        2007
                                                                                            specific)                        subtag     MIT90s)                                                            tag 2008
Much learning material         Level of "fitness for        Perusal of material,
exceeds expectations on        purpose" of learning         interviews.
layout.                        material.
                                                                                                                  C            P       Students       Delivery         OBDL         HC2        WS4          WN06



Staff increasingly keep        Degree to which staff have   %ages plus narrative.
themselves up to date, "just   competence in VLE and        (Note: this may not involve
in time", except when          tools use, appropriate to    training courses; but is
discontinuous system           job type.                    likely to.)                                           C            I         Staff          Staff          OBSF         HH1        WS3          WN01
change occurs, when
training is provided.

Full Activity-Based            Sophistication of the work Detailed and possibly
Costing or similar system      planning system for        anonymous interviews and
used and adapted to e-         teaching.                  questionnaires. Some union                                                                Resources and
                                                                                                                  D            P        Value                          OBVL         HH2        WS4          WN01
learning work planning.                                   sensitivity likely in some                                                               value for money
                                                          institutions.

Full Activity-Based            Level of understanding of    Interviews and
Costing or similar system      costs.                       questionnaires.
                                                                                                                                                    Resources and
used and adapted to e-                                                                                            C            P        Value                          OBVL         HB1        WS4          WN01
                                                                                                                                                   value for money
learning.

Integrated planning process                                 Interviews with senior staff
allowing e.g. trade-offs of                                 in centre and departments.                                                             Management and
                                                                                                                  C            P       Strategy                        OBML         HB1        WS1          WN01
courses versus buildings.                                                                                                                            leadership

Evaluation built into an       Level of thoroughness of     Interviews with key
Excellence, TQM or other       evaluation, regarded as a    evaluators. Perusal of
                                                                                                                                                   Communication,
quality enhancement            "pyramid" stretching from    conference and journal
                                                                                                                  C            P        Quality     evaluation and                  HE2        WS6          WN06
process - including            informal broadly-based to    papers.
                                                                                                                                                        review
benchmarking aspects.          expert studies.

Beginning of the withering                                  Interview with senior
away of explicit e-learning                                 management.
                                                                                                                                                   Management and
posts and structures.                                                                                             C            O      Coherence                        OBML         HE1        WS2          WN01
                                                                                                                                                     leadership


Increasing technical                                        Interviews with seniorl
sophistication of staff                                     staff and selective
means that explicit                                         interviews with grass-roots                           C            I         Staff        Delivery         OBDL         HH1        WS3          WN01
technical support can                                       staff.
reduce.




                                                                                                         Prepared by Paul Bacsich 3/30/2012                                                                            Page 28
                                                                                                                     Page 29                                                     ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




                                                                                          Local tag                        MIT90s   ELDAA tag                                                            HEFCW
                                   Process notes and                                                      Local view of                                                        HEFCE tag   HEFCW tag
    Level 6 statement                                            Evidence areas          institution                        tag/     (balanced     OBHE tag        OBHE code                            short-term
                                     commentary                                                           central or not                                                         2005        2007
                                                                                          specific)                        subtag     MIT90s)                                                            tag 2008
Leadership re external         Level of institutional    Interviews, questionnaires,
quality agency and wider       overall commitment to the quality reviews, etc.
quality agencies as to         national quality and                                                                                              Communication,
appropriate quality regimes    excellence agenda for e-                                                         C            E        Quality     evaluation and     OBCR         HE2        WS3          WN01
for e-learning.                learning.                                                                                                              review


Staff engaged only in e-       Level of staff recognition   Documentary evidence
learning (and not e.g.         (not only and not            (needs Deans to be
research) can reach a high     necessarily financial)       involved).                                          D            I         Staff          Staff          OBST         HH2        WS3          WN01
level of salary and            against the pressure for
responsibility.                RAE.
Decisions taken in an          Robustness, sophistication   Observation and perusal of
organic and efficient way.     and subtlety of decision-    relevant Courses
                                                                                                                                                 Management and
                               making.                      Committee papers.                                   C            P       Strategy                        OBML         HE2        WS2          WN01
                                                                                                                                                   leadership


Total integration of such                                   Perusal of institution
work with e-learning                                        Quality Enhancement
including integration of any                                Programme reports (e.g.                                                              Communication,
national teaching                                           TQEF for English HE).                               C            P        Quality     evaluation and     OBCR         HA2        WS3          WN06
enhancement self-audit                                                                                                                                review
with benchmarking e-
learning.




                                                                                                       Prepared by Paul Bacsich 3/30/2012                                                                            Page 29
                                                                                     Page 30                                              ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




                                                          Local tag                        MIT90s   ELDAA tag                                                     HEFCW
                    Process notes and                                     Local view of                                                 HEFCE tag   HEFCW tag
Level 6 statement                       Evidence areas   institution                        tag/     (balanced   OBHE tag   OBHE code                            short-term
                      commentary                                          central or not                                                  2005        2007
                                                          specific)                        subtag     MIT90s)                                                     tag 2008




                                                                       Prepared by Paul Bacsich 3/30/2012                                                                     Page 30
                                                                                                                          Page 31                                                    ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




                                                                                               Local tag                        MIT90s   ELDAA tag                                                           HEFCW
                                  Process notes and                                                            Local view of                                                       HEFCE tag   HEFCW tag
    Level 6 statement                                              Evidence areas             institution                        tag/     (balanced     OBHE tag       OBHE code                            short-term
                                    commentary                                                                 central or not                                                        2005        2007
                                                                                               specific)                        subtag     MIT90s)                                                           tag 2008




Sector leadership.


                                                                                                                     D            I                      Delivery        OBDL         HA1                     WN06



Institution offers a better   This is particularly relevant
service to e-learning         to those institutions with
students and conventional     substantial programmes in
offering is under pressure    distance learning and/or                                                               C            T                      Delivery        OBDL         HC1                     WN07
to catch up.                  work-based learning.



Institution actively takes
responsibility for ensuring
bandwidth to off-campus
users.
                                                                                                                     C            T                      Delivery        OBDL         HC1                     WN07




                              The time period is              It is important to be crystal
                              24x7x365 with scheduled         clear what systems are
  0.9999 - 99.99% (four       downtime being counted as       counted as "core e-learning                            C            T                      Delivery        OBDL         HC1                     WN04
         sigma)               unavailability.                 systems" and what are not.


Some e-learning systems       Institution must decide    UCISA and general IT
exceed stakeholder            which systems are in scope guidelines.
expectations.                 as "e-learning systems".                                                               C            T                      Delivery        OBDL         HC1                     WN04


Both look-ahead and lab,      Foresight-informed
working in concert; both      development agenda for e-                                                                                               Management and
                                                                                                                     C            E                                      OBML         HA2                     WN04
should be sector leaders.     learning.                                                                                                                 leadership




                                                                                                            Prepared by Paul Bacsich 3/30/2012                                                                           Page 31
                                                                                                                    Page 32                                                     ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




                                                                                         Local tag                        MIT90s   ELDAA tag                                                            HEFCW
                                  Process notes and                                                      Local view of                                                        HEFCE tag   HEFCW tag
    Level 6 statement                                              Evidence areas       institution                        tag/     (balanced     OBHE tag        OBHE code                            short-term
                                    commentary                                                           central or not                                                         2005        2007
                                                                                         specific)                        subtag     MIT90s)                                                            tag 2008
Sector leadership.            Level and breadth of skill      Sales figures and
                              in selling e-learning           supporting reports and
                                                                                                                                                Management and
                              programmes. (Excludes           analyses.                                        C            P                                       OBML                                 WN05
                                                                                                                                                  leadership
                              market research and
                              competitor research.)
Sector leadership.            Intellectual Property (IPR)     Documentary review of
                              aspects of e-learning re        staff agreements and
                                                                                                                                                Management and
                              staff, consultants and          consultant and supplier                          C            P                                       OBML         HE1                     WN08
                                                                                                                                                  leadership
                              suppliers.                      contracts.

Market research up to         (We have drawn on the
leading sector standards as   HEFCE Maximize
e.g. done by British          benchmarking project
                                                                                                                                                Communication,
Council, OBHE, etc.           results in formulating this.)                                                    D            E                                                                            WN05
                                                                                                                                                 evaluation and     OBCR
                                                                                                                                                     review



Competitor research up to There is little public best
leading sector standards as practice to draw on.
e.g. done by British                                                                                                                            Communication,
Council, OBHE, etc.                                                                                            D            E                    evaluation and     OBCR                                 WN08
                                                                                                                                                     review


Sector leadership.            Level of skill by which the IT audit report.
                              institution manages who
                              can access which system,
                              monitors and enforces it.
                                                                                                               C            T                      Delivery         OBDL         HF1                     WN05




Sector leadership.            Level of integration of e-      JISCInfonet guidance is
                              learning with                   useful
                              administrative systems                                                           C            T                      Delivery         OBDL         HF1                     WN05




                                                                                                      Prepared by Paul Bacsich 3/30/2012                                                                            Page 32
                                                                                                                Page 33                                                    ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




                                                                                     Local tag                        MIT90s   ELDAA tag                                                           HEFCW
                                Process notes and                                                    Local view of                                                       HEFCE tag   HEFCW tag
    Level 6 statement                                        Evidence areas         institution                        tag/     (balanced     OBHE tag       OBHE code                            short-term
                                  commentary                                                         central or not                                                        2005        2007
                                                                                     specific)                        subtag     MIT90s)                                                           tag 2008
Sector leadership.         Level and delicacy of
                           exploitation of students’
                           pre-existing IT and
                           information skills.                                                             C            I                      Students        OBST         HC1                     WN06




Sector leadership.         Level of use of techniques Check discussions of
                           to deter the occurrence of plagiarism and L&T papers
                           plagiarism including both on how to avoid it.
                           awareness-raising and                                                           D            I                      Students        OBST         HD1                     WN04
                           adjustment of assessments.


Sector leadership.                                      Check records of
                                                        plagiarism cases and how
                                                        they were resolved.
                                                                                                           D            I                      Students        OBST         HD1                     WN04




Sector leadership.         Level of integration of e-
                           learning with physical                                                                                              Strategy
                                                                                                           C            S                                      OBSD         HB1                     WN09
                           space management                                                                                                  development

Sector leadership.         Level of management of       Check central and local
                           risks associated with e-     Risk Registers and
                           learning.                    associated documentation                                                            Management and
                                                                                                           C            P                                      OBML         HB1                     WN09
                                                        (committee papers, etc.).                                                             leadership


4* and at least one world- Amount and level of          RAE 2008 rehearsals.
class e-learning researcher research output leveraged
in the institution.         on e-learning operations.                                                      C            I                        Staff         OBSF                                 WN08
                            Relevant in HEIs, not
                            relevant in FECs.
Sector leadership.          Research input to e-
                            learning courses
                                                                                                           D            E                      Delivery        OBDL         HE3                     WN04




                                                                                                  Prepared by Paul Bacsich 3/30/2012                                                                           Page 33
                                                                                                             Page 34                                                     ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




                                                                                  Local tag                        MIT90s   ELDAA tag                                                            HEFCW
                            Process notes and                                                     Local view of                                                        HEFCE tag   HEFCW tag
    Level 6 statement                                     Evidence areas         institution                        tag/     (balanced    OBHE tag         OBHE code                            short-term
                              commentary                                                          central or not                                                         2005        2007
                                                                                  specific)                        subtag     MIT90s)                                                            tag 2008
Sector leadership.      Integration of e-learning
                        with Widening
                        Participation agenda
                                                                                                                                            Strategy
                                                                                                        D            S                                       OBSD         HC1                     WN05
                                                                                                                                          development



Sector leadership.      Integration of e-learning
                        with disadvantaged
                        support.
                                                                                                                                            Strategy
                                                                                                        D            S                                       OBSD         HC1                     WN07
                                                                                                                                          development



Sector leadership.      Integration of e-learning
                        with personalisation
                        agenda


                                                                                                        D            I                      Students         OBST         HC1                     WN05




Sector leadership.      Level of skill in ensuring Committee papers,
                        that the e-learning activity interviews etc.
                        contributes as much as is                                                                                           Strategy
                                                                                                        C            P                                       OBSD         HB1                     WN09
                        feasible to the (eco)                                                                                             development
                        sustainability agenda.

Sector leadership.      Level of skill in managing   Analysis of collaborative
                        collaboration.               agreements.
                                                                                                                                         Partnership and
                                                                                                        D            E                                       OBPC         HG1                     WN08
                                                                                                                                          collaboration


Sector leadership.

                                                                                                        D            T                      Students         OBDL         HD1                     WN04




                                                                                               Prepared by Paul Bacsich 3/30/2012                                                                            Page 34
                                                                                            Page 35                                              ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




                                                                 Local tag                        MIT90s   ELDAA tag                                                     HEFCW
                           Process notes and                                     Local view of                                                 HEFCE tag   HEFCW tag
    Level 6 statement                          Evidence areas   institution                        tag/     (balanced   OBHE tag   OBHE code                            short-term
                             commentary                                          central or not                                                  2005        2007
                                                                 specific)                        subtag     MIT90s)                                                     tag 2008
Sector leadership.      Developed from P80




                                                                              Prepared by Paul Bacsich 3/30/2012                                                                     Page 35
                                                                                                                    Page 36                                               ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




                                                                                         Local tag                        MIT90s   ELDAA tag                                                      HEFCW
                                 Process notes and                                                       Local view of                                                  HEFCE tag   HEFCW tag
    Level 6 statement                                          Evidence areas           institution                        tag/     (balanced   OBHE tag    OBHE code                            short-term
                                   commentary                                                            central or not                                                   2005        2007
                                                                                         specific)                        subtag     MIT90s)                                                      tag 2008
Sector leadership.


                                                                                                               D            I                    Students     OBST         HC1                     WN06



In addition, students play a Overall student             Can include consideration
role in setting up           understanding of e-learning of input measures also, e.g.
procedures                   implications for them.      student briefings, etc
                                                                                                               D            I                    Students     OBST         HC1                     WN06




Sector leadership.          Competence and timeliness Follow general guidance
                            of Help Desk for students and other benchmarking
                                                      initiatives from UCISA and                               C            I                    Delivery     OBDL         HC1                     WN06
                                                      SCONUL.

Sector leadership.

                                                                                                               C            I                    Students     OBST         HC1                     WN06


Sector leadership.          Overall student satisfaction Use the Student
                            with e-learning              Satisfaction approach
                                                                                                               C            I                    Students     OBST         HC1                     WN06



Sector leadership.
                                                                                                               D            P                    Students     OBST         HC2                     WN05
Sector leadership.



                                                                                                               C            T                    Delivery     OBDL         HE2                     WN04




                                                                                                      Prepared by Paul Bacsich 3/30/2012                                                                      Page 36
                                                                                                Page 37                                              ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




                                                                     Local tag                        MIT90s   ELDAA tag                                                     HEFCW
                               Process notes and                                     Local view of                                                 HEFCE tag   HEFCW tag
    Level 6 statement                              Evidence areas   institution                        tag/     (balanced   OBHE tag   OBHE code                            short-term
                                 commentary                                          central or not                                                  2005        2007
                                                                     specific)                        subtag     MIT90s)                                                     tag 2008
In addition, the institution
is an active generator of
OER as part of its
approach to using OER.

In addition, the institution
is planning the next round
of benchmarking at
institutional or
departmental level.


Sector leadership.
                                                                                           C            P                     Staff      OBSF         HH1                     WN08




                                                                                  Prepared by Paul Bacsich 3/30/2012                                                                     Page 37
                                                                                     Page 38                                              ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




                                                          Local tag                        MIT90s   ELDAA tag                                                     HEFCW
                    Process notes and                                     Local view of                                                 HEFCE tag   HEFCW tag
Level 6 statement                       Evidence areas   institution                        tag/     (balanced   OBHE tag   OBHE code                            short-term
                      commentary                                          central or not                                                  2005        2007
                                                          specific)                        subtag     MIT90s)                                                     tag 2008




                                                                       Prepared by Paul Bacsich 3/30/2012                                                                     Page 38
                                                                                     Page 39                                              ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




                                                          Local tag                        MIT90s   ELDAA tag                                                     HEFCW
                    Process notes and                                     Local view of                                                 HEFCE tag   HEFCW tag
Level 6 statement                       Evidence areas   institution                        tag/     (balanced   OBHE tag   OBHE code                            short-term
                      commentary                                          central or not                                                  2005        2007
                                                          specific)                        subtag     MIT90s)                                                     tag 2008




                                                                       Prepared by Paul Bacsich 3/30/2012                                                                     Page 39
                                                                                     Page 40                                              ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




                                                          Local tag                        MIT90s   ELDAA tag                                                     HEFCW
                    Process notes and                                     Local view of                                                 HEFCE tag   HEFCW tag
Level 6 statement                       Evidence areas   institution                        tag/     (balanced   OBHE tag   OBHE code                            short-term
                      commentary                                          central or not                                                  2005        2007
                                                          specific)                        subtag     MIT90s)                                                     tag 2008




                                                                       Prepared by Paul Bacsich 3/30/2012                                                                     Page 40
                                                                                     Page 41                                              ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




                                                          Local tag                        MIT90s   ELDAA tag                                                     HEFCW
                    Process notes and                                     Local view of                                                 HEFCE tag   HEFCW tag
Level 6 statement                       Evidence areas   institution                        tag/     (balanced   OBHE tag   OBHE code                            short-term
                      commentary                                          central or not                                                  2005        2007
                                                          specific)                        subtag     MIT90s)                                                     tag 2008




                                                                       Prepared by Paul Bacsich 3/30/2012                                                                     Page 41
                                                                                     Page 42                                              ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




                                                          Local tag                        MIT90s   ELDAA tag                                                     HEFCW
                    Process notes and                                     Local view of                                                 HEFCE tag   HEFCW tag
Level 6 statement                       Evidence areas   institution                        tag/     (balanced   OBHE tag   OBHE code                            short-term
                      commentary                                          central or not                                                  2005        2007
                                                          specific)                        subtag     MIT90s)                                                     tag 2008




                                                                       Prepared by Paul Bacsich 3/30/2012                                                                     Page 42
                                                                                     Page 43                                              ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




                                                          Local tag                        MIT90s   ELDAA tag                                                     HEFCW
                    Process notes and                                     Local view of                                                 HEFCE tag   HEFCW tag
Level 6 statement                       Evidence areas   institution                        tag/     (balanced   OBHE tag   OBHE code                            short-term
                      commentary                                          central or not                                                  2005        2007
                                                          specific)                        subtag     MIT90s)                                                     tag 2008




                                                                       Prepared by Paul Bacsich 3/30/2012                                                                     Page 43
                                                                                     Page 44                                              ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




                                                          Local tag                        MIT90s   ELDAA tag                                                     HEFCW
                    Process notes and                                     Local view of                                                 HEFCE tag   HEFCW tag
Level 6 statement                       Evidence areas   institution                        tag/     (balanced   OBHE tag   OBHE code                            short-term
                      commentary                                          central or not                                                  2005        2007
                                                          specific)                        subtag     MIT90s)                                                     tag 2008




                                                                       Prepared by Paul Bacsich 3/30/2012                                                                     Page 44
                                                                                     Page 45                                              ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




                                                          Local tag                        MIT90s   ELDAA tag                                                     HEFCW
                    Process notes and                                     Local view of                                                 HEFCE tag   HEFCW tag
Level 6 statement                       Evidence areas   institution                        tag/     (balanced   OBHE tag   OBHE code                            short-term
                      commentary                                          central or not                                                  2005        2007
                                                          specific)                        subtag     MIT90s)                                                     tag 2008




                                                                       Prepared by Paul Bacsich 3/30/2012                                                                     Page 45
                                                                                     Page 46                                              ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




                                                          Local tag                        MIT90s   ELDAA tag                                                     HEFCW
                    Process notes and                                     Local view of                                                 HEFCE tag   HEFCW tag
Level 6 statement                       Evidence areas   institution                        tag/     (balanced   OBHE tag   OBHE code                            short-term
                      commentary                                          central or not                                                  2005        2007
                                                          specific)                        subtag     MIT90s)                                                     tag 2008




                                                                       Prepared by Paul Bacsich 3/30/2012                                                                     Page 46
                                                                                     Page 47                                              ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




                                                          Local tag                        MIT90s   ELDAA tag                                                     HEFCW
                    Process notes and                                     Local view of                                                 HEFCE tag   HEFCW tag
Level 6 statement                       Evidence areas   institution                        tag/     (balanced   OBHE tag   OBHE code                            short-term
                      commentary                                          central or not                                                  2005        2007
                                                          specific)                        subtag     MIT90s)                                                     tag 2008




                                                                       Prepared by Paul Bacsich 3/30/2012                                                                     Page 47
                                                                                     Page 48                                              ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




                                                          Local tag                        MIT90s   ELDAA tag                                                     HEFCW
                    Process notes and                                     Local view of                                                 HEFCE tag   HEFCW tag
Level 6 statement                       Evidence areas   institution                        tag/     (balanced   OBHE tag   OBHE code                            short-term
                      commentary                                          central or not                                                  2005        2007
                                                          specific)                        subtag     MIT90s)                                                     tag 2008




                                                                       Prepared by Paul Bacsich 3/30/2012                                                                     Page 48
                                                                                     Page 49                                              ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




                                                          Local tag                        MIT90s   ELDAA tag                                                     HEFCW
                    Process notes and                                     Local view of                                                 HEFCE tag   HEFCW tag
Level 6 statement                       Evidence areas   institution                        tag/     (balanced   OBHE tag   OBHE code                            short-term
                      commentary                                          central or not                                                  2005        2007
                                                          specific)                        subtag     MIT90s)                                                     tag 2008




                                                                       Prepared by Paul Bacsich 3/30/2012                                                                     Page 49
                                                                                     Page 50                                              ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




                                                          Local tag                        MIT90s   ELDAA tag                                                     HEFCW
                    Process notes and                                     Local view of                                                 HEFCE tag   HEFCW tag
Level 6 statement                       Evidence areas   institution                        tag/     (balanced   OBHE tag   OBHE code                            short-term
                      commentary                                          central or not                                                  2005        2007
                                                          specific)                        subtag     MIT90s)                                                     tag 2008




                                                                       Prepared by Paul Bacsich 3/30/2012                                                                     Page 50
                                                                                     Page 51                                              ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




                                                          Local tag                        MIT90s   ELDAA tag                                                     HEFCW
                    Process notes and                                     Local view of                                                 HEFCE tag   HEFCW tag
Level 6 statement                       Evidence areas   institution                        tag/     (balanced   OBHE tag   OBHE code                            short-term
                      commentary                                          central or not                                                  2005        2007
                                                          specific)                        subtag     MIT90s)                                                     tag 2008




                                                                       Prepared by Paul Bacsich 3/30/2012                                                                     Page 51
                                                                                     Page 52                                              ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




                                                          Local tag                        MIT90s   ELDAA tag                                                     HEFCW
                    Process notes and                                     Local view of                                                 HEFCE tag   HEFCW tag
Level 6 statement                       Evidence areas   institution                        tag/     (balanced   OBHE tag   OBHE code                            short-term
                      commentary                                          central or not                                                  2005        2007
                                                          specific)                        subtag     MIT90s)                                                     tag 2008




                                                                       Prepared by Paul Bacsich 3/30/2012                                                                     Page 52
                        Page 53                 ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




LLUK tag


 RADP



 MOFR




 LLAT



 LLAT




 LLAT




  PFTF




  PFTF




 RADP




           Prepared by Paul Bacsich 3/30/2012                                   Page 53
                        Page 54                 ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




LLUK tag




 LLAT




 RADP




 MOFR




 MOFR




  PFTF




 WPEN




  PFTF




 RADP




           Prepared by Paul Bacsich 3/30/2012                                   Page 54
                        Page 55                 ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




LLUK tag




 ARAR




 RADP




  PFTF




 ARAR




           Prepared by Paul Bacsich 3/30/2012                                   Page 55
                        Page 56                 ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




LLUK tag




           Prepared by Paul Bacsich 3/30/2012                                   Page 56
                        Page 57                 ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




LLUK tag




 LLAT




 LLAT




 LLAT




 LLAT




 LLAT




  PFTF




           Prepared by Paul Bacsich 3/30/2012                                   Page 57
                        Page 58                 ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




LLUK tag




 MOFR




 ARAR




 WPEN




 WPEN




 ARAR




 MOFR




           Prepared by Paul Bacsich 3/30/2012                                   Page 58
                        Page 59                 ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




LLUK tag




 LLAT




 LLAT




 LLAT




  PFTF




 ARAR




 WPEN




 WPEN




           Prepared by Paul Bacsich 3/30/2012                                   Page 59
                        Page 60                 ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




LLUK tag




  PFTF




  PFTF




  PFTF




 MOFR




 WPEN




 LLAT




           Prepared by Paul Bacsich 3/30/2012                                   Page 60
                        Page 61                 ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




LLUK tag




           Prepared by Paul Bacsich 3/30/2012                                   Page 61
                        Page 62                 ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




LLUK tag




 LLAT




 LLAT




 LLAT




 WPEN




 WPEN



 LLAT




 LLAT




           Prepared by Paul Bacsich 3/30/2012                                   Page 62
                        Page 63                 ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




LLUK tag




 RADP




           Prepared by Paul Bacsich 3/30/2012                                   Page 63
                        Page 64                 ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




LLUK tag




           Prepared by Paul Bacsich 3/30/2012                                   Page 64
                        Page 65                 ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




LLUK tag




           Prepared by Paul Bacsich 3/30/2012                                   Page 65
                        Page 66                 ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




LLUK tag




           Prepared by Paul Bacsich 3/30/2012                                   Page 66
                        Page 67                 ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




LLUK tag




           Prepared by Paul Bacsich 3/30/2012                                   Page 67
                        Page 68                 ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




LLUK tag




           Prepared by Paul Bacsich 3/30/2012                                   Page 68
                        Page 69                 ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




LLUK tag




           Prepared by Paul Bacsich 3/30/2012                                   Page 69
                        Page 70                 ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




LLUK tag




           Prepared by Paul Bacsich 3/30/2012                                   Page 70
                        Page 71                 ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




LLUK tag




           Prepared by Paul Bacsich 3/30/2012                                   Page 71
                        Page 72                 ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




LLUK tag




           Prepared by Paul Bacsich 3/30/2012                                   Page 72
                        Page 73                 ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




LLUK tag




           Prepared by Paul Bacsich 3/30/2012                                   Page 73
                        Page 74                 ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




LLUK tag




           Prepared by Paul Bacsich 3/30/2012                                   Page 74
                        Page 75                 ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




LLUK tag




           Prepared by Paul Bacsich 3/30/2012                                   Page 75
                        Page 76                 ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




LLUK tag




           Prepared by Paul Bacsich 3/30/2012                                   Page 76
                        Page 77                 ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




LLUK tag




           Prepared by Paul Bacsich 3/30/2012                                   Page 77
                        Page 78                 ed7ac629-124f-4775-9a9c-3eb0cc65027e.xls




LLUK tag




           Prepared by Paul Bacsich 3/30/2012                                   Page 78

				
DOCUMENT INFO
Shared By:
Categories:
Tags:
Stats:
views:0
posted:3/30/2012
language:
pages:78