Docstoc

Learning Management System Report _ Recommendations

Document Sample
Learning Management System Report _ Recommendations Powered By Docstoc
					Technology Solution Assessment for Learning




Learning Management System
Report & Recommendations
Analysis and Recommendations
October 28, 2005


Prepared by

Steve Foreman
Rob Davis

Prepared for

Terry Farmer, Eaton University
Eaton University                                                                                                  October 7, 2005
LMS Report and Recommendations                                                                                            Page 2




                                                        Contents
Executive Summary.......................................................................................................... 4
The Purpose ...................................................................................................................... 6
The Evaluation Process ................................................................................................... 8
  Business Needs Analysis for Learning...................................................................... 8
  Technology Solution Assessment for Learning ....................................................... 8
  LMS Requirements Definition ..................................................................................... 8
  Vendor Selection & Data Gathering............................................................................ 9
  Analysis Method ......................................................................................................... 12
The Requirements........................................................................................................... 13
  Eaton Corporation’s LMS Requirements................................................................. 13
  LMS Capability Categories........................................................................................ 18
    Content Handling ...................................................................................................... 18
    Navigation ................................................................................................................. 19
    Self Service............................................................................................................... 19
    Training Administration ............................................................................................. 19
    Localization ............................................................................................................... 20
    External Delivery....................................................................................................... 20
    Systems Integration .................................................................................................. 20
The Findings.................................................................................................................... 22
  Disclaimer .................................................................................................................... 22
  Vendor & Product Highlights .................................................................................... 22
    Cornerstone OnDemand........................................................................................... 22
    GeoLearning, Inc. ..................................................................................................... 22
    GeoMetrix Data Systems.......................................................................................... 23
    Oracle USA ............................................................................................................... 23
    Plateau Systems Ltd................................................................................................. 24
    Saba Software........................................................................................................... 24
    SumTotal................................................................................................................... 25
    WBT Systems ........................................................................................................... 25
  LMS Standings............................................................................................................ 26
    Overall Standings ...................................................................................................... 26
    Standings – Content Handling Capabilities .............................................................. 28
    Standings – Navigation Capabilities ......................................................................... 29
    Standings – Self Service Capabilities ....................................................................... 30
    Standings – Training Administration Capabilities ..................................................... 31
    Standings – Localization Capabilities ....................................................................... 32
    Standings - External Delivery Capabilities ............................................................... 33
    Standings - Systems Integration Capabilities........................................................... 34
The Recommendations .................................................................................................. 35
  Overview of Recommendations ................................................................................ 35
    1. Saba.................................................................................................................. 35
      Recommendation Rationale ................................................................................. 35
Eaton University                                                                                                  October 7, 2005
LMS Report and Recommendations                                                                                            Page 3


       Match with Requirements – Saba Software ......................................................... 35
       2.Plateau.............................................................................................................. 36
       Recommendation Rationale ................................................................................. 36
       Match with Requirements – Plateau, Ltd.............................................................. 37
    3. SumTotal.......................................................................................................... 38
       Recommendation Rationale ................................................................................. 38
       Match with Requirements – SumTotal Systems .................................................. 38
  Finalist Comparison Charts....................................................................................... 39
    Administration ........................................................................................................... 39
    Catalog & Search...................................................................................................... 40
    Complex Course Structures...................................................................................... 40
    Content Publishing .................................................................................................... 41
    Enrollment & Completion Transactions .................................................................... 41
    External Content Servers.......................................................................................... 42
    Language Support .................................................................................................... 42
    Licensing ................................................................................................................... 43
    Off-Line Training ....................................................................................................... 43
    Other Capabilities ..................................................................................................... 44
    Role-Based Learning ................................................................................................ 44
    Standards .................................................................................................................. 45
    Technology................................................................................................................ 45
    Testing & Assessment.............................................................................................. 47
    Training Plans & Certification Programs .................................................................. 47
    User Interface Customization, Localization & Personalization ................................ 48
    Virtual Learning Environment (VLE) ......................................................................... 49
APPENDIX A: LMS Vetting Criteria............................................................................... 50
APPENDIX B: Evaluation Data for Non-Finalists ........................................................ 52
  Match with Requirements – Cornerstone OnDemand ................................................. 52
  Match with Requirements – GeoLearning, Inc............................................................. 53
  Match with Requirements – GeoMetrix Data Systems ................................................ 54
  Match with Requirements – Oracle .............................................................................. 55
  Match with Requirements – WBT Systems.................................................................. 56
Eaton University                                                                October 7, 2005
LMS Report and Recommendations                                                          Page 4



Executive Summary
E-learning is becoming an essential tool for most companies as they seek to improve the
performance of their people in the fastest possible time and at a reasonable level of
investment. In these times of rapid change, the ability to use e-learning to reach
everyone – quickly – with the most accurate and reliable information, has tremendous
competitive value for Eaton Corporation.

A Learning Management System (LMS) is a fundamental component of a corporate
training technology infrastructure. The LMS fulfills a number of essential functions
including, training registration, tracking and reporting, catalog, e-learning delivery,
facilities and resources management and more.

An LMS solution involves a significant investment. LMS analysis and decision-making is
complex and risky. Too many e-learning/LMS efforts start strong and then fail, primarily
because not all the critical success factors were considered.

Consider these industry findings: Organizations with 50,000 or more employees spend
an average of $18.5 million on training. While much of this is spent on salaries, a
significant amount is invested in e-learning. The three-year cost of just one key tool, a
learning management system (LMS) can be between $350,000 and $500,000 for 10,000
users, and up to $900,000 for 25,000 users. And this is before any investment in other
tools or learning content! Today, about 51% of companies have some form of LMS, but
only a third of them are satisfied with their investment.1

Eaton University is at a crossroads. After purchasing an LMS over four years ago, it
finds that the system’s functionality is no longer adequate, and the product is no longer
supported by its manufacturer. The system has been customized in such a way that it
cannot be upgraded to a newer version.

Meanwhile, business demands require that the learning management system operations
be expanded to deliver training to external audiences, provide audience-specific views of
the catalog, handle multiple languages and integrate seamlessly with the corporate IT
infrastructure including the JOE portal and customer billing and payment systems.

The technology decisions Eaton University makes now will have a great impact on how
well it is positioned to adapt and grow its e-learning infrastructure as learning
technologies evolve into the future.

This report is the outcome of an extensive process of data gathering and analysis.
Business and technology requirements were gathered through focus groups, interviews,
and system and documentation reviews.

Through a rapid vetting process, ten products were selected for evaluation from a field of
over 160 available LMS products. Eight of the ten vendors responded to a request for


1
    Sources: Brandon-Hall, Training Magazine, IDC.
Eaton University                                                              October 7, 2005
LMS Report and Recommendations                                                        Page 5


information. Responses were analyzed and three vendors are recommended as
finalists.

The finalists are: Saba Software, Plateau Ltd, and SumTotal Systems. The capabilities
offered in the LMS products of these three companies most closely match Eaton
Corporation’s requirements for a Learning Management System.

We recommend that Eaton University focus the next and final stage of its LMS selection
process on these three products by viewing demonstrations, exploring licensing and
pricing options, and asking for clarification and elaboration on several issues related to
product capabilities and functionality.
Eaton University                                                                October 7, 2005
LMS Report and Recommendations                                                          Page 6




The Purpose
Early in 2005, Eaton University began to consider options for enhancing its e-learning
architecture. EU recognized that:

•   In the engineering and manufacturing business, technologies, standards and
    products are in a rapid state of flux. Keeping employees, partners and customers
    abreast of all the latest developments is of critical importance.

•   EU supports four major business units, each with its own set of needs and issues, as
    well as staff functions, business partners and customers.

•   Eaton employees come from diverse geographic locations, cultures, time zones and
    speak several different languages.

•   EU delivers a wide array of training content, including commercial courseware
    libraries, custom courses developed by the business units and multiple vendors,
    content created by experts throughout the business, and more.

•   EU currently owns and operates an older release of the SumTotal Systems
    (previously Docent) LMS.

•   Eaton’s version of Docent is no longer supported by SumTotal Systems.

•   Commercial LMS products often support a standard feature set and are limited in
    their capacity to be configured to reflect specific ways clients do business. Often,
    LMS vendors discourage their clients from adding customized features to the
    system. These customizations may even void maintenance and support agreements
    and may make upgrading to new LMS releases prohibitively difficult and costly. EU
    may be in a situation such as this with its current LMS and the custom
    enhancements that have been made to it. This adds complexity to your decision-
    making process.

•   The total cost of LMS ownership goes well beyond the system license, extending into
    implementation consulting, content and data migration, annual maintenance and
    support, hosting services and more. It is very difficult for organizations to assess the
    total cost of ownership, in advance of a purchase.

•   Common complaints from LMS clients are that they are “locked in” to their LMS
    vendor because it costs too much to change; that they paid for the entire system but
    only use a small percentage of its functionality; that it doesn’t do “exactly” what they
    need it to do; and that it is very costly to host and maintain. In response, some
    vendors have begun offering outsourced LMS services. You may be open to
    considering an outsourced solution in the mix of LMS options on the table.
Eaton University                                                                October 7, 2005
LMS Report and Recommendations                                                          Page 7


•   EU has several manual processes in place for registering and billing external users,
    such as distributors and customers who attend EU training. These processes, and
    similar post-learning processes, are resource-intensive and cumbersome and could
    benefit from being automated.

•   External users, such as distributors and customers, cannot access EU’s rich catalog
    of e-learning courseware. Each of Eaton’s four major business groups has its own
    set of needs to train distributors and customers. There are many issues to be
    considered including, but not limited to, policies, intellectual property and technology.

•   EU’s plans to grow its capability to offer training to all Eaton employees, regardless
    of the country where the work is done, or the type of work performed. This includes
    production workers in some facilities that are not currently equipped with learning
    workstations and connectivity.

It became clear that, given these challenges, the business imperatives driving Eaton
University’s technology strategy should be thoroughly explored prior to LMS evaluation
and selection.

In mid-2005, Eaton University engaged InfoMedia Designs to perform a Business Needs
Analysis for Learning. In this phase information from Eaton University’s stakeholders
was gathered and the business goals and drivers affecting EUs technology decisions
were a strategically assessed. A high level gap analysis of EUs current- and goal-state
capabilities led to practical recommendations to enhance EU’s e-learning capabilities
and infrastructure.

Concurrently, a Technology Solution Assessment for Learning was performed. In this
phase, information from Eaton’s Information Technology organization, JOE Portal Team
and HR Technologies was gathered to determine, at a high level, how the LMS can be
most effectively integrated into Eaton’s technology infrastructure. Finally, LMS vendor
products were evaluated to produce a short list of recommended vendors that best meet
Eaton’s LMS requirements.
Eaton University                                                             October 7, 2005
LMS Report and Recommendations                                                       Page 8




The Evaluation Process
During several telephone calls and trips to various Eaton business groups and work sites
between June 2 and July 7, 55 employees were interviewed, either individually or in
focus groups.

The employees represented a wide range of levels of leadership and management
including C and VP level executives, directors, division managers, managers and staff.
Corporate and all four business groups were represented. A number of functional areas
were represented including Operations, Engineering, Technical Services, Marketing,
Finance, EBS, Human Resources, Information Technology and Training.

These interviews and focus groups covered a wide range of subjects related to e-
learning at Eaton and in the Company as a whole. The data focused on the current and
future requirements for Eaton University and delved into the context in which e-learning
can be successful.

In addition to the interviews and focus groups, over thirty documents and online systems
were reviewed.


Business Needs Analysis for Learning

Many of the data gathering activities focused on the current and future business
imperatives and the performance culture of the Company. The result was a document
highlighting the findings and providing twelve strategic recommendations for advancing
the role Eaton University plays in support of the achievement of Eaton’s key business
goals. These recommendations provide a strategic framework for identifying LMS
requirements and selecting an appropriate product.

Results and recommendations were delivered on October 7, 2005 in a document
entitled, “Building an E-Learning Strategy for Eaton Corporation and Eaton University”.


Technology Solution Assessment for Learning

The remainder of the data gathering activities were focused on the technological
environment in which e-learning will operate and the relationship between various
organizations within and outside the training community including Eaton University,
Information Technology, the JOE Portal Team and Human Resources Technologies.


LMS Requirements Definition

The findings from both data gathering tracks were analyzed and used to develop a set of
ten (10) higher level vetting requirements (see Appendix A) and forty (40) evaluation
Eaton University                                                                 October 7, 2005
LMS Report and Recommendations                                                           Page 9


requirements (see Requirements section) for Learning Management System (LMS)
selection.


Vendor Selection & Data Gathering

The first step in the LMS selection process was to limit the field from over 160 available
LMS products to the 10 most likely candidates for Eaton.

Thirty-eight likely products were selected for initial investigation based on a review of
market research by Gartner Group, Forrester Research, Brandon Hall Research and
Bersin & Associates.

Manufacturer                     Product
Cobent                           Cobent LCMS
Cornerstone OnDemand             Cornerstone Learning
Convergys                        DigitalThink E-Learning Platform
eLearn Now                       eLearn Now
eLogic Learning                  eSSential
FlexTraining                     Total e-Learning Solution
Generation21                     Generation21 Enterprise
GeoLearning                      Maestro Enterprise LMS
GeoMetrix Data Systems           Training Partner
HyperWave                        eLearning Suite
IBM                              Lotus Learning Management
Integrated Performance Systems   iLearn
Intelladon                       Advanced Learning Platform
Ernst & Young Intellinex         Intellinex LMS
IntraLearn Software              IntraLearn XE
KnowledgePlanet                  Enterprise Learning Suite
Learn.com                        LearnCenter
LearnFrame                       Nebo
Maritz Learning                  Librix
MeridianKSI                      KnowledgeCentre
Nexus Vista                      Nexus Vista LMS
Operitel                         LearnFlex
Oracle                           Oracle iLearning
OutStart                         OutStart Evolution LMS
Plateau                          Plateau LMS
Saba Software                    Saba Learning, Enterprise Edition
SAP                              mySAP ERP HCM LMS
Siebel                           Siebel Training LMS
SumTotal Systems                 TotalLMS
SyberWorks                       SyberWorks Training Center
Synapse SE                       Synapse SE LMS
techniques.org                   knowledgeWorks LMS
TrainCaster                      TrainCaster LMS
VuePoint                         VuePoint Learning System (VLS)
VTN Technologies                 OLE Online Learning Environment
WBT Systems                      TopClass
YNotLearn                        YNotLearn
Ziiva                            Prosperity
Eaton University                                                                 October 7, 2005
LMS Report and Recommendations                                                          Page 10


In order to quickly vet the thirty-eight products down to just ten, higher level vetting
criteria were identified as critical differentiators for an Eaton LMS. The vetting criteria
can be found in Appendix A. Information found on the vendor web sites and available
from third parties was reviewed and evaluated in relation to the vetting criteria and ten
(10) vendor candidates were selected.

         Manufacturer                              Product
Cornerstone OnDemand               Cornerstone Learning
Generation21                       Generation21 Enterprise
GeoMetrix Data Systems             Training Partner
HyperWave                          eLearning Suite
LearnFrame                         Nebo
Oracle                             Oracle iLearning
Plateau                            Plateau LMS
Saba Software                      Saba Learning, Enterprise Edition
SumTotal Sys tems                  TotalLMS
WBT Systems                        TopClass

GeoLearning, an LMS vendor that did not meet the vetting criteria was selected as an
eleventh candidate after they were referred to the evaluation team by Eaton.

A Request for Information (RFI) was developed containing the forty Eaton LMS
requirements along with a set of up to five open-ended questions associated with each
requirement.

Each of the eleven vendors were contacted. One of the vendors, HyperWave, did not
reply after a week’s worth of multiple phone calls, email messages and a complete web
form.

The ten vendors who replied all opted to receive the RFI. The vendors were given two
weeks to deliver a response. One vendor, Generation21, contacted the evaluation team
and withdrew after receiving the RFI.

Eight of the nine remaining vendors responded on or before the due date. LearnFrame
did not respond.

The eight (8) vendors from whom responses were received are:

Cornerstone Learning
Cornerstone OnDemand
www.cornerstoneondemand.com
Tim Newlan, Account Executive, tnewlin@cornerstoneondemand.com
Tim Armstrong, VP Western Region, tarmstrong@cornerstoneondemand.com
2850 Ocean Park Blvd., Suite 225
Santa Monica, CA 90405
Tel: 310.752.0200
Fax: 310.752.0199

GeoNext
GeoLearning, Inc.
www.geolearning.com
Todd Porter, Account Executive, tporter@geolearning.com
Eaton University                                              October 7, 2005
LMS Report and Recommendations                                       Page 11


4600 Westown Parkway, Suite 301
West Des Moines, IA 50266
Tel: 800.970.9903



iLearning
Oracle USA, Inc.
www.oracle.com
Rod Politik, Account Manager, rod.politick@oracle.com
905.501.5225


Plateau LMS
Plateau Systems Ltd.
www.plateau.com
671 North Glebe Road
Arlington, VA 22203
Tel: 703.292.0200
Fax: 703.292.0299
J. Robert Kamal, Account Manager., robert.kamal@plateau.com
810.231.6103 (desk)
313.600.6427 (cell)

Saba Enterprise Learning
Saba Software
www.saba.com
Glenn Antonson, Account Executive, antonson@saba.com
378 Sierra Avenue
Naperville, IL 60181
630.778.7266
cell: 630.258.7558
fax: 630.839.0874

TopClass
WBT Systems, Inc.
www.wbtsystems.com
Mansour Tannas, Director Channel Mgt
781.250.6121
mobile: 617.823.2030
mtannas@wbtsystems.com

TotalLMS
SumTotal Systems
www.sumtotalsystems.com
John Leh, Sr. Account Executive, jleh@sumtotalsystems.com
106 West Seventh Street
Mifflinville, PA 18631
570.759.9900
fax: 570.759.9466
cell: 570.436.3989

Training Partner
GeoMetrix Data Systems
www.trainingpartner.com
Arden Rose, arden.rose@trainingpartner.com
10th Floor, 747 Fort Street
Victoria, BC Canada V8W 3E9
Eaton University                                                              October 7, 2005
LMS Report and Recommendations                                                       Page 12


Tel: 250.361.9300 x223



Analysis Method

The match between Eaton’s requirements and each of the eight systems was evaluated.
The responses to the RFI questions were analyzed and a rating of strong, average or
weak was assessed for each Eaton requirement.

The ratings were translated into numeric values according to the following scale:
   • strong = 3
   • average = 2
   • weak = 1

The scores were tallied and the total was divided by the number of requirements to
arrive at an overall product score. The score was translated into a grade based on the
following scale:

A+:    over 96%      B+:   86 – 89%   C+:   76 – 80%   D+:   66 – 70%    F:   under 60%
A:     93 – 95%      B:    83 – 95%   C:    73 – 75%   D:    63 – 65%
A-:    90 – 92%      B-:   80 – 82%   C-:   70 – 72%   D-:   60 – 62%

The forty evaluation requirements were grouped into seven categories representing
major themes that emerged from interviews with training sponsors, administrators, end
users and technical experts. The seven categories represent higher level capabilities
required by Eaton:

      1.   Content Handling
      2.   Navigation
      3.   Self Service
      4.   Training Administration
      5.   Localization
      6.   External Delivery
      7.   Systems Integration

The requirements associated with a category were tallied and the total was divided by
the number of requirements to arrive at a category score. In this way, each product was
assigned a score for each category.
Eaton University                                                              October 7, 2005
LMS Report and Recommendations                                                       Page 13




The Requirements
Eaton Corporation’s LMS Requirements

1. Facility-based instructor-led training. The LMS must support the administration of
   facility-based instructor-led training including:
   • scheduling class sessions
   • associating instructors with sessions
   • associating facilities with sessions
   • enrolling students
   • wait-list management
   • student withdrawals
   • class session cancellations
   • verification of prerequisites
   • tracking attendance and completions
   • student, instructor and management notifications including the delivery of pre-
       course materials and post-course feedback

2. Online instructor-led training. The LMS must support the administration and
   delivery of online instructor-led training including:
    • scheduling class sessions
    • associating instructors with sessions
    • enrolling students
    • verification of prerequisites
    • student withdrawals
    • class session cancellations
    • tracking student attendance and completions
    • delivering a virtual classroom experience or seamlessly integrating with a virtual
        learning environment provider such as WebEx
    • capture and playback of virtual classroom sessions
    • student, instructor and management notifications including the delivery of pre-
        course materials and post-course feedback

3. Non-instructor-led training. The LMS must support the delivery of a wide variety of
   non-instructor-led training including (but not limited to):
   • self-paced online tutorials
   • videos
   • self-assessments
   • simulations
   • suggested books and publications
   • professional societies and associations
   • certifications
   This variety of training offering types should appear natural to the student and not as
   if all offerings have be forced to fit into a one size fits all course mold.
Eaton University                                                                  October 7, 2005
LMS Report and Recommendations                                                           Page 14


4. AICC & SCORM conformant courseware. The LMS must support delivery and
   tracking of AICC and SCORM conformant courseware. The client uses internally
   developed SCORM and AICC conformant courses as well as commercial
   courseware from Thompson NETg and other third party vendors.

5. Internal/external content hosting. The LMS must facilitate the offering of both
   content that may be hosted internally within the company network (on the same or a
   different machine from the LMS), and content that is hosted externally outside of the
   company firewall.

6. Third party content. The LMS must enable the client to publish new content
   licensed from third party content providers (e.g. SkillSoft and Thompson NETg) as
   well as custom built proprietary content on an ongoing basis.

7. Complex course structures. The LMS must support complex course structures.
   The client offers a number of complex course structures such as blended models,
   multi-session, multi-instructor and multi-location offerings. The LMS should handle
   this complexity elegantly, behind an intuitive, easy-to-use end user and
   administrative user interface.

8. Catalog: The LMS must support a multi-layered and networked catalog of training
   offerings.

9. Search Function: The LMS must provide, in addition to the normal course catalog,
   the ability for users to locate applicable training offerings via a robust search facility.
   The search should minimally encompass course titles, descriptions, learning
   objectives, metatags, locations, and curricula. More desirably it should allow for full
   text and keyword search of all course materials and produce results at the module,
   topic, and/or chapter level of training offerings.

10. Self-service enrollment. The LMS must support self service enrollment for both
    company employees and authorized non-company personnel. Self service is intend
    to mean users enrolling themselves and designated users enrolling others.

11. Role-based learning. The LMS must support role-base learning; that is, different
    schemes/rules of entitlement for specific training offerings based on the user’s
    profile.

12. Schemes based on user profile. The LMS must support different course pricing
    and payment schemes based on the specific training offering and the enrolling user’s
    profile. For instance, some offerings may be free to company-employees but billed
    to company-externals at various different rates depending on the student’s
    company’s relationship to this company. Within the company, training may be billed
    to individuals, departments or cost centers.

13. Completions. The LMS should support (but not require) rule-based automated
    course completion and must also allow for authorized administrators to manually
    mark student-course completions and even override automated completions.
Eaton University                                                               October 7, 2005
LMS Report and Recommendations                                                        Page 15


    Manually marked completions should be possible both one at a time and as a batch
    (e.g.; a whole class session at once).

14. Administration. The LMS must support configurable administrator roles,
    permissions and workflow. The client has defined a number of administrative roles
    related to the LMS. Each of these roles should have restricted administrative access
    to specific features, functions and reports. The administrative processes should be
    configurable to reflect the way the client’s various training organizations operate.

15. Reports. The LMS must support the administration of training at the company with
    an appropriate set of customizable reports and the ability to create additional reports
    as necessary. The LMS will not need to produce reports of employee training
    history. That is the responsibility of the company’s HRMS. It will however need to
    produce reports of activity related to the ongoing administration of training.

16. External user tracking. The LMS must report on historical training activity of non-
    company personnel. To do so it will need to be able to associate students with their
    company and also perhaps arrange reports according to different product based
    hierarchies for different business units.

17. Privacy. The LMS must ensure the privacy of personal profile information and
    personal training activity information.

18. Look & feel customization. The LMS must be customized to conform in look-and-
    feel to the company’s corporate guidelines. In particular, the LMS will need to be
    able to have its home page and perhaps some of its inside pages customized to look
    and behave in a company standardized way. Possible customizations include the
    following; branding, fonts, colors, page-layouts, and wording.

19. Localized user interface versions. The LMS should support versions of its user
    interface that are specific to the user’s locale. The company is increasingly a global
    corporation with employees all over the world. The LMS should be able to present
    its user interface in different languages and locale relevant formats.

20. Customized user interface based on user profile. The LMS must be customized
    dynamically at runtime based on the user’s profile information, role in relationship to
    the LMS and training entitlement information. For example; students should only see
    training offerings available to them based on who they are in relationship to the
    company, administrators should only see courses, instructors, students, and so on
    who they are responsible for administering, and managers should be restricted to
    viewing data of students who they manage. Person identity will be retrieved via the
    company single-sign-on solution. The company HRMS will maintain employee
    profile data. External person’s profile data could perhaps be maintained by an
    extension of the distributed LDAP maintenance component of the company’s single-
    sign-on solution. Training entitlement data will need to be maintained by the LMS or
    a customized extension to it.
Eaton University                                                                  October 7, 2005
LMS Report and Recommendations                                                           Page 16


21. Personalized by each user. The LMS should be able to be personalized by
    individual users. For example:
    • It is desirable that users be able to establish and maintain their own unique
        training plan.
    • Users should be able to “opt-out” of email notifications
    • Users should be able to specify the language they prefer and the languages that
        they are able to understand.

22. Training plans. The LMS should support the specification of standard training plans
    and be able to associate those plans with individual users based on their profile.

23. Certification programs. The LMS should support the specification, targeting and
    tracking of certification associated training programs. Specifying a certification
    program may involve grouping and/or sequencing courses, tests and content.
    Targeting may refer to making the program available the program to appropriate
    individuals. Tracking may refer to the monitoring and measurement of individual and
    group progress.

24. Offerings in multiple languages. The LMS should allow for multiple language
    versions of any specific training offering. The client currently does business in 22
    languages. The LMS must include the ability to host content in multiple languages,
    and to present a user interface in multiple languages. The language preference
    should depend on the individual user’s profile.

25. Version control. The LMS should allow for multiple versions of online training
    offerings. In other words, the system may have any features or provisions for
    managing users who are in progress in one version of a course when it is updated.

26. Self-Diagnostics. The LMS should provide features to check the validity of menus,
    branches and http links and manage the shelf life of training offerings, etc.

27. Off-line training. The LMS should accommodate the delivery and tracking of off-line
    training (training performed while disconnected from the company network).

28. Configurable email messaging. The LMS must support configurable email
    messaging. The LMS email messaging features must be configurable. The client
    must be able to configure message contents and messaging rules. Email must
    include an “opt in/out” feature for end users.

29. Internal/external hosting options. The LMS should provide options for both
    internal and external hosting. The client’s IT and CFO leadership have expressed a
    clear preference for an in-house LMS solution. The cost, reliability, security, systems
    integration, networking and IT/Training partnering advantages of an in-house solution
    were cited. On the other hand, the client organization’s leadership prefers to keep
    the option open for an externally hosted solution. Whether a hosted or in-house
    solution is selected initially, the client should have the option to bring the solution in-
    house at any time. Therefore, it is preferable that the LMS support the following
Eaton University                                                                October 7, 2005
LMS Report and Recommendations                                                         Page 17


    client IT standards: a Java Enterprise (J2EE) platform, SQL database (e.g. Oracle)
    and Sun Server support.

30. SSO participation. The LMS must participate in the company’s single-sign-on
    solution. Company employees, customers, suppliers, and distributors who desire
    access to the client’s training offerings must have their (1) identity authenticated and
    (2) authorization to access particular training offerings validated. Company IT has
    centralized identity-management and provides a single-sign-on solution via a
    component of the company Portal. The mechanism used is a Sun Identity Server
    that manages an LDAP directory of person information. The directory identifies
    internal employees who have company email addresses as well as employees of
    selected business partners. In both cases, individuals can be identified by their
    unique email address. The company Employee Portal is programmed in Java and
    executes in a J2EE application server. Company IT has also developed a
    proprietary software component for distributing the registration and management of
    non-company persons to trusted external administrators.

31. Get HRMS employee info. The LMS must obtain employee profile information from
    the company HRMS. The company uses an Oracle HRMS as its definitive source of
    all company employee profile information. In the HRMS employees are uniquely
    identified by their OracleId. For the current LMS there is a nightly batch feed of
    employee data from the HRMS to the LMS.

32. Put HRMS training info. The LMS must report company-employee training
    completions to the company HRMS. The company Oracle HRMS is the repository of
    record for all employee-training history. The LMS will need to report company-
    employee training completions to the HRMS. This is currently being done via a
    nightly batch feed.

33. Unique user identifier (OracleId, email address in authorized domain). The
    LMS must associate training activity data with an OracleId for a company-employee
    or a unique email address for non-company-personnel. In the case of non-company-
    personnel, the domain part of a user’s email address must uniquely identify the
    company to which they belong.

34. Interface with order entry & billing systems. The LMS must interface with
    multiple back office, business unit specific order entry, billing, and/or accounting
    systems in order to offer training to the company’s customers, suppliers, distributors
    and dealers. Each business unit has its own unique billing and accounting systems.
    In some cases the communication will need to occur after training is complete and in
    other cases it will need to occur prior to training taking place. The interface should
    be completely automated (or nearly so) and appear seamless to the user. Of
    particular interest is the ability to accept credit card payment during the enrollment
    process of certain courses for certain student audiences.

35. Associate offerings with competencies defined in external app. The LMS must
    support the association of training offerings with job competencies which are defined
Eaton University                                                               October 7, 2005
LMS Report and Recommendations                                                        Page 18


    in a custom-built HR application. The company maintains job competencies using a
    custom -built Performance Management application.

36. “Deep-linking.” The LMS should support “deep linking” from other systems. That
    is; the LMS should enable other applications (such as the company’s Employee
    Portal and APEX) to programmatically interface in real-time to the LMS at a
    reasonably fine-grained level.

37. Link individuals/groups with training & business objects in external app. The
    LMS should support the linkage for individuals/groups between business goals and
    training and objectives as defined in a third party HR system. A critical focus of the
    company’s training organization is to improve the company’s overall business
    performance by propagating the goals, vision, values, quality policies, metrics and
    key business processes of the corporation through company managers to all
    company employees.

38. Testing & assessment. The LMS should support testing and assessment.

39. Other capabilities & options. It is desirable, though not required that the LMS
    support other capabilities and options including:
    • content authoring
    • learning content management
    • communities of practice
    • ad-hoc communities
    • threaded discussions
    • instant messaging
    • wiki-like spaces
    • user ratings and reviews of training offerings
    • personal annotations of training materials
    • on-going access to training materials of completed offerings
    • knowledge management
    • performance management

40. Flexible and cost-effective licensing. The LMS vendor must offer flexible and
    cost-effective licensing. The LMS provider must offer flexible and cost effective
    licensing arrangements to meet the client’s need for 20,000 core users (employees)
    and unlimited additional ad hoc users (employees, business partners and
    customers).


LMS Capability Categories

Content Handling

The LMS must:
   • handle custom and third party courseware as well as a variety of delivery types
      including facility-based, virtual learning environment, and self-paced.
Eaton University                                                             October 7, 2005
LMS Report and Recommendations                                                      Page 19


    •   handle content hosted on the same server as the LMS, and on other internal and
        external web servers.
    •   be able to present only relevant content to a user, based on the user’s profile.
    •   support the creation and maintenance of certification and compliance programs,
        tests and self-assessments.
    •   support version control for course updates, shelf-life management, and multiple
        language versions of content.

Vendor responses to requirements 1-6, 11-13, 22-25, 27 and 36-39 are indicators of the
product’s content handling capabilities.

Navigation

The LMS must:
   • support multiple methods including, but not limited to, a powerful search feature,
      multi-tiered curricula, learning paths, certification paths, links to APEX
      competencies, and a “deep linking” capability to enable other systems to link to
      specific LMS offerings and features.
   • support personalization based on location, region, job, function, organization,
      business group and various personal preferences.

Vendor responses to requirements 8-9, 12, 18-23, 26 and 35-37 are indicators of the
product’s navigation capabilities.

Self Service

The LMS must:
   • enable easy access and self service transactions by end users.
   • allow users to enroll, withdraw, get waitlisted and move from waitlisted to
      enrolled.
   • protect the privacy of personal information.
   • be personalizable by each user.
   • enable a user to create a personal learning plan.
   • enable a user to take training offline.
   • provide a seamless end-to-end user experience, from sign-on through
      payment/billing.

Vendor responses to requirements 10, 17, 21-22, 27, 30-31 and 33-34 are indicators of
the product’s self service capabilities.

Training Administration

The LMS must:
   • adapt to Eaton’s administration workflow.
   • provide optimum automation and streamlined tools for administration tasks.
   • enable configurable administration roles and priviledges.
Eaton University                                                               October 7, 2005
LMS Report and Recommendations                                                        Page 20


    •   provide flexible and robust reporting features including canned, ad-hoc and
        scheduled reports and report customization.
    •   handle complex course structures e.g., self-paced work blended with a
        “checkerboard” schedule of on-site and virtual events occurring over several
        weeks at multiple locations, each with a different instructor and course materials.
    •   offer configurable email messages and rules.

Vendor responses to requirements 1-3, 7-8, 10-11, 13-16, 18-20, 24-26, 28 and 35-37
are indicators of the product’s training administration capabilities.

Localization

The LMS must:
   • support local languages, time zones, date and number formats.
   • present facilities-based offerings only at relevant locations.
   • handle regionalized versions of learning programs.
   • handle learning programs specific to a work location.

Vendor responses to requirements 8, 11-12, 19-20, 24, 28, 37 and 39 are indicators of
the product’s localization capabilities.

External Delivery

The LMS must:
   • be accessible to external audiences.
   • support self service sign-on and enrollment transactions.
   • handle external-facing look and feel customization.
   • enforce end user entitlements based on user profiles and access rules.
   • enable authentication, online payment and billing.
   • handle scalability to potentially large numbers of total and concurrent end users.
   • deliver a wide variety of training, tests and certification programs.

Vendor responses to requirements 8, 10-12, 16-20, 23-24, 28, 30, 33-34, 36 and 40 are
indicators of the product’s external delivery capabilities

Systems Integration

The LMS must:
   • integrate effectively with the JOE Portal, APEX, HRMS, various billing and
      payment systems and other components of the EU e-learning architecture.
   • deliver optimum system performance and contribute to optimum network
      performance during real-time integration processing.
   • incorporate a component-based multi-tiered application architecture reflecting
      current best practices in enterprise software design.
   • offer flexible licensing terms to accommodate Eaton’s large external audiences.
Eaton University                                                          October 7, 2005
LMS Report and Recommendations                                                   Page 21


Vendor responses to requirements 29-38 are indicators of the product’s systems
integration capabilities.
Eaton University                                                                               October 7, 2005
LMS Report and Recommendations                                                                        Page 22




The Findings
Disclaimer

Findings and recommendation are based on responses to the RFI and product
documentation provided by the product vendors. It is assumed that the information
provided is accurate and up to date. 2

Vendor & Product Highlights

From the analysis process, a view of each product emerged, clearly depicting its
strengths and weaknesses related to Eaton Corporation’s learning goals and
requirements.

Cornerstone OnDemand

This company offers a human capital management (HCM) suite covering learning,
performance management, succession planning and analytics. The LMS product is
called Cornerstone Learning.

                Suite:   Human Capital Management

                 LMS:    Cornerstone Learning

           Strengths:    Administration, tracking & reporting, testing & assessment.

        Weaknesses:      Complex course structures, search feature, localization, off-line training.



GeoLearning, Inc.

This company offers an e-learning suite covering learning management , learning
content management, learning portal, virtual learning environment and authoring tools
(Articulate & Lectora). The LMS application service provider (ASP) solution is called
Maestro. A client-hosted version of Maestro called GeoNext is expected in 1Q06.

                Suite:   e-Learning

                 LMS:    GeoNext

           Strengths:    Testing & assessment, training plans, tracking & reporting.

        Weaknesses:      Complex course structures, role-based learning, localization.




2
 Additional rigor will be required to select the product, e.g. pricing, business health
considerations, demonstrations, etc.
Eaton University                                                                               October 7, 2005
LMS Report and Recommendations                                                                        Page 23




GeoMetrix Data Systems

This company offers an e-learning suite. In addition to offering learning management
and virtual learning environment products, they are North American resellers of learning
content management and authoring tools from Australian company Kookabura Studios.
The LMS product is called Training Partner.

                Suite:   e-Learning

                 LMS:    Training Partner

           Strengths:    Search feature, tracking & reporting, role-based learning, flexible licensing,
                         security & privacy.

        Weaknesses:      Localization, off-line training, self service enrollment.



Oracle USA

During 2005, Oracle spent $18B acquiring its competitors including PeopleSoft, Siebel
and a number of other companies. According to news sources, Oracle intends to
assemble an integrated portfolio of business applications, hoping to surpass SAP as the
largest maker of business applications. The Oracle sales person mentioned the recent
acquisitions and stated that, while Oracle is not currently a market leader in the LMS
space, they intend to be. The LMS product is called Oracle iLearning.

                Suite:   Business Applications

                 LMS:    iLearning

           Strengths:    Role-based learning, localization, Oracle HRMS integration.

        Weaknesses:      Standards conformance, testing & assessment, tracking & reporting, search
                         feature, offline training, certification programs.
Eaton University                                                                              October 7, 2005
LMS Report and Recommendations                                                                       Page 24




Plateau Systems Ltd.

This company offers an HCM suite covering learning, collaboration, performance
management, business intelligence, and analytics. The LMS product is called Plateau
LMS.

                Suite:   Human Capital Management

                 LMS:    Plateau LMS

           Strengths:    Complex course structures, role-based learning, localization, tracking & reporting,
                         testing & assessment, systems integration.

        Weaknesses:      A few nits like shelf life management (which is planned for the next release).



Saba Software

This company offers a suite of products that cover HCM and e-learning. HCM
components include learning management, performance management, talent
management, collaboration and analytics. The e-learning components include learning
content management, authoring tools (Saba Publisher), and a new virtual learning
environment with the acquisition of Centra earlier this month. The LMS product is called
Saba Enterprise Learning.

                Suite:   e-Learning & Human Capital Management

                 LMS:    Saba Enterprise Learning

           Strengths:    Complex course structures, search feature, role-based learning, administration,
                         tracking & reporting, localization, off-line training, testing & assessment.

        Weaknesses:      No real weaknesses, although price was not considered in this round.
Eaton University                                                                              October 7, 2005
LMS Report and Recommendations                                                                       Page 25




SumTotal

This company offers a suite of products that cover HCM and e-learning. HCM
components include learning management, performance management, content
management, collaboration and analytics. The e-learning components include learning
content management, authoring tools (Toolbook), a virtual learning environment, and
offline learning. The LMS product is called TotalLMS.

                Suite:   e-Learning & Human Capital Management

                 LMS:    TotalLMS

           Strengths:    Search feature, role-based learning, tracking & reporting, security & privacy,
                         localization, off-line training, testing & assessment.

        Weaknesses:      Systems integration.



WBT Systems

This company offers an e-learning suite that covers learning management, learning
content management, authoring tools (TopClass Publisher) and offline training. The LMS
product is called TopClass.

                Suite:   e-Learning

                 LMS:    TopClass

           Strengths:    Certification programs, shelf-life management, testing & assessment, systems
                         integration.

        Weaknesses:      Standards conformance, complex course structures, role-based learning,
                         administration, localization.
Eaton University                                                         October 7, 2005
LMS Report and Recommendations                                                  Page 26




LMS Standings

Overall Standings

Three LMS products scored above average. Saba had the highest overall score,
followed by Plateau and SumTotal which were less than a point apart. GeoMetrix
scored on the high side of average. The remaining systems were below average.

Rank   LMS Vendor                                 Overall Score         Grade

 1     Saba                                         93.33%                A

 2     Plateau                                      84.17%                B

 3     SumTotal                                     83.33%                B

 4     GeoMetrix                                    79.17%                C+

 5     WBT Systems                                  69.17%                D+

 6     Cornerstone                                  67.50%                D+

 7     Oracle                                       66.67%                D+

 8     GeoLearning                                  61.67%                D-




                                       Figure 1
Eaton University                                                                October 7, 2005
LMS Report and Recommendations                                                         Page 27




Figure 2 shows LMS product standings in each of the categories: content handling,
navigation, self service, training administration, localization, external delivery, and
systems integration.




                                          Figure 2
Eaton University                                                  October 7, 2005
LMS Report and Recommendations                                           Page 28




Standings – Content Handling Capabilities

The three overall leaders were the leaders in content handling.

Rank   LMS Vendor                                    Score        Grade

 1     Saba                                         96.30%         A+

 2     SumTotal                                     87.04%         B+

 3     Plateau                                      85.19%         B

 4     GeoMetrix                                    77.78%         C+

 5     WBT Systems                                  66.67%         D+

 5     Cornerstone                                  66.67%         D+

 5     Oracle                                       66.67%         D+

 6     GeoLearning                                  64.81%         D




                                         Figure 3
Eaton University                                                          October 7, 2005
LMS Report and Recommendations                                                   Page 29




Standings – Navigation Capabilities

Saba and SumTotal retained the two top spots in navigation capabilities. GeoMetrix had
a slight edge over Plateau, which was in the fourth spot.

Rank    LMS Vendor                                 Score                  Grade

  1     Saba                                       94.87%                  A

  2     SumTotal                                   84.62%                  B

  3     GeoMetrix                                  82.05%                  B-

  4     Plateau                                    79.49%                  C+

  4     WBT Systems                                79.49%                  C+

  5     Oracle                                     71.79%                  C-

  6     Cornerstone                                61.54%                  D-

  7     GeoLearning                                56.41%                  F




                                       Figure 4
Eaton University                                                           October 7, 2005
LMS Report and Recommendations                                                    Page 30




Standings – Self Service Capabilities

The three overall leaders were the leaders in self-service capabilities.

Rank    LMS Vendor                                     Score               Grade

  1     Saba                                          88.89%                B+

  2     Plateau                                       81.48%                B-

  3     SumTotal                                      77.78%                C+

  3     WBT Systems                                   77.78%                C+

  4     Cornerstone                                   74.07%                C

  5     GeoMetrix                                     66.67%                D+

  6     Oracle                                        62.96%                D-

  7     GeoLearning                                   59.26%                F




                                          Figure 5
Eaton University                                                               October 7, 2005
LMS Report and Recommendations                                                        Page 31




Standings – Training Administration Capabilities

The three overall leaders were the leaders in training administration capabilities.

Rank    LMS Vendor                                     Score                  Grade

  1     Saba                                          95.24%                     A

  2     SumTotal                                      90.48%                    A-

  3     Plateau                                       84.13%                     B

  3     GeoMetrix                                     84.13%                     B

  4     Oracle                                        74.60%                    C

  5     WBT Systems                                   69.84%                    D+

  6     Cornerstone                                   66.67%                    D+

  7     GeoLearning                                   61.90%                    D-




                                          Figure 6
Eaton University                                                           October 7, 2005
LMS Report and Recommendations                                                    Page 32




Standings – Localization Capabilities

The three overall leaders were the leaders in localization capabilities.

Rank    LMS Vendor                                     Score               Grade

  1     Saba                                           92.59%               A-

  2     SumTotal                                       88.89%               B+

  3     Plateau                                        81.48%               B-

  4     GeoMetrix                                      77.78%               C+

  5     Oracle                                         74.07%               C

  6     Cornerstone                                    66.67%               D+

  7     WBT Systems                                    59.26%               F

  7     GeoLearning                                    59.26%               F




                                          Figure 7
Eaton University                                                             October 7, 2005
LMS Report and Recommendations                                                      Page 33




Standings - External Delivery Capabilities

Saba and SumTotal retained the two top spots in external delivery capabilities.
GeoMetrix had a slight edge over Plateau, which was in the fourth spot.

Rank    LMS Vendor                                   Score                  Grade

  1     Saba                                         90.20%                   A-

  2     SumTotal                                     88.24%                   B+

  3     GeoMetrix                                    82.35%                   B-

  4     Plateau                                      80.39%                   B-

  5     Oracle                                       74.51%                   C

  6     WBT Systems                                  68.63%                   D+

  6     Cornerstone                                  68.63%                   D+

  7     GeoLearning                                  56.86%                   F




                                         Figure 8
Eaton University                                                           October 7, 2005
LMS Report and Recommendations                                                    Page 34




Standings - Systems Integration Capabilities

Plateau took the number one spot in systems integration capabilities, bumping Saba to
number two. SumTotal scored low in this category.

Rank    LMS Vendor                                  Score                 Grade

  1     Plateau                                    96.97%                   A+

  2     Saba                                       90.91%                   A-

  3     WBT Systems                                87.88%                   B+

  4     GeoMetrix                                  75.76%                   C

  5     Cornerstone                                72.73%                   C-

  5     Oracle                                     72.73%                   C-

  6     SumTotal                                   69.70%                   D+

  7     GeoLearning                                63.64%                   D




                                        Figure 9
Eaton University                                                                October 7, 2005
LMS Report and Recommendations                                                         Page 35




The Recommendations
Overview of Recommendations

1. Saba

    Recommendation Rationale

    Evaluation results indicate that the best match between product capabilities and
    Eaton’s requirements is Saba Software’s Saba Enterprise Learning. The Saba
    product scored highest overall, more than 9 percentage points higher than its nearest
    competitor. The Saba product scored highest in each of the evaluation categories
    except one, systems integration capabilities, where it scored second.

    The instructional features support all types of training that Eaton University currently
    offers as well as many more. The administrative features are role-based and
    workflows can be configured. It has a robust search feature and offers role-based
    views of the catalog. Saba supports the ability for users to download any SCORM-
    conformant training and take it off-line via a player, with scores and data uploaded to
    the LMS on their next connection.

    The user interface supports thirteen (13) of the twenty-two (22) languages required
    by Eaton: Chinese (simplified), Danish, Dutch, English, French, German, Italian,
    Japanese, Korean, Polish, Spanish (Mexican), Spanish (Spain), and Swedish. It
    also supports Brazilian Portuguese, Flemish, French Canadian, Hungarian,
    Indonesian, Norwegian and Russian.

    Saba provides self-service access and enrollment for internal and external
    audiences. It handles complex pricing schemes and can be integrated with single
    sign-on, external billing and other systems through web services.

    Saba offers an array of deep linking and integration capabilities and is built on the
    same underlying Java (J2EE) technology as Eaton’s JOE portal. It provides access
    to much of its functionality to external programs via web services and offers a portlet
    interface for JSR-168 compliant portals.

    Match with Requirements – Saba Software

        1   Facility-based instructor-led training                                   strong
        2   Online instructor-led training                                           strong
        3   Non-instructor-led training                                              strong
        4   AICC & SCORM conformant courseware                                       strong
        5   Internal/external content hosting                                        strong
        6   Third party content                                                      strong
        7   Complex course structures                                                strong
        8   Catalog                                                                  strong
        9   Search Function                                                          strong
Eaton University                                                                      October 7, 2005
LMS Report and Recommendations                                                               Page 36


      10   Self-service enrollment                                                         strong
      11   Role-based learning                                                             strong
      12   Schemes based on user profile                                                   strong
      13   Completions                                                                     strong
      14   Administration                                                                  strong
      15   Reports                                                                         strong
      16   External user tracking                                                         average
      17   Privacy                                                                        average
      18   Look & feel customization                                                       strong
      19   Localized user interface versions                                               strong
      20   Customized user interface based on user profile                                 strong
      21   Personalized by each user                                                       strong
      22   Training plans                                                                  strong
      23   Certification programs                                                          strong
      24   Offerings in multiple languages                                                 strong
      25   Version control                                                                 strong
      26   Self-Diagnostics                                                               average
      27   Off-line training                                                               strong
      28   Configurable email messaging                                                    strong
      29   Internal/external hosting options                                               strong
      30   SSO participation                                                               strong
      31   Get HRMS employee info                                                          strong
      32   Put HRMS training info                                                          strong
      33   Unique user identifier (OracleId, email address in authorized domain)           weak
      34   Interface with order entry & billing systems                                    strong
      35   Associate offerings with competencies defined in external app                   strong
      36   “Deep-linking”                                                                  strong
      37   Link individuals/groups with training & business objects in external app       average
      38   Testing & assessment                                                            strong
      39   Other capabilities & options                                                   average
      40   Flexible and cost-effective licensing                                          average


2. Plateau

    Recommendation Rationale

    Evaluation results indicate that the second best match between product capabilities
    and Eaton requirements is Plateau, Ltd.’s Plateau LMS. Plateau scored second
    highest overall. It was first in the systems integration category, second in self service,
    third in content support, training administration and localization, and fourth in
    navigation and external delivery. It is built on the same underlying technology as
    Eaton’s JOE portal.

    The instructional features support all types of training that Eaton University currently
    offers as well as many more. The administrative features are role-based and
    workflows can be configured. It has a robust search feature and offers role-based
    views of the catalog. Plateau supports the ability for users to download any NETg
Eaton University                                                                October 7, 2005
LMS Report and Recommendations                                                         Page 37


    content and take it off-line with scores and data uploaded to the LMS on their next
    connection.

    The user interface supports eleven (11) of the twenty-two (22) languages required by
    Eaton: Chinese (simplified), Czech, Dutch, English, French, German, Italian,
    Japanese, Polish, Spanish (Mexican), and Spanish (Spain). It also supports
    Brazilian Portuguese, French Canadian and Hungarian.

    Plateau provides self-service access and enrollment for internal and external
    audiences. It handles complex pricing schemes and can be integrated with single
    sign-on, external billing and other systems through its API and web services.

    Plateau offers an array of deep linking and integration capabilities and is built on the
    same underlying Java (J2EE) technology as Eaton’s JOE portal. It provides access
    to much of its functionality to external programs via a Java-based API .

    Match with Requirements – Plateau, Ltd.

       1   Facility-based instructor-led training                                    strong
       2   Online instructor-led training                                            strong
       3   Non-instructor-led training                                               strong
       4   AICC & SCORM conformant courseware                                        strong
       5   Internal/external content hosting                                         strong
       6   Third party content                                                      average
       7   Complex course structures                                                 strong
       8   Catalog                                                                   strong
       9   Search Function                                                          average
      10   Self-service enrollment                                                  average
      11   Role-based learning                                                       strong
      12   Schemes based on user profile                                            average
      13   Completions                                                               strong
      14   Administration                                                           average
      15   Reports                                                                   strong
      16   External user tracking                                                    weak
      17   Privacy                                                                  average
      18   Look & feel customization                                                 strong
      19   Localized user interface versions                                         strong
      20   Customized user interface based on user profile                           strong
      21   Personalized by each user                                                average
      22   Training plans                                                           average
      23   Certification programs                                                   average
      24   Offerings in multiple languages                                           weak
      25   Version control                                                           strong
      26   Self-Diagnostics                                                          weak
      27   Off-line training                                                        average
      28   Configurable email messaging                                             average
      29   Internal/external hosting options                                         strong
      30   SSO participation                                                         strong
      31   Get HRMS employee info                                                    strong
Eaton University                                                                       October 7, 2005
LMS Report and Recommendations                                                                Page 38


      32    Put HRMS training info                                                          strong
      33    Unique user identifier (OracleId, email address in authorized domain)           strong
      34    Interface with order entry & billing systems                                    strong
      35    Associate offerings with competencies defined in external app                   strong
      36    “Deep-linking”                                                                  strong
      37    Link individuals/groups with training & business objects in external app       average
      38    Testing & assessment                                                            strong
      39    Other capabilities & options                                                    strong
      40    Flexible and cost-effective licensing                                          average


3. SumTotal

    Recommendation Rationale

    Evaluation results indicate that the third best match between product capabilities and
    Eaton requirements is SumTotal Systems’ TotalLMS. It scored third highest overall.
    SumTotal scored second in the categories: content support, navigation, training
    administration, localization and external delivery. It scored third in the self service
    category and seventh in systems integration.

    The instructional features support all types of training that Eaton University currently
    offers as well as many more. The administrative features are role-based and
    workflows can be configured. It has a robust search feature and offers role-based
    views of the catalog. SumTotal supports the ability for users to download any
    SCORM conformant content and take it off-line using a player, with scores and data
    uploaded to the LMS on their next connection.

    The user interface supports eight (8) of the twenty-two (22) languages required by
    Eaton: Chinese (simplified), Chinese (traditional), English, French, German, Italian,
    Japanese, Spanish (Universal). It also supports Brazilian Portuguese and French
    Canadian.

    TotalLMS provides self-service access and enrollment for internal and external
    audiences. It handles complex pricing schemes and may be integrated with single
    sign-on, external billing and other systems through its web services.

    TotalLMS is built on Microsoft technology. Given the system requirements, it
    appears that TotalLMS may be in process of evolving from a 2-tier to a 3-tier
    architecture. It provides access to some of its functionality to external programs via
    web services.

    Match with Requirements – SumTotal Systems

        1   Facility-based instructor-led training                                          strong
        2   Online instructor-led training                                                  strong
        3   Non-instructor-led training                                                     strong
        4   AICC & SCORM conformant courseware                                              strong
        5   Internal/external content hosting                                               weak
Eaton University                                                                        October 7, 2005
LMS Report and Recommendations                                                                 Page 39


       6   Third party content                                                              average
       7   Complex course structures                                                        average
       8   Catalog                                                                           strong
       9   Search Function                                                                   strong
      10   Self-service enrollment                                                           strong
      11   Role-based learning                                                               strong
      12   Schemes based on user profile                                                    average
      13   Completions                                                                       strong
      14   Administration                                                                   average
      15   Reports                                                                           strong
      16   External user tracking                                                            strong
      17   Privacy                                                                           strong
      18   Look & feel customization                                                         strong
      19   Localized user interface versions                                                 strong
      20   Customized user interface based on user profile                                   strong
      21   Personalized by each user                                                         strong
      22   Training plans                                                                   average
      23   Certification programs                                                            strong
      24   Offerings in multiple languages                                                   strong
      25   Version control                                                                   strong
      26   Self-Diagnostics                                                                 average
      27   Off-line training                                                                 strong
      28   Configurable email messaging                                                      strong
      29   Internal/external hosting options                                                average
      30   SSO participation                                                                average
      31   Get HRMS employee info                                                           average
      32   Put HRMS training info                                                           average
      33   Unique user identifier (OracleId, email address in authorized domain)             weak
      34   Interface with order entry & billing systems                                     average
      35   Associate offerings with competencies defined in external app                     weak
      36   “Deep-linking”                                                                    strong
      37   Link individuals/groups with training & business objects in external app         average
      38   Testing & assessment                                                              strong
      39   Other capabilities & options                                                     average
      40   Flexible and cost-effective licensing                                            average


Finalist Comparison Charts

Administration

Eaton training coordinators, instructors and others perform many administrative duties.

 Feature                           Saba                   Plateau                     SumTotal

 Shelf-Life Management    Yes, define available   Sunsetting will be        Yes
                          from and discontinued   supported in next
                          from dates              release

 Standard & Editable      Yes, over 300           Yes, modify system-       Yes, over 70, plus create
Eaton University                                                                          October 7, 2005
LMS Report and Recommendations                                                                   Page 40


 Email Reminders           configurable email          defined templates,       custom notices
                           notifications               create own templates

 Configurable Email        Yes, classified by on-      No                       Yes, change recipients
 Rules                     demand, triggered or                                 (to, cc, bcc), frequency
                           periodic


Catalog & Search

Eaton offers a large content inventory which must be organized in a number of ways and
enable users to find things in a number of ways.

 Feature                             Saba                      Plateau                 SumTotal

 Hierarchical Categories   Yes                         Unclear, but probably    Yes

 One Offering Can          Yes                         Unclear, but probably    Yes
 Appear in Multiple
 Places in Catalog

 Advanced Search           Yes, searches metadata,     Yes, simple & advanced   Yes, "contains -based"
                           description, title,         search with filtering    search support for
                           abstract, keywords                                   Microsoft Search and
                           (does not search into                                Oracle Text platforms,
                           learning objects from the                            including text that
                           catalog)                                             resides within HTML,
                                                                                Office and PDF files;
                                                                                google-like search
                                                                                experience with boolean
                                                                                logic, filtering; results
                                                                                sorted on relevancy
                                                                                based on relative
                                                                                proximity of search
                                                                                terms; auto-filtering of
                                                                                "noise" words on a
                                                                                language-by-language
                                                                                basis; may not support
                                                                                “contains -based”
                                                                                searching of content not
                                                                                hosted external to the
                                                                                lms.


Complex Course Structures

Eaton delivers learning programs that may consist of a blended combination of self-
paced and synchronous learning activities which may span several hours, days or
weeks, at internal and external locations.

 Feature                             Saba                      Plateau                 SumTotal

 Assembly Methods          Sync & async items are      Sync & async items are   Can create any
                           combined into packages,     combined into segments   combination.
Eaton University                                                                               October 7, 2005
LMS Report and Recommendations                                                                        Page 41


                           certifications or curricula   & programs

 Multi-Session Offerings   Yes, no limit, can be         Yes, schedule segments     Yes, can span multiple
                           contiguous or non-            contiguously or            days.
                           contiguous                    checkerboard

 External Locations        Yes, thru facility &          Unclear, facility mgt      Yes, thru out-of-box
                           resource mgt                  features included          facility & resource mgt


Content Publishing

Eaton loads, tests, and releases custom and commercial courses.

 Feature                             Saba                         Plateau                  SumTotal

 Publishing Methods        Administration interface      Administration interface   Administration interface
                           or data import utility        or web publishing for      or web publishing for
                                                         non-stds -based content    non-stds -based content

 Pre-Release Staging &     Yes, thru preview             Yes, thru sandbox and      Yes, thru staging
 Testing                   content feature               staging environments       environment

 Phased Releases to        Yes, with granularity         Yes, with granularity      Yes, with granularity
 Specific Audiences

 Publishing Automation     Yes, thru authoring tool      Yes, thru LCMS (Team       Yes, for AICC & SCORM
                           (Publisher) or LMS            Content)                   publishing-compliant
                                                                                    content packages

 Configurability of        Yes, configurable             Yes, configurable          No
 Publishing Workflow       destination content           workflow by admin roles
                           servers. More with
                           LCMS (project creation,
                           routing, approval)

 Version Control for       Robust versioning at          Automated revision mgt,    Admin defines versions
 Content Updates           course and certification      update curricula & dev     which can expire so that
                           level; force all to take      plans, verify cert         no new registrations are
                           new version, force those      statuses, assign trng,     taken, but historical data
                           in progress to restart,       etc. - wizards             is kept
                           force people to take
                           retake updated elements


Enrollment & Completion Transactions

Eaton University enables enrollment and completion via a number of methods.

 Feature                             Saba                         Plateau                  SumTotal

 Self Enrollment           Yes                           Yes                        Yes

 Manager Enrollment        Yes                           Yes                        Yes
Eaton University                                                                            October 7, 2005
LMS Report and Recommendations                                                                     Page 42



 Administrator            Yes                          Yes                        Yes
 Enrollment

 Other Methods            By prescriptive rule         None mentioned             None mentioned
                          (push)

 Enrollment Rules         Yes                          Yes                        Yes
 Configurable by
 Offering

 Configurable Pricing     Yes, thru e-commerce;        Yes                        Yes
                          training units & cost
                          centers; multi price lists
                          per item; package prices

 Payment Options          Credit card, check,          None mentioned             e-Commerce and bill
                          training units, purchase                                back
                          order, cost center
                          charge, partial payment,
                          part by PO/part by credit
                          card

 Completion Triggers      Definable for a single       Definable for each         Definable for each
                          offering or offering         offering.                  offering.
                          groups; admin or
                          manager sign-off option

 Administrator Override   Yes                          Yes                        Yes

 One-Click Batch          Yes                          Yes                        Yes
 Enrollment &
 Completion


External Content Servers

Eaton may place rich media content on internal or external streaming content servers to
optimize network performance.

 Feature                            Saba                       Plateau                   SumTotal

 Remote Content           Yes                          Yes                        Unclear, may be
 Servers (inside or                                                               problematic for
 outside of firewall)                                                             SumTotal architecture if
                                                                                  content is stored in db

 Cross-Domain Security    Yes, install AICC bridge     Yes, use reverse proxy,    Unclear, may be
                          and SCORM redirectory        signed applet or content   problematic for
                          on remote content            relay solution             SumTotal architecture if
                          server                                                  content is stored in db


Language Support

Eaton University does business in 22 languages.
Eaton University                                                                           October 7, 2005
LMS Report and Recommendations                                                                    Page 43




 Feature                            Saba                       Plateau                 SumTotal

 LMS UI Languages         Brazilian Portuguese,      English (US) out-of-box;   English (UK), English
 (out-of-box)             Chinese (Simplified),      also available: Chinese    (US), French, German,
                          Danish, Dutch, English,    (Simplified), Dutch,       Italian, Japanese,
                          English (UK), Flemish,     French, German, Italian,   Portuguese (Brazilian),
                          French Canadian,           Japanese, Spanish,         Spanish (Universal),
                          French, German,            Hungarian, Brazilian       Chinese (Traditional),
                          Hungarian, Indonesian,     Portuguese, Polish,        Chinese (Simple),
                          Italian, Japanese,         Czech, Mexican             Canadian (French)
                          Korean, Norwegian,         Spanish, Canadian
                          Polish, Russian, Spanish   French
                          (Spain), Spanish
                          (Mexican), & Swedish

 Language Method          Language Packs             J2EE Unicode               Unicode

 Language Versions of     Create a single offering   Unclear                    Define which language
 Content                  with multi-language                                   versions should be
                          versions (reporting is                                shown to what
                          easier)                                               audiences.


Licensing

Eaton’s external audience is expected to be much larger than its internal audience.

 Feature                            Saba                       Plateau                 SumTotal

 Pricing Basis            Named users and            User-based or              User-based perpetual,
                          modular products           Subscription based         User-based leased
                                                                                w/time commitment,
                                                                                subscription-based

 External Audiences       no further info            Tailored programs for      no further info
                                                     organizations with large
                                                     external user
                                                     populations


Off-Line Training

Many Eaton people prefer to take training at times and in places where they are not
connected to the network.

 Feature                            Saba                       Plateau                 SumTotal

 Content That Can Be      Any SCORM compliant        NETg content               Any SCORM 1.2
 Taken Offline            object                                                content.

 Player Requirements      Saba Offline Player        None mentioned             TotalAccess Player
Eaton University                                                                  October 7, 2005
LMS Report and Recommendations                                                           Page 44


Other Capabilities

Many Eaton people prefer to take training at times and in places where they are not
connected to the network.

 Feature                           Saba                   Plateau               SumTotal

 Authoring                Yes, add-on product     Yes, add-on product    Yes, add-on product
                          Saba Publisher          Plateau Team Content   TotalLCMS

 LCMS                     Yes, add-on product     Yes, add-on product    Yes, add-on product
                          Saba Publisher          Plateau Team Content   TotalLCMS

 Communities of           Yes, add-on product     Yes, out-of-box        Yes, add-on product
 Practice                 Saba Collaboration                             TotalCollaboration

 Threaded Discussions     Yes, add-on product s   Yes, out-of-box        Yes, add-on product
                          Saba Collaboration,                            TotalCollaboration,
                          Centra                                         TotalVCS

 Instant Messaging        Yes, add-on product s   Yes, out-of-box        Yes, thru SameTime &
                          Saba Collaboration,                            RealChat
                          Centra

 Wikis                    Yes.                    Yes, out-of-box        Yes.

 User Ratings &           Yes.                    Yes, out-of-box        Yes.
 Reviews

 Personal Annotations     Yes.                    Yes, out-of-box        Yes.
 of Training Materials

 On-Going Access to       Yes.                    Yes, out-of-box        Yes.
 Completed Offerings

 Knowledge                Yes.                    Yes, out-of-box        Yes, add-on product
 Management                                                              TotalInformation

 Performance              Yes, Saba Performance   Yes, add-on product    Yes, add-on product
 Management                                       Plateau Performance    TotalPerformance
                                                  Management


Role-Based Learning

Eaton University has many audience segments, each with its own content needs.

 Feature                           Saba                   Plateau               SumTotal

 Define Audiences &       Yes                     Yes                    Yes
 Roles

 Define Content           Yes                     Yes                    Yes
Eaton University                                                                        October 7, 2005
LMS Report and Recommendations                                                                 Page 45


 Domains

 Restrict Catalog View    Yes                       Yes                      Yes
 Based on Roles &
 Domains

 Restrict Enrollment      Yes                       Yes                      Yes
 Based on Roles &
 Domains

 Set Pricing Based on     Unclear                   Yes                      Yes
 Roles & Domains


Standards

Eaton currently uses commercial and custom AICC and SCORM conformant
courseware.

 Feature                            Saba                     Plateau                SumTotal

 AICC                     Yes, Level 1              Yes, Level 2             Yes

 SCORM 1.2                Yes                       Yes                      Yes

 SCORM 2004 (1.3)         Yes                       1Q06                     Next Release

 Content Vendor           70 content vendors        13 content vendors       35 content vendors
 Partnerships             including SkillSoft and   including SkillSoft &    including SkillSoft &
                          NETg                      NETg                     NETg


Technology

Eaton seeks to integrate the LMS with other enterprise systems such as single sign-on,
HRMS, APEX, billing and payment systems.

 Feature                            Saba                     Plateau                SumTotal

 Hosting/ASP Services     Yes                       Yes                      Yes
 Provided

 Can Be Client-Hosted     Yes                       Yes                      Yes

 Operating Systems        Sun Solaris, Microsoft    Sun Solaris, Microsoft   Microsoft Windows
                          Windows, IBM AIX,         Windows
                          Linux

 Database Management      Oracle, Microsoft SQL     Oracle                   Microsoft SQL Server,
 Servers                  Server, IBM DB2                                    Oracle

 Application Servers      BEA WebLogic, IBM         BEA WebLogic, IBM        None
                          WebSphere, JBoss          WebSphere, Oracle
Eaton University                                                                                October 7, 2005
LMS Report and Recommendations                                                                         Page 46


                                                       Application Server

 Other LMS System         None                         None                         Microsoft MDAC,
 Requirements                                                                       MSXML, WinScripting
                                                                                    Engine, Visual Basic
                                                                                    Runtime, msvbvm60.dll,
                                                                                    .NET framework,
                                                                                    SQLXML

 nTier Architecture       Yes, J2EE                    Yes, J2EE                    No, appears to be 2-tier
                                                                                    architecture.

 SSO Interface Support    LDAP and NT SSO              API (typically 3-5 days      Microsoft NT
                          supported out-of-box         for integration)             Authentication, Microsoft
                          thru JAAS                                                 Active Data Objects
                                                                                    (ADO), LDAP

 LMS Trigger SSO          May involve configuring      Yes, use native Plateau      Not recommended
                          the custom login module      authentication

 Get Information from     Flat file (nightly)          API - instantiate a series   Batch, schedulable XML
 Oracle HRMS              processed thru web           of connectors; Java-to-      mapping and data
                          services or stored           Java method calls, XML       transformation utility for
                          procedures                   exchanges or SOAP            intelligent imports,
                                                       over HTTP (web               updates and deletes
                                                       services)

 Put Information into     Nightly batch file or thru   API                          Flat file extract
 Oracle HRMS              web services

 Cope with 2 types of     Yes, can handle both;        Yes can handle both,         Unclear
 userIds - internals      unique username can be       customizable ID
 (OracleId) and           made up of any               scheme, auto-generated
 Externals (email         combination of letters,      or external, secondary
 address w/               symbols and numbers          ID can be captured in a
 authenticated domain)                                 client-defined field

 Billing System           Custom extract LMS           Custom extract LMS           Custom extract LMS
 Interfaces               data to billing systems      data to billing systems ,    data to billing systems
                                                       has been integrated with
                                                       Oracle, PeopleSoft and
                                                       SAP financial modules

 Native Billing/Payment   Credit card thru Verisign    none mentioned               Credit card thru Verisign;
 Features                 & CyberSource                                             charge-back

 APEX Interface           Out-of-box web services,     Out-of-box methods           Import competencies
                          real-time & batch            include a Student            into LMS, may not have
                                                       Connector, a Java-           an update
                                                       based XML driven app

 Get LMS items related    Copy competencies into       Copy competencies into       Copy competencies into
 to APEX competencies     LMS and catalog search       LMS and XML                  LMS and use
                          web service                  integration broker           documented web
                                                                                    services
Eaton University                                                                               October 7, 2005
LMS Report and Recommendations                                                                        Page 47



 Enroll in LMS course     Enrollment web service       Java API auto-               Requires customization
 programmatically from                                 enrollment, given
 APEX                                                  studentID and courseID

 Deep Linking Interface   JSR-168 compliant            Extensive APIs               Limited set of web
                          portlets, deep link          documented with              services
                          emails, interactive          JavaDoc
                          emails, manually created
                          deep links

 Deep Linking Methods     Web services                 Granular access to APIs      Web services
                                                       thru RPC calls and some
                                                       web services

 Deep Linking             Over 20 pre-built web        All learner menu pages,      Activity mgt,
 Functionality            services out-of-box plus     specific info pages;         authentication,
                          several pre-built deep       access to learner,           competency mgt,
                          links                        instructor, curricula &      domain mgt, job mgt, org
                                                       organization functionality   mgt, roster mgt, skill
                                                                                    mgt, supplemental data,
                                                                                    time conversion,
                                                                                    transcript mgt, user mgt


Testing & Assessment

Eaton offers tests, assessments and surveys.

 Feature                            Saba                       Plateau                     SumTotal

 Built-in Testing         Yes, tests, surveys and      Yes, advanced exam           No, only thru TotalCMS
                          evals                        and survey features

 Question Types           Multiple choice, all that    True/false, multiple         Multiple choice, all that
                          apply, fill in the blank,    choice, graphics & hot       apply, ordering,
                          short answer, matching,      spots                        true/false, graphics &
                          drag/drop, essay, etc.                                    hotspots, drag ‘n’ drop,
                                                                                    fill in the blank,
                                                                                    simulations, more

 Test Rules & Scoring     Test rules configurable      WYSIWYG graphical            Media elements,
                          business rules at course     test question editor;        randomization, retakes,
                          level (e.g. mgr sign-off);   feedback during,             scoring rules (weights,
                          Scoring thru AICC and        feedback at end,             test out, unscored items)
                          SCORM standards              sequential, free form,
                                                       object-based
                                                       remediation

 Third Party Testing      Yes, QuestionMark and        Yes, QuestionMark,           Yes, QuestionMark and
 Systems                  other AICC/SCORM             Lectora and other            other AICC/SCORM
                          conformant platforms         AICC/SCORM                   conformant platforms
                                                       conformant platforms


Training Plans & Certification Programs
Eaton University                                                                                October 7, 2005
LMS Report and Recommendations                                                                         Page 48




Eaton University creates standard training plans that may be localized by group or
region and personalized by end users, and certification and compliance programs for
various internal functions or external audiences.

 Feature                            Saba                        Plateau                     SumTotal

 Define Standard          Yes, for jobs and roles;      Yes, systematically          Yes, create plan goals
 Training Plans           prescriptive rules based      manage translations of       linked to tasks linked to
                          on job role, org, mgr,        top-level org goals to       catalog offerings
                          type, hire date, audience     individual learning plans
                          type, etc

 Adjust Training Plans    Yes, can be done by           Yes, plans can be            Yes, plans can be
 for Individuals          admins, managers or           completed self-directed      created by admins,
                          end users                     or prescribed                managers or users

 Adjust Training Plans    Yes, thru course              Yes, test results can        Yes, via a 360 degree
 Based on Test Scores     equivalents,                  drive course features        tool
                          prerequisites,                such as objectives,
                          competencies and              remediation or opt-out
                          external training

 Define & Track           Yes, group learning           Yes, as a curriculum - n     Yes, create programs
 Certification Programs   offerings; different paths;   level sub curricula          linked to media and
                          link to job types;                                         tests, specify as req or
                          adaptive lrng based on                                     recommended for a
                          prereqs; versioning &                                      user, due date, expiry
                          recert; date                                               date, manually expire,
                          requirements (acquire                                      four reports, ad-hoc
                          within, valid for, notify                                  email notifications, my
                          before, etc.)                                              status


User Interface Customization, Localization & Personalization

Eaton University has many audience segments, each with its own content needs.

 Feature                            Saba                        Plateau                     SumTotal

 Customization Options    Branding, fonts, colors,      Branding, fonts, colors,     Branding, fonts, colors,
                          page-layouts, and             page-layouts, and            page-layouts, and
                          wording; multiple looks &     wording                      wording
                          feels

 Customization Methods    Configurable thru admin       Change html pages and        Configurable thru admin
                          interface                     cascading style sheets       interface

 Localization             Yes                           Yes, internationalization    Yes, multi-language,
                                                        and localization features,   time zone, currency; ui,
                                                        a locale is a language,      reporting, help and set-
                                                        time zone, number            up functions in multi-
                                                        settings/displays; applies   languages (languages
                                                        to admin & user ui           are stored in resource
Eaton University                                                                           October 7, 2005
LMS Report and Recommendations                                                                    Page 49


                                                                                files)

 User-Configurable        Configure home page,        Learning plan, language   Layout, notifications,
 Personalization          notification preferences,   preference, opt-out of    preferred language, time
 Features                 catalog search              email                     zone, favorites, training
                          preferences, locale                                   plans
                          preferences, learning
                          plan

 Users Can Opt In/Out     Only by removing email      Yes                       No
 of Emails                address from profile


Virtual Learning Environment (VLE)

Eaton currently uses WebEx as a virtual learning environment for delivering online
instructor-led training.

 Feature                            Saba                     Plateau                     SumTotal

 Native VLE               Yes, Centra                 Yes, Plateau VLS          Yes, TotalVCS

 WebEx                    Yes                         Yes                       Yes

 LiveMeeting              Yes                         Yes                       No

 Centra                   Yes                         Yes                       Yes

 Interwise                Yes                         No                        Yes

 Breeze                   No                          Yes                       No
Eaton University                                                                October 7, 2005
LMS Report and Recommendations                                                         Page 50




                             APPENDIX A: LMS Vetting Criteria

    1. In-House Solution Positioning. Both the CFO and Information Technology VP
       have expressed a clear preference for an in-house LMS solution. The CFO cited
       the cost, reliability and security advantages of an in-house solution. The
       Information Technology VP cited the systems integration, networking and
       IT/Training partnering advantages of an in-house solution. On the other hand,
       externally hosted solutions are sometimes less expensive and faster to
       implement and maintain. Whether a hosted or in-house solution is selected
       initially, Eaton should have the option to bring the solution in-house at any time.
       Therefore, LMS vetting criteria should include the following Eaton IT standards: a
       Java Enterprise (J2EE) platform, SQL database and Sun Server support.

    2. Web Services or Remote Procedure Call (RPC) Interface. The need to
       integrate the LMS with other Eaton systems drives another LMS vetting criterion.
       The LMS must be able to integrate with external competency tables, LDAP user
       lookup, external billing systems and more. The Eaton IT systems integration
       preference is a Web Services or RPC approach. An LMS that has one or both of
       these types of interface is likely to be less costly and easier to integrate with
       other Eaton enterprise IT systems.

    3. Content Entitlements based on User Role. There are numerous employee
       and external end user roles related to the LMS. Each of these roles must have
       access to specific content. LMS vetting criteria must include this critical
       capability.

    4. Function Entitlements based on Administrator Role. There are numerous
       administrative related to the LMS. Each of these roles must have access to
       specific features, functions and reports. LMS vetting criteria must include this
       capability.

    5. Language Support. Eaton currently does business in 22 languages. LMS
       vetting criteria must include the ability to host content in multiple languages, and
       to present a user interface in multiple languages. The language preference
       should depend on the individual user’s profile.

    6. External/Internal Facing. Access to the LMS must be available, sooner or later,
       to external as well as internal audiences. LMS vetting criteria must include a
       number of options for unique user identification and a secure, multi-tiered hosting
       topography.

    7. Support for Complex Course Structures. The LMS must be able to support
       complex course structures such as blended models, multi-session, multi-
       instructor and multi-location offerings. At the same time, the LMS must handle
       this complexity elegantly, behind an intuitive, easy-to-use end user and
       administrative user interface.
Eaton University                                                            October 7, 2005
LMS Report and Recommendations                                                     Page 51


    8. Configurable UI and Administrative Workflow. The LMS UI must be
       skinnable so that it can be branded by EU. Content must be metatagged and
       organized in a variety of ways. The administrative processes must be
       configurable to reflect the way Eaton’s training organizations operate.

    9. Configurable Email Messaging. The LMS’ email messaging features must be
       configurable. Eaton must be able to configure message contents and messaging
       rules. Email must include an “opt in/out” feature for end users.

    10. Flexible Licensing. The LMS provider must offer flexible and cost effective
        licensing arrangements to meet Eaton’s need for 18,500 core users
        (management and professional employees), and unlimited additional ad hoc
        users (production employees and external audiences).
Eaton University                                                                      October 7, 2005
LMS Report and Recommendations                                                               Page 52




                     APPENDIX B: Evaluation Data for Non-Finalists


    Match with Requirements – Cornerstone OnDemand

       1   Facility-based instructor-led training                                          strong
       2   Online instructor-led training                                                  strong
       3   Non-instructor-led training                                                    average
       4   AICC & SCORM conformant courseware                                              strong
       5   Internal/external content hosting                                               weak
       6   Third party content                                                            average
       7   Complex course structures                                                       weak
       8   Catalog                                                                         strong
       9   Search Function                                                                 weak
      10   Self-service enrollment                                                         strong
      11   Role-based learning                                                            average
      12   Schemes based on user profile                                                  average
      13   Completions                                                                     weak
      14   Administration                                                                  strong
      15   Reports                                                                         strong
      16   External user tracking                                                          weak
      17   Privacy                                                                        average
      18   Look & feel customization                                                       strong
      19   Localized user interface versions                                               weak
      20   Customized user interface based on user profile                                average
      21   Personalized by each user                                                      average
      22   Training plans                                                                 average
      23   Certification programs                                                          strong
      24   Offerings in multiple languages                                                 weak
      25   Version control                                                                average
      26   Self-Diagnostics                                                                weak
      27   Off-line training                                                               weak
      28   Configurable email messaging                                                    strong
      29   Internal/external hosting options                                               weak
      30   SSO participation                                                              average
      31   Get HRMS employee info                                                          strong
      32   Put HRMS training info                                                          strong
      33   Unique user identifier (OracleId, email address in authorized domain)           strong
      34   Interface with order entry & billing systems                                   average
      35   Associate offerings with competencies defined in external app                   weak
      36   “Deep-linking”                                                                  weak
      37   Link individuals/groups with training & business objects in external app       average
      38   Testing & assessment                                                            strong
      39   Other capabilities & options                                                   average
      40   Flexible and cost-effective licensing                                           weak
Eaton University                                                                      October 7, 2005
LMS Report and Recommendations                                                               Page 53




    Match with Requirements – GeoLearning, Inc.

       1   Facility-based instructor-led training                                          strong
       2   Online instructor-led training                                                  strong
       3   Non-instructor-led training                                                    average
       4   AICC & SCORM conformant courseware                                              weak
       5   Internal/external content hosting                                               weak
       6   Third party content                                                            average
       7   Complex course structures                                                       weak
       8   Catalog                                                                         strong
       9   Search Function                                                                average
      10   Self-service enrollment                                                         weak
      11   Role-based learning                                                             weak
      12   Schemes based on user profile                                                   weak
      13   Completions                                                                     strong
      14   Administration                                                                 average
      15   Reports                                                                         strong
      16   External user tracking                                                         average
      17   Privacy                                                                        average
      18   Look & feel customization                                                      average
      19   Localized user interface versions                                               weak
      20   Customized user interface based on user profile                                average
      21   Personalized by each user                                                       weak
      22   Training plans                                                                  strong
      23   Certification programs                                                         average
      24   Offerings in multiple languages                                                average
      25   Version control                                                                 weak
      26   Self-Diagnostics                                                                weak
      27   Off-line training                                                              average
      28   Configurable email messaging                                                   average
      29   Internal/external hosting options                                              average
      30   SSO participation                                                              average
      31   Get HRMS employee info                                                         average
      32   Put HRMS training info                                                         average
      33   Unique user identifier (OracleId, email address in authorized domain)           weak
      34   Interface with order entry & billing systems                                   average
      35   Associate offerings with competencies defined in external app                   weak
      36   “Deep-linking”                                                                  weak
      37   Link individuals/groups with training & business objects in external app       average
      38   Testing & assessment                                                            strong
      39   Other capabilities & options                                                   average
      40   Flexible and cost-effective licensing                                          average
Eaton University                                                                      October 7, 2005
LMS Report and Recommendations                                                               Page 54




    Match with Requirements – GeoMetrix Data Systems

       1   Facility-based instructor-led training                                          strong
       2   Online instructor-led training                                                  strong
       3   Non-instructor-led training                                                    average
       4   AICC & SCORM conformant courseware                                             average
       5   Internal/external content hosting                                              average
       6   Third party content                                                            average
       7   Complex course structures                                                      average
       8   Catalog                                                                        average
       9   Search Function                                                                 strong
      10   Self-service enrollment                                                         weak
      11   Role-based learning                                                             strong
      12   Schemes based on user profile                                                   strong
      13   Completions                                                                     strong
      14   Administration                                                                  strong
      15   Reports                                                                         strong
      16   External user tracking                                                          strong
      17   Privacy                                                                         strong
      18   Look & feel customization                                                       strong
      19   Localized user interface versions                                              average
      20   Customized user interface based on user profile                                 strong
      21   Personalized by each user                                                      average
      22   Training plans                                                                  strong
      23   Certification programs                                                         average
      24   Offerings in multiple languages                                                average
      25   Version control                                                                 strong
      26   Self-Diagnostics                                                               average
      27   Off-line training                                                               weak
      28   Configurable email messaging                                                    strong
      29   Internal/external hosting options                                              average
      30   SSO participation                                                               strong
      31   Get HRMS employee info                                                         average
      32   Put HRMS training info                                                          strong
      33   Unique user identifier (OracleId, email address in authorized domain)           weak
      34   Interface with order entry & billing systems                                   average
      35   Associate offerings with competencies defined in external app                  average
      36   “Deep-linking”                                                                  strong
      37   Link individuals/groups with training & business objects in external app       average
      38   Testing & assessment                                                           average
      39   Other capabilities & options                                                    weak
      40   Flexible and cost-effective licensing                                           strong
Eaton University                                                                      October 7, 2005
LMS Report and Recommendations                                                               Page 55




    Match with Requirements – Oracle

       1   Facility-based instructor-led training                                          strong
       2   Online instructor-led training                                                  strong
       3   Non-instructor-led training                                                    average
       4   AICC & SCORM conformant courseware                                              weak
       5   Internal/external content hosting                                              average
       6   Third party content                                                            average
       7   Complex course structures                                                      average
       8   Catalog                                                                         strong
       9   Search Function                                                                 weak
      10   Self-service enrollment                                                        average
      11   Role-based learning                                                             strong
      12   Schemes based on user profile                                                   strong
      13   Completions                                                                    average
      14   Administration                                                                 average
      15   Reports                                                                         weak
      16   External user tracking                                                          strong
      17   Privacy                                                                         weak
      18   Look & feel customization                                                       strong
      19   Localized user interface versions                                               strong
      20   Customized user interface based on user profile                                average
      21   Personalized by each user                                                      average
      22   Training plans                                                                 average
      23   Certification programs                                                          weak
      24   Offerings in multiple languages                                                average
      25   Version control                                                                average
      26   Self-Diagnostics                                                                weak
      27   Off-line training                                                               weak
      28   Configurable email messaging                                                    weak
      29   Internal/external hosting options                                               weak
      30   SSO participation                                                              average
      31   Get HRMS employee info                                                          strong
      32   Put HRMS training info                                                          strong
      33   Unique user identifier (OracleId, email address in authorized domain)          average
      34   Interface with order entry & billing systems                                   average
      35   Associate offerings with competencies defined in external app                  average
      36   “Deep-linking”                                                                  strong
      37   Link individuals/groups with training & business objects in external app       average
      38   Testing & assessment                                                            weak
      39   Other capabilities & options                                                    weak
      40   Flexible and cost-effective licensing                                          average
Eaton University                                                                      October 7, 2005
LMS Report and Recommendations                                                               Page 56




    Match with Requirements – WBT Systems

       1   Facility-based instructor-led training                                         average
       2   Online instructor-led training                                                 average
       3   Non-instructor-led training                                                     strong
       4   AICC & SCORM conformant courseware                                              weak
       5   Internal/external content hosting                                               weak
       6   Third party content                                                            average
       7   Complex course structures                                                       weak
       8   Catalog                                                                        average
       9   Search Function                                                                average
      10   Self-service enrollment                                                        average
      11   Role-based learning                                                             weak
      12   Schemes based on user profile                                                   weak
      13   Completions                                                                    average
      14   Administration                                                                  weak
      15   Reports                                                                        average
      16   External user tracking                                                         average
      17   Privacy                                                                         weak
      18   Look & feel customization                                                      average
      19   Localized user interface versions                                               weak
      20   Customized user interface based on user profile                                 strong
      21   Personalized by each user                                                      average
      22   Training plans                                                                  strong
      23   Certification programs                                                          strong
      24   Offerings in multiple languages                                                average
      25   Version control                                                                 weak
      26   Self-Diagnostics                                                                strong
      27   Off-line training                                                               strong
      28   Configurable email messaging                                                    strong
      29   Internal/external hosting options                                              average
      30   SSO participation                                                               strong
      31   Get HRMS employee info                                                          strong
      32   Put HRMS training info                                                          strong
      33   Unique user identifier (OracleId, email address in authorized domain)           weak
      34   Interface with order entry & billing systems                                    strong
      35   Associate offerings with competencies defined in external app                   strong
      36   “Deep-linking”                                                                  strong
      37   Link individuals/groups with training & business objects in external app        strong
      38   Testing & assessment                                                            strong
      39   Other capabilities & options                                                   average
      40   Flexible and cost-effective licensing                                          average

				
DOCUMENT INFO
Shared By:
Categories:
Tags:
Stats:
views:24
posted:2/15/2012
language:English
pages:56