COTS Assessment Report _CAR_

Document Sample
COTS Assessment Report _CAR_ Powered By Docstoc
					COTS/NDI Assessment Report (CAR)                                Version 2.2




         COTS/NDI Assessment Report (CAR)


                                   Team # 11

                      Web-based Service for TPC Foundation




          Brijen Ved            Project Manager
          Kevin Sanghavi        Software Architect
          Natasha Julka         Prototyper
          Sheena Singh          Operational Concept Engineer
          Prathima Naidu        Planning and Control Engineer
          Ankitsinh Rana        Feasibility Analyst
          Ely Lerner            IIV & V / Shaper
          Pat Means             Client




CAR_OCP_F08a_T11_V2.2                    1 of 14                 7/17/2012
COTS/NDI Assessment Report (CAR)                                               Version 2.2


Version History
   Date         Author        Version       Changes Made                  Rationale
11/09/2008   Ankitsinh Rana     1.0        Prepared Initial        As a part of CCD,
                                            Draft for CAR            CAR document is to
                                                                     be submitted.
11/22/2008   Ankitsinh Rana     2.0        Removed sections        Small Business
                                            for Small Business       System does not
                                            System                   require any changes
                                                                     by the developer team
                                           Modified Purpose        Made changes in
                                            and assumptions          purpose and
                                                                     assumption to reflect
                                                                     the document
                                                                     objectives more
                                                                     precisely
11/30/2008   Ankitsinh Rana     2.1        Correction in           Made the changes as
                                            COTS Assessment          per IIV & V review to
                                            approach                 incorporate his
                                           Corrections in           comments
                                            COTS Assessment
                                            for clearer
                                            understanding
12/06/2008   Ankitsinh Rana     2.2        Updated               It was found during
                                            Evaluation Matrix      ARB that some of the
                                            for calculation        calculations are
                                                                   incorrect in
                                                                   evaluation matrix
                                                                   which required
                                                                   correction.




CAR_OCP_F08a_T11_V2.2                   2 of 14                                 7/17/2012
COTS/NDI Assessment Report (CAR)                                                                                      Version 2.2


                                            Table of Content
1.   Executive Summary .............................................................................................................. 6
2.   Purpose, Scope and Assumptions ........................................................................................ 7
3.   Assessment Approach ........................................................................................................... 8
  3.1. System Objectives and Context ..................................................................................... 8
  3.2. Assessment Objectives and Approach .......................................................................... 8
4. Assessment Results................................................................................................................ 9
  4.1. Assessment Results-Part 1 ............................................................................................. 9
     4.1.1. COTS Assessed ........................................................................................................ 9
     4.1.2. Evaluation Criteria ............................................................................................... 10
     4.1.3. Evaluation Results Screen Matrix ....................................................................... 11
     4.1.4. Business Case Analysis ......................................................................................... 12
5. Conclusion and Recommendations ................................................................................... 14




CAR_OCP_F08a_T11_V2.2                                         3 of 14                                                    7/17/2012
COTS/NDI Assessment Report (CAR)                                                                                         Version 2.2


                                               Table of Tables
Table 1: COTS Assessed ................................................................................................................ 9
Table 2: Evaluation Criteria .......................................................................................................... 10
Table 3: Functionality Breakdown for .......................................................................................... 10
SmartStart Youth Financial Literacy Program ............................................................................. 10
Table 5: Evaluation Results Screen Matrix .................................................................................. 11
Table 6: COTS Ownership Cost ................................................................................................... 12
Table 7: COTS Development Cost ............................................................................................... 12
Table 8: COTS Transition Cost .................................................................................................... 12
Table 9: COTS Operational COST ............................................................................................... 13
Table 10: COTS Maintenance COST ........................................................................................... 13




CAR_OCP_F08a_T11_V2.2                                           4 of 14                                                    7/17/2012
COTS/NDI Assessment Report (CAR)                Version 2.2



                             Table of Figures
Figures are not available.




CAR_OCP_F08a_T11_V2.2              5 of 14       7/17/2012
COTS/NDI Assessment Report (CAR)                                                      Version 2.2




1. Executive Summary
   In Software market various COTS products are available with different features. These
   products differ from each other in aspects like functionality, speed, system requirement,
   support and cost. The Objective of COTS/NDI assessment is to compare and evaluate
   project relevant COTS products with respect to requirement and feasibility of usage.

   COTS/NDI Assessment report given below shortly summarizes the process of evaluation and
   the result of evaluation of different COTS products analyzed by team members. It is
   observed that ‘Moodle’ is one such COTS product, which satisfies all the requirements in the
   project for SmartStart Youth Financial Literacy Program. Also ‘CollectiveX’, which is used
   right now by the client for Small Business module seems a correct solution as it provides
   most of the functionality. Also an upcoming version of CollectiveX will have provision to
   satisfy evolutionary requirement. It is widely used system across the world and is
   continuously evolving with more advance features which will give the client plenty of
   opportunity to enhance the website as the requirements are added in future.




CAR_OCP_F08a_T11_V2.2                        6 of 14                                   7/17/2012
COTS/NDI Assessment Report (CAR)                                                Version 2.2




2. Purpose, Scope and Assumptions
   Purpose:
    To summarize process followed for assessing the COTS product.
    To provide results of COTS analysis
    To provide conclusion of COTS analysis and make recommendation to client for using
      ‘Moodle’ as a COTS solution.
    To provide rationale for the recommendation.

   Scope:
    Covers the COTS/NDI assessment objectives, context, approach, results, conclusions,
      recommendations, and supporting data.




CAR_OCP_F08a_T11_V2.2                     7 of 14                                 7/17/2012
COTS/NDI Assessment Report (CAR)                                                     Version 2.2



3. Assessment Approach
   3.1. System Objectives and Context
   Objectives:
    The objective of this project is to provide a web based system for TPC foundation to
      support their ‘SmartStart Youth Financial Literacy Program’. The system should be
      capable of providing features to support learning modules, assignments, discussion
      forums and such other learning related features for schools participating in this program.

   Constraints:
    The system should be in form of a third party hosted solution so that client does not have
      to host the solution themselves and do not have to worry about backend maintenance
      tasks and troubleshooting.
    Since the project will be developed by students of CSCI577a course, the project should
      be completed in Fall-2008 semester with 7 person development team. Although this is not
      strongly required, it is recommended as many of the team members may not be available
      to provide development and deployment support during Spring-2009 semester.

   Priorities:
    Initial plan for the system is to support around 6 schools as an experiment. For this reason
       the system is required to do many of the basic tasks. As the system reaches more mature
       state and users are comfortable with using basic functionality, the system will add more
       features to enhance learning experience for the users.

   3.2. Assessment Objectives and Approach
   The objective of COTS/NDI assessment is to evaluate candidate COTS products. We are
   following the Incremental Commitment Model to develop the system. The project
   requirements are divided based on various factors and COTS products are assessed with
   respect to these factors.

   To ensure successful assessment of the COTS products
    Instruments are used like Weights for requirements, Demos, Documentation etc.
    Facilities like Computers with internet connection, ninehub.com hosting service,
      Microsoft Windows, php, MySQL and Apache tomcat are used.
    Popularity of product in market and its user base is considered.
    Maximum support for third party products like Operating Systems and Web Browser is
      considered to ensure maximum availability of the web service to users.
    Risks in COTS assessment process are identified, tracked and mitigated.




CAR_OCP_F08a_T11_V2.2                       8 of 14                                    7/17/2012
COTS/NDI Assessment Report (CAR)                                                    Version 2.2



4. Assessment Results
   Focus of this COTS assessment task has been on assessing a single COTS product to fulfill
   all the requirements. This section describes the assessment results for various COTS product.
   Based on the evaluation matrix a recommendation is made to the client that Moodle is most
   suitable solution for given project requirement.

   4.1. Assessment Results-Part 1
      4.1.1.COTS Assessed
                               Table 1: COTS Assessed
       COTS           Web Address                   Description
       Product
       Moodle         http://moodle.org/                    Moodle is a free and open source e-
                                                            learning software platform.
       ILIAS          http://www.ilias.de/                  ILIAS is an open source web-based
                                                            learning management system.
       KEWL           http://nextgen.ug.edu.gh/index.php    KEWL.NextGen is an advanced e-
                      ?module=splashscreen                  learning system with features
                                                            similar to common proprietary
                                                            systems.
       Sakai          www.sakaiproject.org                  Sakai is a community of academic
                                                            institutions, commercial
                                                            organizations and individuals who
                                                            work together to develop a common
                                                            Collaboration and Learning
                                                            Environment (CLE).
       Dokeos         http://www.dokeos.com/                Dokeos is one of the largest and
                                                            most recognized companies
                                                            dedicated to open source Learning
                                                            Management Systems.
       Ning           http://www.ning.com/                  Ning is an online platform for users
                                                            to create their own social websites
                                                            and social networks.
       CollectiveX    http://www.collectivex.com/           CollectiveX is a social
                                                            collaboration tool that enables
                                                            groups of all types and sizes to
                                                            create collaboration communities
                                                            called Groupsites.




CAR_OCP_F08a_T11_V2.2                        9 of 14                                  7/17/2012
COTS/NDI Assessment Report (CAR)                                                       Version 2.2



      4.1.2.Evaluation Criteria
      Following attributes are considered when analyzing COTS product. Based on the project
      Win Conditions weight of each COTS attribute is determined after discussion with
      project team members.

                                 Table 2: Evaluation Criteria
           No.       Evaluation Criteria – COTS attributes                              Weight
            1          Functionality                                                            180
            2          Third party hosting solution                                             140
            3          Ease of use                                                              130
            4          Training for users                                                       130
            5          Minimum effort for Front end Maintenance                                 100
            6          Technical Support for the system                                           90
            7          Browser Support                                                            90
            8          Cost                                                                       70
            9          Evolution capability                                                       40
           10          Popularity in other learning institutes                                    30
      Each evaluation criteria is weighed based on its importance for the project. Initially the
      system will be provided for around 6 schools, so basic functionality has been on the
      higher side of the evaluation criteria. Also as client do not want to spend many resources
      in maintaining or supporting the solution, the availability and support of hosting service
      provider is considered as a very important factor. The COTS product with no hosting
      service provider cannot be considered as a solution even if it provides all the rest of the
      functionality.

      Functionality of the system is provided using following feature checklist. This will help
      in analyzing the COTS product on granular level.

      There are various functionality requirements for SmartStart Youth Financial Literacy
      Program. The importance of each of this functionality is discussed with client and weight
      is provided based on it.

  Table 3: Functionality Breakdown for SmartStart Youth Financial Literacy Program
            Weight        Features
                   0.05 Financial Aid Links
                   0.10 Discussion Boards
                   0.05 Download Assignments
                   0.30 Lesson Modules
                   0.10 Post Assignments
                   0.20 School Areas
                   0.10 Student Profiles
                   0.10 Submit Assignments
                     1.0 Total




CAR_OCP_F08a_T11_V2.2                       10 of 14                                     7/17/2012
COTS/NDI Assessment Report (CAR)                                                   Version 2.2


       4.1.3.Evaluation Results Screen Matrix
       Client currently has CollectiveX implementation for Small Business system with all the
       requirements satisfied. One of the requirements of ‘Community Management’ that is not
       provided by CollectiveX is deferred as an evolutionary requirement. So CollectiveX is
       finalized as a COTS solution for Small Business system. For this reason evaluation
       matrix for CollectiveX is not included here.

       Following table provides evaluation result of COTS candidates for SmartStart Youth
       Financial Literacy Program.
                         Table 5: Evaluation Results Screen Matrix
Functionality            Moodle                ILIAS              KEWL
                         Rate - 1    Score Rate - 1 Score Rate – 1               Score
Financial Aid Links          10         0.05          10    0.05         0          0.00
Discussion Boards            10         0.10          10    0.10        10          0.10
Download                     10         0.05           0    0.00        10          0.05
Assignments
Lesson Modules               10         0.30          10    0.30        10          0.30
Post Assignments             10         0.10          10    0.10        10          0.10
School Areas                 10         0.20          10    0.20        10          0.20
Student Profiles             10         0.10          10    0.10        10          0.10
Submit Assignments           10         0.10           5    0.05        10          0.10
                           Total        1.00     Total      0.90      Total         0.95



Functionality           Sakai               Ning                Dokeos
                        Rate - 1     Score Rate – 1      Score Rate - 1         Score
Financial Aid Links          0         0.00     5         0.025     10            0.05
Discussion Boards           10         0.10    10          0.10     10            0.10
Download                    10         0.05     5         0.025     10            0.05
Assignments
Lesson Modules              10         0.30      0         0.00       10           0.30
Post Assignments            10         0.10      5         0.05       10           0.10
School Areas                 0         0.00     10         0.20       10           0.20
Student Profiles            10         0.10     10         0.10        0           0.00
Submit Assignments          10         0.10      0         0.00       10           0.10
                           Total       0.75    Total       0.50      Total         0.90




CAR_OCP_F08a_T11_V2.2                      11 of 14                                 7/17/2012
COTS/NDI Assessment Report (CAR)                                                  Version 2.2



      4.1.4.Business Case Analysis
         4.1.4.1. COTS Ownership Cost
                             Table 6: COTS Ownership Cost
          COTS Product                                Ownership Cost
          Moodle                                              $0.0
          ILIAS                                               $0.0
          KEWL                                                $0.0
          Sakai                                               $0.0
          Ning                                                $0.0
          Dokeos                                              $0.0


         Most of the COTS products analyzed for the system are open source system so they
         are not required to purchase from the providers for ownership. Most of these systems
         are provided with open source licensing.

         4.1.4.2. Development Cost
                       Table 7: COTS Development Cost
          COTS Product                            Development Cost
          Moodle                                          $0.0
          ILIAS                                           $0.0
          KEWL                                            $0.0
          Sakai                                           $0.0
          Ning                                            $0.0
          Dokeos                                          $0.0


         Most of the COTS products analyzed for the system are open source system. For the
         systems which do not have support for any of the requirement, the development team
         would develop the feature. Since the development team consists of student from
         CSCI577a class the COST for development would be $0 for all the COTS products.

         4.1.4.3. Transition Cost
                             Table 8: COTS Transition Cost
          COTS Product                                 Transition Cost
          Moodle                                                 $0.0
          ILIAS                                                  $0.0
          KEWL                                                   $0.0
          Sakai                                                  $0.0
          Ning                                                   $0.0
          Dokeos                                                 $0.0




CAR_OCP_F08a_T11_V2.2                    12 of 14                                   7/17/2012
COTS/NDI Assessment Report (CAR)                                                      Version 2.2


         Most of the COTS products analyzed for the system are web based system. These
         COTS products will be deployed by a third party hosting solution provider. Currently
         client does not have a system to make a transition. For this reason transition cost is $0
         for all the COTS products.

         4.1.4.4. Operational Cost
                             Table 9: COTS Operational COST
          COTS Product                                       Operational Cost
          Moodle                                                            $100.0/year
          ILIAS                                                             $900.0/year
          KEWL                                                              $900.0/year
          Sakai                                                                  $1500.0
          Ning                                                              $680.0/year
          Dokeos                                                                 $1500.0
         The COTS solution will be hosted as a web based service on a third party hosting
         provider. Out of wide variety of hosting providers above average costs are deduced.
         For most of the hosting providers more cost will result in better hosting quality and
         technical support. Systems like Dokeos or Sakai are required to be hosted by client.
         This will result in higher operational cost.

         4.1.4.5. Maintenance Cost
                            Table 10: COTS Maintenance COST
          COTS Product                                       Maintenance Cost
          Moodle                                                   $7800.0/year
          ILIAS                                                    $7800.0/year
          KEWL                                                     $7800.0/year
          Sakai                                                    $7800.0/year
          Ning                                                     $7800.0/year
          Dokeos                                                   $7800.0/year
         The COTS solution will be hosted as a web based service on a third party hosting
         provider. The system will be required to be maintained by TPC foundation. For this
         approximately 312 human hours/year will be required. Considering hourly rate of
         $25/hr, the total estimated maintenance cost will be $7800.0




CAR_OCP_F08a_T11_V2.2                      13 of 14                                    7/17/2012
COTS/NDI Assessment Report (CAR)                                                       Version 2.2



5. Conclusion and Recommendations
   For each of the COTS product the conclusion and recommendations are as follows.
       C1.     ‘Moodle’ has proved to be the most suitable system for SmartStart Youth
   Financial Literacy Program so far. In addition to supporting all the requirements it is also
   very popular in market and has a wide user base.
       R1.     Use ‘Moodle’ for providing Financial Literacy Module.
       C2.     ‘KEWL’ satisfies most of the project requirements. However it does not have
   reputed hosting service providers.
       R2.     If using Moodle is not feasible for the project, use KEWL as a secondary option
   for the system
       C3.     ‘Dokeos’ and ‘ILIAS’ are rated at almost same level for satisfying requirements.
   ‘Dokeos’ requires hosting the solution by client. ‘ILIAS’ does not have reputed solution
   provider so this might cause problems in providing support and maintainability for client.
       R3.     Since client does not have resource and technical expertise for hosting the
   solution by herself, it is recommended not to use ‘Dokeos’ system for Financial Literacy
   Module. Since reputed hosting solution providers are note available for ‘ILIAS’ it not
   recommended for providing solution.
       C4.     ‘Sakai’ does not support many of the functionalities required by client. Also it is
   required to be hosted by client.
       R4.     ‘Sakai’ is not recommended for providing solution.
       C5.     ‘Ning’ does not support many of the functionality required by client. It is more
   oriented toward social networking rather than learning management system.
       R5.     ‘Ning’ is not recommended for providing solution.
       C6.     ‘CollectiveX’ is currently used by client and is providing all the functionalities
   required by the project.
       R6.     ‘CollectiveX’ should be continued for providing Small Business system.




CAR_OCP_F08a_T11_V2.2                        14 of 14                                    7/17/2012

				
DOCUMENT INFO
Shared By:
Categories:
Tags:
Stats:
views:4
posted:7/17/2012
language:English
pages:14