Docstoc

Forrester SOA Wave Models

Document Sample
Forrester SOA Wave Models Powered By Docstoc
					  Forrester SOA And Web Services Management Wave, Q1 2006
          0
 by Randy Heffner
                                                                          Market Presence
                                                                                                                                                   Your Custom Scores
                                                                                                           Forrester Scores                        (Not Yet Customized)
              Risky                            Strong                                                      AmberPoint                    3.77      AmberPoint                       3.77
              Bets     Contenders             Performers                     Leaders                       Actional                      3.76      Actional                         3.76
 Strong                                                                                                    IBM                           3.30      IBM                              3.30
              Note: Because SOA                                                                            Hewlett-Packard               3.27      Hewlett-Packard                  3.27
              management vendors have                                                                      Oracle                        3.22      Oracle                           3.22
              widely varying strategies for                                                                TIBCO Software                3.14      TIBCO Software                   3.14
              product packaging, it is very
                                                                                                           SOA Software                  3.10      SOA Software                     3.10
              important for buyers to read
              the associated Wave reports                                          AmberPoint              webMethods                    3.01      webMethods                       3.01
                                                               TIBCO                                       CA                            2.96      CA                               2.96
              and not rely solely on the                       Software
              Wave graphic.                                                         Actional               Infravio                      2.52      Infravio                         2.52
                                                                                                           Itellix                       2.10      Itellix                          2.10
                                               SOA Software
                                                                             IBM
                                                               CA              Oracle                      See The Data And Methods                Create Your Custom
Current                                                                            HP                      Behind The Forrester Wave               Scores
                                                 Infravio
Offering                                                                   webMethods                  >   View vendor scores and weightings     > Enter custom criteria weightings
                                                     Itellix                                           >   View evaluation criteria                By customizing the criteria weightings, you
                                                                                                       >   Read the Forrester Wave methodology     can rank the vendors in this Forrester Wave
                                                                                                       >   Schedule an Inquiry with an analyst     based on your company's requirements.
                                                                                                       >   How to use this tool                    The graphic will not change.


                                                                                                           See Individual Product Scorecards
                                                                                                       >   Actional
                                                                                                       >   AmberPoint
                                                                                                       >   CA
 Weak                                                                                                  >   Hewlett-Packard
                                                                                                       >   IBM
              Weak                              Strategy                                               >   Infravio
                                                                                           Strong      >   Itellix
                                                                                                       >   Oracle
© 2006, Forrester Research, Inc. All rights reserved. Forrester, Forrester Wave, WholeView 2,          >   SOA Software
Technographics, and Total Economic Impact are trademarks of Forrester Research, Inc. All other         >   TIBCO Software
trademarks are the property of their respective companies. Forrester clients may make one attributed   >   webMethods
copy or slide of each figure contained herein. Additional reproduction is strictly prohibited. For
additional reproduction rights and usage information, go to www.forrester.com. Information is based
on best available resources. Opinions reflect judgment at the time and are subject to change.




    © 2006, Forrester Research, Inc.                                                                                                                                                    1
    Cell: A1
Comment: Hyperlink Target Cell


    Cell: A3
Comment: This range is used to identify valid vendor worksheets when looping through all worksheets in the workbook.


    Cell: A5
Comment: This cell displays the number of vendor worksheets in the model. We use this to determine which rows in the HideRows range should be hidden.


    Cell: A7
Comment: If the user has not modified the custom weightings on the Scores and Weightings worksheet this will be False. Once the weightings have been changed this will be True. This cell is used to modify the
          title above the custom ranking list.




          © 2006, Forrester Research, Inc.                                                                                                                                                           2
  Forrester SOA And Web Services Management Wave, Q1 2006
    0
  by Randy Heffner




                                                                                                                                              Hewlett-Packard




                                                                                                                                                                                                                         TIBCO Software
                                                                                                                                                                                                         SOA Software




                                                                                                                                                                                                                                           webMethods
                                                                                                                         AmberPoint
                                                                                                             Actional




                                                                                                                                                                        Infravio




                                                                                                                                                                                               Oracle
                                                                                                                                                                                    Itellix
                                                                                                                                                                 IBM
                                                                                                                                       CA
  Forrester's Overall Scores                                                                                3.76 3.77 2.96 3.27 3.30 2.52 2.10 3.22 3.10 3.14 3.01
  Customized Overall Scores                                                     > View your custom scores   3.76 3.77 2.96 3.27 3.30 2.52 2.10 3.22 3.10 3.14 3.01

   Control Level of Criteria Detail
   Less                     More
                                                       View scores with:
> View criteria explanations                           Forrester's Weightings    Your Custom Weightings
  CURRENT OFFERING                                      50%                       50%                       3.55        3.70          2.83   2.62               3.10   2.44        2.10       2.77      3.23            3.74              2.70
      Products included                                       0%                        0%                  0.00        0.00          0.00   0.00               0.00   0.00        0.00       0.00      0.00            0.00              0.00
      IT-level management                                    20%                       20%                  4.30        4.20          3.50   2.70               4.00   2.90        2.50       2.60      2.60            4.50              3.50
            Endpoint support                                        20%                      20%            4.00        4.00          4.00   3.00               4.00   3.00        1.00       4.00      3.00            5.00              3.00
            Performance management                                  30%                      30%            4.00        4.00          2.00   3.00               5.00   2.00        2.00       2.00      2.00            5.00              4.00
            Availability management                                 30%                      30%            5.00        4.00          5.00   2.00               3.00   3.00        3.00       2.00      2.00            4.00              3.00
            Service-level management                                20%                      20%            4.00        5.00          3.00   3.00               4.00   4.00        4.00       3.00      4.00            4.00              4.00
      Business-level management                               5%                        5%                  3.35        3.35          1.65   2.00               4.65   1.65        1.00       4.30      1.35            3.65              3.65
            Business activity monitoring (BAM)                      30%                      30%            3.00        3.00          2.00   2.00               5.00   2.00        1.00       5.00      1.00            4.00              4.00
            Usability by business users                             35%                      35%            4.00        4.00          1.00   1.00               5.00   2.00        0.00       5.00      0.00            4.00              4.00
            Integration for business monitoring                     35%                      35%            3.00        3.00          2.00   3.00               4.00   1.00        2.00       3.00      3.00            3.00              3.00
      Product architecture                                   15%                       15%                  3.00        3.45          2.45   3.60               3.00   2.45        1.85       1.70      3.60            3.55              3.15
            Deployment styles and requirements                      20%                      20%            4.00        5.00          3.00   4.00               3.00   3.00        2.00       3.00      4.00            3.00              3.00
            Metamodel for services and processes                    20%                      20%            2.00        3.00          1.00   5.00               3.00   3.00        1.00       1.00      4.00            4.00              3.00
            Enterprise management integration                       20%                      20%            2.00        3.00          3.00   3.00               3.00   2.00        1.00       0.00      3.00            4.00              4.00
            Metadata and repository integration                      5%                       5%            4.00        3.00          2.00   3.00               2.00   2.00        1.00       2.00      4.00            2.00              2.00
            Development life-cycle integration                       5%                       5%            4.00        2.00          1.00   2.00               3.00   2.00        1.00       2.00      2.00            3.00              3.00
            Load balancing and scalability (product)                 5%                       5%            3.00        2.00          3.00   3.00               4.00   3.00        1.00       3.00      4.00            3.00              3.00
            Load balancing and scalability (service)                 5%                       5%            2.00        3.00          0.00   2.00               3.00   3.00        4.00       0.00      3.00            4.00              2.00
            Failover (product)                                       5%                       5%            3.00        3.00          2.00   2.00               4.00   2.00        5.00       3.00      3.00            3.00              3.00
            Failover (service)                                       5%                       5%            4.00        4.00          5.00   2.00               2.00   3.00        3.00       2.00      2.00            4.00              2.00
            Dynamic reconfiguration                                 10%                      10%            4.00        4.00          4.00   5.00               3.00   1.00        3.00       3.00      5.00            4.00              4.00
            Performance-specific features                            0%                       0%            0.00        0.00          0.00   0.00               0.00   0.00        0.00       0.00      0.00            0.00              0.00
      Trust enablement                                       10%                       10%                  4.20        3.60          3.40   2.80               2.40   2.40        1.80       3.40      3.60            3.20              2.60
            Authentication and authorization                        20%                      20%            4.00        4.00          5.00   3.00               3.00   3.00        3.00       3.00      4.00            3.00              3.00
            Identity management integration                         40%                      40%            5.00        4.00          2.00   2.00               1.00   3.00        1.00       3.00      3.00            3.00              3.00
            Encryption and signatures                               20%                      20%            3.00        4.00          5.00   4.00               4.00   3.00        4.00       4.00      4.00            5.00              4.00
            Application security integration                        20%                      20%            4.00        2.00          3.00   3.00               3.00   0.00        0.00       4.00      4.00            2.00              0.00
      Administrative tooling and integration                 10%                       10%                  4.50        4.60          2.95   2.05               2.75   3.05        3.65       3.30      4.15            3.40              3.50
            Management administration                               30%                      30%            5.00        5.00          2.00   2.00               2.00   4.00        3.00       4.00      4.00            3.00              4.00
            Security administration                                 25%                      25%            4.00        4.00          5.00   1.00               2.00   3.00        4.00       3.00      4.00            3.00              3.00
            Management console                                      25%                      25%            5.00        5.00          4.00   2.00               4.00   2.00        4.00       3.00      4.00            4.00              3.00
            Capacity planning                                        5%                       5%            3.00        2.00          2.00   2.00               4.00   3.00        3.00       3.00      4.00            3.00              4.00
            Administrative integration                              15%                      15%            4.00        5.00          0.00   4.00               3.00   3.00        4.00       3.00      5.00            4.00              4.00
      Application integration and mediation                   5%                        5%                  3.05        2.85          0.90   2.60               3.75   2.30        2.75       3.25      2.65            4.20              2.10
            Version resolution                                      40%                      40%            4.00        3.00          1.00   4.00               3.00   3.00        5.00       3.00      2.00            3.00              3.00
            Protocol mediation                                      20%                      20%            2.00        2.00          1.00   2.00               4.00   1.00        0.00       3.00      4.00            5.00              1.00
            Transformation                                          15%                      15%            3.00        3.00          1.00   3.00               4.00   3.00        3.00       3.00      3.00            5.00              1.00

        © 2006, Forrester Research, Inc.                                                                                                                                                                                                                3
  Forrester SOA And Web Services Management Wave, Q1 2006
   0
  by Randy Heffner




                                                                                                                                          Hewlett-Packard




                                                                                                                                                                                                                     TIBCO Software
                                                                                                                                                                                                     SOA Software




                                                                                                                                                                                                                                       webMethods
                                                                                                                     AmberPoint
                                                                                                         Actional




                                                                                                                                                                    Infravio




                                                                                                                                                                                           Oracle
                                                                                                                                                                                Itellix
                                                                                                                                                             IBM
                                                                                                                                   CA
 Forrester's Overall Scores                                                                             3.76 3.77 2.96 3.27 3.30 2.52 2.10 3.22 3.10 3.14 3.01
 Customized Overall Scores                                                  > View your custom scores   3.76 3.77 2.96 3.27 3.30 2.52 2.10 3.22 3.10 3.14 3.01

  Control Level of Criteria Detail
  Less                     More
                                                   View scores with:
> View criteria explanations                       Forrester's Weightings    Your Custom Weightings
            Policy-based processing                             15%                      15%            4.00        4.00          1.00   1.00               5.00   3.00        2.00       4.00      4.00            5.00              3.00
            Other integration                                   10%                      10%            0.00        2.00          0.00   0.00               4.00   0.00        0.00       4.00      0.00            5.00              1.00
      Deployment management                               5%                        5%                  2.25        2.70          2.25   1.70               1.20   2.45        0.45       0.85      3.30            3.10              1.45
            Deployment artifacts                                15%                      15%            2.00        2.00          2.00   5.00               2.00   3.00        2.00       2.00      3.00            2.00              2.00
            Deployment package configuration                    30%                      30%            2.00        2.00          4.00   0.00               0.00   0.00        0.00       0.00      4.00            4.00              0.00
            Rollback                                            20%                      20%            3.00        3.00          2.00   1.00               2.00   4.00        0.00       2.00      3.00            3.00              1.00
            Environment staging                                 15%                      15%            1.00        4.00          1.00   1.00               2.00   4.00        1.00       1.00      3.00            4.00              1.00
            Deployment integration                              20%                      20%            3.00        3.00          1.00   3.00               1.00   3.00        0.00       0.00      3.00            2.00              4.00
      Alerting, events, and exception management         10%                       10%                  3.50        4.50          3.10   2.90               2.80   1.80        2.00       2.70      3.10            3.90              3.20
            Alerting methods                                    30%                      30%            3.00        4.00          3.00   4.00               3.00   3.00        2.00       2.00      4.00            5.00              3.00
            Alert and event specification                       20%                      20%            3.00        4.00          4.00   3.00               3.00   3.00        3.00       3.00      4.00            4.00              3.00
            Autoresponse                                        30%                      30%            4.00        5.00          4.00   3.00               3.00   1.00        2.00       3.00      3.00            4.00              3.00
            Exception management tools                          20%                      20%            4.00        5.00          1.00   1.00               2.00   0.00        1.00       3.00      1.00            2.00              4.00
      Logging and auditing                               10%                       10%                  2.70        3.35          3.25   2.50               2.55   1.95        1.70       2.75      3.55            3.40              0.00
            Logging levels                                      35%                      35%            3.00        4.00          4.00   4.00               3.00   2.00        3.00       4.00      4.00            4.00              0.00
            Log integration                                     20%                      20%            3.00        3.00          4.00   4.00               3.00   4.00        1.00       3.00      4.00            4.00              0.00
            Log integrity                                       15%                      15%            0.00        2.00          0.00   0.00               0.00   0.00        0.00       0.00      3.00            3.00              0.00
            Audit tools                                         15%                      15%            4.00        3.00          4.00   2.00               3.00   3.00        3.00       2.00      4.00            4.00              0.00
            Diagnostic tools                                    15%                      15%            3.00        4.00          3.00   0.00               3.00   0.00        0.00       3.00      2.00            1.00              0.00
      Support for standards and specifications            7%                        7%                  3.30        2.85          2.35   2.80               3.05   2.50        2.40       3.50      3.80            3.75              2.40
            Core Web services support                           25%                      25%            4.00        4.00          3.00   4.00               5.00   4.00        4.00       5.00      4.00            5.00              3.00
            Management support                                  20%                      20%            1.00        1.00          1.00   3.00               1.00   2.00        1.00       3.00      4.00            4.00              3.00
            Security token support                              20%                      20%            4.00        4.00          3.00   3.00               2.00   2.00        3.00       3.00      4.00            3.00              3.00
            Security protocol support                           20%                      20%            4.00        3.00          2.00   2.00               3.00   2.00        2.00       3.00      4.00            3.00              2.00
            Advanced Web services support                        5%                       5%            2.00        1.00          0.00   0.00               2.00   0.00        0.00       1.00      2.00            0.00              1.00
            Other standards                                     10%                      10%            4.00        2.00          4.00   2.00               5.00   3.00        2.00       4.00      3.00            5.00              0.00
      Other product features                              3%                        3%                  2.80        3.00          3.00   0.00               3.40   2.70        0.90       3.70      3.30            3.60              2.40
            Core SOA management features                        70%                      70%            4.00        3.00          3.00   0.00               4.00   3.00        0.00       4.00      3.00            3.00              3.00
            Other features                                      30%                      30%            0.00        3.00          3.00   0.00               2.00   2.00        3.00       3.00      4.00            5.00              1.00
      Other SOA infrastructure products                   0%                        0%                  0.00        0.00          0.00   0.00               0.00   0.00        0.00       0.00      0.00            0.00              0.00
            Attack protection                                    0%                       0%            5.00        0.00          0.00   0.00               5.00   0.00        0.00       0.00      5.00            0.00              0.00
            Registry and repository                              0%                       0%            0.00        0.00          5.00   0.00               5.00   5.00        0.00       5.00      5.00            5.00              5.00
            SOA life-cycle management                            0%                       0%            0.00        0.00          5.00   0.00               5.00   0.00        0.00       0.00      0.00            0.00              5.00
            Application development (design)                     0%                       0%            5.00        0.00          5.00   5.00               5.00   0.00        0.00       0.00      0.00            5.00              5.00
            Application development (coding)                     0%                       0%            5.00        0.00          5.00   0.00               5.00   0.00        0.00       5.00      0.00            0.00              5.00
            Application integration                              0%                       0%            5.00        0.00          5.00   0.00               5.00   0.00        0.00       5.00      0.00            5.00              5.00
            Data integration                                     0%                       0%            5.00        0.00          0.00   0.00               5.00   0.00        0.00       5.00      0.00            5.00              5.00
            Other SOA-related products                           0%                       0%            5.00        5.00          5.00   5.00               5.00   0.00        0.00       5.00      5.00            5.00              0.00

       © 2006, Forrester Research, Inc.                                                                                                                                                                                                             4
  Forrester SOA And Web Services Management Wave, Q1 2006
    0
  by Randy Heffner




                                                                                                                                                                                Hewlett-Packard




                                                                                                                                                                                                                                                           TIBCO Software
                                                                                                                                                                                                                                           SOA Software




                                                                                                                                                                                                                                                                             webMethods
                                                                                                                                                           AmberPoint
                                                                                                                                               Actional




                                                                                                                                                                                                          Infravio




                                                                                                                                                                                                                                 Oracle
                                                                                                                                                                                                                      Itellix
                                                                                                                                                                                                   IBM
                                                                                                                                                                         CA
  Forrester's Overall Scores                                                                                                                 3.76 3.77 2.96 3.27 3.30 2.52 2.10 3.22 3.10 3.14 3.01
  Customized Overall Scores                                                                             > View your custom scores            3.76 3.77 2.96 3.27 3.30 2.52 2.10 3.22 3.10 3.14 3.01

   Control Level of Criteria Detail
   Less                     More
                                                                     View scores with:
> View criteria explanations                                          Forrester's Weightings              Your Custom Weightings

  STRATEGY                                                            50%                                  50%                               3.98         3.84          3.08   3.92               3.50   2.60        2.11       3.68      2.97            2.54              3.32
     Product strategy                                                        45%                                  45%                        4.20         4.20          2.60   4.20               5.00   2.00        1.20       4.20      2.80            2.20              3.00
         SOA and Web services management                                            80%                                  80%                 4.00         4.00          2.00   4.00               5.00   2.00        1.00       4.00      3.00            2.00              3.00
         Other SOA infrastructure products                                           0%                                   0%                 3.00         1.00          3.00   2.00               5.00   1.00        1.00       4.00      1.00            3.00              3.00
         Enterprise focus                                                           20%                                  20%                 5.00         5.00          5.00   5.00               5.00   2.00        2.00       5.00      2.00            3.00              3.00
     Financial resources to support strategy                                 25%                                  25%                        5.00         3.00          5.00   5.00               5.00   2.00        1.00       5.00      3.00            5.00              5.00
     Cost                                                                    30%                                  30%                        2.80         4.00          2.20   2.60               0.00   4.00        4.40       1.80      3.20            1.00              2.40
         Medium deployment license cost                                             60%                                  60%                 2.00         4.00          3.00   3.00               0.00   4.00        4.00       1.00      2.00            1.00              2.00
         Minimum license cost                                                       40%                                  40%                 4.00         4.00          1.00   2.00               0.00   4.00        5.00       3.00      5.00            1.00              3.00
         Maintenance cost                                                            0%                                   0%                 0.00         0.00          0.00   0.00               0.00   0.00        0.00       0.00      0.00            0.00              0.00
         Pricing structure                                                           0%                                   0%                 0.00         0.00          0.00   0.00               0.00   0.00        0.00       0.00      0.00            0.00              0.00

  MARKET PRESENCE                                                       0%                                   0%                              2.39         2.45          3.56   2.62               3.16   1.63        0.40       2.91      2.25            3.90              3.07
     Installed base                                                          30%                                  30%                        2.30         3.15          3.10   1.80               0.60   1.75        0.00       2.20      3.00            5.00              2.40
          This product                                                              40%                                  40%                 2.00         3.00          1.00   0.00               0.00   1.00        0.00       1.00      3.00            5.00              3.00
          All SOA products                                                          15%                                  15%                 2.00         1.00          5.00   5.00               4.00   1.00        0.00       5.00      2.00            5.00              4.00
          New customers                                                             30%                                  30%                 2.00         4.00          4.00   1.00               0.00   2.00        0.00       1.00      3.00            5.00              0.00
          Users on maintenance                                                      15%                                  15%                 4.00         4.00          5.00   5.00               0.00   4.00        0.00       5.00      4.00            5.00              4.00
          Reference accounts                                                         0%                                   0%                 0.00         0.00          0.00   0.00               0.00   0.00        0.00       0.00      0.00            0.00              0.00
     Revenue                                                                 25%                                  25%                        3.00         2.00          5.00   5.00               5.00   1.00        1.00       5.00      2.00            3.00              3.00
     Revenue growth                                                           0%                                   0%                        0.00         0.00          0.00   0.00               0.00   0.00        0.00       0.00      0.00            0.00              0.00
     Systems integrators                                                     15%                                  15%                        1.00         2.00          2.00   0.00               5.00   2.00        0.00       0.00      1.00            4.00              2.00
     Services                                                                10%                                  10%                        3.00         2.50          4.50   4.50               3.50   3.00        0.50       4.50      4.00            5.00              5.00
          Implementation engineers                                                  50%                                  50%                 1.00         0.00          4.00   4.00               4.00   1.00        0.00       4.00      3.00            5.00              5.00
          Training                                                                  50%                                  50%                 5.00         5.00          5.00   5.00               3.00   5.00        1.00       5.00      5.00            5.00              5.00
     Employees                                                               10%                                  10%                        3.50         3.00          3.75   3.75               3.75   2.00        0.50       4.50      2.50            3.00              3.00
          Total employees                                                           50%                                  50%                 4.00         3.00          5.00   5.00               5.00   2.00        0.00       5.00      3.00            4.00              4.00
          Dedicated engineers                                                       25%                                  25%                 2.00         3.00          0.00   0.00               0.00   3.00        1.00       3.00      3.00            0.00              0.00
          Sales staff                                                               25%                                  25%                 4.00         3.00          5.00   5.00               5.00   1.00        1.00       5.00      1.00            4.00              4.00
     Technology partners                                                     10%                                  10%                        1.50         1.50          2.50   0.00               2.50   0.50        0.50       1.00      0.50            2.50              5.00
          License partners                                                          50%                                  50%                 2.00         1.00          0.00   0.00               0.00   0.00        0.00       1.00      0.00            0.00              5.00
          Resellers                                                                 50%                                  50%                 1.00         2.00          5.00   0.00               5.00   1.00        1.00       1.00      1.00            5.00              5.00
          Other partners                                                             0%                                   0%                 0.00         0.00          0.00   0.00               0.00   0.00        0.00       0.00      0.00            0.00              0.00

  © 2006, Forrester Research, Inc. All rights reserved. Forrester, Forrester Wave, WholeView 2, Technographics, and Total Econo mic Impact
  are trademarks of Forrester Research, Inc. All other trademarks are the property of their respective companies. Forrester cli ents may make
  one attributed copy or slide of each figure contained herein. Additional reproduction is strictly prohibited. For additional reproduction rights
  and usage information, go to www.forrester.com. Information is based on best available resources. Opinions reflect judgment a t the time
      © 2006, Forrester Research, Inc.                                                                                                                                                                                                                                                    5
  Forrester SOA And Web Services Management Wave, Q1 2006
    0
  by Randy Heffner




                                                                                                                                                                      Hewlett-Packard




                                                                                                                                                                                                                                           TIBCO Software
                                                                                                                                                                                                                            SOA Software




                                                                                                                                                                                                                                                            webMethods
                                                                                                                                                    AmberPoint
                                                                                                                                         Actional




                                                                                                                                                                                              Infravio




                                                                                                                                                                                                                   Oracle
                                                                                                                                                                                                         Itellix
                                                                                                                                                                                        IBM
                                                                                                                                                                 CA
  Forrester's Overall Scores                                                                                                           3.76 3.77 2.96 3.27 3.30 2.52 2.10 3.22 3.10 3.14 3.01
  Customized Overall Scores                                                                        > View your custom scores           3.76 3.77 2.96 3.27 3.30 2.52 2.10 3.22 3.10 3.14 3.01

   Control Level of Criteria Detail
   Less                     More
                                                                 View scores with:
> View criteria explanations                                      Forrester's Weightings             Your Custom Weightings
  and usage information, go to www.forrester.com. Information is based on best available resources. Opinions reflect judgment a t the time




        © 2006, Forrester Research, Inc.                                                                                                                                                                                                                                 6
      Forrester SOA And Web Services Management Wave, Q1 2006
      by Randy Heffner                                                                    > View Forrester Wave graphic and custom scores
                                                                                          > Back to "Scores and weightings"

       Control Level of Criteria Detail
       Less                     More

      Evaluation Criteria                           Criteria Explanation                     Scale Explanation
      CURRENT OFFERING
          Products included                         What is the precise product or set of    This item is for information only and is not scored
                                                    products that the vendor offers as its   or weighted.
                                                    service-oriented architecture (SOA)
                                                    and Web services management
                                                    solution?
          IT-level management                       How does the product manage              This score is a weighted average of its
                                                    service performance and availability?    subattributes: Endpoint support, Performance
                                                                                             management, Availability management, and
                                                                                             Service-level management.
               Endpoint support                     What access protocols (SOAP,             Measured by the breadth of support for various
                                                    XML/HTTP, Java Message Service           protocols, payload types, and native agents for
                                                    (JMS), Java RMI, WebSphere MQ,           specific products:
                                                    .NET Remoting, others) and service       5 = Broad support.
                                                    implementation technologies (Java        3 = Average support.
                                                    EE, .NET, databases, others) does        1 = Minimal support.
                                                    the product fully monitor? What          0 = No support.
                                                    specific products does the product
                                                    support?
               Performance management               How does the product gather, report,     Measured by the breadth and depth of
                                                    and analyze service performance          functionality for gathering, analyzing, and
                                                    data, including 1) reporting against     correlating data about service invocations and
                                                    performance goals and 2) correlation     service implementations:
                                                    of performance data across               5 = Deep functionality.
                                                    technology layers within service         3 = Average functionality.
                                                    implementations?                         1 = Minimal functionality.
                                                                                             0 = No functionality.
               Availability management              How does the product gather, report, Measured by the breadth and depth of
                                                    and analyze service availability data, functionality for identifying, analyzing, and
                                                    including root cause analysis of         correlating availability issues for services and
                                                    availability issues across technology service implementations:
                                                    layers within service                    5 = Deep functionality.
                                                    implementations?                         3 = Average functionality.
                                                                                             1 = Minimal functionality.
                                                                                             0 = No functionality.
               Service-level management             How does the product 1) specify          Measured by the breadth and depth of
                                                    service-level goals, 2) tie service-     functionality for specifying service-level goals and
                                                    level goals to specific users or         SLAs and monitoring and managing operations to
                                                    groups to create service-level           maintain service-level goals:
                                                    agreements (SLAs), 3) monitor and 5 = Deep functionality.
                                                    report service-level compliance over 3 = Average functionality.
                                                    time, and 4) automatically adjust        1 = Minimal functionality.
                                                    service operations to better achieve 0 = No functionality.
                                                    SLAs?
          Business-level management                 How does the product provide             This score is a weighted average of its
                                                    business insight by extracting and       subattributes: Business activity montioring,
                                                    reporting data from service request- Usability by business users, and Integration for
                                                    response flows?                          business monitoring.
               Business activity monitoring (BAM)   How do the product's built-in features Measured by the breadth and depth of
                                                    provide business insight from service functionality for capturing business data from
                                                    operation by extracting, analyzing,      service requests and tying that data to business
                                                    and reporting on business data           processes:
                                                    contained in the flow of service         5 = Deep functionality.
                                                    requests and responses? What are 3 = Average functionality.
                                                    its capabilities for tying such analysis 1 = Minimal functionality.
                                                    to an end-to-end business process        0 = No functionality.
                                                    flow?


© 2006, Forrester Research, Inc.                                                                                                         7
      Forrester SOA And Web Services Management Wave, Q1 2006
      by Randy Heffner                                                                      > View Forrester Wave graphic and custom scores
                                                                                            > Back to "Scores and weightings"

       Control Level of Criteria Detail
       Less                     More

      Evaluation Criteria                             Criteria Explanation                    Scale Explanation
               Usability by business users            How understandable to and usable        Measured by the breadth and depth of
                                                      by business staff are the product's     functionality for creating business-oriented
                                                      business activity monitoring tools?     displays and the extent to which these are usable
                                                                                              by business staff:
                                                                                              5 = Deep functionality.
                                                                                              3 = Average functionality.
                                                                                              1 = Minimal functionality.
                                                                                              0 = No functionality.
               Integration for business monitoring    What are the data capture methods Measured by the breadth of options by which
                                                      and configuration options for feeding other products can get business activity data
                                                      data to other analysis tools (BAM,      captured by the product:
                                                      data warehousing, others)?              5 = Deep integration options.
                                                                                              3 = Average integration options.
                                                                                              1 = Minimal integration options.
                                                                                              0 = No integration options.
          Product architecture                        How robust is the product's overall     This score is a weighted average of its
                                                      architecture, including its integration subattributes: Deployment styles and
                                                      with development life-cycle             requirements, metamodel for services and
                                                      management infrastructure?              processes, Enterprise management integration,
                                                                                              Metadata and repository integration, Development
                                                                                              life-cycle integration, Load balancing and
                                                                                              scalability (product), Load balancing and
                                                                                              scalability (service), Failover (product), Dynamic
                                                                                              reconfiguration, and Performance-specific
                                                                                              features.
               Deployment styles and requirements     What are the options for deployment Measured by the breadth of deployment options
                                                      of monitoring elements (such as         and depth of integration with numerous service
                                                      agent, proxy, inline, tool kit for      endpoint technologies:
                                                      embedding an agent in an                5 = Broad deployment options.
                                                      application, others)? What servers or 3 = Average deployment options.
                                                      other infrastructure are required?      1 = Limited deployment options.

               Metamodel for services and processes   What is the underlying structure,         Measured by the breadth and extensibility of the
                                                      extensibility, and integrability of the   product's metamodels for services and their
                                                      product's service and process model,      surrounding context (processes, infrastructure,
                                                      including 1) the metamodel for            etc.):
                                                      defining both services and the            5 = Broad and highly extensible model.
                                                      processes into which they fit and 2)      3 = Basic model with some extensibility.
                                                      the breadth of different technologies     1 = Narrow model with no extensibility.
                                                      included in the model?
               Enterprise management integration      How does the product integrate with   Measured by the breadth of options for and the
                                                      enterprise IT management              extent of prebuilt integration with enterprise
                                                                                            infrastructure management solutions:
                                                      infrastructure, particularly to achieve
                                                      a correlated view of 1) all technology5 = Deep standards-based and prebuilt
                                                      layers of a service implementation    integration.
                                                                                            3 = Basic integration.
                                                      and 2) all technologies that affect the
                                                      health of a given business process?   1 = Minimal integration.
                                                                                            0 = No integration.
               Metadata and repository integration    How does the product share            Measured by the breadth of options for and the
                                                      metadata with other products (import, extent of prebuilt integration with service
                                                      export, common repository)?           repositories (UDDI and others):
                                                                                            5 = Deep standards-based and prebuilt
                                                                                            integration.
                                                                                            3 = Basic integration.
                                                                                            1 = Minimal integration.
                                                                                            0 = No integration.




© 2006, Forrester Research, Inc.                                                                                                          8
      Forrester SOA And Web Services Management Wave, Q1 2006
      by Randy Heffner                                                                              > View Forrester Wave graphic and custom scores
                                                                                                    > Back to "Scores and weightings"

       Control Level of Criteria Detail
       Less                     More

      Evaluation Criteria                                 Criteria Explanation                        Scale Explanation
               Development life-cycle integration         How does the product integrate with         Measured by the breadth and depth of feature-
                                                          development tools, repositories, and        function for development life-cycle integration:
                                                          SOA governance solutions? In                5 = Deep integration.
                                                          particular: 1) for deployment, how          3 = Basic integration.
                                                          does the product import development         1 = Minimal integration.
                                                          tool definitions of service                 0 = No integration.
                                                          implementation structure and service
                                                          relationships and 2) for guiding future
                                                          development, how does the product
                                                          provide developers with an integrated
                                                          view of service configuration and
                                                          operations history?

               Load balancing and scalability (product)   What is the architecture for sharing a Measured by the extent to which all product
                                                          workload across multiple product       elements may participate in a load balancing
                                                          instances?                             architecture:
                                                                                                 5 = Deep load balancing abilities.
                                                                                                 3 = Basic load balancing abilities.
                                                                                                 1 = Minimal load balancing abilities.
                                                                                                 0 = No load balancing abilities.
               Load balancing and scalability (service)   How does the product load balance Measured by the breadth and depth of feature-
                                                          incoming service requests across       function for service load balancing:
                                                          multiple underlying instances of a     5 = Deep features.
                                                          service?                               3 = Basic features.
                                                                                                 1 = Minimal features.
                                                                                                 0 = No features.
               Failover (product)                         What is the architecture for failing   Measured by the extent to which all product
                                                          over a workload from one product       elements may participate in a failover
                                                          instance to another?                   architecture:
                                                                                                 5 = Deep failover abilities.
                                                                                                 3 = Basic failover abilities.
                                                                                                 1 = Minimal failover abilities.
                                                                                                 0 = No failover abilities.
               Failover (service)                         How does the product manage            Measured by the breadth and depth of feature-
                                                          failover from one instance of a        function for service failover:
                                                          service to another? Does the product 5 = Deep features.
                                                          monitor services using heartbeats?     3 = Basic features.
                                                                                                 1 = Minimal features.
                                                                                                 0 = No features.
               Dynamic reconfiguration                    What product configuration options, Measured by the product's features and design
                                                          when changed, require a product        for performing service configuration changes,
                                                          restart (such as performing product product configuration changes, and product
                                                          upgrades, adding/removing              upgrades with no downtime:
                                                          management server instances or         5 = Deep features.
                                                          management consoles, etc.)?            3 = Basic features.
                                                                                                 1 = Minimal features.
                                                                                                 0 = No features.
               Performance-specific features              What product features are              Because performance is best measured via direct
                                                          specifically intended as performance- tests, this item is not scored or weighted, but
                                                          enhancing options (such as             rather simply provided for information.
                                                          persistent network connections)?

          Trust enablement                                How rich are the product's features         This score is a weighted average of its
                                                          for establishing trust and fitting with     subattributes: Authentication/authorization,
                                                          an overall architecture for trust           Identity management integration, Encryption and
                                                          management?                                 signatures, Identity propagation, and Application
                                                                                                      security integration.


© 2006, Forrester Research, Inc.                                                                                                                 9
      Forrester SOA And Web Services Management Wave, Q1 2006
      by Randy Heffner                                                                   > View Forrester Wave graphic and custom scores
                                                                                         > Back to "Scores and weightings"

       Control Level of Criteria Detail
       Less                     More

      Evaluation Criteria                          Criteria Explanation                    Scale Explanation
               Authentication and authorization    For managed services, what              Measured by the product's built-in features for
                                                   authentication protocols, token types,  authentication and authorization:
                                                   and authorization styles and policies   5 = Deep features.
                                                   (such as role-based access control)     3 = Basic features.
                                                   does the product support?               1 = Minimal features.
                                                                                           0 = No features.
               Identity management integration     To what identity management             Measured by the product's breadth and depth of
                                                   infrastructure products can the         integration with identity management platforms for
                                                   product delegate authentication and authentication and authorization:
                                                   authorization decisions (including      5 = Deep integration.
                                                   LDAP and other directories)?            3 = Basic integration.
                                                                                           1 = Minimal integration.
                                                                                           0 = No integration.
               Encryption and signatures           What encryption and digital signature Measured by the product's breadth of options for
                                                   options does the product support        providing encryption and signatures using the
                                                   (transport-level, message-level,        product:
                                                   message element-level, various          5 = Many options.
                                                   protocols)?                             3 = Some options.
                                                                                           1 = Few options.
                                                                                           0 = No options.
               Application security integration    What out-of-box support is provided Measured by the product's breadth of options for
                                                   for propagating identity to underlying propagating identity to underlying services:
                                                   service implementations? For            5 = Many options.
                                                   integrating the product's security with 3 = Some options.
                                                   the native security models of           1 = Few options.
                                                   underlying application platforms?       0 = No options.

          Administrative tooling and integration   How functional, usable, integrable,      This score is a weighted average of its
                                                   and complete are the product's           subattributes: Management administration,
                                                   administrative interfaces?               Security administration, Management console,
                                                                                            Capacity planning, and Administrative integration.

               Management administration           What service management policies Measured by the richness, breadth, and overall
                                                   and service configuration options do usability of the product's service configuration
                                                   administrative tools provide for        capabilities and interface and the product's
                                                   controlling service operation? What features for role-based access control to
                                                   access control and customization        administrative screens:
                                                   does the product provide for            5 = Advanced configuration options and access
                                                   administration functions (such as role- control.
                                                   based security and customized           3 = Average configuration options and access
                                                   displays)?                              control.
                                                                                           1 = Limited configuration options and access
                                                                                           control.
               Security administration             What service security policy            Measured by the richness, breadth, and overall
                                                   (authentication, authorization,         usability of the product's security configuration
                                                   auditing) and security log              capabilities and interface:
                                                   configuration options do the product's 5 = Advanced configuration options.
                                                   administrative tools provide? Can       3 = Average configuration options.
                                                   security events be logged to a          1 = Limited configuration options.
                                                   separate log?
               Management console                  What range of status and command Measured by the richness, breadth, and overall
                                                   displays does the product provide?      usability of the product's status displays:
                                                   How usable are they?                    5 = Advanced configuration options.
                                                                                           3 = Average configuration options.
                                                                                           1 = Limited configuration options.




© 2006, Forrester Research, Inc.                                                                                                     10
      Forrester SOA And Web Services Management Wave, Q1 2006
      by Randy Heffner                                                                 > View Forrester Wave graphic and custom scores
                                                                                       > Back to "Scores and weightings"

       Control Level of Criteria Detail
       Less                     More

      Evaluation Criteria                         Criteria Explanation                  Scale Explanation
               Capacity planning                  What support does the product         Measured by the depth and breadth of features
                                                  provide for planning capacity of both and resources for planning capacity of managed
                                                  underlying services and the product   services and of the product itself:
                                                  itself?                               5 = Several features and resources.
                                                                                        3 = Some features and resources.
                                                                                        1 = Limited features and resources.
               Administrative integration         What are the integration interfaces   Measured by the product's breadth and depth of
                                                  for programmatic configuration and    integration APIs and options:
                                                  access to metrics data (that is, for  5 = Full APIs for integration, multiple options.
                                                  bypassing the product's user          3 = Basic APIs for integration.
                                                  interfaces and integrating with other 1 = Minimal APIs for integration.
                                                  tools)?                               0 = No APIs for integration.
          Application integration and mediation   What features does the product have This score is a weighted average of its
                                                  for mediating between different       subattributes: Version control, Protocol mediation,
                                                  message formats and protocols used Transformation, Policy-based processing, and
                                                  by service requesters and providers? Other integration.

               Version resolution                 How can the product route an             Measured by the product's depth of
                                                  incoming service request to the          understanding of versioning and its built-in
                                                  correct version of an underlying         (preferred) or configurable capabilities for routing
                                                  service (assuming that multiple          requests to different versions:
                                                  versions of a service can run in         5 = Deep version routing features.
                                                  production at the same time)?            3 = Basic routing based on XML Path Language
                                                                                           (XPath).
                                                                                           1 = Minimal version routing.
                                                                                           0 = No version routing.
               Protocol mediation                 What protocols can the product           Measured by the product's range of support for
                                                  mediate between (when an incoming        transport protocol mediation:
                                                  service request arrives on a different   5 = Extensive protocol mediation.
                                                  protocol than is supported by the        3 = Basic protocol mediation.
                                                  underlying service)?                     1 = Minimal protocol mediation.
                                                                                           0 = No protocol mediation.
               Transformation                     What capabilities does the product       Measured by the product's range of support for
                                                  provide for resolving between            message transformation:
                                                  different syntax and semantics of        5 = Extensive transformation features.
                                                  incoming request formats and             3 = Basic transformation features.
                                                  formats supported by underlying          1 = Minimal transformation features.
                                                  services?                                0 = No transformation features.
               Policy-based processing            How can the product process service      Measured by the product's features and flexibility
                                                  requests differently based on            for configuring business policy-based routing:
                                                  business parameters for service          5 = Deep features.
                                                  policy (for example, priority            3 = Basic features.
                                                  processing for premium customers or      1 = Minimal features.
                                                  alternate routing for requests from a    0 = No features.
                                                  particular source)? How flexible is the
                                                  architecture for policy-based
                                                  processing?
               Other integration                  Does the product provide any            Measured by the depth and importance of any
                                                  additional application adaptation and additional features for application integration:
                                                  integration capabilities?               5 = Deep features.
                                                                                          3 = Basic features.
                                                                                          1 = Minimal features.
                                                                                          0 = No features.
          Deployment management                   How does the product control            This score is a weighted average of its
                                                  deployment of its own artifacts and     subattributes: Deployment artificats, Deployment
                                                  integrate its deployments with other package configuration, Rollback, Environment
                                                  service infrastructure?                 staging, and Deployment integration.


© 2006, Forrester Research, Inc.                                                                                                      11
      Forrester SOA And Web Services Management Wave, Q1 2006
      by Randy Heffner                                                                         > View Forrester Wave graphic and custom scores
                                                                                               > Back to "Scores and weightings"

       Control Level of Criteria Detail
       Less                     More

      Evaluation Criteria                              Criteria Explanation                       Scale Explanation
               Deployment artifacts                    For what application and service           Measured by the depth and breadth of service
                                                       artifacts can the product control          deployment features:
                                                       production deployment? Across what         5 = Deep features.
                                                       range of network and infrastructure        3 = Basic features.
                                                       topologies?                                1 = Minimal features.
                                                                                                  0 = No features.
               Deployment package configuration        What are the capabilities for              Measured by the richness of the product's service
                                                       specifying a group of artifacts to be      packaging structures:
                                                       deployed to production as a unit?          5 = Deep features.
                                                                                                  3 = Basic features.
                                                                                                  1 = Minimal features.
                                                                                                  0 = No features.
               Rollback                                How does the product undo past             Measured by the richness of the product's
                                                       production deployments and restore         rollback capabilities:
                                                       the prior configuration?                   5 = Deep features.
                                                                                                  3 = Basic features.
                                                                                                  1 = Minimal features.
                                                                                                  0 = No features.
               Environment staging                     What is the product's support for          Measured by the richness of the product's
                                                       multiple staging environments (such        environment staging capabilities:
                                                       as test, system test, production),         5 = Deep features.
                                                       including deployment and rollback          3 = Basic features.
                                                       between them?                              1 = Minimal features.
                                                                                                  0 = No features.
               Deployment integration                  How can the product's deployment           Measured by the range of options for creating
                                                       capabilities be integrated with other      integrated service deployment solutions:
                                                       products' deployment features (to          5 = Deep features.
                                                       achieve a larger-scale unified             3 = Basic features.
                                                       deployment)?                               1 = Minimal features.
                                                                                                  0 = No features.
          Alerting, events, and exception management   What range of options does the             This score is a weighted average of its
                                                       product have for responding to             subattributes: Alerting methods, Alert and event
                                                       events and exceptions?                     specification, Autoresponse, and Exception
                                                                                                  management tools.
               Alerting methods                        What channels are provided for             Measured by the range of options for sending
                                                       notification of IT and business-level      alerts and notifications:
                                                       events, exceptions, and alerts (email,     5 = Many options.
                                                       IM, SNMP trap, event integration           3 = Some options.
                                                       features, others)?                         1 = Minimal options.
                                                                                                  0 = No options.
               Alert and event specification           What tools does the product provide        Measured by the depth and breadth of features
                                                       for specifying alert and event criteria?   for specifying alerts:
                                                       How usable are the tools?                  5 = Deep features.
                                                                                                  3 = Basic features.
                                                                                                  1 = Minimal features.
                                                                                                  0 = No features.
               Autoresponse                            How does the product configure             Measured by the depth and breadth of features
                                                       automatic responses to exception           for initiating autoresponse actions:
                                                       conditions?                                5 = Deep features.
                                                                                                  3 = Basic features.
                                                                                                  1 = Minimal features.
                                                                                                  0 = No features.
               Exception management tools              What tools does the product provide        Measured by the depth and breadth of features
                                                       for displaying request processing          for handling service exceptions and errors:
                                                       exceptions, correcting messages,           5 = Deep features.
                                                       and resubmitting them?                     3 = Basic features.
                                                                                                  1 = Minimal features.
                                                                                                  0 = No features.

© 2006, Forrester Research, Inc.                                                                                                          12
      Forrester SOA And Web Services Management Wave, Q1 2006
      by Randy Heffner                                                                       > View Forrester Wave graphic and custom scores
                                                                                             > Back to "Scores and weightings"

       Control Level of Criteria Detail
       Less                     More

      Evaluation Criteria                            Criteria Explanation                      Scale Explanation
          Logging and auditing                       How integrable, secure, and               This score is a weighted average of its
                                                     auditable are the product's               subattributes: Logging levels, Log integration, Log
                                                     operational logs?                         integrity, Audit tools, and Diagnostic tools.
               Logging levels                        How many logging levels does the          Measured by the depth and configurability of
                                                     product provide? How detailed can         logging:
                                                     logging be? How configurable is the       5 = Deep features.
                                                     content of the log?                       3 = Basic features.
                                                                                               1 = Minimal features.
                                                                                               0 = No features.
               Log integration                       Can the product 1) integrate its          Measured by the range of options for log
                                                     logging with that of other service        integration:
                                                     infrastructure or 2) act as a central     5 = Many options.
                                                     logging service for other SOA             3 = Some options.
                                                     infrastructure?                           1 = Minimal options.
                                                                                               0 = No options.
               Log integrity                         What does the product provide for         Measured by the depth of features for ensuring
                                                     ensuring the integrity of individual      log integrity:
                                                     logs and of a series of log files (such   5 = Deep features.
                                                     as signed, chained logs)?                 3 = Basic features.
                                                                                               1 = Minimal features.
                                                                                               0 = No features.
               Audit tools                           What capabilities does the product        Measured by the depth of features for log review
                                                     provide for auditing and reviewing log    and integration of external audit tools:
                                                     contents (or support for external         5 = Deep features.
                                                     auditing tools)?                          3 = Basic features.
                                                                                               1 = Minimal features.
                                                                                               0 = No features.
               Diagnostic tools                      What tools does the product provide       Measured by the breadth of diagnostic tool
                                                     for diagnosing service processing         functions:
                                                     problems?                                 5 = Deep functionality.
                                                                                               3 = Basic functionality.
                                                                                               1 = Minimal functionality.
                                                                                               0 = No functionality.
          Support for standards and specifications   What standards does the product           This score is a weighted average of its
                                                     support?                                  subattributes: Core Web services support,
                                                                                               Management support, Security token support,
                                                                                               Security support, Advanced Web services
                                                                                               support, and Other standards.
               Core Web services support             What basic Web services                   Measured by the breadth of standards support:
                                                     specifications and standards does         5 = Broad support.
                                                     the product support (including SOAP,      3 = Average support.
                                                     WSDL, UDDI, WS-I Basic Profile,           1 = Minimal support.
                                                     XML Schema, WS-I Attachments              0 = No support.
                                                     Profile, WS-BPEL, WS-
                                                     Choreography, XSLT, others)?
               Management support                    What management specifications            Measured by the breadth of standards support:
                                                     and standards does the product            5 = Broad support.
                                                     support (including WSDM-MOWS,             3 = Average support.
                                                     WSDM-MUWS, WS-Management,                 1 = Minimal support.
                                                     SNMP, others)?                            0 = No support.
               Security token support                What security token specifications        Measured by the breadth of standards support:
                                                     and standards does the product            5 = Broad support.
                                                     support (username-password, x.509,        3 = Average support.
                                                     SAML, Kerberos, XRML, others)?            1 = Minimal support.
                                                                                               0 = No support.




© 2006, Forrester Research, Inc.                                                                                                        13
      Forrester SOA And Web Services Management Wave, Q1 2006
      by Randy Heffner                                                              > View Forrester Wave graphic and custom scores
                                                                                    > Back to "Scores and weightings"

       Control Level of Criteria Detail
       Less                     More

      Evaluation Criteria                      Criteria Explanation                    Scale Explanation
               Security protocol support       What security protocol specifications   Measured by the breadth of standards support:
                                               and standards does the product          5 = Broad support.
                                               support (WS-Security: SOAP              3 = Average support.
                                               Message Security, Liberty ID-FF,        1 = Minimal support.
                                               Liberty ID-WSF, WS-I Basic Security     0 = No support.
                                               Profile, WS-Policy, WS-Trust, WS-
                                               SecurityPolicy, WS-
                                               PolicyAttachments, WS-Federation,
                                               WS-SecureConversation, XML
                                               Encryption, XML Signature,
                                               SSL/TLS, HTTP basic authentication,
                                               others)?
               Advanced Web services support   What advanced Web services              Measured by the breadth of standards support:
                                               specifications and standards does       5 = Broad support.
                                               the product support (WS-Reliability,    3 = Average support.
                                               WS-Addressing, WS-Eventing, WS-         1 = Minimal support.
                                               ReliableExchange, WS-                   0 = No support.
                                               BusinessActivity, WS-
                                               AtomicTransactions, WS-CAF (WS-
                                               CF, WS-TXM, WS-CTX), Fast
                                               Infoset, Message Transmission
                                               Optimization Mechanism (MTOM),
                                               BEEP, WS-MetadataExchange, WS-
                                               Notification, ASAP, WS-Discovery,
                                               others)?
               Other standards                 What other SOA, management, and         Measured by the breadth of standards support:
                                               messaging related standards does        5 = Broad support.
                                               the product support (Java Message       3 = Average support.
                                               Service, IIOP, Java RMI, JMX,           1 = Minimal support.
                                               others)?                                0 = No support.
          Other product features               What other generally useful features    This score is a weighted average of its
                                               does the product have?                  subattributes: Core SOA management features
                                                                                       and Other features.
               Core SOA management features    Are there additional features that      Measured by the depth and importance of any
                                               relate directly to service management additional features for SOA management:
                                               and monitoring?                         5 = Deep features.
                                                                                       3 = Basic features.
                                                                                       1 = Minimal features.
                                                                                       0 = No features.
               Other features                  Are there additional ancillary features Measured by the depth and importance of any
                                               (that is, beyond service management additional product features:
                                               and monitoring)?                        5 = Deep features.
                                                                                       3 = Basic features.
                                                                                       1 = Minimal features.
                                                                                       0 = No features.
          Other SOA infrastructure products    What other SOA infrastructure is        Forrester includes this criterion as information for
                                               available as part of the vendor's       clients, therefore this line item is weighted at 0%.
                                               overall product set?                    To place a value on vendors' other SOA products,
                                                                                       clients may add custom weightings, in which case
                                                                                       this score is a weighted average of its
                                                                                       subattributes: Attack protection, Registry-
                                                                                       repository, SOA life-cycle management,
                                                                                       Application development (design), Application
                                                                                       development (coding), Application integration,
                                                                                       Data integration, and Other SOA-related
                                                                                       products.




© 2006, Forrester Research, Inc.                                                                                                 14
      Forrester SOA And Web Services Management Wave, Q1 2006
      by Randy Heffner                                                                 > View Forrester Wave graphic and custom scores
                                                                                       > Back to "Scores and weightings"

       Control Level of Criteria Detail
       Less                     More

      Evaluation Criteria                         Criteria Explanation                     Scale Explanation
               Attack protection                  What other products does the vendor      This line item is intended to be informational and
                                                  have that provide direct SOA and         is therefore weighted at 0%. A score of five is
                                                  Web services support for the attack      given if a vendor has any products to offer, so
                                                  protection side of security?             that Forrester clients can assign a weighting if
                                                                                           they choose to.
               Registry and repository            What products does the vendor have       This line item is intended to be informational and
                                                  for registry and repository functions?   is therefore weighted at 0%. A score of five is
                                                                                           given if a vendor has any products to offer, so
                                                                                           that Forrester clients can assign a weighting if
                                                                                           they choose to.
               SOA life-cycle management          What products does the vendor have       This line item is informational and is therefore
                                                  for overall service life-cycle           weighted at 0%. A score of five is given if a
                                                  management (that is, end-to-end          vendor has any products to offer, so that
                                                  development life-cycle                   Forrester clients can assign a weighting if they
                                                  management)?                             choose to.
               Application development (design)   What other products does the vendor      This line item is informational and is therefore
                                                  have for business modeling, process      weighted at 0%. A score of five is given if a
                                                  modeling, service modeling, and          vendor has any products to offer, so that
                                                  service design?                          Forrester clients can assign a weighting if they
                                                                                           choose to.
               Application development (coding)   What products does the vendor have       This line item is informational and is therefore
                                                  for detailed service development and     weighted at 0%. A score of five is given if a
                                                  administration?                          vendor has any products to offer, so that
                                                                                           Forrester clients can assign a weighting if they
                                                                                           choose to.
               Application integration            What products does the vendor have       This line item is informational and is therefore
                                                  that provide full application            weighted at 0%. A score of five is given if a
                                                  integration features and functions       vendor has any products to offer, so that
                                                  (beyond simple transformation that       Forrester clients can assign a weighting if they
                                                  the product may inherently support)?     choose to.

               Data integration                   What products does the vendor have This line item is informational and is therefore
                                                  for data-level integration?         weighted at 0%. A score of five is given if a
                                                                                      vendor has any products to offer, so that
                                                                                      Forrester clients can assign a weighting if they
                                                                                      choose to.
               Other SOA-related products         What other products does the vendor This line item is informational and is therefore
                                                  have that address other major       weighted at 0%. A score of five is given if a
                                                  requirements for SOA and Web        vendor has any products to offer, so that
                                                  services?                           Forrester clients can assign a weighting if they
                                                                                      choose to.

      STRATEGY
         Product strategy                         What is the vendor's approach to the     This score is a weighted average of its
                                                  SOA management market in terms of        subattributes: SOA and Web services
                                                  near-term plans and long-term            management, Broader SOA infrastructure product
                                                  focus?                                   directions, and Enterprise focus.
               SOA and Web services management    What future enhancements does the        Measured by Forrester's assessment of the
                                                  vendor currently plan for the product    product plans and vision stated by the vendor:
                                                  that would help it score better on       5 = Strong road map in many areas.
                                                  SOA and Web services management          3 = Strong road map in some areas.
                                                  criteria? (That is, all of the Current   1 = Weak road map.
                                                  offering criteria above except the       0 = Vendor hasn't disclosed.
                                                  "Other SOA infrastructure products"
                                                  criterion.)




© 2006, Forrester Research, Inc.                                                                                                     15
      Forrester SOA And Web Services Management Wave, Q1 2006
      by Randy Heffner                                                                      > View Forrester Wave graphic and custom scores
                                                                                            > Back to "Scores and weightings"

       Control Level of Criteria Detail
       Less                     More

      Evaluation Criteria                           Criteria Explanation                        Scale Explanation
               Other SOA infrastructure products    What future product directions has          This line item is informational and is therefore
                                                    the vendor disclosed that would             weighted at 0%. So that Forrester clients can
                                                    move it toward broader and more             assign a weighting if they choose to, Forrester
                                                    complete SOA infrastructure                 has measured the vendor's response based on
                                                    capabilities beyond SOA and Web             the breadth of broader SOA categories that the
                                                    services management? In other               vendor intends to provide products for.
                                                    words, how will it build its cababilities
                                                    in the "Other SOA infrastructure
                                                    products" criterion above?

                 Enterprise focus                   In the vendor's view, what is the full      Measured by Forrester's assessment of the
                                                    scope of enterprise requirements for        vendor's stated understanding of the scope of
                                                    SOA management and SOA                      enterprise-class SOA management:
                                                    infrastructure?                             5 = Strong view of enterprise SOA management
                                                                                                requirements.
                                                                                                3 = Average view of enterprise SOA
                                                                                                requirements.
                                                                                                1 = Weak view of enterprise SOA requirements.
                                                                                                0 = the vendor hasn't disclosed.

          Financial resources to support strategy   Is the vendor profitable? Does the   Measured by Forrester's assessment of public
                                                    company have sufficient funding,     data (which receives greater weight) and vendor
                                                    revenues, profits, and cash flow to  claims as to the resources available for product
                                                    support its strategies?              development and the overall stability of the
                                                                                         vendor:
                                                                                         5 = Clearly sufficient resources and stability from
                                                                                         public data.
                                                                                         3 = Reasonable resources and likely stability from
                                                                                         private data.
                                                                                         1 = Questionable resources and stability (or lack
                                                                                         of data).
          Cost                                      What is the cost of the product?     The score is a weighted average of the scores for
                                                                                         these subattributes: Medium deployment license
                                                                                         cost, Minimum license cost, Maintenance cost,
                                                                                         and Pricing structure.
                 Medium deployment license cost     What would be the total license cost This score is based on the license cost for this
                                                    for a deployment to manage 100       configuration as reported by the vendor:
                                                    separate WSDL interfaces spread      5 = Up to $99,999.
                                                    across 20 servers (four CPUs each) 4 = $100,000 to $199,999.
                                                    with two management consoles?        3 = $200,000 to $399,999.
                                                                                         2 = $400,000 to $699,999.
                                                                                         1 = $700,000 or more.
                                                                                         0 = The vendor hasn't disclosed.
                 Minimum license cost               What would be the total license cost This score is based on the license cost for this
                                                    for a deployment to manage one       configuration as reported by the vendor:
                                                    WSDL interface on one server (two 5 = Up to $49,999.
                                                    CPUs) with one management            4 = $50,000 to $99,999.
                                                    console?                             3 = $100,000 to $149,999.
                                                                                         2 = $150,000 to $199,999.
                                                                                         1 = $200,000 or more.
                                                                                         0 = The vendor hasn't disclosed
                 Maintenance cost                   What is the annual maintenance cost Forrester provides this information to aid our
                                                    structure for this product?          clients' decisions; we give a default score of 0 to
                                                                                         the vendor for this attribute.




© 2006, Forrester Research, Inc.                                                                                                         16
      Forrester SOA And Web Services Management Wave, Q1 2006
      by Randy Heffner                                                            > View Forrester Wave graphic and custom scores
                                                                                  > Back to "Scores and weightings"

       Control Level of Criteria Detail
       Less                     More

      Evaluation Criteria                 Criteria Explanation                      Scale Explanation
               Pricing structure          What are the details of the product's     Forrester provides this information to aid our
                                          pricing structure?                        clients' decisions; we give a default score of 0 to
                                                                                    the vendor for this attribute.

      MARKET PRESENCE
         Installed base                   How large is the vendor's installed       This score is a weighted average of its
                                          base of customers for this product        subattributes: This product, All SOA products,
                                          and for all products?                     New customers, Users on maintenance, and
                                                                                    Reference accounts.
               This product               What is the installed base of             This factor is scored on the number of customer
                                          customers (separate stock tickers)        installations the vendor reports having:
                                          for this product?                         5 = 300 or more.
                                                                                    4 = 100 to 299.
                                                                                    3 = 60 to 99.
                                                                                    2 = 30 to 59.
                                                                                    1 = Five to 29.
                                                                                    0 = Fewer than five or the vendor hasn't
                                                                                    disclosed.

               All SOA products           What is the installed base of             This factor is scored on the number of customer
                                          customers (separate stock tickers)        installations the vendor reports having:
                                          for all of the vendor's SOA products      5 = 2,000 or more.
                                          (including this product and those         4 = 1,000 to 1,999.
                                          listed in the "Other SOA                  3 = 500 to 999.
                                          infrastructure products" criterion        2 = 100 to 499.
                                          above)?                                   1 = 10 to 99.
                                                                                    0 = Fewer than 10 or the vendor hasn't disclosed.


               New customers              How many customers bought or         This factor is scored on the number of customer
                                          upgraded the product during the past installations the vendor reports having:
                                          year?                                5 = 40 or more.
                                                                               4 = 30 to 39.
                                                                               3 = 20 to 29.
                                                                               2 = 10 to 19.
                                                                               1 = Three to nine.
                                                                               0 = Fewer than three or the vendor hasn't
                                                                               disclosed.

               Users on maintenance       What percentage of customers of all This factor is scored on the percentage of
                                          versions of this product are on active customers for all versions of this product that the
                                          maintenance agreements?                vendor reports are on maintenance agreement:
                                                                                 5 = 97% or more.
                                                                                 4 = 90% to 96%.
                                                                                 3 = 80% to 89%.
                                                                                 2 = 70% to 79%.
                                                                                 1 = 60% to 69%.
                                                                                 0 = Less than 60% or the vendor hasn't disclosed.


               Reference accounts         What companies are the major          Forrester provides this information to aid our
                                          reference customers for this product? clients' decisions; we don't score or weight this
                                                                                attribute.




© 2006, Forrester Research, Inc.                                                                                               17
      Forrester SOA And Web Services Management Wave, Q1 2006
      by Randy Heffner                                                          > View Forrester Wave graphic and custom scores
                                                                                > Back to "Scores and weightings"

       Control Level of Criteria Detail
       Less                     More

      Evaluation Criteria                 Criteria Explanation                    Scale Explanation
          Revenue                         What is the vendor's revenue over       This score is based on overall revenue as
                                          the period from Q4 2004 through Q3      reported by the vendor:
                                          2005?                                   5 = More than $1 billion.
                                                                                  4 = $500 million to $1 billion.
                                                                                  3 = $50 million to $499 million.
                                                                                  2 = $10 million to $49 million.
                                                                                  1 = Less than $10 million.
                                                                                  0 = The vendor hasn't disclosed.
          Revenue growth                  What is the vendor's year-over-year     Forrester provides this information to aid our
                                          revenue growth over the period from     clients' decisions; we don't score or weight this
                                          Q3 2004 through Q3 2005?                attribute.

          Systems integrators             What systems integrator partners        This factor is scored on the number of systems
                                          have completed three or more            integrator partners the vendor reports have
                                          deployments of any version of this      completed three or more deployments of this
                                          product in the past 18 months?          product in the past 18 months:
                                                                                  5 = Five or more.
                                                                                  4 = Four.
                                                                                  3 = Three.
                                                                                  2 = Two.
                                                                                  1 = One.
                                                                                  0 = Zero or the vendor hasn't disclosed.
          Services                        How strong are the vendor's             This score is a weighted average of its
                                          implementation and training             subattributes: Implementation engineers and
                                          services?                               Training.
               Implementation engineers   How many employees provide              This factor is scored on the number of employees
                                          implementation services for this        the vendor reports having dedicated to
                                          product?                                implementation services for this product:
                                                                                  5 = 100 or more.
                                                                                  4 = 70 to 99.
                                                                                  3 = 40 to 69.
                                                                                  2 = 20 to 49.
                                                                                  1 = 10 to 19.
                                                                                  0 = Fewer than 10 or the vendor hasn't disclosed.

               Training                   Does the vendor offer classroom,        Measured by how many training channels the
                                          Web-based, and on-site training?        vendor offers:
                                                                                  5 = All three channels.
                                                                                  3 = Two channels.
                                                                                  1 = One channel.
                                                                                  0 = No training offered.
          Employees                       How many engineers does the             This score is a weighted average of its
                                          vendor have dedicated to this           subattributes: Total employees, Dedicated
                                          product? How big is the vendor's        engineers, and Sales staff.
                                          sales presence?
               Total employees            How many employees does the             This factor is scored on the total number of
                                          vendor have?                            employees the vendor reports having:
                                                                                  5 = 10,000 or more.
                                                                                  4 = 300 to 9,999.
                                                                                  3 = 80 to 299.
                                                                                  2 = 40 to 79.
                                                                                  1 = 25 to 39.
                                                                                  0 = Fewer than 25 or the vendor hasn't disclosed.




© 2006, Forrester Research, Inc.                                                                                             18
      Forrester SOA And Web Services Management Wave, Q1 2006
      by Randy Heffner                                                                             > View Forrester Wave graphic and custom scores
                                                                                                   > Back to "Scores and weightings"

       Control Level of Criteria Detail
       Less                     More

      Evaluation Criteria                                    Criteria Explanation                    Scale Explanation
               Dedicated engineers                           How many engineers are dedicated        This factor is scored on the total number of
                                                             to research and development of this     engineers the vendor reports having dedicated to
                                                             product line?                           this product line:
                                                                                                     5 = 300 or more.
                                                                                                     4 = 100 to 299.
                                                                                                     3 = 30 to 99.
                                                                                                     2 = 15 to 29.
                                                                                                     1 = 5 to 14.
                                                                                                     0 = Fewer than five or vendor hasn't disclosed.
               Sales staff                                   How large and how global is the         Measured by size and global footprint of sales
                                                             vendor's sales force? What              organization:
                                                             percentage of the sales force           5 = 100-plus, with global presence.
                                                             supports Europe, Asia Pacific, and      3 = 25 to 99, no global presence.
                                                             Rest of World?                          1 = Less than 25, no global presence.
          Technology partners                                How strongly do technology partners This score is a weighted average of its
                                                             support this product?                   subattributes: License partners, Resellers, and
                                                                                                     Other partners.
               License partners                              What vendors license or bundle this This score is the weighted average of the number
                                                             product?                                of vendors that the vendor reports license or
                                                                                                     bundle this product:
                                                                                                     5 = 10 or more.
                                                                                                     4 = Seven to nine.
                                                                                                     3 = Five or six.
                                                                                                     2 = Three or four.
                                                                                                     1 = One or two.
                                                                                                     0 = Zero or the vendor hasn't disclosed.
               Resellers                                     What firms resell this product?         This score is the weighted average of the number
                                                                                                     of resellers that the vendor reports offer this
                                                                                                     product:
                                                                                                     5 = 20 or more.
                                                                                                     4 = 15 to 19.
                                                                                                     3 = 10 to 14.
                                                                                                     2 = Five to nine.
                                                                                                     1 = One to four.
                                                                                                     0 = Zero or vendor hasn't disclosed.
               Other partners                                What other vendors have modified        Forrester provides this information to aid our
                                                             their products to better integrate with clients' decisions; we score this attribute 0 in all
                                                             this product (as opposed to having      cases.
                                                             only standards-based interop)?


      © 2006, Forrester Research, Inc. All rights reserved. Forrester, Forrester Wave, WholeView 2, Technographics, and Total Economic Impact
      are trademarks of Forrester Research, Inc. All other trademarks are the property of their respective companies. Forrester clients may make
      one attributed copy or slide of each figure contained herein. Additional reproduction is strictly prohibited. For additional reproduction rights
      and usage information, go to www.forrester.com. Information is based on best available resources. Opinions reflect judgment at the time




© 2006, Forrester Research, Inc.                                                                                                                19
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                     > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                       > Back to "Scores and weightings"

 Vendor Scorecard: Actional




                                                                                                                                    Forrester
                                                                                                                                                                    Show Criteria and Scale Explanations




                                                                                                                                    Weightin
  Control Level of Criteria Detail
                                                                                                                                                                    Hide Criteria and Scale Explanations




                                                                                                                                                Score
  Less                     More

 Evaluation Criteria                 Criteria Explanation                     Scale Explanation                                                      Score Explanation




                                                                                                                                    g
 CURRENT OFFERING                                                                                                                       50%     3.55
     Products included               What is the precise product or set of    This item is for information only and is not scored        0%     0.00 Actional offers Actional Looking Glass 6.0 and
                                     products that the vendor offers as its   or weighted.                                                           Actional SOAPstation 6.0.
                                     service-oriented architecture (SOA)
                                     and Web services management
                                     solution?
      IT-level management            How does the product manage              This score is a weighted average of its                   20%     4.30 Actional supports a wide range of service
                                     service performance and availability?    subattributes: Endpoint support, Performance                           endpoint protocols, and it can tie service-level
                                                                              management, Availability management, and                               goals to particular users to create service-level
                                                                              Service-level management.                                              agreements (SLAs). It can incorporate operational
                                                                                                                                                     data from service implementations, and its
                                                                                                                                                     availability management includes service
                                                                                                                                                     heartbeats.
          Endpoint support           What access protocols (SOAP,             Measured by the breadth of support for various            20%     4.00 For Java, Actional supports SOAP and XML over
                                     XML/HTTP, Java Message Service           protocols, payload types, and native agents for                        HTTP, JMS, remote method invocation (RMI),
                                     (JMS), Java RMI, WebSphere MQ,           specific products:                                                     Enterprise Java Beans (EJBs), and calls through
                                     .NET Remoting, others) and service       5 = Broad support.                                                     Java database connectivity (JDBC). For .NET,
                                     implementation technologies (Java        3 = Average support.                                                   Actional supports SOAP and XML over HTTP.
                                     EE, .NET, databases, others) does        1 = Minimal support.                                                   Actional is developing support for ADO.NET, .NET
                                     the product fully monitor? What          0 = No support.                                                        Remoting, and ODBC. Specific products
                                     specific products does the product                                                                              supported are BEA WebLogic, IBM WebSphere,
                                     support?                                                                                                        JBoss, Microsoft IIS, and Systinet Server for
                                                                                                                                                     Java. In addition, the agent development kit
                                                                                                                                                     provides for building custom agents.

          Performance management     How does the product gather, report,     Measured by the breadth and depth of                      30%     4.00 Actional proxies and agents collect data and
                                     and analyze service performance          functionality for gathering, analyzing, and                            analyze it locally for adherence to performance
                                     data, including 1) reporting against     correlating data about service invocations and                         policy. Violations can generate alerts to the
                                     performance goals and 2) correlation     service implementations:                                               central server. Data is periodically sent to the
                                     of performance data across               5 = Deep functionality.                                                central server. Actional's agents can observe and
                                     technology layers within service         3 = Average functionality.                                             integrate data from some layers of service
                                     implementations?                         1 = Minimal functionality.                                             implementations. Actional can understand normal
                                                                              0 = No functionality.                                                  service operation by setting a portion of history
                                                                                                                                                     data as the service's baseline.




© 2006, Forrester Research, Inc.                                                                                                                                                                20
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                       > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                         > Back to "Scores and weightings"

 Vendor Scorecard: Actional




                                                                                                                                      Forrester
                                                                                                                                                                      Show Criteria and Scale Explanations




                                                                                                                                      Weightin
  Control Level of Criteria Detail
                                                                                                                                                                      Hide Criteria and Scale Explanations




                                                                                                                                                  Score
  Less                     More

 Evaluation Criteria                 Criteria Explanation                      Scale Explanation                                                       Score Explanation




                                                                                                                                      g
          Availability management    How does the product gather, report,      Measured by the breadth and depth of                       30%     5.00 When a message causes the Looking Glass
                                     and analyze service availability data,    functionality for identifying, analyzing, and                           server to generate an alert (such as for a policy
                                     including root cause analysis of          correlating availability issues for services and                        violation), Looking Glass proactively gathers data
                                     availability issues across technology     service implementations:                                                about that specific message from all agents and
                                     layers within service                     5 = Deep functionality.                                                 proxies. This data is used to construct a "fault
                                     implementations?                          3 = Average functionality.                                              map," which shows the message's exact path
                                                                               1 = Minimal functionality.                                              through the SOA infrastructure and includes data
                                                                               0 = No functionality.                                                   available from the various technology layers and
                                                                                                                                                       protocols. In addition, Actional provides a
                                                                                                                                                       watchdog feature to monitor service availability.
                                                                                                                                                       Actional provides an "HTTP Get" watchdog and
                                                                                                                                                       an API for creating custom watchdogs.

          Service-level management   How does the product 1) specify           Measured by the breadth and depth of                       20%     4.00 Service-level goals are entered via Actional's user
                                     service-level goals, 2) tie service-      functionality for specifying service-level goals and                    interface and deployed to agents and proxies.
                                     level goals to specific users or groups   SLAs and monitoring and managing operations to                          Service-level goals are based on point-in-time or
                                     to create service-level agreements        maintain service-level goals:                                           aggregate events. Service-level goals may be
                                     (SLAs), 3) monitor and report service-    5 = Deep functionality.                                                 associated with specific customers or groups to
                                     level compliance over time, and 4)        3 = Average functionality.                                              reflect SLAs. Actional's "Service Stabilizers"
                                     automatically adjust service              1 = Minimal functionality.                                              enable automated action to avoid SLA violation.
                                     operations to better achieve SLAs?        0 = No functionality.                                                   For example, the system can be configured so
                                                                                                                                                       that, prior to actual SLA violation, an automated
                                                                                                                                                       action might begin redirecting message traffic to
                                                                                                                                                       an alternate endpoint.
      Business-level management      How does the product provide              This score is a weighted average of its                     5%     3.35 Actional can extract business data from
                                     business insight by extracting and        subattributes: Business activity montioring,                            messages (via XPath) and track the business
                                     reporting data from service request-      Usability by business users, and Integration for                        process state and report both events and
                                     response flows?                           business monitoring.                                                    nonevents via a portal interface. Business data is
                                                                                                                                                       available via database reads and integration APIs.




© 2006, Forrester Research, Inc.                                                                                                                                                                  21
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                               > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                                 > Back to "Scores and weightings"

 Vendor Scorecard: Actional




                                                                                                                                              Forrester
                                                                                                                                                                              Show Criteria and Scale Explanations




                                                                                                                                              Weightin
  Control Level of Criteria Detail
                                                                                                                                                                              Hide Criteria and Scale Explanations




                                                                                                                                                          Score
  Less                     More

 Evaluation Criteria                            Criteria Explanation                       Scale Explanation                                                   Score Explanation




                                                                                                                                              g
          Business activity monitoring (BAM)    How do the product's built-in features     Measured by the breadth and depth of                   30%     3.00 Actional uses XPath to extract business data from
                                                provide business insight from service      functionality for capturing business data from                      message flows, and it stores and analyzes the
                                                operation by extracting, analyzing,        service requests and tying that data to business                    data for reporting key performance indicators.
                                                and reporting on business data             processes:                                                          Actional can be configured to recognize the
                                                contained in the flow of service           5 = Deep functionality.                                             beginning and ending messages of a business
                                                requests and responses? What are           3 = Average functionality.                                          process flow and capture business performance
                                                its capabilities for tying such analysis   1 = Minimal functionality.                                          data in the context of the process. Actional's
                                                to an end-to-end business process          0 = No functionality.                                               tracking of process state includes notification of
                                                flow?                                                                                                          when a process instance is in a state too long and
                                                                                                                                                               measuring, alerting, and triggering corrective
                                                                                                                                                               actions based on elapsed time within a process.


          Usability by business users           How understandable to and usable by Measured by the breadth and depth of                          35%     4.00 Actional's portal interface enables customized,
                                                business staff are the product's        functionality for creating business-oriented                           display-only versions for use by business staff,
                                                business activity monitoring tools?     displays and the extent to which these are usable                      and the data can be filtered based on access
                                                                                        by business staff:                                                     rights and preferences of particular user roles.
                                                                                        5 = Deep functionality.                                                Tech-savvy business analysts could use display
                                                                                        3 = Average functionality.                                             configuration tools to customize business
                                                                                        1 = Minimal functionality.                                             screens.
                                                                                        0 = No functionality.
          Integration for business monitoring   What are the data capture methods Measured by the breadth of options by which                     35%     3.00 Collected data is stored in an external database
                                                and configuration options for feeding other products can get business activity data                            and is available for access. In addition, Actional
                                                data to other analysis tools (BAM,      captured by the product:                                               provides integration APIs for other products to pull
                                                data warehousing, others)?              5 = Deep integration options.                                          business data.
                                                                                        3 = Average integration options.
                                                                                        1 = Minimal integration options.
                                                                                        0 = No integration options.
      Product architecture                      How robust is the product's overall     This score is a weighted average of its                   15%     3.00 Actional provides both proxies and native agents
                                                architecture, including its integration subattributes: Deployment styles and                                   for several platforms. Its service model is not
                                                with development life-cycle             requirements, metamodel for services and                               extensible. It has some out-of-the-box enterprise
                                                management infrastructure?              processes, Enterprise management integration,                          management and development life-cycle
                                                                                        Metadata and repository integration, Development                       integration. It has average capabilities for service
                                                                                        life-cycle integration, Load balancing and                             failover and load balancing.
                                                                                        scalability (product), Load balancing and
                                                                                        scalability (service), Failover (product), Dynamic
                                                                                        reconfiguration, and Performance-specific
                                                                                        features.




© 2006, Forrester Research, Inc.                                                                                                                                                                          22
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                               > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                                 > Back to "Scores and weightings"

 Vendor Scorecard: Actional




                                                                                                                                              Forrester
                                                                                                                                                                              Show Criteria and Scale Explanations




                                                                                                                                              Weightin
  Control Level of Criteria Detail
                                                                                                                                                                              Hide Criteria and Scale Explanations




                                                                                                                                                          Score
  Less                     More

 Evaluation Criteria                             Criteria Explanation                      Scale Explanation                                                   Score Explanation




                                                                                                                                              g
          Deployment styles and requirements     What are the options for deployment       Measured by the breadth of deployment options          20%     4.00 Looking Glass provides the core of Actional's
                                                 of monitoring elements (such as           and depth of integration with numerous service                      architecture, including the central management
                                                 agent, proxy, inline, tool kit for        endpoint technologies:                                              server, endpoint agents (called "Ghost Agents,"
                                                 embedding an agent in an                  5 = Broad deployment options.                                       these provide data collection and policy
                                                 application, others)? What servers or     3 = Average deployment options.                                     enforcement), a browser-based management
                                                 other infrastructure are required?        1 = Limited deployment options.                                     console, and business-oriented dashboards.
                                                                                                                                                               SOAPstation supplements this with an SOA
                                                                                                                                                               management proxy layer (SOAPstation can also
                                                                                                                                                               be deployed in a standalone mode). Native ghost
                                                                                                                                                               agents are provided for BEA WebLogic,
                                                                                                                                                               WebSphere, JBoss, SAP NetWeaver, and .NET
                                                                                                                                                               (IIS). In addition, built-in ghost agents are
                                                                                                                                                               provided in products from Cisco Systems,
                                                                                                                                                               Reactivity, and Sarvega (acquired by Intel).
          Metamodel for services and processes   What is the underlying structure,         Measured by the breadth and extensibility of the       20%     2.00 Actional's service model is built in and not
                                                 extensibility, and integrability of the   product's metamodels for services and their                         extensible, but the product can be extended to
                                                 product's service and process model,      surrounding context (processes, infrastructure,                     monitor additional resources through its agent
                                                 including 1) the metamodel for            etc.):                                                              software development kits (SDKs).
                                                 defining both services and the            5 = Broad and highly extensible model.
                                                 processes into which they fit and 2)      3 = Basic model with some extensibility.
                                                 the breadth of different technologies     1 = Narrow model with no extensibility.
                                                 included in the model?
          Enterprise management integration      How does the product integrate with       Measured by the breadth of options for and the         20%     2.00 Actional can send Simple Network Management
                                                 enterprise IT management                  extent of prebuilt integration with enterprise                      Protocol (SNMP) traps to enterprise management
                                                 infrastructure, particularly to achieve   infrastructure management solutions:                                products. In addition, Actional provides two
                                                 a correlated view of 1) all technology    5 = Deep standards-based and prebuilt                               software development kits (SDKs) that may be
                                                 layers of a service implementation        integration.                                                        used to build deeper enterprise management.
                                                 and 2) all technologies that affect the   3 = Basic integration.                                              First, there is an agent SDK (Java, C++, and C#)
                                                 health of a given business process?       1 = Minimal integration.                                            for creating new agents for additional endpoints
                                                                                           0 = No integration.                                                 and technology layers. Second, there is an SDK
                                                                                                                                                               for creating custom alert notifiers (Java and C#)
                                                                                                                                                               that can be plugged into Actional's alerting
                                                                                                                                                               engine. Actional has specific product integration
                                                                                                                                                               with Wily Technology Introscope, Microsoft
                                                                                                                                                               Operations Manager, and Mercury Interactive
                                                                                                                                                               SiteScope.




© 2006, Forrester Research, Inc.                                                                                                                                                                          23
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                               > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                                 > Back to "Scores and weightings"

 Vendor Scorecard: Actional




                                                                                                                                              Forrester
                                                                                                                                                                              Show Criteria and Scale Explanations




                                                                                                                                              Weightin
  Control Level of Criteria Detail
                                                                                                                                                                              Hide Criteria and Scale Explanations




                                                                                                                                                          Score
  Less                     More

 Evaluation Criteria                                 Criteria Explanation                    Scale Explanation                                                 Score Explanation




                                                                                                                                              g
          Metadata and repository integration        How does the product share              Measured by the breadth of options for and the        5%     4.00 Actional can synchronize its service data with that
                                                     metadata with other products (import,   extent of prebuilt integration with service                       of a UDDI registry. The synchronization is
                                                     export, common repository)?             repositories (UDDI and others):                                   bidirectional in that a service may be initially
                                                                                             5 = Deep standards-based and prebuilt                             defined to either UDDI or Actional. In addition, this
                                                                                             integration.                                                      synchronization includes service dependencies,
                                                                                             3 = Basic integration.                                            service metrics, and WS-Policy specifications as
                                                                                             1 = Minimal integration.                                          well (with Systinet Registry 6.5 and Systinet's
                                                                                             0 = No integration.                                               Blizzard platform).
          Development life-cycle integration         How does the product integrate with Measured by the breadth and depth of feature-             5%     4.00 Actional can import WSDL and XML schema
                                                     development tools, repositories, and function for development life-cycle integration:                     definitions. Through Actional's UDDI
                                                     SOA governance solutions? In            5 = Deep integration.                                             synchronization and integration with Systinet
                                                     particular: 1) for deployment, how      3 = Basic integration.                                            Registry, Actional supports Systinet's governance
                                                     does the product import development 1 = Minimal integration.                                              capabilities, and Actional can populate service
                                                     tool definitions of service             0 = No integration.                                               history data in the registry for use by service
                                                     implementation structure and service                                                                      developers. Actional can identify unregistered
                                                     relationships and 2) for guiding future                                                                   services that are operating in production and
                                                     development, how does the product                                                                         submit them to Systinet's publishing approval
                                                     provide developers with an integrated                                                                     system. Actional synchronizes service metrics
                                                     view of service configuration and                                                                         with Systinet Registry. Developers can also view
                                                     operations history?                                                                                       service history through the product's management
                                                                                                                                                               console and its historical displays.

          Load balancing and scalability (product)   What is the architecture for sharing a Measured by the extent to which all product            5%     3.00 Actional's Looking Glass server and SOAPstation
                                                     workload across multiple product       elements may participate in a load balancing                       may be deployed in clusters, and configuration
                                                     instances?                             architecture:                                                      data (but not service metrics) are replicated
                                                                                            5 = Deep load balancing abilities.                                 between servers. Communication between
                                                                                            3 = Basic load balancing abilities.                                product elements is over HTTP, enabling the use
                                                                                            1 = Minimal load balancing abilities.                              of network load balancing.
                                                                                            0 = No load balancing abilities.
          Load balancing and scalability (service)   How does the product load balance      Measured by the breadth and depth of feature-          5%     2.00 SOAPstation proxies (but not Actional's ghost
                                                     incoming service requests across       function for service load balancing:                               agents) can load balance across service
                                                     multiple underlying instances of a     5 = Deep features.                                                 instances using round robin or least loaded
                                                     service?                               3 = Basic features.                                                algorithms.
                                                                                            1 = Minimal features.
                                                                                            0 = No features.
          Failover (product)                         What is the architecture for failing   Measured by the extent to which all product            5%     3.00 Looking Glass server and SOAPstation rely on
                                                     over a workload from one product       elements may participate in a failover                             load balancing hardware to detect failures and
                                                     instance to another?                   architecture:                                                      route requests to alternate product instances.
                                                                                            5 = Deep failover abilities.                                       Agents rely on the failover strategy of the
                                                                                            3 = Basic failover abilities.                                      containers into which they are deployed. Proxies
                                                                                            1 = Minimal failover abilities.                                    can be clustered for redundancy.
                                                                                            0 = No failover abilities.

© 2006, Forrester Research, Inc.                                                                                                                                                                          24
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                         > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                           > Back to "Scores and weightings"

 Vendor Scorecard: Actional




                                                                                                                                        Forrester
                                                                                                                                                                        Show Criteria and Scale Explanations




                                                                                                                                        Weightin
  Control Level of Criteria Detail
                                                                                                                                                                        Hide Criteria and Scale Explanations




                                                                                                                                                    Score
  Less                     More

 Evaluation Criteria                      Criteria Explanation                      Scale Explanation                                                    Score Explanation




                                                                                                                                        g
          Failover (service)              How does the product manage               Measured by the breadth and depth of feature-            5%     4.00 Upon detecting a nonresponsive service instance,
                                          failover from one instance of a           function for service failover:                                       Actional will cease to deliver service requests to it
                                          service to another? Does the product      5 = Deep features.                                                   (and take it out of the load balancing rotation) and
                                          monitor services using heartbeats?        3 = Basic features.                                                  can start routing requests to an alternate service
                                                                                    1 = Minimal features.                                                instance. To improve the efficiency of this
                                                                                    0 = No features.                                                     process, Actional provides a heartbeat
                                                                                                                                                         architecture that services may implement to
                                                                                                                                                         enable proactive discovery of failed services.

          Dynamic reconfiguration         What product configuration options,       Measured by the product's features and design for       10%     4.00 No service configuration changes require a
                                          when changed, require a product           performing service configuration changes, product                    product restart. Agents and proxies may be
                                          restart (such as performing product       configuration changes, and product upgrades with                     installed and upgraded on the fly and, because
                                          upgrades, adding/removing                 no downtime:                                                         they cache policy and metrics locally, agents and
                                          management server instances or            5 = Deep features.                                                   proxies will continue to run without the central
                                          management consoles, etc.)?               3 = Basic features.                                                  servers. In this way, Actional explicitly focuses on
                                                                                    1 = Minimal features.                                                the design goal of enabling a no-downtime rolling
                                                                                    0 = No features.                                                     upgrade from one Actional version to another by
                                                                                                                                                         first upgrading the agents and then upgrading the
                                                                                                                                                         central servers. Actional's design goal is for the
                                                                                                                                                         central servers to support agents that are one
                                                                                                                                                         level back.
          Performance-specific features   What product features are specifically Because performance is best measured via direct             0%     0.00 Actional's agents directly read the application
                                          intended as performance-enhancing tests, this item is not scored or weighted, but                              platform’s security credentials and other data,
                                          options (such as persistent network rather simply provided for information.                                    reducing the amount of message parsing. Actional
                                          connections)?                                                                                                  employs incremental XML parsing, pooling of
                                                                                                                                                         network connections (HTTP, database, directory),
                                                                                                                                                         credential caching, and message throttling (the
                                                                                                                                                         ability to give priority to certain messages, such
                                                                                                                                                         as requests from premium customers).

      Trust enablement                    How rich are the product's features       This score is a weighted average of its                 10%     4.20 Actional has broad support for different types of
                                          for establishing trust and fitting with   subattributes: Authentication/authorization,                         authentication, including broad support for
                                          an overall architecture for trust         Identity management integration, Encryption and                      external identity management products and good
                                          management?                               signatures, Identity propagation, and Application                    support for identity propagation.
                                                                                    security integration.




© 2006, Forrester Research, Inc.                                                                                                                                                                    25
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                              > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                                > Back to "Scores and weightings"

 Vendor Scorecard: Actional




                                                                                                                                             Forrester
                                                                                                                                                                             Show Criteria and Scale Explanations




                                                                                                                                             Weightin
  Control Level of Criteria Detail
                                                                                                                                                                             Hide Criteria and Scale Explanations




                                                                                                                                                         Score
  Less                     More

 Evaluation Criteria                           Criteria Explanation                     Scale Explanation                                                     Score Explanation




                                                                                                                                             g
          Authentication and authorization     For managed services, what               Measured by the product's built-in features for          20%     4.00 Transport-level authentication is via HTTP basic
                                               authentication protocols, token types,   authentication and authorization:                                     authentication or two-way SSL. Message-level
                                               and authorization styles and policies    5 = Deep features.                                                    authentication is via WS-Security (Security
                                               (such as role-based access control)      3 = Basic features.                                                   Assertion Markup Language (SAML), username,
                                               does the product support?                1 = Minimal features.                                                 X.509), CA eTrust SiteMinder token, or Oracle
                                                                                        0 = No features.                                                      COREid (formerly NetPoint) token. Actional's
                                                                                                                                                              service configuration screens provide strong
                                                                                                                                                              integration with role-based access integration with
                                                                                                                                                              identity management products.

          Identity management integration      To what identity management             Measured by the product's breadth and depth of            40%     5.00 Actional can delegate to LDAP (authentication
                                               infrastructure products can the         integration with identity management platforms for                     only), XKMS, CA eTrust SiteMinder, Oracle
                                               product delegate authentication and     authentication and authorization:                                      COREid (formerly Oblix NetPoint), IBM Tivoli
                                               authorization decisions (including      5 = Deep integration.                                                  Access Manager, SunONE Identity Server, HP
                                               LDAP and other directories)?            3 = Basic integration.                                                 OpenView Select Access, and RSA ClearTrust.
                                                                                       1 = Minimal integration.
                                                                                       0 = No integration.
          Encryption and signatures            What encryption and digital signature Measured by the product's breadth of options for            20%     3.00 Actional supports message-level encryption and
                                               options does the product support        providing encryption and signatures using the                          signatures through WS-Security's support for
                                               (transport-level, message-level,        product:                                                               these.
                                               message element-level, various          5 = Many options.
                                               protocols)?                             3 = Some options.
                                                                                       1 = Few options.
                                                                                       0 = No options.
          Application security integration     What out-of-box support is provided Measured by the product's breadth of options for              20%     4.00 Actional can pass through any security tokens
                                               for propagating identity to underlying propagating identity to underlying services:                            present in an incoming request. It can perform
                                               service implementations? For            5 = Many options.                                                      role-based credential mapping into outbound
                                               integrating the product's security with 3 = Some options.                                                      messages, and it can convert between token
                                               the native security models of           1 = Few options.                                                       types (username, X.509, binary, and SAML
                                               underlying application platforms?       0 = No options.                                                        tokens). It does not populate native security
                                                                                                                                                              session contexts.
      Administrative tooling and integration   How functional, usable, integrable,      This score is a weighted average of its                  10%     4.50 Actional has strong tooling for administration (both
                                               and complete are the product's           subattributes: Management administration,                             management and security) and a strong
                                               administrative interfaces?               Security administration, Management console,                          management console. It has full APIs for custom
                                                                                        Capacity planning, and Administrative integration.                    management integration.




© 2006, Forrester Research, Inc.                                                                                                                                                                         26
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                    > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                      > Back to "Scores and weightings"

 Vendor Scorecard: Actional




                                                                                                                                   Forrester
                                                                                                                                                                   Show Criteria and Scale Explanations




                                                                                                                                   Weightin
  Control Level of Criteria Detail
                                                                                                                                                                   Hide Criteria and Scale Explanations




                                                                                                                                               Score
  Less                     More

 Evaluation Criteria                  Criteria Explanation                    Scale Explanation                                                     Score Explanation




                                                                                                                                   g
          Management administration   What service management policies        Measured by the richness, breadth, and overall           30%     5.00 Actional's service configuration features include
                                      and service configuration options do usability of the product's service configuration                         security, access control, routing, transformation,
                                      administrative tools provide for        capabilities and interface and the product's                          monitoring, alerts, and automatic responses. In
                                      controlling service operation? What features for role-based access control to                                 addition to specifying service-level goals, Actional
                                      access control and customization        administrative screens:                                               can specify SLAs by defining different service-
                                      does the product provide for            5 = Advanced configuration options and access                         level goals for different customers or groups.
                                      administration functions (such as role- control.                                                              Access to console functions can be controlled by
                                      based security and customized           3 = Average configuration options and access                          role. In addition, Actional allows administrators to
                                      displays)?                              control.                                                              have access to only their own services, which
                                                                              1 = Limited configuration options and access                          may help in controlling a large base of services
                                                                              control.                                                              that are managed by different teams or
                                                                                                                                                    customers. Services are initially entered into
                                                                                                                                                    Actional via autodiscovery rather than by manual
                                                                                                                                                    entry. Actional is able to autodiscover services
                                                                                                                                                    and discover dependency relationships between
                                                                                                                                                    services either by analyzing the flow of messages
                                                                                                                                                    or through user configuration of correlation keys.


          Security administration     What service security policy             Measured by the richness, breadth, and overall          25%     4.00 Actional's user interface is used for maintaining
                                      (authentication, authorization,          usability of the product's security configuration                    authentication, authorization, and other security
                                      auditing) and security log               capabilities and interface:                                          policies. Security policies are configured
                                      configuration options do the product's   5 = Advanced configuration options.                                  independently and then applied to services in a
                                      administrative tools provide? Can        3 = Average configuration options.                                   subsequent step, allowing for greater scalability of
                                      security events be logged to a           1 = Limited configuration options.                                   security-policy maintenance. Security events are
                                      separate log?                                                                                                 logged together with administrative events, but
                                                                                                                                                    Actional's log viewing tools allow filtering of
                                                                                                                                                    display so as to isolate security (or other) events.

          Management console          What range of status and command         Measured by the richness, breadth, and overall          25%     5.00 The Looking Glass console provides real-time and
                                      displays does the product provide?       usability of the product's status displays:                          historical displays via a rich GUI interface and will
                                      How usable are they?                     5 = Advanced configuration options.                                  be moving to a browser interface in the next
                                                                               3 = Average configuration options.                                   version. Status displays include alerts status,
                                                                               1 = Limited configuration options.                                   warning status, and dependency graphs between
                                                                                                                                                    services, with drill-down tools for the status of
                                                                                                                                                    message flows between services and for the
                                                                                                                                                    specific message paths of messages that errored
                                                                                                                                                    out. The tools provide multiple means of filtering
                                                                                                                                                    service displays and can also report on service
                                                                                                                                                    usage by particular customers and groups.




© 2006, Forrester Research, Inc.                                                                                                                                                               27
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                           > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                             > Back to "Scores and weightings"

 Vendor Scorecard: Actional




                                                                                                                                          Forrester
                                                                                                                                                                          Show Criteria and Scale Explanations




                                                                                                                                          Weightin
  Control Level of Criteria Detail
                                                                                                                                                                          Hide Criteria and Scale Explanations




                                                                                                                                                      Score
  Less                     More

 Evaluation Criteria                          Criteria Explanation                  Scale Explanation                                                      Score Explanation




                                                                                                                                          g
          Capacity planning                   What support does the product         Measured by the depth and breadth of features              5%     3.00 For managed services, Actional provides its
                                              provide for planning capacity of both and resources for planning capacity of managed                         standard historical reports for use in capacity
                                              underlying services and the product   services and of the product itself:                                    planning. Integration with Wily Introscope
                                              itself?                               5 = Several features and resources.                                    provides data for planning the capacity of
                                                                                    3 = Some features and resources.                                       Actional's product.
                                                                                    1 = Limited features and resources.
          Administrative integration          What are the integration interfaces   Measured by the product's breadth and depth of            15%     4.00 One hundred percent of Actional's service
                                              for programmatic configuration and    integration APIs and options:                                          configuration and service history data are
                                              access to metrics data (that is, for  5 = Full APIs for integration, multiple options.                       available through Web services APIs.
                                              bypassing the product's user          3 = Basic APIs for integration.
                                              interfaces and integrating with other 1 = Minimal APIs for integration.
                                              tools)?                               0 = No APIs for integration.
      Application integration and mediation   What features does the product have This score is a weighted average of its                      5%     3.05 Actional has relatively strong features for version
                                              for mediating between different       subattributes: Version control, Protocol mediation,                    resolution though limited features for protocol
                                              message formats and protocols used Transformation, Policy-based processing, and                              mediation. Its transformation and policy-based
                                              by service requesters and providers? Other integration.                                                      processing features are good.

          Version resolution                  How can the product route an           Measured by the product's depth of understanding         40%     4.00 Actional can use XPath and Extensible Stylesheet
                                              incoming service request to the        of versioning and its built-in (preferred) or                         Language Transformation (XSLT) to route service
                                              correct version of an underlying       configurable capabilities for routing requests to                     requests to the appropriate version, including the
                                              service (assuming that multiple        different versions:                                                   ability to route based on the requesting customer
                                              versions of a service can run in       5 = Deep version routing features.                                    or group. In addition, Actional's tooling includes
                                              production at the same time)?          3 = Basic routing based on XML Path Language                          specific features for versioning of service policies
                                                                                     (XPath).                                                              and configuration of routing between different
                                                                                     1 = Minimal version routing.                                          versions.
                                                                                     0 = No version routing.
          Protocol mediation                  What protocols can the product         Measured by the product's range of support for           20%     2.00 Actional can mediate either direction between
                                              mediate between (when an incoming transport protocol mediation:                                              HTTP and JMS transports.
                                              service request arrives on a different 5 = Extensive protocol mediation.
                                              protocol than is supported by the      3 = Basic protocol mediation.
                                              underlying service)?                   1 = Minimal protocol mediation.
                                                                                     0 = No protocol mediation.
          Transformation                      What capabilities does the product     Measured by the product's range of support for           15%     3.00 Actional can apply XSLT transforms to messages.
                                              provide for resolving between          message transformation:                                               It bundles an unlimited license to the Contivo
                                              different syntax and semantics of      5 = Extensive transformation features.                                Analyst tool for authoring XSLT.
                                              incoming request formats and           3 = Basic transformation features.
                                              formats supported by underlying        1 = Minimal transformation features.
                                              services?                              0 = No transformation features.




© 2006, Forrester Research, Inc.                                                                                                                                                                      28
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                             > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                               > Back to "Scores and weightings"

 Vendor Scorecard: Actional




                                                                                                                                            Forrester
                                                                                                                                                                            Show Criteria and Scale Explanations




                                                                                                                                            Weightin
  Control Level of Criteria Detail
                                                                                                                                                                            Hide Criteria and Scale Explanations




                                                                                                                                                        Score
  Less                     More

 Evaluation Criteria                         Criteria Explanation                      Scale Explanation                                                     Score Explanation




                                                                                                                                            g
          Policy-based processing            How can the product process service       Measured by the product's features and flexibility       15%     4.00 Actional can use XPath to classify incoming
                                             requests differently based on             for configuring business policy-based routing:                        requests according to customer or group, and it
                                             business parameters for service           5 = Deep features.                                                    can also read attributes from LDAP or other user
                                             policy (for example, priority             3 = Basic features.                                                   repositories and apply routing rules based on the
                                             processing for premium customers or       1 = Minimal features.                                                 data retrieved.
                                             alternate routing for requests from a     0 = No features.
                                             particular source)? How flexible is the
                                             architecture for policy-based
                                             processing?
          Other integration                  Does the product provide any              Measured by the depth and importance of any              10%     0.00 No features.
                                             additional application adaptation and     additional features for application integration:
                                             integration capabilities?                 5 = Deep features.
                                                                                       3 = Basic features.
                                                                                       1 = Minimal features.
                                                                                       0 = No features.
      Deployment management                  How does the product control              This score is a weighted average of its                   5%     2.25 Actional's deployment is via import-export of only
                                             deployment of its own artifacts and       subattributes: Deployment artificats, Deployment                      its own artifacts, although it provides APIs and a
                                             integrate its deployments with other      package configuration, Rollback, Environment                          command-line interface for custom deployment
                                             service infrastructure?                   staging, and Deployment integration.                                  integration.

          Deployment artifacts               For what application and service          Measured by the depth and breadth of service             15%     2.00 Actional controls deployment of only its own policy
                                             artifacts can the product control         deployment features:                                                  definitions.
                                             production deployment? Across what        5 = Deep features.
                                             range of network and infrastructure       3 = Basic features.
                                             topologies?                               1 = Minimal features.
                                                                                       0 = No features.
          Deployment package configuration   What are the capabilities for             Measured by the richness of the product's service        30%     2.00 For services that are defined as part of the same
                                             specifying a group of artifacts to be     packaging structures:                                                 message flow (for example, as alternate
                                             deployed to production as a unit?         5 = Deep features.                                                    endpoints based on routing parameters), Actional
                                                                                       3 = Basic features.                                                   can package them as a service group. Export-
                                                                                       1 = Minimal features.                                                 import functions can then treat these related
                                                                                       0 = No features.                                                      services as one deployment unit.
          Rollback                           How does the product undo past            Measured by the richness of the product's rollback       20%     3.00 Actional's service groups maintain revision history
                                             production deployments and restore        capabilities:                                                         on service policies, and Actional can reactivate a
                                             the prior configuration?                  5 = Deep features.                                                    prior version. In addition, rollback can be
                                                                                       3 = Basic features.                                                   accomplished by storing deployment files in a
                                                                                       1 = Minimal features.                                                 version control system and reapplying an earlier
                                                                                       0 = No features.                                                      version of a service specification.




© 2006, Forrester Research, Inc.                                                                                                                                                                        29
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                                > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                                  > Back to "Scores and weightings"

 Vendor Scorecard: Actional




                                                                                                                                               Forrester
                                                                                                                                                                               Show Criteria and Scale Explanations




                                                                                                                                               Weightin
  Control Level of Criteria Detail
                                                                                                                                                                               Hide Criteria and Scale Explanations




                                                                                                                                                           Score
  Less                     More

 Evaluation Criteria                               Criteria Explanation                     Scale Explanation                                                   Score Explanation




                                                                                                                                               g
          Environment staging                      What is the product's support for        Measured by the richness of the product's              15%     1.00 No features beyond import-export from one
                                                   multiple staging environments (such      environment staging capabilities:                                   environment to another.
                                                   as test, system test, production),       5 = Deep features.
                                                   including deployment and rollback        3 = Basic features.
                                                   between them?                            1 = Minimal features.
                                                                                            0 = No features.
          Deployment integration                   How can the product's deployment         Measured by the range of options for creating          20%     3.00 Actional has three features to support deployment
                                                   capabilities be integrated with other    integrated service deployment solutions:                            integration: import-export of configuration data, a
                                                   products' deployment features (to        5 = Deep features.                                                  command-line interface, and Web services APIs.
                                                   achieve a larger-scale unified           3 = Basic features.
                                                   deployment)?                             1 = Minimal features.
                                                                                            0 = No features.
      Alerting, events, and exception management   What range of options does the           This score is a weighted average of its                10%     3.50 Actional has average alerting features but strong
                                                   product have for responding to           subattributes: Alerting methods, Alert and event                    autoresponse features and exception
                                                   events and exceptions?                   specification, Autoresponse, and Exception                          management tools.
                                                                                            management tools.
          Alerting methods                         What channels are provided for           Measured by the range of options for sending           30%     3.00 Actional supports notification via email and SNMP
                                                   notification of IT and business-level alerts and notifications:                                              traps and provides an alert plug-in for writing
                                                   events, exceptions, and alerts (email, 5 = Many options.                                                     custom alert notification mechanisms.
                                                   IM, SNMP trap, event integration         3 = Some options.
                                                   features, others)?                       1 = Minimal options.
                                                                                            0 = No options.
          Alert and event specification            What tools does the product provide Measured by the depth and breadth of features               20%     3.00 Alert thresholds and actions are specified as part
                                                   for specifying alert and event criteria? for specifying alerts:                                              of service configuration in Actional's
                                                   How usable are the tools?                5 = Deep features.                                                  administrative tools. Alert criteria may be
                                                                                            3 = Basic features.                                                 immediate (one slow message) or aggregate over
                                                                                            1 = Minimal features.                                               time (average response over time).
                                                                                            0 = No features.
          Autoresponse                             How does the product configure           Measured by the depth and breadth of features          30%     4.00 Actional autoresponse mechanism works in two
                                                   automatic responses to exception         for initiating autoresponse actions:                                parts. First, when an alert threshold is violated,
                                                   conditions?                              5 = Deep features.                                                  the product turns on a "Service Stabilizer"
                                                                                            3 = Basic features.                                                 indicator. A second specification based on the
                                                                                            1 = Minimal features.                                               stabilizer switch would then kick off either a built-in
                                                                                            0 = No features.                                                    action or, using the alert notifier SDK, arbitrary
                                                                                                                                                                custom actions to respond to the event.




© 2006, Forrester Research, Inc.                                                                                                                                                                           30
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                    > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                      > Back to "Scores and weightings"

 Vendor Scorecard: Actional




                                                                                                                                   Forrester
                                                                                                                                                                   Show Criteria and Scale Explanations




                                                                                                                                   Weightin
  Control Level of Criteria Detail
                                                                                                                                                                   Hide Criteria and Scale Explanations




                                                                                                                                               Score
  Less                     More

 Evaluation Criteria                   Criteria Explanation                    Scale Explanation                                                    Score Explanation




                                                                                                                                   g
          Exception management tools   What tools does the product provide     Measured by the depth and breadth of features           20%     4.00 For each message that causes an exception,
                                       for displaying request processing       for handling service exceptions and errors:                          Actional captures a flow map that can be used to
                                       exceptions, correcting messages,        5 = Deep features.                                                   display messages and examine message flow —
                                       and resubmitting them?                  3 = Basic features.                                                  including display of the message itself. If a
                                                                               1 = Minimal features.                                                message fails because of a security exception,
                                                                               0 = No features.                                                     and if the service supports WS-
                                                                                                                                                    MetadataExchange and WS-Policy, Actional will
                                                                                                                                                    automatically refresh the policy and retry the
                                                                                                                                                    service. The product has no built-in features for
                                                                                                                                                    message correction and resubmission. It bundles
                                                                                                                                                    a one-year license for Mindreef SOAPScope.

      Logging and auditing             How integrable, secure, and auditable This score is a weighted average of its                   10%     2.70 Actional has good logging and log integration. It
                                       are the product's operational logs?   subattributes: Logging levels, Log integration, Log                    has strong auditing support and good diagnostic
                                                                             integrity, Audit tools, and Diagnostic tools.                          tools.
          Logging levels               How many logging levels does the      Measured by the depth and configurability of              35%     3.00 Actional provides four logging levels: error,
                                       product provide? How detailed can     logging:                                                               warning, info, and debug. At the error level, only
                                       logging be? How configurable is the 5 = Deep features.                                                       exceptions are recorded in the log. The debug
                                       content of the log?                   3 = Basic features.                                                    level captures detailed information from each
                                                                             1 = Minimal features.                                                  processing subsystem in the products pipeline
                                                                             0 = No features.                                                       (recommended only for development and testing
                                                                                                                                                    scenarios).
          Log integration              Can the product 1) integrate its        Measured by the range of options for log                20%     3.00 Actional can redirect its logs to any log4j
                                       logging with that of other service      integration:                                                         destination.
                                       infrastructure or 2) act as a central   5 = Many options.
                                       logging service for other SOA           3 = Some options.
                                       infrastructure?                         1 = Minimal options.
                                                                               0 = No options.
          Log integrity                What does the product provide for       Measured by the depth of features for ensuring          15%     0.00 Product has no features for signed logs.
                                       ensuring the integrity of individual    log integrity:
                                       logs and of a series of log files (such 5 = Deep features.
                                       as signed, chained logs)?               3 = Basic features.
                                                                               1 = Minimal features.
                                                                               0 = No features.
          Audit tools                  What capabilities does the product      Measured by the depth of features for log review        15%     4.00 Actional records audit data to a relational
                                       provide for auditing and reviewing log and integration of external audit tools:                              database, where it is available to any audit tools.
                                       contents (or support for external       5 = Deep features.                                                   Actional provides a tool for flexible reporting from
                                       auditing tools)?                        3 = Basic features.                                                  the audit database.
                                                                               1 = Minimal features.
                                                                               0 = No features.




© 2006, Forrester Research, Inc.                                                                                                                                                               31
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                        > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                          > Back to "Scores and weightings"

 Vendor Scorecard: Actional




                                                                                                                                       Forrester
                                                                                                                                                                       Show Criteria and Scale Explanations




                                                                                                                                       Weightin
  Control Level of Criteria Detail
                                                                                                                                                                       Hide Criteria and Scale Explanations




                                                                                                                                                   Score
  Less                     More

 Evaluation Criteria                             Criteria Explanation                  Scale Explanation                                                Score Explanation




                                                                                                                                       g
          Diagnostic tools                       What tools does the product provide   Measured by the breadth of diagnostic tool          15%     3.00 Actional's two primary diagnostic tools are its
                                                 for diagnosing service processing     functions:                                                       service flow maps and built-in logging (both
                                                 problems?                             5 = Deep functionality.                                          described above).
                                                                                       3 = Basic functionality.
                                                                                       1 = Minimal functionality.
                                                                                       0 = No functionality.
      Support for standards and specifications   What standards does the product       This score is a weighted average of its              7%     3.30 Actional's standards support is strong for core
                                                 support?                              subattributes: Core Web services support,                        Web services and security but weak for
                                                                                       Management support, Security token support,                      management protocols.
                                                                                       Security support, Advanced Web services
                                                                                       support, and Other standards.
          Core Web services support              What basic Web services               Measured by the breadth of standards support:       25%     4.00 SOAP 1.1, 1.2, WSDL, UDDI (2.0, 3.0), XML
                                                 specifications and standards does     5 = Broad support.                                               schema, XSLT, WS-I Basic Profile, WS-I
                                                 the product support (including SOAP, 3 = Average support.                                              Attachments Profile.
                                                 WSDL, UDDI, WS-I Basic Profile,       1 = Minimal support.
                                                 XML Schema, WS-I Attachments          0 = No support.
                                                 Profile, WS-BPEL, WS-
                                                 Choreography, XSLT, others)?
          Management support                     What management specifications and Measured by the breadth of standards support:          20%     1.00 Actional supports sending SNMP traps.
                                                 standards does the product support 5 = Broad support.
                                                 (including WSDM-MOWS, WSDM-           3 = Average support.
                                                 MUWS, WS-Management, SNMP,            1 = Minimal support.
                                                 others)?                              0 = No support.
          Security token support                 What security token specifications    Measured by the breadth of standards support:       20%     4.00 Username-password, X.509, SAML, CA eTrust
                                                 and standards does the product        5 = Broad support.                                               SiteMinder token, Oracle COREid token, and
                                                 support (username-password, x.509, 3 = Average support.                                                Kerberos.
                                                 SAML, Kerberos, XRML, others)?        1 = Minimal support.
                                                                                       0 = No support.
          Security protocol support              What security protocol specifications Measured by the breadth of standards support:       20%     4.00 WS-Security (multiple versions), WS-I Basic
                                                 and standards does the product        5 = Broad support.                                               Security Profile, WS-Policy (multiple), WS-
                                                 support (WS-Security: SOAP            3 = Average support.                                             SecurityPolicy, WS-PolicyAttachments, SSL, XML
                                                 Message Security, Liberty ID-FF,      1 = Minimal support.                                             Encryption 1.0, XML Signature 1.0, and XML Key
                                                 Liberty ID-WSF, WS-I Basic Security 0 = No support.                                                    Management Standard (XKMS). In the next
                                                 Profile, WS-Policy, WS-Trust, WS-                                                                      release, Actional will support WS-Federation, WS-
                                                 SecurityPolicy, WS-                                                                                    Trust, and Extensible Access Control Markup
                                                 PolicyAttachments, WS-Federation,                                                                      Language (XACML).
                                                 WS-SecureConversation, XML
                                                 Encryption, XML Signature, SSL/TLS,
                                                 HTTP basic authentication, others)?




© 2006, Forrester Research, Inc.                                                                                                                                                                   32
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                  > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                    > Back to "Scores and weightings"

 Vendor Scorecard: Actional




                                                                                                                                 Forrester
                                                                                                                                                                 Show Criteria and Scale Explanations




                                                                                                                                 Weightin
  Control Level of Criteria Detail
                                                                                                                                                                 Hide Criteria and Scale Explanations




                                                                                                                                             Score
  Less                     More

 Evaluation Criteria                      Criteria Explanation                   Scale Explanation                                                Score Explanation




                                                                                                                                 g
          Advanced Web services support   What advanced Web services             Measured by the breadth of standards support:        5%     2.00 WS-Addressing, WS-ReliableMessaging, and WS-
                                          specifications and standards does      5 = Broad support.                                               MetadataExchange.
                                          the product support (WS-Reliability,   3 = Average support.
                                          WS-Addressing, WS-Eventing, WS-        1 = Minimal support.
                                          ReliableExchange, WS-                  0 = No support.
                                          BusinessActivity, WS-
                                          AtomicTransactions, WS-CAF (WS-
                                          CF, WS-TXM, WS-CTX), Fast
                                          Infoset, Message Transmission
                                          Optimization Mechanism (MTOM),
                                          BEEP, WS-MetadataExchange, WS-
                                          Notification, ASAP, WS-Discovery,
                                          others)?
          Other standards                 What other SOA, management, and        Measured by the breadth of standards support:       10%     4.00 JMS, Internet Inter-ORB Protocol (IIOP), and Java
                                          messaging related standards does       5 = Broad support.                                               RMI.
                                          the product support (Java Message      3 = Average support.
                                          Service, IIOP, Java RMI, JMX,          1 = Minimal support.
                                          others)?                               0 = No support.
      Other product features              What other generally useful features   This score is a weighted average of its              3%     2.80 Actional's core SOA management features are
                                          does the product have?                 subattributes: Core SOA management features                      supplemented by the ability to raise alerts on
                                                                                 and Other features.                                              nonevents and correlate messages within a
                                                                                                                                                  process flow.
          Core SOA management features    Are there additional features that    Measured by the depth and importance of any          70%     4.00 Actional can raise service alerts based on
                                          relate directly to service management additional features for SOA management:                           nonevents. Specifically, it can define a policy for
                                          and monitoring?                       5 = Deep features.                                                the maximum time it should take for the next step
                                                                                3 = Basic features.                                               in a long-running task to occur and kick off an
                                                                                1 = Minimal features.                                             alert if the time limit is exceeded. Actional also
                                                                                0 = No features.                                                  can define business-centric key performance
                                                                                                                                                  indicators (KPIs) that can be used in defining
                                                                                                                                                  service-level goals. KPIs are numeric figures
                                                                                                                                                  derived from message content or external
                                                                                                                                                  systems. Actional provides two methods for
                                                                                                                                                  message correlation. First, message correlations
                                                                                                                                                  can be manually defined (where administrators
                                                                                                                                                  define a correlation like "match based on fields X,
                                                                                                                                                  Y, Z of message A and fields L, M, N of message
                                                                                                                                                  B"). Second, Actional's agents can perform
                                                                                                                                                  automatic correlation by inserting nonintrusive
                                                                                                                                                  message headers (HTTP headers, JMS
                                                                                                                                                  properties, SOAP headers, etc.).




© 2006, Forrester Research, Inc.                                                                                                                                                             33
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                               > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                                 > Back to "Scores and weightings"

 Vendor Scorecard: Actional




                                                                                                                                              Forrester
                                                                                                                                                                              Show Criteria and Scale Explanations




                                                                                                                                              Weightin
  Control Level of Criteria Detail
                                                                                                                                                                              Hide Criteria and Scale Explanations




                                                                                                                                                          Score
  Less                     More

 Evaluation Criteria                         Criteria Explanation                      Scale Explanation                                                       Score Explanation




                                                                                                                                              g
          Other features                     Are there additional ancillary features   Measured by the depth and importance of any                30%     0.00 No features.
                                             (that is, beyond service management       additional product features:
                                             and monitoring)?                          5 = Deep features.
                                                                                       3 = Basic features.
                                                                                       1 = Minimal features.
                                                                                       0 = No features.
      Other SOA infrastructure products      What other SOA infrastructure is          Forrester includes this criterion as information for        0%     0.00 Actional has an XML security gateway, and it
                                             available as part of the vendor's         clients, therefore this line item is weighted at 0%.                    bundles a couple of design and development
                                             overall product set?                      To place a value on vendors' other SOA products,                        tools.
                                                                                       clients may add custom weightings, in which case
                                                                                       this score is a weighted average of its
                                                                                       subattributes: Attack protection, Registry-
                                                                                       repository, SOA life-cycle management,
                                                                                       Application development (design), Application
                                                                                       development (coding), Application integration,
                                                                                       Data integration, and Other SOA-related products.

          Attack protection                  What other products does the vendor    This line item is intended to be informational and             0%     5.00 Actional Security Gateway.
                                             have that provide direct SOA and       is therefore weighted at 0%. A score of five is
                                             Web services support for the attack    given if a vendor has any products to offer, so that
                                             protection side of security?           Forrester clients can assign a weighting if they
                                                                                    choose to.
          Registry and repository            What products does the vendor have This line item is intended to be informational and                 0%     0.00 None.
                                             for registry and repository functions? is therefore weighted at 0%. A score of five is
                                                                                    given if a vendor has any products to offer, so that
                                                                                    Forrester clients can assign a weighting if they
                                                                                    choose to.
          SOA life-cycle management          What products does the vendor have This line item is informational and is therefore                   0%     0.00 None.
                                             for overall service life-cycle         weighted at 0%. A score of five is given if a
                                             management (that is, end-to-end        vendor has any products to offer, so that Forrester
                                             development life-cycle                 clients can assign a weighting if they choose to.
                                             management)?
          Application development (design)   What other products does the vendor This line item is informational and is therefore                  0%     5.00 Actional's recent acquistion by Sonic Software
                                             have for business modeling, process weighted at 0%. A score of five is given if a                                 places it in a product family with Sonic
                                             modeling, service modeling, and        vendor has any products to offer, so that Forrester                        Workbench.
                                             service design?                        clients can assign a weighting if they choose to.

          Application development (coding)   What products does the vendor have This line item is informational and is therefore                   0%     5.00 Actional bundles Mindreef SOAPscope.
                                             for detailed service development and weighted at 0%. A score of five is given if a
                                             administration?                      vendor has any products to offer, so that Forrester
                                                                                  clients can assign a weighting if they choose to.



© 2006, Forrester Research, Inc.                                                                                                                                                                          34
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                            > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                              > Back to "Scores and weightings"

 Vendor Scorecard: Actional




                                                                                                                                           Forrester
                                                                                                                                                                           Show Criteria and Scale Explanations




                                                                                                                                           Weightin
  Control Level of Criteria Detail
                                                                                                                                                                           Hide Criteria and Scale Explanations




                                                                                                                                                       Score
  Less                     More

 Evaluation Criteria                        Criteria Explanation                     Scale Explanation                                                      Score Explanation




                                                                                                                                           g
          Application integration           What products does the vendor have       This line item is informational and is therefore           0%     5.00 Actional's recent acquistion by Sonic Software
                                            that provide full application            weighted at 0%. A score of five is given if a                          places it in a product family with Sonic ESB, Sonic
                                            integration features and functions       vendor has any products to offer, so that Forrester                    Orchestration Server, Sonic Collaboration Server,
                                            (beyond simple transformation that       clients can assign a weighting if they choose to.                      and Adapters for Sonic ESB.
                                            the product may inherently support)?

          Data integration                  What products does the vendor have This line item is informational and is therefore                 0%     5.00 Actional bundles Contivo Analyst. Actional's
                                            for data-level integration?        weighted at 0%. A score of five is given if a                                recent acquistion by Sonic Software places it in a
                                                                               vendor has any products to offer, so that Forrester                          product family with Sonic Database Service.
                                                                               clients can assign a weighting if they choose to.

          Other SOA-related products        What other products does the vendor      This line item is informational and is therefore           0%     5.00 Actional's recent acquistion by Sonic Software
                                            have that address other major            weighted at 0%. A score of five is given if a                          places it in a product family with Sonic ESB and
                                            requirements for SOA and Web             vendor has any products to offer, so that Forrester                    Sonic Orchestration Server.
                                            services?                                clients can assign a weighting if they choose to.


 STRATEGY                                                                                                                                      50%     3.98
    Product strategy                        What is the vendor's approach to the This score is a weighted average of its                       45%     4.20 Actional has a deep vision for how SOA
                                            SOA management market in terms of subattributes: SOA and Web services                                           management needs to have visibility across both
                                            near-term plans and long-term focus? management, Broader SOA infrastructure product                             service interfaces and service implementations,
                                                                                 directions, and Enterprise focus.                                          including non-XML endpoints. It sees the need to
                                                                                                                                                            integrate with multiple types of SOA governance
                                                                                                                                                            and enterprise management infrastructure. Its
                                                                                                                                                            own product investments will focus on
                                                                                                                                                            management and security for large SOA
                                                                                                                                                            deployments.
          SOA and Web services management   What future enhancements does the        Measured by Forrester's assessment of the                 80%     4.00 Actional's major product investments will be in
                                            vendor currently plan for the product    product plans and vision stated by the vendor:                         deeper integration and partnerships with SOA life-
                                            that would help it score better on       5 = Strong road map in many areas.                                     cycle and governance products, native agents for
                                            SOA and Web services management          3 = Strong road map in some areas.                                     additional endpoint platforms (including non-XML
                                            criteria? (That is, all of the Current   1 = Weak road map.                                                     endpoints), additional management console
                                            offering criteria above except the       0 = Vendor hasn't disclosed.                                           features for managing very large numbers of
                                            "Other SOA infrastructure products"                                                                             services (including the need to accommodate a
                                            criterion.)                                                                                                     wide variety of organizational structures and
                                                                                                                                                            responsibilities in relation to service
                                                                                                                                                            management), endpoint security models, and
                                                                                                                                                            compliance.




© 2006, Forrester Research, Inc.                                                                                                                                                                       35
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                                > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                                  > Back to "Scores and weightings"

 Vendor Scorecard: Actional




                                                                                                                                               Forrester
                                                                                                                                                                               Show Criteria and Scale Explanations




                                                                                                                                               Weightin
  Control Level of Criteria Detail
                                                                                                                                                                               Hide Criteria and Scale Explanations




                                                                                                                                                           Score
  Less                     More

 Evaluation Criteria                            Criteria Explanation                     Scale Explanation                                                      Score Explanation




                                                                                                                                               g
          Other SOA infrastructure products     What future product directions has       This line item is informational and is therefore           0%     3.00 Actional is focused on enterprise-class SOA and
                                                the vendor disclosed that would move     weighted at 0%. So that Forrester clients can                          Web services management and intends to
                                                it toward broader and more complete      assign a weighting if they choose to, Forrester has                    concentrate its investments here, with
                                                SOA infrastructure capabilities          measured the vendor's response based on the                            partnerships and product-level integration to
                                                beyond SOA and Web services              breadth of broader SOA categories that the                             connect Actional to the rest of the ecosystem of
                                                management? In other words, how          vendor intends to provide products for.                                SOA-related products. Actional's recent acquistion
                                                will it build its cababilities in the                                                                           by Sonic Software will increase the scope of its
                                                "Other SOA infrastructure products"                                                                             family of SOA infrastructure products.
                                                criterion above?

          Enterprise focus                      In the vendor's view, what is the full   Measured by Forrester's assessment of the                 20%     5.00 Actional's vision for enterprise-class SOA and
                                                scope of enterprise requirements for     vendor's stated understanding of the scope of                          Web services management entails support for
                                                SOA management and SOA                   enterprise-class SOA management:                                       these major characteristics: heterogeneous
                                                infrastructure?                          5 = Strong view of enterprise SOA management                           environment (XML and non-XML), scalability for
                                                                                         requirements.                                                          thousands of services, low overhead of the
                                                                                         3 = Average view of enterprise SOA                                     management solution, security management
                                                                                         requirements.                                                          (including integration to enterprise identity
                                                                                         1 = Weak view of enterprise SOA requirements.                          management infrastructure), reliability of the
                                                                                         0 = the vendor hasn't disclosed.                                       management solution, tiered administration and
                                                                                                                                                                delegated administration (as in allowing multiple
                                                                                                                                                                parties to each maintain subsets of service
                                                                                                                                                                configurations according to their responsibilities),
                                                                                                                                                                broad support for major vendor platforms, end-to-
                                                                                                                                                                end view of business processes, functionality for
                                                                                                                                                                multiple types of users (business, application
                                                                                                                                                                development, IT operations, and security
                                                                                                                                                                management), and ease of use.

      Financial resources to support strategy   Is the vendor profitable? Does the       Measured by Forrester's assessment of public              25%     5.00 Actional projects that it will achieve profitability in
                                                company have sufficient funding,         data (which receives greater weight) and vendor                        Q1 2006. Actional has to date raised $28 million
                                                revenues, profits, and cash flow to      claims as to the resources available for product                       in venture funding, in addition to at least $15
                                                support its strategies?                  development and the overall stability of the                           million raised by Westbridge Technology before
                                                                                         vendor:                                                                the two companies merged. Actional does not
                                                                                         5 = Clearly sufficient resources and stability from                    disclose its cash balance. Actional's recent
                                                                                         public data.                                                           acquisition by Sonic Software significantly
                                                                                         3 = Reasonable resources and likely stability from                     enhances its access to financial resources: As of
                                                                                         private data.                                                          August 2005, Progress Software (Sonic's parent
                                                                                         1 = Questionable resources and stability (or lack                      company) is profitable and has $250 million in
                                                                                         of data).                                                              cash and short-term investments.




© 2006, Forrester Research, Inc.                                                                                                                                                                            36
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                          > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                            > Back to "Scores and weightings"

 Vendor Scorecard: Actional




                                                                                                                                         Forrester
                                                                                                                                                                         Show Criteria and Scale Explanations




                                                                                                                                         Weightin
  Control Level of Criteria Detail
                                                                                                                                                                         Hide Criteria and Scale Explanations




                                                                                                                                                     Score
  Less                     More

 Evaluation Criteria                       Criteria Explanation                 Scale Explanation                                                         Score Explanation




                                                                                                                                         g
     Cost                                  What is the cost of the product?     The score is a weighted average of the scores for            30%     2.80 Actional has a low entry-point cost for its solution,
                                                                                these subattributes: Medium deployment license                            but it loses this advantage for larger deployments.
                                                                                cost, Minimum license cost, Maintenance cost,
                                                                                and Pricing structure.
          Medium deployment license cost   What would be the total license cost This score is based on the license cost for this             60%     2.00 The total license cost would be $675,000,
                                           for a deployment to manage 100       configuration as reported by the vendor:                                  assuming that agents are deployed for each
                                           separate WSDL interfaces spread      5 = Up to $99,999.                                                        individual WSDL (which would provide the highest
                                           across 20 servers (four CPUs each) 4 = $100,000 to $199,999.                                                   level of functionality the product can offer).
                                           with two management consoles?        3 = $200,000 to $399,999.
                                                                                2 = $400,000 to $699,999.
                                                                                1 = $700,000 or more.
                                                                                0 = The vendor hasn't disclosed.
          Minimum license cost             What would be the total license cost This score is based on the license cost for this             40%     4.00 The total license cost would be $55,000.
                                           for a deployment to manage one       configuration as reported by the vendor:
                                           WSDL interface on one server (two    5 = Up to $49,999.
                                           CPUs) with one management            4 = $50,000 to $99,999.
                                           console?                             3 = $100,000 to $149,999.
                                                                                2 = $150,000 to $199,999.
                                                                                1 = $200,000 or more.
                                                                                0 = The vendor hasn't disclosed
          Maintenance cost                 What is the annual maintenance cost Forrester provides this information to aid our                 0%     0.00 8x5 support is 18% of actual sales price; 24x7
                                           structure for this product?          clients' decisions; we give a default score of 0 to                       support is 20% of actual sales price.
                                                                                the vendor for this attribute.


          Pricing structure                What are the details of the product's   Forrester provides this information to aid our             0%     0.00 Actional uses a point system to determine the
                                           pricing structure?                      clients' decisions; we give a default score of 0 to                    management footprint of a given deployment and
                                                                                   the vendor for this attribute.                                         calculates pricing based on total points. Points are
                                                                                                                                                          counted for each agent and proxy deployed.
                                                                                                                                                          Actional's management console, central server,
                                                                                                                                                          and portal are included (they don't add points).


 MARKET PRESENCE                                                                                                                              0%     2.39
    Installed base                         How large is the vendor's installed     This score is a weighted average of its                   30%     2.30 Actional has about 40 customers for its SOA
                                           base of customers for this product      subattributes: This product, All SOA products,                         management solution, half of which are new in the
                                           and for all products?                   New customers, Users on maintenance, and                               past year.
                                                                                   Reference accounts.




© 2006, Forrester Research, Inc.                                                                                                                                                                     37
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                    > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                      > Back to "Scores and weightings"

 Vendor Scorecard: Actional




                                                                                                                                   Forrester
                                                                                                                                                                   Show Criteria and Scale Explanations




                                                                                                                                   Weightin
  Control Level of Criteria Detail
                                                                                                                                                                   Hide Criteria and Scale Explanations




                                                                                                                                               Score
  Less                     More

 Evaluation Criteria                 Criteria Explanation                      Scale Explanation                                                    Score Explanation




                                                                                                                                   g
          This product               What is the installed base of             This factor is scored on the number of customer         40%     2.00 There are 40 customers.
                                     customers (separate stock tickers) for    installations the vendor reports having:
                                     this product?                             5 = 300 or more.
                                                                               4 = 100 to 299.
                                                                               3 = 60 to 99.
                                                                               2 = 30 to 59.
                                                                               1 = Five to 29.
                                                                               0 = Fewer than five or the vendor hasn't
                                                                               disclosed.

          All SOA products           What is the installed base of             This factor is scored on the number of customer         15%     2.00 Actional's installed base is 51 customers
                                     customers (separate stock tickers) for    installations the vendor reports having:                             (including Actional Looking Glass, SOAPstation,
                                     all of the vendor's SOA products          5 = 2,000 or more.                                                   and Actional Security Gateway). Actional's recent
                                     (including this product and those         4 = 1,000 to 1,999.                                                  acquistion by Sonic Software notably increases
                                     listed in the "Other SOA infrastructure   3 = 500 to 999.                                                      the base of customers for all SOA products,
                                     products" criterion above)?               2 = 100 to 499.                                                      including 300+ customers for Sonic ESB.
                                                                               1 = 10 to 99.
                                                                               0 = Fewer than 10 or the vendor hasn't disclosed.


          New customers              How many customers bought or         This factor is scored on the number of customer              30%     2.00 18 customers.
                                     upgraded the product during the past installations the vendor reports having:
                                     year?                                5 = 40 or more.
                                                                          4 = 30 to 39.
                                                                          3 = 20 to 29.
                                                                          2 = 10 to 19.
                                                                          1 = Three to nine.
                                                                          0 = Fewer than three or the vendor hasn't
                                                                          disclosed.

          Users on maintenance       What percentage of customers of all This factor is scored on the percentage of                    15%     4.00 95%.
                                     versions of this product are on active customers for all versions of this product that the
                                     maintenance agreements?                vendor reports are on maintenance agreement:
                                                                            5 = 97% or more.
                                                                            4 = 90% to 96%.
                                                                            3 = 80% to 89%.
                                                                            2 = 70% to 79%.
                                                                            1 = 60% to 69%.
                                                                            0 = Less than 60% or the vendor hasn't disclosed.




© 2006, Forrester Research, Inc.                                                                                                                                                               38
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                 > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                   > Back to "Scores and weightings"

 Vendor Scorecard: Actional




                                                                                                                                Forrester
                                                                                                                                                                Show Criteria and Scale Explanations




                                                                                                                                Weightin
  Control Level of Criteria Detail
                                                                                                                                                                Hide Criteria and Scale Explanations




                                                                                                                                            Score
  Less                     More

 Evaluation Criteria                 Criteria Explanation                  Scale Explanation                                                     Score Explanation




                                                                                                                                g
          Reference accounts         What companies are the major          Forrester provides this information to aid our            0%     0.00 California ISO, Starwood Hotels & Resorts
                                     reference customers for this product? clients' decisions; we don't score or weight this                     Worldwide, and Thomson Prometric.
                                                                           attribute.
      Revenue                        What is the vendor's revenue over     This score is based on overall revenue as                25%     3.00 Actional's revenue over the period from Q4 2004
                                     the period from Q4 2004 through Q3 reported by the vendor:                                                  through Q3 2005 is less than $20 million.
                                     2005?                                 5 = More than $1 billion.                                             Actional's recent acquisition by Sonic Software
                                                                           4 = $500 million to $1 billion.                                       (and its parent company, Progress Software)
                                                                           3 = $50 million to $499 million.                                      brings overall company revenue to $390 million
                                                                           2 = $10 million to $49 million.                                       over the period from Q4 2004 to Q3 2005.
                                                                           1 = Less than $10 million.
                                                                           0 = The vendor hasn't disclosed.
      Revenue growth                 What is the vendor's year-over-year Forrester provides this information to aid our              0%     0.00 Actional's year-over-year revenue growth from Q3
                                     revenue growth over the period from clients' decisions; we don't score or weight this                       2004 through Q3 2005 is 300%.
                                     Q3 2004 through Q3 2005?              attribute.

      Systems integrators            What systems integrator partners       This factor is scored on the number of systems          15%     1.00 IBM is the only systems integrator partner that
                                     have completed three or more           integrator partners the vendor reports have                          has completed three or more deployments of any
                                     deployments of any version of this     completed three or more deployments of this                          version of Actional's product in the past 18
                                     product in the past 18 months?         product in the past 18 months:                                       months.
                                                                            5 = Five or more.
                                                                            4 = Four.
                                                                            3 = Three.
                                                                            2 = Two.
                                                                            1 = One.
                                                                            0 = Zero or the vendor hasn't disclosed.
      Services                       How strong are the vendor's            This score is a weighted average of its                 10%     3.00 Actional's in-house professional services team is
                                     implementation and training            subattributes: Implementation engineers and                          small, but it has a full range of training options.
                                     services?                              Training.
          Implementation engineers   How many employees provide             This factor is scored on the number of employees        50%     1.00 Actional has 10 implementation engineers. To
                                     implementation services for this       the vendor reports having dedicated to                               supplement this, it has a partnership with
                                     product?                               implementation services for this product:                            Momentum SI. Actional's recent acquisition by
                                                                            5 = 100 or more.                                                     Sonic Software will increase its access to
                                                                            4 = 70 to 99.                                                        implementation engineers.
                                                                            3 = 40 to 69.
                                                                            2 = 20 to 49.
                                                                            1 = 10 to 19.
                                                                            0 = Fewer than 10 or the vendor hasn't disclosed.




© 2006, Forrester Research, Inc.                                                                                                                                                            39
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                  > Back to "Scores and weightings"

 Vendor Scorecard: Actional




                                                                                                                               Forrester
                                                                                                                                                               Show Criteria and Scale Explanations




                                                                                                                               Weightin
  Control Level of Criteria Detail
                                                                                                                                                               Hide Criteria and Scale Explanations




                                                                                                                                           Score
  Less                     More

 Evaluation Criteria                 Criteria Explanation                  Scale Explanation                                                    Score Explanation




                                                                                                                               g
          Training                   Does the vendor offer classroom,      Measured by how many training channels the              50%     5.00 Actional offers classroom, Web-based, and on-
                                     Web-based, and on-site training?      vendor offers:                                                       site training.
                                                                           5 = All three channels.
                                                                           3 = Two channels.
                                                                           1 = One channel.
                                                                           0 = No training offered.
      Employees                      How many engineers does the           This score is a weighted average of its                 10%     3.50 Actional is a small firm based only in the US. It
                                     vendor have dedicated to this         subattributes: Total employees, Dedicated                            has a small to moderately sized engineering team.
                                     product? How big is the vendor's      engineers, and Sales staff.
                                     sales presence?
          Total employees            How many employees does the           This factor is scored on the total number of            50%     4.00 Actional has 62 employees. Actional's recent
                                     vendor have?                          employees the vendor reports having:                                 acquisition by Sonic Software brings its total
                                                                           5 = 10,000 or more.                                                  employee base to over 1000 (including Sonic's
                                                                           4 = 300 to 9,999.                                                    parent company, Progress Software).
                                                                           3 = 80 to 299.
                                                                           2 = 40 to 79.
                                                                           1 = 25 to 39.
                                                                           0 = Fewer than 25 or the vendor hasn't disclosed.

          Dedicated engineers        How many engineers are dedicated      This factor is scored on the total number of            25%     2.00 Actional has 25 engineers dedicated to research
                                     to research and development of this   engineers the vendor reports having dedicated to                     and development of this product.
                                     product line?                         this product line:
                                                                           5 = 300 or more.
                                                                           4 = 100 to 299.
                                                                           3 = 30 to 99.
                                                                           2 = 15 to 29.
                                                                           1 = 5 to 14.
                                                                           0 = Fewer than five or vendor hasn't disclosed.
          Sales staff                How large and how global is the       Measured by size and global footprint of sales          25%     4.00 Actional has six field sales representatives based
                                     vendor's sales force? What            organization:                                                        in the US, plus a smaller inside sales team.
                                     percentage of the sales force         5 = 100-plus, with global presence.                                  Europe and Asia Pacific are supported by the US-
                                     supports Europe, Asia Pacific, and    3 = 25 to 99, no global presence.                                    based staff. Actional's recent acquisition by Sonic
                                     Rest of World?                        1 = Less than 25, no global presence.                                Software brings it a broader sales force with a
                                                                                                                                                larger global presence (including Sonic's parent
                                                                                                                                                company, Progress Software).

      Technology partners            How strongly do technology partners This score is a weighted average of its                   10%     1.50 Actional has an initial set of partners, including
                                     support this product?               subattributes: License partners, Resellers, and                        some with product-level integration.
                                                                         Other partners.




© 2006, Forrester Research, Inc.                                                                                                                                                           40
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                                        > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                                          > Back to "Scores and weightings"

 Vendor Scorecard: Actional




                                                                                                                                                       Forrester
                                                                                                                                                                                       Show Criteria and Scale Explanations




                                                                                                                                                       Weightin
  Control Level of Criteria Detail
                                                                                                                                                                                       Hide Criteria and Scale Explanations




                                                                                                                                                                   Score
  Less                     More

 Evaluation Criteria                                    Criteria Explanation                    Scale Explanation                                                       Score Explanation




                                                                                                                                                       g
          License partners                              What vendors license or bundle this     This score is the weighted average of the number           50%     2.00 IBM Global Services, HP Services, and Cisco.
                                                        product?                                of vendors that the vendor reports license or
                                                                                                bundle this product:
                                                                                                5 = 10 or more.
                                                                                                4 = Seven to nine.
                                                                                                3 = Five or six.
                                                                                                2 = Three or four.
                                                                                                1 = One or two.
                                                                                                0 = Zero or the vendor hasn't disclosed.
          Resellers                                     What firms resell this product?         This score is the weighted average of the number           50%     1.00 IBM Global Services, HP Services, and Cisco
                                                                                                of resellers that the vendor reports offer this                         Systems.
                                                                                                product:
                                                                                                5 = 20 or more.
                                                                                                4 = 15 to 19.
                                                                                                3 = 10 to 14.
                                                                                                2 = Five to nine.
                                                                                                1 = One to four.
                                                                                                0 = Zero or vendor hasn't disclosed.
          Other partners                                What other vendors have modified        Forrester provides this information to aid our              0%     0.00 BEA Systems, Cisco Systems, Reactivity, RSA
                                                        their products to better integrate with clients' decisions; we score this attribute 0 in all                    Security, Sarvega (Intel), SAP, Sonic Software,
                                                        this product (as opposed to having      cases.                                                                  and Systinet.
                                                        only standards-based interop)?


 © 2006, Forrester Research, Inc. All rights reserved. Forrester, Forrester Wave, WholeView 2, Technographics, and Total Economic Impact
 are trademarks of Forrester Research, Inc. All other trademarks are the property of their respective companies. Forrester clients may make
 one attributed copy or slide of each figure contained herein. Additional reproduction is strictly prohibited. For additional reproduction rights
 and usage information, go to www.forrester.com. Information is based on best available resources. Opinions reflect judgment at the time




© 2006, Forrester Research, Inc.                                                                                                                                                                                   41
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                     > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                       > Back to "Scores and weightings"

 Vendor Scorecard: AmberPoint




                                                                                                                                    Forrester
                                                                                                                                                                    Show Criteria and Scale Explanations




                                                                                                                                    Weightin
  Control Level of Criteria Detail
                                                                                                                                                                    Hide Criteria and Scale Explanations




                                                                                                                                                Score
  Less                     More

 Evaluation Criteria                 Criteria Explanation                     Scale Explanation                                                      Score Explanation




                                                                                                                                    g
 CURRENT OFFERING                                                                                                                       50%     3.70
     Products included               What is the precise product or set of    This item is for information only and is not scored        0%     0.00 AmberPoint offers AmberPoint SOA Management
                                     products that the vendor offers as its   or weighted.                                                           System 5.0.
                                     service-oriented architecture (SOA)
                                     and Web services management
                                     solution?
      IT-level management            How does the product manage              This score is a weighted average of its                   20%     4.20 AmberPoint supports a wide range of service
                                     service performance and availability?    subattributes: Endpoint support, Performance                           endpoint protocols, and it can tie service-level
                                                                              management, Availability management, and                               goals to particular users to create SLAs, for which
                                                                              Service-level management.                                              it has extensive reporting. It can incorporate
                                                                                                                                                     operational data from service implementations,
                                                                                                                                                     and its availability management includes service
                                                                                                                                                     heartbeats.
          Endpoint support           What access protocols (SOAP,             Measured by the breadth of support for various            20%     4.00 AmberPoint supports SOAP and plain XML
                                     XML/HTTP, Java Message Service           protocols, payload types, and native agents for                        payloads over HTTP, JMS, RMI, and WebSphere
                                     (JMS), Java RMI, WebSphere MQ,           specific products:                                                     MQ transport layers. It provides native agents for
                                     .NET Remoting, others) and service       5 = Broad support.                                                     Tomcat, WebLogic, WebSphere, JBoss, JRun,
                                     implementation technologies (Java        3 = Average support.                                                   .NET (1.1, 2.0), Sonic ESB, and JDBC (the JDBC
                                     EE, .NET, databases, others) does        1 = Minimal support.                                                   agents connect into the processing flow of a
                                     the product fully monitor? What          0 = No support.                                                        JDBC driver to gain visibility to database activity).
                                     specific products does the product                                                                              AmberPoint also provides a tool kit for building
                                     support?                                                                                                        custom agents to handle additional protocols.

          Performance management     How does the product gather, report,     Measured by the breadth and depth of                      30%     4.00 AmberPoint gathers data about individual service
                                     and analyze service performance          functionality for gathering, analyzing, and                            requests and can store data based on a
                                     data, including 1) reporting against     correlating data about service invocations and                         configurable level of aggregation (store each
                                     performance goals and 2) correlation     service implementations:                                               individual service request or store period
                                     of performance data across               5 = Deep functionality.                                                summaries at a defined interval). The product can
                                     technology layers within service         3 = Average functionality.                                             gather CPU and memory usage data and its
                                     implementations?                         1 = Minimal functionality.                                             "nano-agents" provide visibility into EJBs,
                                                                              0 = No functionality.                                                  databases, and ESBs. Custom-built observer
                                                                                                                                                     agents and WSDM or Web services integration
                                                                                                                                                     with enterprise management products provide
                                                                                                                                                     additional visibility across service implementation
                                                                                                                                                     layers.




© 2006, Forrester Research, Inc.                                                                                                                                                                42
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                               > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                                 > Back to "Scores and weightings"

 Vendor Scorecard: AmberPoint




                                                                                                                                              Forrester
                                                                                                                                                                              Show Criteria and Scale Explanations




                                                                                                                                              Weightin
  Control Level of Criteria Detail
                                                                                                                                                                              Hide Criteria and Scale Explanations




                                                                                                                                                          Score
  Less                     More

 Evaluation Criteria                           Criteria Explanation                    Scale Explanation                                                       Score Explanation




                                                                                                                                              g
          Availability management              How does the product gather, report,    Measured by the breadth and depth of                       30%     4.00 AmberPoint can track availability of services and
                                               and analyze service availability data,  functionality for identifying, analyzing, and                           availability of service containers (using integration
                                               including root cause analysis of        correlating availability issues for services and                        with external management points). AmberPoint
                                               availability issues across technology   service implementations:                                                can ping service containers to proactively test
                                               layers within service                   5 = Deep functionality.                                                 service availability.
                                               implementations?                        3 = Average functionality.
                                                                                       1 = Minimal functionality.
                                                                                       0 = No functionality.
          Service-level management             How does the product 1) specify         Measured by the breadth and depth of                       20%     5.00 AmberPoint can track both systemwide service-
                                               service-level goals, 2) tie service-    functionality for specifying service-level goals and                    level goals and SLAs tied to different service
                                               level goals to specific users or groups SLAs and monitoring and managing operations to                          users. Aggregate service-level goals may be
                                               to create service-level agreements      maintain service-level goals:                                           specified for sliding windows (last 60 minutes) or
                                               (SLAs), 3) monitor and report service- 5 = Deep functionality.                                                  fixed windows (every hour on the hour).
                                               level compliance over time, and 4)      3 = Average functionality.                                              Scheduled downtime may be excluded from SLA
                                               automatically adjust service            1 = Minimal functionality.                                              reporting. SLA reports may be exported to
                                               operations to better achieve SLAs?      0 = No functionality.                                                   formats, including PDF, XML, Excel, and RTF.
                                                                                                                                                               Warnings and alerts may initiate preconfigured
                                                                                                                                                               corrective actions. Performance goals may be
                                                                                                                                                               given multiple early warning thresholds for
                                                                                                                                                               notification prior to service-level violation.
      Business-level management                How does the product provide               This score is a weighted average of its                  5%     3.35 AmberPoint can extract business data from
                                               business insight by extracting and         subattributes: Business activity montioring,                         messages (via XPath) and present summarized
                                               reporting data from service request-       Usability by business users, and Integration for                     business status and exceptions via its user
                                               response flows?                            business monitoring.                                                 interface. Business data is available via database
                                                                                                                                                               reads and integration APIs.
          Business activity monitoring (BAM)   How do the product's built-in features     Measured by the breadth and depth of                    30%     3.00 Via XPath expressions, AmberPoint can extract
                                               provide business insight from service      functionality for capturing business data from                       and store business data from message payloads.
                                               operation by extracting, analyzing,        service requests and tying that data to business                     This data may then be summarized and presented
                                               and reporting on business data             processes:                                                           on business-oriented dashboards. AmberPoint's
                                               contained in the flow of service           5 = Deep functionality.                                              exception management features may also be
                                               requests and responses? What are           3 = Average functionality.                                           used to present business-level exceptions as part
                                               its capabilities for tying such analysis   1 = Minimal functionality.                                           of the dashboard displays.
                                               to an end-to-end business process          0 = No functionality.
                                               flow?




© 2006, Forrester Research, Inc.                                                                                                                                                                          43
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                              > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                                > Back to "Scores and weightings"

 Vendor Scorecard: AmberPoint




                                                                                                                                             Forrester
                                                                                                                                                                             Show Criteria and Scale Explanations




                                                                                                                                             Weightin
  Control Level of Criteria Detail
                                                                                                                                                                             Hide Criteria and Scale Explanations




                                                                                                                                                         Score
  Less                     More

 Evaluation Criteria                            Criteria Explanation                    Scale Explanation                                                     Score Explanation




                                                                                                                                             g
          Usability by business users           How understandable to and usable by     Measured by the breadth and depth of                     35%     4.00 Role-based access controls within AmberPoint's
                                                business staff are the product's        functionality for creating business-oriented                          user interface enable construction of business-
                                                business activity monitoring tools?     displays and the extent to which these are usable                     specific portals for displaying business activity,
                                                                                        by business staff:                                                    business exceptions, and service status.
                                                                                        5 = Deep functionality.
                                                                                        3 = Average functionality.
                                                                                        1 = Minimal functionality.
                                                                                        0 = No functionality.
          Integration for business monitoring   What are the data capture methods Measured by the breadth of options by which                    35%     3.00 AmberPoint captures activity data to a relational
                                                and configuration options for feeding other products can get business activity data                           database using data layouts fixed by AmberPoint.
                                                data to other analysis tools (BAM,      captured by the product:                                              The database is open to access and integration
                                                data warehousing, others)?              5 = Deep integration options.                                         by a wide range of other products. In addition,
                                                                                        3 = Average integration options.                                      AmberPoint's configurable logging may be used,
                                                                                        1 = Minimal integration options.                                      for example, to capture billing records.
                                                                                        0 = No integration options.
      Product architecture                      How robust is the product's overall     This score is a weighted average of its                  15%     3.45 AmberPoint provides both proxies and native
                                                architecture, including its integration subattributes: Deployment styles and                                  agents for several platforms. Its service model
                                                with development life-cycle             requirements, metamodel for services and                              has some extensibility. It has above-average out-
                                                management infrastructure?              processes, Enterprise management integration,                         of-box enterprise management integration and
                                                                                        Metadata and repository integration, Development                      some development life-cycle integration. It has
                                                                                        life-cycle integration, Load balancing and                            average capabilities for service failover and load
                                                                                        scalability (product), Load balancing and                             balancing.
                                                                                        scalability (service), Failover (product), Dynamic
                                                                                        reconfiguration, and Performance-specific
                                                                                        features.
          Deployment styles and requirements    What are the options for deployment Measured by the breadth of deployment options                20%     5.00 AmberPoint's deployment architecture has
                                                of monitoring elements (such as         and depth of integration with numerous service                        multiple options. The product is designed to have
                                                agent, proxy, inline, tool kit for      endpoint technologies:                                                multiple server elements for various parts of the
                                                embedding an agent in an                5 = Broad deployment options.                                         data collection and analysis cycle, and these
                                                application, others)? What servers or 3 = Average deployment options.                                         elements may be deployed on the same or
                                                other infrastructure are required?      1 = Limited deployment options.                                       different physical servers. The browser-based
                                                                                                                                                              user interface is enhanced with Flash for graphic
                                                                                                                                                              displays. There are multiple types of
                                                                                                                                                              intermediaries and data collectors, including
                                                                                                                                                              embedded agents for Java and .NET, proxies,
                                                                                                                                                              observer agents (data collection only), and
                                                                                                                                                              infrastructure agents (which are not in the service
                                                                                                                                                              request path and can gather data from various
                                                                                                                                                              SOA infrastructure elements). In addition,
                                                                                                                                                              AmberPoint provides a deployable client-side
                                                                                                                                                              component that can perform client-side
                                                                                                                                                              responsibilities for security.

© 2006, Forrester Research, Inc.                                                                                                                                                                         44
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                               > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                                 > Back to "Scores and weightings"

 Vendor Scorecard: AmberPoint




                                                                                                                                              Forrester
                                                                                                                                                                              Show Criteria and Scale Explanations




                                                                                                                                              Weightin
  Control Level of Criteria Detail
                                                                                                                                                                              Hide Criteria and Scale Explanations




                                                                                                                                                          Score
  Less                     More

 Evaluation Criteria                             Criteria Explanation                      Scale Explanation                                                   Score Explanation




                                                                                                                                              g
          Metamodel for services and processes   What is the underlying structure,         Measured by the breadth and extensibility of the       20%     3.00 AmberPoint's service model is built for awareness
                                                 extensibility, and integrability of the   product's metamodels for services and their                         of SOA infrastructure beyond services alone. The
                                                 product's service and process model,      surrounding context (processes, infrastructure,                     model is extensible for customers to add
                                                 including 1) the metamodel for            etc.):                                                              additional attributes to existing types in the model,
                                                 defining both services and the            5 = Broad and highly extensible model.                              and the vendor intends to add more extensibility
                                                 processes into which they fit and 2)      3 = Basic model with some extensibility.                            in the future.
                                                 the breadth of different technologies     1 = Narrow model with no extensibility.
                                                 included in the model?
          Enterprise management integration      How does the product integrate with     Measured by the breadth of options for and the           20%     3.00 AmberPoint has native integration with HP
                                                 enterprise IT management                extent of prebuilt integration with enterprise                        OpenView, Tivoli, and BMC Patrol. Integration
                                                 infrastructure, particularly to achieve infrastructure management solutions:                                  with Wiley is currently under way. The vendor
                                                 a correlated view of 1) all technology  5 = Deep standards-based and prebuilt                                 plans for future integration to be based on WSDM.
                                                 layers of a service implementation      integration.
                                                 and 2) all technologies that affect the 3 = Basic integration.
                                                 health of a given business process?     1 = Minimal integration.
                                                                                         0 = No integration.
          Metadata and repository integration    How does the product share              Measured by the breadth of options for and the            5%     3.00 AmberPoint can synchronize service endpoint
                                                 metadata with other products (import, extent of prebuilt integration with service                             data (and some policy definitions) with UDDI
                                                 export, common repository)?             repositories (UDDI and others):                                       registries. Work is under way to integrate with
                                                                                         5 = Deep standards-based and prebuilt                                 Systinet's proprietary extensions to UDDI's
                                                                                         integration.                                                          metamodel. In addition, AmberPoint provides a
                                                                                         3 = Basic integration.                                                command line interface, import-export functions,
                                                                                         1 = Minimal integration.                                              and APIs that may be used for repository
                                                                                         0 = No integration.                                                   integration.
          Development life-cycle integration     How does the product integrate with Measured by the breadth and depth of feature-                 5%     2.00 AmberPoint has two mechanisms for life-cycle
                                                 development tools, repositories, and function for development life-cycle integration:                         integration: It can synchronize endpoint data with
                                                 SOA governance solutions? In            5 = Deep integration.                                                 UDDI, and the free AmberPoint Express edition
                                                 particular: 1) for deployment, how      3 = Basic integration.                                                installs into the Visual Studio .NET to provide
                                                 does the product import development 1 = Minimal integration.                                                  performance and fault feedback at development
                                                 tool definitions of service             0 = No integration.                                                   time. Beyond this, developers can view service
                                                 implementation structure and service                                                                          history through the product's management
                                                 relationships and 2) for guiding future                                                                       console and its historical displays, as well as use
                                                 development, how does the product                                                                             AmberPoint's APIs to build custom integration.
                                                 provide developers with an integrated
                                                 view of service configuration and
                                                 operations history?




© 2006, Forrester Research, Inc.                                                                                                                                                                          45
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                               > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                                 > Back to "Scores and weightings"

 Vendor Scorecard: AmberPoint




                                                                                                                                              Forrester
                                                                                                                                                                              Show Criteria and Scale Explanations




                                                                                                                                              Weightin
  Control Level of Criteria Detail
                                                                                                                                                                              Hide Criteria and Scale Explanations




                                                                                                                                                          Score
  Less                     More

 Evaluation Criteria                                 Criteria Explanation                     Scale Explanation                                                Score Explanation




                                                                                                                                              g
          Load balancing and scalability (product)   What is the architecture for sharing a   Measured by the extent to which all product          5%     2.00 Most elements of AmberPoint's server
                                                     workload across multiple product         elements may participate in a load balancing                     environment can be deployed in multiple-server
                                                     instances?                               architecture:                                                    configurations for load balancing. However, some
                                                                                              5 = Deep load balancing abilities.                               elements, such as the service-level manager,
                                                                                              3 = Basic load balancing abilities.                              maintain state (for performance reasons) and
                                                                                              1 = Minimal load balancing abilities.                            cannot be deployed in a multiple server
                                                                                              0 = No load balancing abilities.                                 arrangement. Communication between elements
                                                                                                                                                               of AmberPoint's infrastructure is via HTTP,
                                                                                                                                                               allowing the use of network load balancing.

          Load balancing and scalability (service)   How does the product load balance        Measured by the breadth and depth of feature-        5%     3.00 AmberPoint's content- and context-based routing
                                                     incoming service requests across         function for service load balancing:                             features may be used for load balancing, and
                                                     multiple underlying instances of a       5 = Deep features.                                               such load balancing policies may be activated
                                                     service?                                 3 = Basic features.                                              based on warnings or alerts defined by service-
                                                                                              1 = Minimal features.                                            level goals. In addition, AmberPoint has built-in
                                                                                              0 = No features.                                                 load balancing capabilities that use a percentage
                                                                                                                                                               distribution algorithm.

          Failover (product)                         What is the architecture for failing Measured by the extent to which all product              5%     3.00 AmberPoint's server environment may be
                                                     over a workload from one product     elements may participate in a failover                               configured in an active-passive failover mode,
                                                     instance to another?                 architecture:                                                        and this depends on the configuration of network
                                                                                          5 = Deep failover abilities.                                         load balancing. Multiple AmberPoint agents can
                                                                                          3 = Basic failover abilities.                                        simultaneously manage the same service
                                                                                          1 = Minimal failover abilities.                                      instances, allowing for redundancy.
                                                                                          0 = No failover abilities.
          Failover (service)                         How does the product manage          Measured by the breadth and depth of feature-            5%     4.00 AmberPoint provides built-in failover policies for
                                                     failover from one instance of a      function for service failover:                                       routing to alternate service instances. These can
                                                     service to another? Does the product 5 = Deep features.                                                   failover based on SOAP faults or other custom
                                                     monitor services using heartbeats?   3 = Basic features.                                                  criteria. In addition, the product can proactively
                                                                                          1 = Minimal features.                                                ping service containers to watch for availability
                                                                                          0 = No features.                                                     issues.
          Dynamic reconfiguration                    What product configuration options, Measured by the product's features and design for        10%     4.00 No service configuration changes require a
                                                     when changed, require a product      performing service configuration changes, product                    product restart. Agents and proxies may be
                                                     restart (such as performing product  configuration changes, and product upgrades with                     installed and upgraded on the fly and, because
                                                     upgrades, adding/removing            no downtime:                                                         they cache policy and metrics locally, agents and
                                                     management server instances or       5 = Deep features.                                                   proxies will continue to run without the central
                                                     management consoles, etc.)?          3 = Basic features.                                                  servers. In this way, AmberPoint explicitly focuses
                                                                                          1 = Minimal features.                                                on the design goal of enabling a no-downtime
                                                                                          0 = No features.                                                     rolling upgrade from one AmberPoint version to
                                                                                                                                                               another by first upgrading the agents and then
                                                                                                                                                               upgrading the central servers.



© 2006, Forrester Research, Inc.                                                                                                                                                                          46
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                           > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                             > Back to "Scores and weightings"

 Vendor Scorecard: AmberPoint




                                                                                                                                          Forrester
                                                                                                                                                                          Show Criteria and Scale Explanations




                                                                                                                                          Weightin
  Control Level of Criteria Detail
                                                                                                                                                                          Hide Criteria and Scale Explanations




                                                                                                                                                      Score
  Less                     More

 Evaluation Criteria                         Criteria Explanation                      Scale Explanation                                                   Score Explanation




                                                                                                                                          g
          Performance-specific features      What product features are specifically    Because performance is best measured via direct         0%     0.00 AmberPoint uses client-side UDDI caching.
                                             intended as performance-enhancing         tests, this item is not scored or weighted, but
                                             options (such as persistent network       rather simply provided for information.
                                             connections)?

      Trust enablement                       How rich are the product's features    This score is a weighted average of its                   10%     3.60 AmberPoint has broad support for different types
                                             for establishing trust and fitting withsubattributes: Authentication/authorization,                           of authentication, including good support for
                                             an overall architecture for trust      Identity management integration, Encryption and                        external identity management products but limited
                                             management?                            signatures, Identity propagation, and Application                      support for identity propagation.
                                                                                    security integration.
          Authentication and authorization   For managed services, what             Measured by the product's built-in features for           20%     4.00 Transport-level authentication is via HTTP basic
                                             authentication protocols, token types, authentication and authorization:                                      authentication. Message-level authentication is
                                             and authorization styles and policies 5 = Deep features.                                                      via WS-Security (username, X.509, Security
                                             (such as role-based access control) 3 = Basic features.                                                       Assertion Markup Language (SAML), Oracle
                                             does the product support?              1 = Minimal features.                                                  COREid tokens) or via custom credentials
                                                                                    0 = No features.                                                       extracted via XPath. In addition, AmberPoint can
                                                                                                                                                           extract identity from service containers.
                                                                                                                                                           AmberPoint provides role-based access and can
                                                                                                                                                           retrieve user attributes from directories for use in
                                                                                                                                                           authorization.
          Identity management integration    To what identity management             Measured by the product's breadth and depth of           40%     4.00 AmberPoint can delegate authentication and
                                             infrastructure products can the         integration with identity management platforms for                    authorization decisions to Oracle COREid
                                             product delegate authentication and     authentication and authorization:                                     (formerly Oblix NetPoint), CA eTrust SiteMinder
                                             authorization decisions (including      5 = Deep integration.                                                 and TransactionMinder, and IBM Tivoli Access
                                             LDAP and other directories)?            3 = Basic integration.                                                Manager. It can also delegate authentication to
                                                                                     1 = Minimal integration.                                              LDAP (including ActiveDirectory's LDAP
                                                                                     0 = No integration.                                                   interface).
          Encryption and signatures          What encryption and digital signature Measured by the product's breadth of options for           20%     4.00 For transport-level encryption, AmberPoint relies
                                             options does the product support        providing encryption and signatures using the                         on the underlying service container. AmberPoint
                                             (transport-level, message-level,        product:                                                              provides message-level protection through direct
                                             message element-level, various          5 = Many options.                                                     support for XML Signature and XML Encryption
                                             protocols)?                             3 = Some options.                                                     and via WS-Security's support for them.
                                                                                     1 = Few options.
                                                                                     0 = No options.
          Application security integration   What out-of-box support is provided Measured by the product's breadth of options for             20%     2.00 AmberPoint can pass through tokens in an
                                             for propagating identity to underlying propagating identity to underlying services:                           incoming message. It can also populate preset
                                             service implementations? For            5 = Many options.                                                     downstream security credentials based on the role
                                             integrating the product's security with 3 = Some options.                                                     of the incoming user.
                                             the native security models of           1 = Few options.
                                             underlying application platforms?       0 = No options.




© 2006, Forrester Research, Inc.                                                                                                                                                                      47
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                             > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                               > Back to "Scores and weightings"

 Vendor Scorecard: AmberPoint




                                                                                                                                            Forrester
                                                                                                                                                                            Show Criteria and Scale Explanations




                                                                                                                                            Weightin
  Control Level of Criteria Detail
                                                                                                                                                                            Hide Criteria and Scale Explanations




                                                                                                                                                        Score
  Less                     More

 Evaluation Criteria                          Criteria Explanation                     Scale Explanation                                                     Score Explanation




                                                                                                                                            g
     Administrative tooling and integration   How functional, usable, integrable,      This score is a weighted average of its                  10%     4.60 AmberPoint has strong tooling for administration
                                              and complete are the product's           subattributes: Management administration,                             (both management and security) and a strong
                                              administrative interfaces?               Security administration, Management console,                          management console. It has full APIs for custom
                                                                                       Capacity planning, and Administrative integration.                    management integration.

          Management administration           What service management policies        Measured by the richness, breadth, and overall            30%     5.00 AmberPoint supports policies for security, routing,
                                              and service configuration options do usability of the product's service configuration                          logging, exception management, alerting, service-
                                              administrative tools provide for        capabilities and interface and the product's                           level goals, and SLAs. The browser-based
                                              controlling service operation? What features for role-based access control to                                  console provides role-based security to enable
                                              access control and customization        administrative screens:                                                access control and display configuration for
                                              does the product provide for            5 = Advanced configuration options and access                          particular user groups. Minor filtering capabilities
                                              administration functions (such as role- control.                                                               further enhance the display. AmberPoint provides
                                              based security and customized           3 = Average configuration options and access                           for greater scalability of policy specification by
                                              displays)?                              control.                                                               enabling policies to be specified independently
                                                                                      1 = Limited configuration options and access                           and applied to services in a separate, later
                                                                                      control.                                                               configuration step. Further, policies can be
                                                                                                                                                             applied using a "where clause" and thus do not
                                                                                                                                                             have to be individually applied to every service.

          Security administration             What service security policy             Measured by the richness, breadth, and overall           25%     4.00 AmberPoint's security configuration includes
                                              (authentication, authorization,          usability of the product's security configuration                     policies for message-level authentication, role-
                                              auditing) and security log               capabilities and interface:                                           based authorization, encryption, signatures, and
                                              configuration options do the product's   5 = Advanced configuration options.                                   auditing. Security events may be directed to a
                                              administrative tools provide? Can        3 = Average configuration options.                                    separate destination (container, file, Web
                                              security events be logged to a           1 = Limited configuration options.                                    service).
                                              separate log?
          Management console                  What range of status and command         Measured by the richness, breadth, and overall           25%     5.00 AmberPoint's status displays include red/green
                                              displays does the product provide?       usability of the product's status displays:                           service availability, throughput, response times
                                              How usable are they?                     5 = Advanced configuration options.                                   (average, max), faults, trend analysis, client-
                                                                                       3 = Average configuration options.                                    based views (which service clients are
                                                                                       1 = Limited configuration options.                                    experiencing problems), service dependency
                                                                                                                                                             diagrams, and visualization of service
                                                                                                                                                             dependencies. Graphic information is displayed
                                                                                                                                                             via Flash and is dynamically updated.
          Capacity planning                   What support does the product            Measured by the depth and breadth of features             5%     2.00 For managed services, AmberPoint provides its
                                              provide for planning capacity of both    and resources for planning capacity of managed                        standard historical reports for use in capacity
                                              underlying services and the product      services and of the product itself:                                   planning. A corollary add-on product, the SOA
                                              itself?                                  5 = Several features and resources.                                   Validation System, can replay message streams
                                                                                       3 = Some features and resources.                                      for stress testing, displaying service data
                                                                                       1 = Limited features and resources.                                   combined with data on CPU and memory
                                                                                                                                                             utilization within a service container.



© 2006, Forrester Research, Inc.                                                                                                                                                                        48
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                             > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                               > Back to "Scores and weightings"

 Vendor Scorecard: AmberPoint




                                                                                                                                            Forrester
                                                                                                                                                                            Show Criteria and Scale Explanations




                                                                                                                                            Weightin
  Control Level of Criteria Detail
                                                                                                                                                                            Hide Criteria and Scale Explanations




                                                                                                                                                        Score
  Less                     More

 Evaluation Criteria                          Criteria Explanation                    Scale Explanation                                                      Score Explanation




                                                                                                                                            g
          Administrative integration          What are the integration interfaces     Measured by the product's breadth and depth of            15%     5.00 One hundred percent of AmberPoint's service
                                              for programmatic configuration and      integration APIs and options:                                          history data and configuration functions are
                                              access to metrics data (that is, for    5 = Full APIs for integration, multiple options.                       available through Web services APIs. Available
                                              bypassing the product's user            3 = Basic APIs for integration.                                        configuration and monitoring integration includes
                                              interfaces and integrating with other   1 = Minimal APIs for integration.                                      interfaces for gathering data from other
                                              tools)?                                 0 = No APIs for integration.                                           infrastructure, sending and receiving event data,
                                                                                                                                                             sharing policy (via WS-Policy and WSDM), and
                                                                                                                                                             sharing service metadata. AmberPoint also
                                                                                                                                                             provide a command line interface.

      Application integration and mediation   What features does the product have     This score is a weighted average of its                    5%     2.85 AmberPoint has average features for version
                                              for mediating between different         subattributes: Version control, Protocol mediation,                    resolution and limited features for protocol
                                              message formats and protocols used      Transformation, Policy-based processing, and                           mediation. Its transformation and policy-based
                                              by service requesters and providers?    Other integration.                                                     processing features are good. In addition, it can
                                                                                                                                                             filter message content based on user role.
          Version resolution                  How can the product route an           Measured by the product's depth of understanding           40%     3.00 AmberPoint's content- and context-based routing
                                              incoming service request to the        of versioning and its built-in (preferred) or                           features may be used for version resolution.
                                              correct version of an underlying       configurable capabilities for routing requests to
                                              service (assuming that multiple        different versions:
                                              versions of a service can run in       5 = Deep version routing features.
                                              production at the same time)?          3 = Basic routing based on XML Path Language
                                                                                     (XPath).
                                                                                     1 = Minimal version routing.
                                                                                     0 = No version routing.
          Protocol mediation                  What protocols can the product         Measured by the product's range of support for             20%     2.00 AmberPoint can mediate either direction between
                                              mediate between (when an incoming transport protocol mediation:                                                HTTP and JMS transports.
                                              service request arrives on a different 5 = Extensive protocol mediation.
                                              protocol than is supported by the      3 = Basic protocol mediation.
                                              underlying service)?                   1 = Minimal protocol mediation.
                                                                                     0 = No protocol mediation.
          Transformation                      What capabilities does the product     Measured by the product's range of support for             15%     3.00 AmberPoint can execute Extensible Stylesheet
                                              provide for resolving between          message transformation:                                                 Language Transformations (XSLT) transforms as
                                              different syntax and semantics of      5 = Extensive transformation features.                                  part of its message processing pipeline.
                                              incoming request formats and           3 = Basic transformation features.                                      Transformations may be conditionally applied.
                                              formats supported by underlying        1 = Minimal transformation features.                                    The tool includes an XPath editor.
                                              services?                              0 = No transformation features.




© 2006, Forrester Research, Inc.                                                                                                                                                                        49
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                             > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                               > Back to "Scores and weightings"

 Vendor Scorecard: AmberPoint




                                                                                                                                            Forrester
                                                                                                                                                                            Show Criteria and Scale Explanations




                                                                                                                                            Weightin
  Control Level of Criteria Detail
                                                                                                                                                                            Hide Criteria and Scale Explanations




                                                                                                                                                        Score
  Less                     More

 Evaluation Criteria                         Criteria Explanation                      Scale Explanation                                                     Score Explanation




                                                                                                                                            g
          Policy-based processing            How can the product process service       Measured by the product's features and flexibility       15%     4.00 AmberPoint supports content- and context-based
                                             requests differently based on             for configuring business policy-based routing:                        routing using XPath expressions on message
                                             business parameters for service           5 = Deep features.                                                    header and body. Policies may be specified for
                                             policy (for example, priority             3 = Basic features.                                                   individual services or specified separately and
                                             processing for premium customers or       1 = Minimal features.                                                 applied to multiple services using a "where
                                             alternate routing for requests from a     0 = No features.                                                      clause."
                                             particular source)? How flexible is the
                                             architecture for policy-based
                                             processing?
          Other integration                  Does the product provide any              Measured by the depth and importance of any              10%     2.00 AmberPoint has policies to perform role-based
                                             additional application adaptation and     additional features for application integration:                      censorship wherein it will apply different XSLT
                                             integration capabilities?                 5 = Deep features.                                                    transforms based on the role of the service
                                                                                       3 = Basic features.                                                   requestor (for example, to remove certain data
                                                                                       1 = Minimal features.                                                 elements from a request response).
                                                                                       0 = No features.
      Deployment management                  How does the product control              This score is a weighted average of its                   5%     2.70 AmberPoint controls deployment of only its own
                                             deployment of its own artifacts and       subattributes: Deployment artificats, Deployment                      artifacts, and it maintains past versions of policies
                                             integrate its deployments with other      package configuration, Rollback, Environment                          that may be manually reapplied. It can control
                                             service infrastructure?                   staging, and Deployment integration.                                  policy across multiple staging environments, and
                                                                                                                                                             it has APIs and a command-line interface for
                                                                                                                                                             custom deployment integration.
          Deployment artifacts               For what application and service          Measured by the depth and breadth of service             15%     2.00 AmberPoint controls deployment of only its own
                                             artifacts can the product control         deployment features:                                                  policy definitions.
                                             production deployment? Across what        5 = Deep features.
                                             range of network and infrastructure       3 = Basic features.
                                             topologies?                               1 = Minimal features.
                                                                                       0 = No features.
          Deployment package configuration   What are the capabilities for             Measured by the richness of the product's service        30%     2.00 AmberPoint does not have a formal configuration
                                             specifying a group of artifacts to be     packaging structures:                                                 packaging mechanism, but service attributes may
                                             deployed to production as a unit?         5 = Deep features.                                                    be used to associate a group of services together
                                                                                       3 = Basic features.                                                   by giving them a common attribute value.
                                                                                       1 = Minimal features.
                                                                                       0 = No features.
          Rollback                           How does the product undo past            Measured by the richness of the product's rollback       20%     3.00 AmberPoint maintains past versions of policies.
                                             production deployments and restore        capabilities:                                                         The user interface has a function to manually
                                             the prior configuration?                  5 = Deep features.                                                    reapply a prior version of a policy (this is done
                                                                                       3 = Basic features.                                                   individually for each policy).
                                                                                       1 = Minimal features.
                                                                                       0 = No features.




© 2006, Forrester Research, Inc.                                                                                                                                                                        50
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                                > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                                  > Back to "Scores and weightings"

 Vendor Scorecard: AmberPoint




                                                                                                                                               Forrester
                                                                                                                                                                               Show Criteria and Scale Explanations




                                                                                                                                               Weightin
  Control Level of Criteria Detail
                                                                                                                                                                               Hide Criteria and Scale Explanations




                                                                                                                                                           Score
  Less                     More

 Evaluation Criteria                               Criteria Explanation                    Scale Explanation                                                    Score Explanation




                                                                                                                                               g
          Environment staging                      What is the product's support for       Measured by the richness of the product's               15%     4.00 If a single AmberPoint deployment is used for
                                                   multiple staging environments (such     environment staging capabilities:                                    both production and development, AmberPoint's
                                                   as test, system test, production),      5 = Deep features.                                                   policy mechanisms allow separate policies to be
                                                   including deployment and rollback       3 = Basic features.                                                  applied to different groups of service
                                                   between them?                           1 = Minimal features.                                                environments. Also, AmberPoint could, upon
                                                                                           0 = No features.                                                     dynamic discovery that a new service is operating
                                                                                                                                                                on production servers, retrieve and apply the
                                                                                                                                                                same policies used for that service on
                                                                                                                                                                development servers.
          Deployment integration                   How can the product's deployment         Measured by the range of options for creating          20%     3.00 AmberPoint provides a command line interface
                                                   capabilities be integrated with other    integrated service deployment solutions:                            and Web services APIs that may be used for
                                                   products' deployment features (to        5 = Deep features.                                                  constructing custom deployment integration.
                                                   achieve a larger-scale unified           3 = Basic features.
                                                   deployment)?                             1 = Minimal features.
                                                                                            0 = No features.
      Alerting, events, and exception management   What range of options does the           This score is a weighted average of its                10%     4.50 AmberPoint has strong alerting and very strong
                                                   product have for responding to           subattributes: Alerting methods, Alert and event                    autoresponse features and exception
                                                   events and exceptions?                   specification, Autoresponse, and Exception                          management tools.
                                                                                            management tools.
          Alerting methods                         What channels are provided for           Measured by the range of options for sending           30%     4.00 AmberPoint supports notification via email, Web
                                                   notification of IT and business-level alerts and notifications:                                              services calls, native alerts to BMC Patrol, HP
                                                   events, exceptions, and alerts (email, 5 = Many options.                                                     OpenView, and IBM Tivoli.
                                                   IM, SNMP trap, event integration         3 = Some options.
                                                   features, others)?                       1 = Minimal options.
                                                                                            0 = No options.
          Alert and event specification            What tools does the product provide Measured by the depth and breadth of features               20%     4.00 AmberPoint's browser-based interface enables
                                                   for specifying alert and event criteria? for specifying alerts:                                              specifying alerts based on latency, availability,
                                                   How usable are the tools?                5 = Deep features.                                                  security exceptions, and arbitrary exceptions
                                                                                            3 = Basic features.                                                 based on message content. Alert criteria may be
                                                                                            1 = Minimal features.                                               immediate (one slow message) or aggregate over
                                                                                            0 = No features.                                                    time (average response over time). Alerts can
                                                                                                                                                                either be immediate (first error generates an alert)
                                                                                                                                                                or grouped (collect 10 alerts and send them in
                                                                                                                                                                one message). It can also generate alerts based
                                                                                                                                                                on exceptions in a flow over multiple service
                                                                                                                                                                requests (this is based on either AmberPoint's
                                                                                                                                                                autodiscovery of service relationships or user
                                                                                                                                                                specification of correlation ids, such as an order
                                                                                                                                                                number).




© 2006, Forrester Research, Inc.                                                                                                                                                                           51
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                    > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                      > Back to "Scores and weightings"

 Vendor Scorecard: AmberPoint




                                                                                                                                   Forrester
                                                                                                                                                                   Show Criteria and Scale Explanations




                                                                                                                                   Weightin
  Control Level of Criteria Detail
                                                                                                                                                                   Hide Criteria and Scale Explanations




                                                                                                                                               Score
  Less                     More

 Evaluation Criteria                   Criteria Explanation                    Scale Explanation                                                    Score Explanation




                                                                                                                                   g
          Autoresponse                 How does the product configure          Measured by the depth and breadth of features           30%     5.00 An alert can turn on (activate) another policy,
                                       automatic responses to exception        for initiating autoresponse actions:                                 such as a routing rule, that constitutes the
                                       conditions?                             5 = Deep features.                                                   autoresponse to the alert. When the alert
                                                                               3 = Basic features.                                                  condition is rectified, AmberPoint can
                                                                               1 = Minimal features.                                                automatically deactivate the autoresponse policy.
                                                                               0 = No features.                                                     Alerts can kick off an arbitrary Web service call to
                                                                                                                                                    perform other actions.
          Exception management tools   What tools does the product provide   Measured by the depth and breadth of features             20%     5.00 AmberPoint's exception management system
                                       for displaying request processing     for handling service exceptions and errors:                            includes the ability to configure business-level
                                       exceptions, correcting messages,      5 = Deep features.                                                     exceptions in addition to technical exceptions. The
                                       and resubmitting them?                3 = Basic features.                                                    exception handling facility enables editing and
                                                                             1 = Minimal features.                                                  resubmission of messages.
                                                                             0 = No features.
      Logging and auditing             How integrable, secure, and auditable This score is a weighted average of its                   10%     3.35 AmberPoint has very good logging and good log
                                       are the product's operational logs?   subattributes: Logging levels, Log integration, Log                    integration. It has good auditing support and
                                                                             integrity, Audit tools, and Diagnostic tools.                          strong diagnostic tools.
          Logging levels               How many logging levels does the      Measured by the depth and configurability of              35%     4.00 AmberPoint's logging levels include no logging,
                                       product provide? How detailed can     logging:                                                               severe (serious failures), warning (potential
                                       logging be? How configurable is the 5 = Deep features.                                                       problems), informational messages, config (logs
                                       content of the log?                   3 = Basic features.                                                    static configuration messages), fine (minimal
                                                                             1 = Minimal features.                                                  tracing), finer (detailed tracing), finest (highly
                                                                             0 = No features.                                                       detailed tracing), and all (logs all messages).
                                                                                                                                                    Logging can be configured to capture variable
                                                                                                                                                    portions of requests (header only, selected
                                                                                                                                                    message content, etc.).
          Log integration              Can the product 1) integrate its        Measured by the range of options for log                20%     3.00 Agents log to individual files, which are
                                       logging with that of other service      integration:                                                         aggregated by AmberPoint's central servers.
                                       infrastructure or 2) act as a central   5 = Many options.                                                    Logging can be to files, containers, a Web
                                       logging service for other SOA           3 = Some options.                                                    services destination, or a database.
                                       infrastructure?                         1 = Minimal options.
                                                                               0 = No options.
          Log integrity                What does the product provide for       Measured by the depth of features for ensuring          15%     2.00 AmberPoint provides a hook for a log preparation
                                       ensuring the integrity of individual    log integrity:                                                       service, which could sign log entries. Out of the
                                       logs and of a series of log files (such 5 = Deep features.                                                   box, AmberPoint's log preparation service can
                                       as signed, chained logs)?               3 = Basic features.                                                  encrypt log entries or apply XSLT transforms to
                                                                               1 = Minimal features.                                                censor log data.
                                                                               0 = No features.




© 2006, Forrester Research, Inc.                                                                                                                                                               52
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                          > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                            > Back to "Scores and weightings"

 Vendor Scorecard: AmberPoint




                                                                                                                                         Forrester
                                                                                                                                                                         Show Criteria and Scale Explanations




                                                                                                                                         Weightin
  Control Level of Criteria Detail
                                                                                                                                                                         Hide Criteria and Scale Explanations




                                                                                                                                                     Score
  Less                     More

 Evaluation Criteria                             Criteria Explanation                 Scale Explanation                                                   Score Explanation




                                                                                                                                         g
          Audit tools                            What capabilities does the product   Measured by the depth of features for log review       15%     3.00 AmberPoint provides a log viewer that supports
                                                                                      and integration of external audit tools:
                                                 provide for auditing and reviewing log                                                                   both detailed message review and simplified
                                                 contents (or support for external    5 = Deep features.                                                  message views. AmberPoint can log all
                                                 auditing tools)?                     3 = Basic features.                                                 configuration changes for later auditing and
                                                                                      1 = Minimal features.                                               review.
                                                                                      0 = No features.
          Diagnostic tools                       What tools does the product provide Measured by the breadth of diagnostic tool              15%     4.00 AmberPoint's graphic displays include service
                                                 for diagnosing service processing    functions:                                                          dependency graphs that can show current status
                                                 problems?                            5 = Deep functionality.                                             and relationships between services. From here, a
                                                                                      3 = Basic functionality.                                            user can drill down to service exceptions and view
                                                                                      1 = Minimal functionality.                                          actual messages involved in an exception or alert.
                                                                                      0 = No functionality.
      Support for standards and specifications   What standards does the product      This score is a weighted average of its                 7%     2.85 AmberPoint's standards support is strong for core
                                                 support?                             subattributes: Core Web services support,                           Web services and security token types and good
                                                                                      Management support, Security token support,                         for other security functions. Support for Web
                                                                                      Security support, Advanced Web services                             services management standards will be in a future
                                                                                      support, and Other standards.                                       release.
          Core Web services support              What basic Web services              Measured by the breadth of standards support:          25%     4.00 XML 1.1, XML Schema, SOAP 1.1, SOAP with
                                                 specifications and standards does    5 = Broad support.                                                  Attachments, WSDL 1.1, UDDI (2.0, 3.0), and
                                                 the product support (including SOAP, 3 = Average support.                                                XSLT.
                                                 WSDL, UDDI, WS-I Basic Profile,      1 = Minimal support.
                                                 XML Schema, WS-I Attachments         0 = No support.
                                                 Profile, WS-BPEL, WS-
                                                 Choreography, XSLT, others)?
          Management support                     What management specifications and Measured by the breadth of standards support:            20%     1.00 SNMP and WSDM support is expected in mid-
                                                 standards does the product support 5 = Broad support.                                                    2006.
                                                 (including WSDM-MOWS, WSDM-          3 = Average support.
                                                 MUWS, WS-Management, SNMP,           1 = Minimal support.
                                                 others)?                             0 = No support.
          Security token support                 What security token specifications   Measured by the breadth of standards support:          20%     4.00 Via WS-Security 2004, AmberPoint supports
                                                 and standards does the product       5 = Broad support.                                                  X.509, SAML, username-password, and binary
                                                 support (username-password, x.509, 3 = Average support.                                                  tokens (for Oracle CoreID).
                                                 SAML, Kerberos, XRML, others)?       1 = Minimal support.
                                                                                      0 = No support.




© 2006, Forrester Research, Inc.                                                                                                                                                                     53
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                   > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                     > Back to "Scores and weightings"

 Vendor Scorecard: AmberPoint




                                                                                                                                  Forrester
                                                                                                                                                                  Show Criteria and Scale Explanations




                                                                                                                                  Weightin
  Control Level of Criteria Detail
                                                                                                                                                                  Hide Criteria and Scale Explanations




                                                                                                                                              Score
  Less                     More

 Evaluation Criteria                      Criteria Explanation                    Scale Explanation                                                Score Explanation




                                                                                                                                  g
          Security protocol support       What security protocol specifications   Measured by the breadth of standards support:       20%     3.00 XML Signature, XML Encryption, SAML 1.1, WS-
                                          and standards does the product          5 = Broad support.                                               Security 2004, WS-Policy, WS-SecurityPolicy
                                          support (WS-Security: SOAP              3 = Average support.                                             (with some modifications), WS-
                                          Message Security, Liberty ID-FF,        1 = Minimal support.                                             PolicyAttachments.
                                          Liberty ID-WSF, WS-I Basic Security     0 = No support.
                                          Profile, WS-Policy, WS-Trust, WS-
                                          SecurityPolicy, WS-
                                          PolicyAttachments, WS-Federation,
                                          WS-SecureConversation, XML
                                          Encryption, XML Signature, SSL/TLS,
                                          HTTP basic authentication, others)?

          Advanced Web services support   What advanced Web services              Measured by the breadth of standards support:        5%     1.00 WS-Notification (preliminary versions) is used for
                                          specifications and standards does       5 = Broad support.                                               all AmberPoint notification.
                                          the product support (WS-Reliability,    3 = Average support.
                                          WS-Addressing, WS-Eventing, WS-         1 = Minimal support.
                                          ReliableExchange, WS-                   0 = No support.
                                          BusinessActivity, WS-
                                          AtomicTransactions, WS-CAF (WS-
                                          CF, WS-TXM, WS-CTX), Fast
                                          Infoset, Message Transmission
                                          Optimization Mechanism (MTOM),
                                          BEEP, WS-MetadataExchange, WS-
                                          Notification, ASAP, WS-Discovery,
                                          others)?
          Other standards                 What other SOA, management, and         Measured by the breadth of standards support:       10%     2.00 JMS (including vendor-specific nuances).
                                          messaging related standards does        5 = Broad support.
                                          the product support (Java Message       3 = Average support.
                                          Service, IIOP, Java RMI, JMX,           1 = Minimal support.
                                          others)?                                0 = No support.
      Other product features              What other generally useful features    This score is a weighted average of its              3%     3.00 AmberPoint's core SOA management functions
                                          does the product have?                  subattributes: Core SOA management features                      are supplemented by a client-side tool kit that may
                                                                                  and Other features.                                              help with policy management, security,
                                                                                                                                                   performance measurement, and logging. Beyond
                                                                                                                                                   this, it can define a virtual service as a collection
                                                                                                                                                   of operations from multiple services.




© 2006, Forrester Research, Inc.                                                                                                                                                              54
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                          > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                            > Back to "Scores and weightings"

 Vendor Scorecard: AmberPoint




                                                                                                                                         Forrester
                                                                                                                                                                         Show Criteria and Scale Explanations




                                                                                                                                         Weightin
  Control Level of Criteria Detail
                                                                                                                                                                         Hide Criteria and Scale Explanations




                                                                                                                                                     Score
  Less                     More

 Evaluation Criteria                      Criteria Explanation                    Scale Explanation                                                       Score Explanation




                                                                                                                                         g
          Core SOA management features    Are there additional features that      Measured by the depth and importance of any                70%     3.00 AmberPoint's product includes a client-side
                                          relate directly to service management   additional features for SOA management:                                 component that can implement policy discovery
                                          and monitoring?                         5 = Deep features.                                                      and perform client-side functions for secure Web
                                                                                  3 = Basic features.                                                     services connections. In addition, the client-side
                                                                                  1 = Minimal features.                                                   component can collect service metrics from the
                                                                                  0 = No features.                                                        client-side perspective and send them to the
                                                                                                                                                          central management infrastructure, and it can log
                                                                                                                                                          requests and responses as seen by the client
                                                                                                                                                          side.
          Other features                  Are there additional ancillary features Measured by the depth and importance of any                30%     3.00 AmberPoint provides the capability to define a
                                          (that is, beyond service management additional product features:                                                virtual service (a melding of selected operations
                                          and monitoring)?                        5 = Deep features.                                                      from one or more other services) and apply any of
                                                                                  3 = Basic features.                                                     its policies to the virtual service.
                                                                                  1 = Minimal features.
                                                                                  0 = No features.
      Other SOA infrastructure products   What other SOA infrastructure is        Forrester includes this criterion as information for        0%     0.00 AmberPoint also has a product for replaying SOA
                                          available as part of the vendor's       clients, therefore this line item is weighted at 0%.                    messages in test mode.
                                          overall product set?                    To place a value on vendors' other SOA products,
                                                                                  clients may add custom weightings, in which case
                                                                                  this score is a weighted average of its
                                                                                  subattributes: Attack protection, Registry-
                                                                                  repository, SOA life-cycle management,
                                                                                  Application development (design), Application
                                                                                  development (coding), Application integration,
                                                                                  Data integration, and Other SOA-related products.

          Attack protection               What other products does the vendor    This line item is intended to be informational and           0%     0.00 None.
                                          have that provide direct SOA and       is therefore weighted at 0%. A score of five is
                                          Web services support for the attack    given if a vendor has any products to offer, so that
                                          protection side of security?           Forrester clients can assign a weighting if they
                                                                                 choose to.
          Registry and repository         What products does the vendor have This line item is intended to be informational and               0%     0.00 None.
                                          for registry and repository functions? is therefore weighted at 0%. A score of five is
                                                                                 given if a vendor has any products to offer, so that
                                                                                 Forrester clients can assign a weighting if they
                                                                                 choose to.
          SOA life-cycle management       What products does the vendor have This line item is informational and is therefore                 0%     0.00 None.
                                          for overall service life-cycle         weighted at 0%. A score of five is given if a
                                          management (that is, end-to-end        vendor has any products to offer, so that Forrester
                                          development life-cycle                 clients can assign a weighting if they choose to.
                                          management)?



© 2006, Forrester Research, Inc.                                                                                                                                                                     55
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                           > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                             > Back to "Scores and weightings"

 Vendor Scorecard: AmberPoint




                                                                                                                                          Forrester
                                                                                                                                                                          Show Criteria and Scale Explanations




                                                                                                                                          Weightin
  Control Level of Criteria Detail
                                                                                                                                                                          Hide Criteria and Scale Explanations




                                                                                                                                                      Score
  Less                     More

 Evaluation Criteria                         Criteria Explanation                   Scale Explanation                                                      Score Explanation




                                                                                                                                          g
          Application development (design)   What other products does the vendor    This line item is informational and is therefore           0%     0.00 None.
                                             have for business modeling, process    weighted at 0%. A score of five is given if a
                                             modeling, service modeling, and        vendor has any products to offer, so that Forrester
                                             service design?                        clients can assign a weighting if they choose to.

          Application development (coding)   What products does the vendor have This line item is informational and is therefore               0%     0.00 None.
                                             for detailed service development and weighted at 0%. A score of five is given if a
                                             administration?                      vendor has any products to offer, so that Forrester
                                                                                  clients can assign a weighting if they choose to.

          Application integration            What products does the vendor have     This line item is informational and is therefore           0%     0.00 None.
                                             that provide full application          weighted at 0%. A score of five is given if a
                                             integration features and functions     vendor has any products to offer, so that Forrester
                                             (beyond simple transformation that     clients can assign a weighting if they choose to.
                                             the product may inherently support)?

          Data integration                   What products does the vendor have This line item is informational and is therefore               0%     0.00 None.
                                             for data-level integration?        weighted at 0%. A score of five is given if a
                                                                                vendor has any products to offer, so that Forrester
                                                                                clients can assign a weighting if they choose to.

          Other SOA-related products         What other products does the vendor    This line item is informational and is therefore           0%     5.00 AmberPoint's SOA Validation System enables
                                             have that address other major          weighted at 0%. A score of five is given if a                          capture and replay of service message flows. This
                                             requirements for SOA and Web           vendor has any products to offer, so that Forrester                    may be helpful in both regression testing and
                                             services?                              clients can assign a weighting if they choose to.                      stress testing. AmberPoint Express is a developer-
                                                                                                                                                           only version of AmberPoint's SOA management
                                                                                                                                                           environment.

 STRATEGY                                                                                                                                     50%     3.84
    Product strategy                         What is the vendor's approach to the This score is a weighted average of its                     45%     4.20 AmberPoint has a deep vision for how SOA
                                             SOA management market in terms of subattributes: SOA and Web services                                         management needs to have visibility across both
                                             near-term plans and long-term focus? management, Broader SOA infrastructure product                           service interfaces and service implementations,
                                                                                  directions, and Enterprise focus.                                        including non-SOAP/HTTP protocols. It sees the
                                                                                                                                                           need to integrate with multiple types of SOA
                                                                                                                                                           governance and enterprise management
                                                                                                                                                           infrastructure. Its own product investments will
                                                                                                                                                           focus on management, security, and policy
                                                                                                                                                           provisioning (including provisioning to non-
                                                                                                                                                           AmberPoint's runtime infrastructure).




© 2006, Forrester Research, Inc.                                                                                                                                                                      56
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                              > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                                > Back to "Scores and weightings"

 Vendor Scorecard: AmberPoint




                                                                                                                                             Forrester
                                                                                                                                                                             Show Criteria and Scale Explanations




                                                                                                                                             Weightin
  Control Level of Criteria Detail
                                                                                                                                                                             Hide Criteria and Scale Explanations




                                                                                                                                                         Score
  Less                     More

 Evaluation Criteria                          Criteria Explanation                     Scale Explanation                                                      Score Explanation




                                                                                                                                             g
          SOA and Web services management     What future enhancements does the        Measured by Forrester's assessment of the                 80%     4.00 Major items on AmberPoint's road map include
                                              vendor currently plan for the product    product plans and vision stated by the vendor:                         support for more transport protocols (beyond
                                              that would help it score better on       5 = Strong road map in many areas.                                     HTTP and JMS), additional failover options,
                                              SOA and Web services management          3 = Strong road map in some areas.                                     further performance improvements (that is,
                                              criteria? (That is, all of the Current   1 = Weak road map.                                                     overhead reduction) for agents and proxies,
                                              offering criteria above except the       0 = Vendor hasn't disclosed.                                           enhanced service provisioning in connection with
                                              "Other SOA infrastructure products"                                                                             AmberPoint's client-side component,
                                              criterion.)                                                                                                     internationalization of the product's user interface,
                                                                                                                                                              further standards support, deeper integration with
                                                                                                                                                              service repositories and registries, and improved
                                                                                                                                                              clustering.
          Other SOA infrastructure products   What future product directions has       This line item is informational and is therefore           0%     1.00 AmberPoint is heavily focused on runtime
                                              the vendor disclosed that would move     weighted at 0%. So that Forrester clients can                          management, and it will be extending this to SOA
                                              it toward broader and more complete      assign a weighting if they choose to, Forrester has                    infrastructure beyond managing at the service-
                                              SOA infrastructure capabilities          measured the vendor's response based on the                            interface level. In particular, AmberPoint will be
                                              beyond SOA and Web services              breadth of broader SOA categories that the                             developing capabilities for provisioning policy to
                                              management? In other words, how          vendor intends to provide products for.                                underlying SOA infrastructure, such as application
                                              will it build its cababilities in the                                                                           servers, network load balancers, XML security
                                              "Other SOA infrastructure products"                                                                             gateways, and enterprise service buses (ESBs).
                                              criterion above?

          Enterprise focus                    In the vendor's view, what is the full   Measured by Forrester's assessment of the                 20%     5.00 In AmberPoint's view, enterprise management of
                                              scope of enterprise requirements for     vendor's stated understanding of the scope of                          SOA centers on policy management, and policy
                                              SOA management and SOA                   enterprise-class SOA management:                                       management must efficiently operate across
                                              infrastructure?                          5 = Strong view of enterprise SOA management                           hundreds or thousands of services using either
                                                                                       requirements.                                                          centralized policy management, federated policy
                                                                                       3 = Average view of enterprise SOA                                     management, or a combination of the two. With
                                                                                       requirements.                                                          this as the overall context, major issues to
                                                                                       1 = Weak view of enterprise SOA requirements.                          address include deployment and versioning of
                                                                                       0 = the vendor hasn't disclosed.                                       services, combined with all of the policies that
                                                                                                                                                              govern service operation, use of service
                                                                                                                                                              management tools by a wide variety of roles and
                                                                                                                                                              organizations, scalability of policy specification
                                                                                                                                                              and maintenance, and full visibility and integrated
                                                                                                                                                              management across all layers of service
                                                                                                                                                              implementations.




© 2006, Forrester Research, Inc.                                                                                                                                                                         57
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                              > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                                > Back to "Scores and weightings"

 Vendor Scorecard: AmberPoint




                                                                                                                                             Forrester
                                                                                                                                                                             Show Criteria and Scale Explanations




                                                                                                                                             Weightin
  Control Level of Criteria Detail
                                                                                                                                                                             Hide Criteria and Scale Explanations




                                                                                                                                                         Score
  Less                     More

 Evaluation Criteria                           Criteria Explanation                    Scale Explanation                                                      Score Explanation




                                                                                                                                             g
     Financial resources to support strategy   Is the vendor profitable? Does the      Measured by Forrester's assessment of public              25%     3.00 As to profitability, AmberPoint claims to have
                                               company have sufficient funding,        data (which receives greater weight) and vendor                        achieved or be very near breakeven. AmberPoint
                                               revenues, profits, and cash flow to     claims as to the resources available for product                       has raised $31 million in venture capital and has a
                                               support its strategies?                 development and the overall stability of the                           cash balance of $7 million.
                                                                                       vendor:
                                                                                       5 = Clearly sufficient resources and stability from
                                                                                       public data.
                                                                                       3 = Reasonable resources and likely stability from
                                                                                       private data.
                                                                                       1 = Questionable resources and stability (or lack
                                                                                       of data).
      Cost                                     What is the cost of the product?        The score is a weighted average of the scores for         30%     4.00 AmberPoint has a low entry-point cost —
                                                                                       these subattributes: Medium deployment license                         including a free developer version — and
                                                                                       cost, Minimum license cost, Maintenance cost,                          maintains a cost advantage in larger deployments
                                                                                       and Pricing structure.                                                 by not charging for management endpoints.

             Medium deployment license cost    What would be the total license cost This score is based on the license cost for this             60%     4.00 Assuming one central server (four CPUs) and one
                                               for a deployment to manage 100       configuration as reported by the vendor:                                  passive standby server (AmberPoint does not
                                               separate WSDL interfaces spread      5 = Up to $99,999.                                                        charge for passive standbys), the total license
                                               across 20 servers (four CPUs each)   4 = $100,000 to $199,999.                                                 cost would be $140,000.
                                               with two management consoles?        3 = $200,000 to $399,999.
                                                                                    2 = $400,000 to $699,999.
                                                                                    1 = $700,000 or more.
                                                                                    0 = The vendor hasn't disclosed.
             Minimum license cost              What would be the total license cost This score is based on the license cost for this             40%     4.00 A two-CPU licenses would be $70,000, but
                                               for a deployment to manage one       configuration as reported by the vendor:                                  AmberPoint will sell a one-CPU version for
                                               WSDL interface on one server (two    5 = Up to $49,999.                                                        $35,000. AmberPoint Express is a free product
                                               CPUs) with one management            4 = $50,000 to $99,999.                                                   but is limited in its capabilities.
                                               console?                             3 = $100,000 to $149,999.
                                                                                    2 = $150,000 to $199,999.
                                                                                    1 = $200,000 or more.
                                                                                    0 = The vendor hasn't disclosed
             Maintenance cost                  What is the annual maintenance cost Forrester provides this information to aid our                 0%     0.00 10x5 support is 20% of actual sales price; 24x7
                                               structure for this product?          clients' decisions; we give a default score of 0 to                       support is 25% (minimum $50,000).
                                                                                    the vendor for this attribute.


             Pricing structure                 What are the details of the product's   Forrester provides this information to aid our             0%     0.00 The pricing structure is $70,000 per central
                                               pricing structure?                      clients' decisions; we give a default score of 0 to                    management server (one or two CPUs).
                                                                                       the vendor for this attribute.

 MARKET PRESENCE                                                                                                                                  0%     2.45


© 2006, Forrester Research, Inc.                                                                                                                                                                         58
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                    > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                      > Back to "Scores and weightings"

 Vendor Scorecard: AmberPoint




                                                                                                                                   Forrester
                                                                                                                                                                   Show Criteria and Scale Explanations




                                                                                                                                   Weightin
  Control Level of Criteria Detail
                                                                                                                                                                   Hide Criteria and Scale Explanations




                                                                                                                                               Score
  Less                     More

 Evaluation Criteria                 Criteria Explanation                   Scale Explanation                                                       Score Explanation




                                                                                                                                   g
     Installed base                  How large is the vendor's installed    This score is a weighted average of its                    30%     3.15 AmberPoint has about 70 customers, half of which
                                     base of customers for this product     subattributes: This product, All SOA products,                          are new in the past year.
                                     and for all products?                  New customers, Users on maintenance, and
                                                                            Reference accounts.
          This product               What is the installed base of          This factor is scored on the number of customer            40%     3.00 The install base for this product is 72 customers.
                                     customers (separate stock tickers) for installations the vendor reports having:                                In addition, AmberPoint reports more than 4,000
                                     this product?                          5 = 300 or more.                                                        downloads of its free AmberPoint Express edition.
                                                                            4 = 100 to 299.
                                                                            3 = 60 to 99.
                                                                            2 = 30 to 59.
                                                                            1 = Five to 29.
                                                                            0 = Fewer than five or the vendor hasn't
                                                                            disclosed.

          All SOA products           What is the installed base of             This factor is scored on the number of customer         15%     1.00 In addition to deployments of its main product,
                                     customers (separate stock tickers) for    installations the vendor reports having:                             SOA Validation System is currently in beta at six
                                     all of the vendor's SOA products          5 = 2,000 or more.                                                   customer sites.
                                     (including this product and those         4 = 1,000 to 1,999.
                                     listed in the "Other SOA infrastructure   3 = 500 to 999.
                                     products" criterion above)?               2 = 100 to 499.
                                                                               1 = 10 to 99.
                                                                               0 = Fewer than 10 or the vendor hasn't disclosed.


          New customers              How many customers bought or         This factor is scored on the number of customer              30%     4.00 36 customers.
                                     upgraded the product during the past installations the vendor reports having:
                                     year?                                5 = 40 or more.
                                                                          4 = 30 to 39.
                                                                          3 = 20 to 29.
                                                                          2 = 10 to 19.
                                                                          1 = Three to nine.
                                                                          0 = Fewer than three or the vendor hasn't
                                                                          disclosed.




© 2006, Forrester Research, Inc.                                                                                                                                                               59
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                     > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                       > Back to "Scores and weightings"

 Vendor Scorecard: AmberPoint




                                                                                                                                    Forrester
                                                                                                                                                                    Show Criteria and Scale Explanations




                                                                                                                                    Weightin
  Control Level of Criteria Detail
                                                                                                                                                                    Hide Criteria and Scale Explanations




                                                                                                                                                Score
  Less                     More

 Evaluation Criteria                 Criteria Explanation                     Scale Explanation                                                      Score Explanation




                                                                                                                                    g
          Users on maintenance       What percentage of customers of all      This factor is scored on the percentage of                15%     4.00 Ninety-three percent of customers are on active
                                     versions of this product are on active   customers for all versions of this product that the                    maintenance agreements.
                                     maintenance agreements?                  vendor reports are on maintenance agreement:
                                                                              5 = 97% or more.
                                                                              4 = 90% to 96%.
                                                                              3 = 80% to 89%.
                                                                              2 = 70% to 79%.
                                                                              1 = 60% to 69%.
                                                                              0 = Less than 60% or the vendor hasn't disclosed.


          Reference accounts         What companies are the major          Forrester provides this information to aid our                0%     0.00 Best Buy, British Telecom, Defence Information
                                     reference customers for this product? clients' decisions; we don't score or weight this                         Systems Agency (DISA), H&R Block Financial
                                                                           attribute.                                                                Advisors, Kaiser Permanente, MedicAlert,
                                                                                                                                                     Motorola, and Orange.
      Revenue                        What is the vendor's revenue over        This score is based on overall revenue as                 25%     2.00 The vendor's revenue is $10 million to $15 million.
                                     the period from Q4 2004 through Q3       reported by the vendor:
                                     2005?                                    5 = More than $1 billion.
                                                                              4 = $500 million to $1 billion.
                                                                              3 = $50 million to $499 million.
                                                                              2 = $10 million to $49 million.
                                                                              1 = Less than $10 million.
                                                                              0 = The vendor hasn't disclosed.
      Revenue growth                 What is the vendor's year-over-year      Forrester provides this information to aid our             0%     0.00 The vendor reports revenue growth of 380%.
                                     revenue growth over the period from      clients' decisions; we don't score or weight this
                                     Q3 2004 through Q3 2005?                 attribute.

      Systems integrators            What systems integrator partners         This factor is scored on the number of systems            15%     2.00 Booz Allen Hamilton, IBM Global Services, and
                                     have completed three or more             integrator partners the vendor reports have                            Merlin Technical Solutions are each in process
                                     deployments of any version of this       completed three or more deployments of this                            with major customer deployments, but most
                                     product in the past 18 months?           product in the past 18 months:                                         customer deployments have been handled by
                                                                              5 = Five or more.                                                      AmberPoint's own professional services group.
                                                                              4 = Four.
                                                                              3 = Three.
                                                                              2 = Two.
                                                                              1 = One.
                                                                              0 = Zero or the vendor hasn't disclosed.
      Services                       How strong are the vendor's              This score is a weighted average of its                   10%     2.50 AmberPoint's in-house professional services team
                                     implementation and training              subattributes: Implementation engineers and                            is small, but it has a full range of training
                                     services?                                Training.                                                              offerings.




© 2006, Forrester Research, Inc.                                                                                                                                                                60
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                  > Back to "Scores and weightings"

 Vendor Scorecard: AmberPoint




                                                                                                                               Forrester
                                                                                                                                                               Show Criteria and Scale Explanations




                                                                                                                               Weightin
  Control Level of Criteria Detail
                                                                                                                                                               Hide Criteria and Scale Explanations




                                                                                                                                           Score
  Less                     More

 Evaluation Criteria                 Criteria Explanation                  Scale Explanation                                                    Score Explanation




                                                                                                                               g
          Implementation engineers   How many employees provide            This factor is scored on the number of employees        50%     0.00 Five (four in US and one in Europe).
                                     implementation services for this      the vendor reports having dedicated to
                                     product?                              implementation services for this product:
                                                                           5 = 100 or more.
                                                                           4 = 70 to 99.
                                                                           3 = 40 to 69.
                                                                           2 = 20 to 49.
                                                                           1 = 10 to 19.
                                                                           0 = Fewer than 10 or the vendor hasn't disclosed.

          Training                   Does the vendor offer classroom,      Measured by how many training channels the              50%     5.00 AmberPoint offers all three options. In addition,
                                     Web-based, and on-site training?      vendor offers:                                                       the product comes with an electronic tutorial that
                                                                           5 = All three channels.                                              has a full, running SOA application consisting of
                                                                           3 = Two channels.                                                    five services in both Java and .NET.
                                                                           1 = One channel.
                                                                           0 = No training offered.
      Employees                      How many engineers does the           This score is a weighted average of its                 10%     3.00 AmberPoint is a small firm, but it has begun to
                                     vendor have dedicated to this         subattributes: Total employees, Dedicated                            establish a global presence. It has a moderately
                                     product? How big is the vendor's      engineers, and Sales staff.                                          sized engineering team.
                                     sales presence?
          Total employees            How many employees does the           This factor is scored on the total number of            50%     3.00 AmberPoint has 109 employees.
                                     vendor have?                          employees the vendor reports having:
                                                                           5 = 10,000 or more.
                                                                           4 = 300 to 9,999.
                                                                           3 = 80 to 299.
                                                                           2 = 40 to 79.
                                                                           1 = 25 to 39.
                                                                           0 = Fewer than 25 or the vendor hasn't disclosed.

          Dedicated engineers        How many engineers are dedicated      This factor is scored on the total number of            25%     3.00 AmberPoint has 65 engineers dedicated to
                                     to research and development of this   engineers the vendor reports having dedicated to                     research and development of this product.
                                     product line?                         this product line:
                                                                           5 = 300 or more.
                                                                           4 = 100 to 299.
                                                                           3 = 30 to 99.
                                                                           2 = 15 to 29.
                                                                           1 = 5 to 14.
                                                                           0 = Fewer than five or vendor hasn't disclosed.




© 2006, Forrester Research, Inc.                                                                                                                                                           61
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                                        > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                                          > Back to "Scores and weightings"

 Vendor Scorecard: AmberPoint




                                                                                                                                                       Forrester
                                                                                                                                                                                       Show Criteria and Scale Explanations




                                                                                                                                                       Weightin
  Control Level of Criteria Detail
                                                                                                                                                                                       Hide Criteria and Scale Explanations




                                                                                                                                                                   Score
  Less                     More

 Evaluation Criteria                                    Criteria Explanation                    Scale Explanation                                                       Score Explanation




                                                                                                                                                       g
          Sales staff                                   How large and how global is the         Measured by size and global footprint of sales             25%     3.00 AmberPoint has 30 sales staff, with offices in
                                                        vendor's sales force? What              organization:                                                           North America, EMEA, and Asia Pacific. Each
                                                        percentage of the sales force           5 = 100-plus, with global presence.                                     region has dedicated vice presidents and sales
                                                        supports Europe, Asia Pacific, and      3 = 25 to 99, no global presence.                                       teams. AmberPoint supports European customers
                                                        Rest of World?                          1 = Less than 25, no global presence.                                   via a support center in Paris.
      Technology partners                               How strongly do technology partners     This score is a weighted average of its                    10%     1.50 AmberPoint has an initial set of partners, including
                                                        support this product?                   subattributes: License partners, Resellers, and                         some with product-level integration.
                                                                                                Other partners.
          License partners                              What vendors license or bundle this This score is the weighted average of the number               50%     1.00 Microsoft bundles AmberPoint Express (free
                                                        product?                                of vendors that the vendor reports license or                           version) with Visual Studio .NET, and Microsoft
                                                                                                bundle this product:                                                    has additional joint development and licensing
                                                                                                5 = 10 or more.                                                         agreements with AmberPoint.
                                                                                                4 = Seven to nine.
                                                                                                3 = Five or six.
                                                                                                2 = Three or four.
                                                                                                1 = One or two.
                                                                                                0 = Zero or the vendor hasn't disclosed.
          Resellers                                     What firms resell this product?         This score is the weighted average of the number           50%     2.00 IBM, Accenture, Merlin, SYSCOM (Taiwan), Blue
                                                                                                of resellers that the vendor reports offer this                         Turtle (South Africa), CTC (Japan), SRA (Japan),
                                                                                                product:                                                                Samsung Data Systems (Korea), and Rogue
                                                                                                5 = 20 or more.                                                         Wave Software. AmberPoint's agreement with
                                                                                                4 = 15 to 19.                                                           these vendors allows them to sell the product
                                                                                                3 = 10 to 14.                                                           outright or run it as a hosted service.
                                                                                                2 = Five to nine.
                                                                                                1 = One to four.
                                                                                                0 = Zero or vendor hasn't disclosed.
          Other partners                                What other vendors have modified        Forrester provides this information to aid our              0%     0.00 BEA Systems, GT Software, BM (WebSphere),
                                                        their products to better integrate with clients' decisions; we score this attribute 0 in all                    and Sonic Software.
                                                        this product (as opposed to having      cases.
                                                        only standards-based interop)?


 © 2006, Forrester Research, Inc. All rights reserved. Forrester, Forrester Wave, WholeView 2, Technographics, and Total Economic Impact
 are trademarks of Forrester Research, Inc. All other trademarks are the property of their respective companies. Forrester clients may make
 one attributed copy or slide of each figure contained herein. Additional reproduction is strictly prohibited. For additional reproduction rights
 and usage information, go to www.forrester.com. Information is based on best available resources. Opinions reflect judgment at the time




© 2006, Forrester Research, Inc.                                                                                                                                                                                   62
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                     > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                       > Back to "Scores and weightings"

 Vendor Scorecard: CA




                                                                                                                                    Forrester
                                                                                                                                                                    Show Criteria and Scale Explanations




                                                                                                                                    Weightin
  Control Level of Criteria Detail
                                                                                                                                                                    Hide Criteria and Scale Explanations




                                                                                                                                                Score
  Less                     More

 Evaluation Criteria                 Criteria Explanation                     Scale Explanation                                                      Score Explanation




                                                                                                                                    g
 CURRENT OFFERING                                                                                                                       50%     2.83
     Products included               What is the precise product or set of    This item is for information only and is not scored        0%     0.00 CA offers Unicenter Web Services Distributed
                                     products that the vendor offers as its   or weighted.                                                           Management (WSDM) 3.50 and eTrust
                                     service-oriented architecture (SOA)                                                                             TransactionMinder 6.0 SP1.
                                     and Web services management
                                     solution?
      IT-level management            How does the product manage              This score is a weighted average of its                   20%     3.50 CA directly supports a narrow range of service
                                     service performance and availability?    subattributes: Endpoint support, Performance                           endpoint protocols but indirectly supports
                                                                              management, Availability management, and                               additional ones. It tracks only service-level goals
                                                                              Service-level management.                                              — not service-level agreements (SLAs) tied to
                                                                                                                                                     users. Its availability management includes the
                                                                                                                                                     most extensive architecture for service heartbeats
                                                                                                                                                     of any of the solutions in this Wave.

          Endpoint support           What access protocols (SOAP,             Measured by the breadth of support for various            20%     4.00 Unicenter WSDM supports SOAP over HTTP and
                                     XML/HTTP, Java Message Service           protocols, payload types, and native agents for                        JMS. In addition, because its Java agent is
                                     (JMS), Java RMI, WebSphere MQ,           specific products:                                                     implemented as a JAX-RPC handler, the product
                                     .NET Remoting, others) and service       5 = Broad support.                                                     will transparently handle requests that come in on
                                     implementation technologies (Java        3 = Average support.                                                   any other protocol supported by the application
                                     EE, .NET, databases, others) does        1 = Minimal support.                                                   server's JAX-RPC handler chain. Custom
                                     the product fully monitor? What          0 = No support.                                                        handlers for other message types may be custom
                                     specific products does the product                                                                              built using its agent development kit. It provides
                                     support?                                                                                                        native agents for .NET, SAP, WebSphere,
                                                                                                                                                     WebLogic, JBoss, Sun Microsystems, and
                                                                                                                                                     Apache Axis.
          Performance management     How does the product gather, report,     Measured by the breadth and depth of                      30%     2.00 Unicenter WSDM collects and reports
                                     and analyze service performance          functionality for gathering, analyzing, and                            performance data for both individual services and
                                     data, including 1) reporting against     correlating data about service invocations and                         service groups, which may be defined to include
                                     performance goals and 2) correlation     service implementations:                                               services important to a given business unit or
                                     of performance data across               5 = Deep functionality.                                                region. Via integration with CA's other Unicenter
                                     technology layers within service         3 = Average functionality.                                             products, Unicenter WSDM can participate in
                                     implementations?                         1 = Minimal functionality.                                             creating a correlated performance view across
                                                                              0 = No functionality.                                                  technology tiers.




© 2006, Forrester Research, Inc.                                                                                                                                                                63
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                                  > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                                    > Back to "Scores and weightings"

 Vendor Scorecard: CA




                                                                                                                                                 Forrester
                                                                                                                                                                                 Show Criteria and Scale Explanations




                                                                                                                                                 Weightin
  Control Level of Criteria Detail
                                                                                                                                                                                 Hide Criteria and Scale Explanations




                                                                                                                                                             Score
  Less                     More

 Evaluation Criteria                           Criteria Explanation                       Scale Explanation                                                       Score Explanation




                                                                                                                                                 g
          Availability management              How does the product gather, report,       Measured by the breadth and depth of                       30%     5.00 Unicenter WSDM collects and reports availability
                                               and analyze service availability data,     functionality for identifying, analyzing, and                           data in the same manner as performance data,
                                               including root cause analysis of           correlating availability issues for services and                        and it actively monitors service availability via two
                                               availability issues across technology      service implementations:                                                methods. First, it can generate synthetic
                                               layers within service                      5 = Deep functionality.                                                 transactions to a service (either to a special
                                               implementations?                           3 = Average functionality.                                              service operation built for the purpose or to an
                                                                                          1 = Minimal functionality.                                              existing service operation). Second, it can
                                                                                          0 = No functionality.                                                   generate a ping to the agent monitoring the
                                                                                                                                                                  service (which is deployed within the service's
                                                                                                                                                                  container). In addition, a synthetic transaction can
                                                                                                                                                                  invoke a series of calls to multiple services,
                                                                                                                                                                  enabling availability testing for more complex
                                                                                                                                                                  aggregate service scenarios.

          Service-level management             How does the product 1) specify            Measured by the breadth and depth of                       20%     3.00 Unicenter WSDM tracks systemwide service-level
                                               service-level goals, 2) tie service-       functionality for specifying service-level goals and                    goals but not SLAs tied to different service users
                                               level goals to specific users or groups    SLAs and monitoring and managing operations to                          or groups. It provides a large number of patterns
                                               to create service-level agreements         maintain service-level goals:                                           for service-level goals and metrics. Via integration
                                               (SLAs), 3) monitor and report service-     5 = Deep functionality.                                                 with CA's Unicenter Service Management product,
                                               level compliance over time, and 4)         3 = Average functionality.                                              Unicenter WSDM can participate in creating a
                                               automatically adjust service               1 = Minimal functionality.                                              larger and more complete picture of service-level
                                               operations to better achieve SLAs?         0 = No functionality.                                                   management. There are no built-in features for
                                                                                                                                                                  automatically adjusting service operations for
                                                                                                                                                                  service-level compliance, but autoresponse
                                                                                                                                                                  features allow custom adjustments.

      Business-level management                How does the product provide               This score is a weighted average of its                     5%     1.65 CA's solution can extract business data from
                                               business insight by extracting and         subattributes: Business activity montioring,                            messages (via XPath). Other CA products provide
                                               reporting data from service request-       Usability by business users, and Integration for                        business-oriented portal displays. Business data
                                               response flows?                            business monitoring.                                                    is available via integration APIs or by reading
                                                                                                                                                                  logs.
          Business activity monitoring (BAM)   How do the product's built-in features     Measured by the breadth and depth of                       30%     2.00 Unicenter WSDM supports business activity
                                               provide business insight from service      functionality for capturing business data from                          analysis by providing XPath-based extraction of
                                               operation by extracting, analyzing,        service requests and tying that data to business                        business data from message payloads. Its Eclipse-
                                               and reporting on business data             processes:                                                              based SOAP Explorer tool may be used to
                                               contained in the flow of service           5 = Deep functionality.                                                 visually author XPath expressions based on real-
                                               requests and responses? What are           3 = Average functionality.                                              world message content. Unicenter WSDM also
                                               its capabilities for tying such analysis   1 = Minimal functionality.                                              can invoke Web services calls or custom Java
                                               to an end-to-end business process          0 = No functionality.                                                   code to drive other elements of a business activity
                                               flow?                                                                                                              monitoring solution, including CA's Unicenter
                                                                                                                                                                  Service Management product.



© 2006, Forrester Research, Inc.                                                                                                                                                                             64
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                              > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                                > Back to "Scores and weightings"

 Vendor Scorecard: CA




                                                                                                                                             Forrester
                                                                                                                                                                             Show Criteria and Scale Explanations




                                                                                                                                             Weightin
  Control Level of Criteria Detail
                                                                                                                                                                             Hide Criteria and Scale Explanations




                                                                                                                                                         Score
  Less                     More

 Evaluation Criteria                            Criteria Explanation                    Scale Explanation                                                     Score Explanation




                                                                                                                                             g
          Usability by business users           How understandable to and usable by     Measured by the breadth and depth of                     35%     1.00 Although Unicenter WSDM does not provide a
                                                business staff are the product's        functionality for creating business-oriented                          business console, it integrates with CA's other
                                                business activity monitoring tools?     displays and the extent to which these are usable                     service management and Unicenter ServicePlus
                                                                                        by business staff:                                                    solutions, which do.
                                                                                        5 = Deep functionality.
                                                                                        3 = Average functionality.
                                                                                        1 = Minimal functionality.
                                                                                        0 = No functionality.
          Integration for business monitoring   What are the data capture methods Measured by the breadth of options by which                    35%     2.00 Other products can access business activity data
                                                and configuration options for feeding other products can get business activity data                           through Unicenter WSDM's APIs or by reading its
                                                data to other analysis tools (BAM,      captured by the product:                                              logs.
                                                data warehousing, others)?              5 = Deep integration options.
                                                                                        3 = Average integration options.
                                                                                        1 = Minimal integration options.
                                                                                        0 = No integration options.
      Product architecture                      How robust is the product's overall     This score is a weighted average of its                  15%     2.45 Unicenter WSDM provides native agents for
                                                architecture, including its integration subattributes: Deployment styles and                                  several platforms and a proxy configuration via an
                                                with development life-cycle             requirements, metamodel for services and                              agent built into TransactionMinder's proxy. CA's
                                                management infrastructure?              processes, Enterprise management integration,                         service model is not extensible. It has deep out-of-
                                                                                        Metadata and repository integration, Development                      the-box enterprise management integration with
                                                                                        life-cycle integration, Load balancing and                            CA products but is otherwise limited. It has limited
                                                                                        scalability (product), Load balancing and                             development life-cycle integration and limited
                                                                                        scalability (service), Failover (product), Dynamic                    capabilities for service failover and load
                                                                                        reconfiguration, and Performance-specific                             balancing.
                                                                                        features.




© 2006, Forrester Research, Inc.                                                                                                                                                                         65
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                               > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                                 > Back to "Scores and weightings"

 Vendor Scorecard: CA




                                                                                                                                              Forrester
                                                                                                                                                                              Show Criteria and Scale Explanations




                                                                                                                                              Weightin
  Control Level of Criteria Detail
                                                                                                                                                                              Hide Criteria and Scale Explanations




                                                                                                                                                          Score
  Less                     More

 Evaluation Criteria                             Criteria Explanation                      Scale Explanation                                                   Score Explanation




                                                                                                                                              g
          Deployment styles and requirements     What are the options for deployment       Measured by the breadth of deployment options          20%     3.00 Unicenter WSDM provides an agent deployment
                                                 of monitoring elements (such as           and depth of integration with numerous service                      model with native agents for Apache Axis, BEA
                                                 agent, proxy, inline, tool kit for        endpoint technologies:                                              Systems WebLogic, IBM WebSphere, JBoss,
                                                 embedding an agent in an                  5 = Broad deployment options.                                       Microsoft .NET, SAP NetWeaver, and Sun
                                                 application, others)? What servers or     3 = Average deployment options.                                     Microsystems Java System Application Server.
                                                 other infrastructure are required?        1 = Limited deployment options.                                     Via eTrust TransactionMinder's proxy-based
                                                                                                                                                               deployment model, Unicenter WSDM provides a
                                                                                                                                                               proxy model because its agents are built into
                                                                                                                                                               TransactionMinder's proxy. TransactionMinder
                                                                                                                                                               also provides agents that deploy into Web servers
                                                                                                                                                               like Apache and IIS. Unicenter WSDM provides
                                                                                                                                                               four central elements: configuration manager,
                                                                                                                                                               monitoring engine, alert engine, and a UI engine,
                                                                                                                                                               all of which run on JBoss. Internal messaging
                                                                                                                                                               between these elements is via JMS. Unicenter
                                                                                                                                                               WSDM includes open interfaces for building
                                                                                                                                                               custom agents for any service container (or other
                                                                                                                                                               SOA infrastructure).
          Metamodel for services and processes   What is the underlying structure,         Measured by the breadth and extensibility of the       20%     1.00 Unicenter WSDM's service metamodel is
                                                 extensibility, and integrability of the   product's metamodels for services and their                         accessible via WSDL interfaces. However, CA
                                                 product's service and process model,      surrounding context (processes, infrastructure,                     does not focus directly on extensibility of the
                                                 including 1) the metamodel for            etc.):                                                              service metamodel.
                                                 defining both services and the            5 = Broad and highly extensible model.
                                                 processes into which they fit and 2)      3 = Basic model with some extensibility.
                                                 the breadth of different technologies     1 = Narrow model with no extensibility.
                                                 included in the model?
          Enterprise management integration      How does the product integrate with   Measured by the breadth of options for and the             20%     3.00 Although available as a standalone product,
                                                 enterprise IT management              extent of prebuilt integration with enterprise                          Unicenter WSDM is very deeply integrated with
                                                                                       infrastructure management solutions:
                                                 infrastructure, particularly to achieve                                                                       the rest of CA's enterprise management product
                                                 a correlated view of 1) all technology5 = Deep standards-based and prebuilt                                   line. For integration to other vendors' enterprise
                                                 layers of a service implementation    integration.                                                            management, it can generate Simple Network
                                                                                       3 = Basic integration.
                                                 and 2) all technologies that affect the                                                                       Management Protocol (SNMP) traps.
                                                 health of a given business process?   1 = Minimal integration.
                                                                                       0 = No integration.
          Metadata and repository integration    How does the product share            Measured by the breadth of options for and the              5%     2.00 Unicenter WSDM can import WSDL interfaces
                                                 metadata with other products (import, extent of prebuilt integration with service                             and information from other UDDI repositories.
                                                 export, common repository)?           repositories (UDDI and others):
                                                                                       5 = Deep standards-based and prebuilt
                                                                                       integration.
                                                                                       3 = Basic integration.
                                                                                       1 = Minimal integration.
                                                                                       0 = No integration.

© 2006, Forrester Research, Inc.                                                                                                                                                                          66
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                                   > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                                     > Back to "Scores and weightings"

 Vendor Scorecard: CA




                                                                                                                                                  Forrester
                                                                                                                                                                                  Show Criteria and Scale Explanations




                                                                                                                                                  Weightin
  Control Level of Criteria Detail
                                                                                                                                                                                  Hide Criteria and Scale Explanations




                                                                                                                                                              Score
  Less                     More

 Evaluation Criteria                                 Criteria Explanation                      Scale Explanation                                                   Score Explanation




                                                                                                                                                  g
          Development life-cycle integration         How does the product integrate with       Measured by the breadth and depth of feature-           5%     1.00 CA is working with SOA repository and
                                                     development tools, repositories, and      function for development life-cycle integration:                    governance vendors to improve Unicenter
                                                     SOA governance solutions? In              5 = Deep integration.                                               WSDM's integration into the full service life-cycle
                                                     particular: 1) for deployment, how        3 = Basic integration.                                              environment. Developers can view service history
                                                     does the product import development       1 = Minimal integration.                                            through the product's management console and
                                                     tool definitions of service               0 = No integration.                                                 its historical displays.
                                                     implementation structure and service
                                                     relationships and 2) for guiding future
                                                     development, how does the product
                                                     provide developers with an integrated
                                                     view of service configuration and
                                                     operations history?

          Load balancing and scalability (product)   What is the architecture for sharing a Measured by the extent to which all product                5%     3.00 Unicenter WSDM's internal architecture is based
                                                     workload across multiple product       elements may participate in a load balancing                           on JMS and leverages reliability features of JMS.
                                                     instances?                             architecture:                                                          TransactionMinder has an internal clustering
                                                                                            5 = Deep load balancing abilities.                                     architecture and policy caching within agent
                                                                                            3 = Basic load balancing abilities.                                    endpoints.
                                                                                            1 = Minimal load balancing abilities.
                                                                                            0 = No load balancing abilities.
          Load balancing and scalability (service)   How does the product load balance      Measured by the breadth and depth of feature-              5%     0.00 Unicenter WSDM has limited capabilities for load
                                                     incoming service requests across       function for service load balancing:                                   balancing across service instances; installations
                                                     multiple underlying instances of a     5 = Deep features.                                                     of the product typically rely on existing load
                                                     service?                               3 = Basic features.                                                    balancing features of the network or the
                                                                                            1 = Minimal features.                                                  underlying service platform.
                                                                                            0 = No features.
          Failover (product)                         What is the architecture for failing   Measured by the extent to which all product                5%     2.00 With a small amount of customization, Unicenter
                                                     over a workload from one product       elements may participate in a failover                                 WSDM agents can switch to a backup
                                                     instance to another?                   architecture:                                                          management server if the primary fails.
                                                                                            5 = Deep failover abilities.                                           TransactionMinder has an internal clustering
                                                                                            3 = Basic failover abilities.                                          architecture and policy caching within agent
                                                                                            1 = Minimal failover abilities.                                        endpoints.
                                                                                            0 = No failover abilities.
          Failover (service)                         How does the product manage            Measured by the breadth and depth of feature-              5%     5.00 Unicenter WSDM's alert facilities may be used to
                                                     failover from one instance of a        function for service failover:                                         invoke automated scripts or Java code to initiate a
                                                     service to another? Does the product 5 = Deep features.                                                       custom failover action. In addition, Unicenter
                                                     monitor services using heartbeats?     3 = Basic features.                                                    WSDM has an advanced architecture for
                                                                                            1 = Minimal features.                                                  proactively monitoring service availability via
                                                                                            0 = No features.                                                       synthetic transactions (described above).




© 2006, Forrester Research, Inc.                                                                                                                                                                              67
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                         > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                           > Back to "Scores and weightings"

 Vendor Scorecard: CA




                                                                                                                                        Forrester
                                                                                                                                                                        Show Criteria and Scale Explanations




                                                                                                                                        Weightin
  Control Level of Criteria Detail
                                                                                                                                                                        Hide Criteria and Scale Explanations




                                                                                                                                                    Score
  Less                     More

 Evaluation Criteria                         Criteria Explanation                   Scale Explanation                                                    Score Explanation




                                                                                                                                        g
          Dynamic reconfiguration            What product configuration options,    Measured by the product's features and design for       10%     4.00 No service configuration changes require a
                                             when changed, require a product        performing service configuration changes, product                    product restart. Within major releases, CA will
                                             restart (such as performing product    configuration changes, and product upgrades with                     allow endpoints to be upgraded while the central
                                             upgrades, adding/removing              no downtime:                                                         server is still back-leveled. Combined with the
                                             management server instances or         5 = Deep features.                                                   ability for Unicenter WSDM agents to switch to a
                                             management consoles, etc.)?            3 = Basic features.                                                  backup management server, this would allow a no-
                                                                                    1 = Minimal features.                                                downtime upgrade.
                                                                                    0 = No features.
          Performance-specific features      What product features are specifically Because performance is best measured via direct          0%     0.00 Agents are multithreaded, network
                                             intended as performance-enhancing tests, this item is not scored or weighted, but                           communications may be configured to be
                                             options (such as persistent network rather simply provided for information.                                 completely asynchronous, and metrics evaluation
                                             connections)?                                                                                               may be configured to run on the agent or the
                                                                                                                                                         management server. Logging responsibilities may
                                                                                                                                                         be split between agents and the central
                                                                                                                                                         management server to balance load.

      Trust enablement                       How rich are the product's features    This score is a weighted average of its                 10%     3.40 CA has broad support for different types of
                                             for establishing trust and fitting withsubattributes: Authentication/authorization,                         authentication but limited support for external
                                             an overall architecture for trust      Identity management integration, Encryption and                      identity management products. It has relatively
                                             management?                            signatures, Identity propagation, and Application                    strong support for identity propagation.
                                                                                    security integration.
          Authentication and authorization   For managed services, what             Measured by the product's built-in features for         20%     5.00 Transport-level authentication is via SSL.
                                             authentication protocols, token types, authentication and authorization:                                    Message-level authentication is via WS-Security
                                             and authorization styles and policies 5 = Deep features.                                                    (username, X.509, and Security Assertion Markup
                                             (such as role-based access control) 3 = Basic features.                                                     Language (SAML) tokens), XML digital
                                             does the product support?              1 = Minimal features.                                                signatures, and by collecting credentials from the
                                                                                    0 = No features.                                                     incoming request body. The product provides role-
                                                                                                                                                         based access by associating roles with services
                                                                                                                                                         as part of the configuration for authentication. In
                                                                                                                                                         addition, it can pull user attributes from a directory
                                                                                                                                                         (such as account numbers or account status) and
                                                                                                                                                         use them in authorization rules.




© 2006, Forrester Research, Inc.                                                                                                                                                                    68
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                             > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                               > Back to "Scores and weightings"

 Vendor Scorecard: CA




                                                                                                                                            Forrester
                                                                                                                                                                            Show Criteria and Scale Explanations




                                                                                                                                            Weightin
  Control Level of Criteria Detail
                                                                                                                                                                            Hide Criteria and Scale Explanations




                                                                                                                                                        Score
  Less                     More

 Evaluation Criteria                           Criteria Explanation                    Scale Explanation                                                     Score Explanation




                                                                                                                                            g
          Identity management integration      To what identity management             Measured by the product's breadth and depth of           40%     2.00 eTrust TransactionMinder, because it is based on
                                               infrastructure products can the         integration with identity management platforms for                    eTrust SiteMinder, supports all of SiteMinder's
                                               product delegate authentication and     authentication and authorization:                                     features and can serve as an integration point to
                                               authorization decisions (including      5 = Deep integration.                                                 enterprise infrastructure for identity and
                                               LDAP and other directories)?            3 = Basic integration.                                                entitlements. Unicenter WSDM can delegate
                                                                                       1 = Minimal integration.                                              authentication to Lightweight Directory Access
                                                                                       0 = No integration.                                                   Protocol (LDAP), and it can use identities stored
                                                                                                                                                             in relational databases. Ir also integrates with
                                                                                                                                                             CA's other identity management and provisioning
                                                                                                                                                             products.
          Encryption and signatures            What encryption and digital signature   Measured by the product's breadth of options for         20%     5.00 Transport-level encryption is via SSL. Message-
                                               options does the product support        providing encryption and signatures using the                         level protection is via XML Signature and XML
                                               (transport-level, message-level,        product:                                                              Encryption (either standalone or via WS-Security).
                                               message element-level, various          5 = Many options.
                                               protocols)?                             3 = Some options.
                                                                                       1 = Few options.
                                                                                       0 = No options.
          Application security integration     What out-of-box support is provided Measured by the product's breadth of options for             20%     3.00 Unicenter WSDM can populate X.509 and SAML
                                               for propagating identity to underlying propagating identity to underlying services:                           tokens in a WS-Security header of a SOAP
                                               service implementations? For            5 = Many options.                                                     message, and it will pass through any identity
                                               integrating the product's security with 3 = Some options.                                                     information in the incoming message. Generated
                                               the native security models of           1 = Few options.                                                      SAML tokens can include user attributes pulled
                                               underlying application platforms?       0 = No options.                                                       from a directory.

      Administrative tooling and integration   How functional, usable, integrable,     This score is a weighted average of its                  10%     2.95 CA has strong tooling for administration, although
                                               and complete are the product's          subattributes: Management administration,                             it lacks role-based access to its admin tools. It
                                               administrative interfaces?              Security administration, Management console,                          has a strong management console but no APIs for
                                                                                       Capacity planning, and Administrative integration.                    custom management integration.

          Management administration            What service management policies        Measured by the richness, breadth, and overall           30%     2.00 Unicenter WSDM, together with eTrust
                                               and service configuration options do usability of the product's service configuration                         TransactionMinder, supports policies for security,
                                               administrative tools provide for        capabilities and interface and the product's                          service-level goals, alerts, and logging. The
                                               controlling service operation? What features for role-based access control to                                 browser-based console does not provide role-
                                               access control and customization        administrative screens:                                               based access control — all authenticated users
                                               does the product provide for            5 = Advanced configuration options and access                         have access to all console functions. Alerts on an
                                               administration functions (such as role- control.                                                              individual service may be defined at three levels
                                               based security and customized           3 = Average configuration options and access                          of increasing severity, each with a different action
                                               displays)?                              control.                                                              or alert. Services can be automatically
                                                                                       1 = Limited configuration options and access                          discovered, populated into the catalog, and,
                                                                                       control.                                                              based on defined parameters, automatically
                                                                                                                                                             placed into existing service groups.



© 2006, Forrester Research, Inc.                                                                                                                                                                        69
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                            > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                              > Back to "Scores and weightings"

 Vendor Scorecard: CA




                                                                                                                                           Forrester
                                                                                                                                                                           Show Criteria and Scale Explanations




                                                                                                                                           Weightin
  Control Level of Criteria Detail
                                                                                                                                                                           Hide Criteria and Scale Explanations




                                                                                                                                                       Score
  Less                     More

 Evaluation Criteria                          Criteria Explanation                     Scale Explanation                                                    Score Explanation




                                                                                                                                           g
          Security administration             What service security policy             Measured by the richness, breadth, and overall          25%     5.00 Unicenter WSDM's policy server provides an
                                              (authentication, authorization,          usability of the product's security configuration                    administrative console for managing
                                              auditing) and security log               capabilities and interface:                                          authentication, authorization, and audit policy,
                                              configuration options do the product's   5 = Advanced configuration options.                                  including keystores and key management.
                                              administrative tools provide? Can        3 = Average configuration options.                                   Security events can be logged to a separate log.
                                              security events be logged to a           1 = Limited configuration options.                                   eTrust TransactionMinder's authorization policies
                                              separate log?                                                                                                 include the ability to write custom authorization
                                                                                                                                                            rules that can incorporate data from a message
                                                                                                                                                            payload and user attributes from a directory.

          Management console                  What range of status and command         Measured by the richness, breadth, and overall          25%     4.00 Unicenter WSDM's graphical displays provide real-
                                              displays does the product provide?       usability of the product's status displays:                          time status displays of service availability,
                                              How usable are they?                     5 = Advanced configuration options.                                  performance, faults, and trends. Views may be
                                                                                       3 = Average configuration options.                                   filtered for selected display of large numbers of
                                                                                       1 = Limited configuration options.                                   services. The product's inherent service groups
                                                                                                                                                            feature may be used to create subset views of
                                                                                                                                                            services and service operations. Graphics include
                                                                                                                                                            defined alert levels for comparison.

          Capacity planning                   What support does the product         Measured by the depth and breadth of features               5%     2.00 For managed services, Unicenter WSDM provides
                                              provide for planning capacity of both and resources for planning capacity of managed                          its standard historical reports for use in capacity
                                              underlying services and the product   services and of the product itself:                                     planning. Integration with other CA management
                                              itself?                               5 = Several features and resources.                                     products provides a broader and deeper view of
                                                                                    3 = Some features and resources.                                        capacity considerations.
                                                                                    1 = Limited features and resources.
          Administrative integration          What are the integration interfaces   Measured by the product's breadth and depth of             15%     0.00 No significant features.
                                              for programmatic configuration and    integration APIs and options:
                                              access to metrics data (that is, for  5 = Full APIs for integration, multiple options.
                                              bypassing the product's user          3 = Basic APIs for integration.
                                              interfaces and integrating with other 1 = Minimal APIs for integration.
                                              tools)?                               0 = No APIs for integration.
      Application integration and mediation   What features does the product have This score is a weighted average of its                       5%     0.90 CA has very limited features for application
                                              for mediating between different       subattributes: Version control, Protocol mediation,                     integration and mediation.
                                              message formats and protocols used Transformation, Policy-based processing, and
                                              by service requesters and providers? Other integration.




© 2006, Forrester Research, Inc.                                                                                                                                                                       70
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                    > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                      > Back to "Scores and weightings"

 Vendor Scorecard: CA




                                                                                                                                   Forrester
                                                                                                                                                                   Show Criteria and Scale Explanations




                                                                                                                                   Weightin
  Control Level of Criteria Detail
                                                                                                                                                                   Hide Criteria and Scale Explanations




                                                                                                                                               Score
  Less                     More

 Evaluation Criteria                 Criteria Explanation                     Scale Explanation                                                     Score Explanation




                                                                                                                                   g
          Version resolution         How can the product route an             Measured by the product's depth of understanding         40%     1.00 Unicenter WSDM does not provide functions to
                                     incoming service request to the          of versioning and its built-in (preferred) or                         support version resolution, but it does provide an
                                     correct version of an underlying         configurable capabilities for routing requests to                     interface for plugging in a custom component to
                                     service (assuming that multiple          different versions:                                                   do so.
                                     versions of a service can run in         5 = Deep version routing features.
                                     production at the same time)?            3 = Basic routing based on XML Path Language
                                                                              (XPath).
                                                                              1 = Minimal version routing.
                                                                              0 = No version routing.
          Protocol mediation         What protocols can the product           Measured by the product's range of support for           20%     1.00 Unicenter WSDM does not provide functions to
                                     mediate between (when an incoming        transport protocol mediation:                                         support protocol mediation, but it does provide an
                                     service request arrives on a different   5 = Extensive protocol mediation.                                     interface for plugging in a custom component to
                                     protocol than is supported by the        3 = Basic protocol mediation.                                         do so.
                                     underlying service)?                     1 = Minimal protocol mediation.
                                                                              0 = No protocol mediation.
          Transformation             What capabilities does the product       Measured by the product's range of support for           15%     1.00 Unicenter WSDM does not provide functions to
                                     provide for resolving between            message transformation:                                               support message transformation, but it does
                                     different syntax and semantics of        5 = Extensive transformation features.                                provide an interface for plugging in a custom
                                     incoming request formats and             3 = Basic transformation features.                                    component to do so.
                                     formats supported by underlying          1 = Minimal transformation features.
                                     services?                                0 = No transformation features.
          Policy-based processing    How can the product process service      Measured by the product's features and flexibility       15%     1.00 Unicenter WSDM does not provide functions to
                                     requests differently based on            for configuring business policy-based routing:                        support this type of policy-based processing, but it
                                     business parameters for service          5 = Deep features.                                                    does provide an interface for plugging in a custom
                                     policy (for example, priority            3 = Basic features.                                                   component to do so.
                                     processing for premium customers or      1 = Minimal features.
                                     alternate routing for requests from a    0 = No features.
                                     particular source)? How flexible is the
                                     architecture for policy-based
                                     processing?
          Other integration          Does the product provide any            Measured by the depth and importance of any               10%     0.00 No features.
                                     additional application adaptation and additional features for application integration:
                                     integration capabilities?               5 = Deep features.
                                                                             3 = Basic features.
                                                                             1 = Minimal features.
                                                                             0 = No features.
      Deployment management          How does the product control            This score is a weighted average of its                    5%     2.25 CA has a strong mechanism for deployment
                                     deployment of its own artifacts and     subattributes: Deployment artificats, Deployment                       packaging, but its deployment is only via import-
                                     integrate its deployments with other package configuration, Rollback, Environment                              export of its own artifacts. It has no APIs for
                                     service infrastructure?                 staging, and Deployment integration.                                   custom deployment integration.




© 2006, Forrester Research, Inc.                                                                                                                                                               71
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                                > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                                  > Back to "Scores and weightings"

 Vendor Scorecard: CA




                                                                                                                                               Forrester
                                                                                                                                                                               Show Criteria and Scale Explanations




                                                                                                                                               Weightin
  Control Level of Criteria Detail
                                                                                                                                                                               Hide Criteria and Scale Explanations




                                                                                                                                                           Score
  Less                     More

 Evaluation Criteria                               Criteria Explanation                   Scale Explanation                                                     Score Explanation




                                                                                                                                               g
          Deployment artifacts                     For what application and service       Measured by the depth and breadth of service             15%     2.00 Unicenter WSDM provides no features beyond
                                                   artifacts can the product control      deployment features:                                                  manual import-export of its own policies, but CA's
                                                   production deployment? Across what     5 = Deep features.                                                    AllFusion Harvest Change Manager product (not
                                                   range of network and infrastructure    3 = Basic features.                                                   part of this evaluation) provides capabilities for
                                                   topologies?                            1 = Minimal features.                                                 deployment management.
                                                                                          0 = No features.
          Deployment package configuration         What are the capabilities for          Measured by the richness of the product's service        30%     4.00 Unicenter WSDM's service definition structures
                                                   specifying a group of artifacts to be  packaging structures:                                                 include the concept of a "service group" wherein
                                                   deployed to production as a unit?      5 = Deep features.                                                    multiple services may be treated as a set for
                                                                                          3 = Basic features.                                                   management and deployment.
                                                                                          1 = Minimal features.
                                                                                          0 = No features.
          Rollback                                 How does the product undo past         Measured by the richness of the product's rollback       20%     2.00 Unicenter WSDM has no built-in features for
                                                   production deployments and restore capabilities:                                                             rollback, but it could reimport a previous version
                                                   the prior configuration?               5 = Deep features.                                                    of service definitions. The product can maintain
                                                                                          3 = Basic features.                                                   multiple versions of a service in its catalog
                                                                                          1 = Minimal features.                                                 simultaneously.
                                                                                          0 = No features.
          Environment staging                      What is the product's support for      Measured by the richness of the product's                15%     1.00 Unicenter WSDM configurations (including the
                                                   multiple staging environments (such environment staging capabilities:                                        service groups noted above) may be exported to
                                                   as test, system test, production),     5 = Deep features.                                                    a file and imported into a production instance of
                                                   including deployment and rollback      3 = Basic features.                                                   Unicenter WSDM.
                                                   between them?                          1 = Minimal features.
                                                                                          0 = No features.
          Deployment integration                   How can the product's deployment       Measured by the range of options for creating            20%     1.00 Unicenter WSDM provides no features beyond
                                                   capabilities be integrated with other  integrated service deployment solutions:                              manual import and export of service definitions.
                                                   products' deployment features (to      5 = Deep features.                                                    An additional CA product, Unicenter Software
                                                   achieve a larger-scale unified         3 = Basic features.                                                   Delivery, provides functionality for deployment
                                                   deployment)?                           1 = Minimal features.                                                 integration.
                                                                                          0 = No features.
      Alerting, events, and exception management   What range of options does the         This score is a weighted average of its                  10%     3.10 CA has average alerting features and good
                                                   product have for responding to         subattributes: Alerting methods, Alert and event                      autoresponse features but limited exception
                                                   events and exceptions?                 specification, Autoresponse, and Exception                            management features.
                                                                                          management tools.
          Alerting methods                         What channels are provided for         Measured by the range of options for sending             30%     3.00 Unicenter WSDM supports notification via SNMP
                                                   notification of IT and business-level alerts and notifications:                                              traps, email, Web services, and native integration
                                                   events, exceptions, and alerts (email, 5 = Many options.                                                     with other Unicenter products (which provides
                                                   IM, SNMP trap, event integration       3 = Some options.                                                     access to the broader alerting capabilities of
                                                   features, others)?                     1 = Minimal options.                                                  Unicenter).
                                                                                          0 = No options.




© 2006, Forrester Research, Inc.                                                                                                                                                                           72
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                       > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                         > Back to "Scores and weightings"

 Vendor Scorecard: CA




                                                                                                                                      Forrester
                                                                                                                                                                      Show Criteria and Scale Explanations




                                                                                                                                      Weightin
  Control Level of Criteria Detail
                                                                                                                                                                      Hide Criteria and Scale Explanations




                                                                                                                                                  Score
  Less                     More

 Evaluation Criteria                      Criteria Explanation                       Scale Explanation                                                 Score Explanation




                                                                                                                                      g
          Alert and event specification   What tools does the product provide        Measured by the depth and breadth of features        20%     4.00 Administration via a browser-based interface
                                          for specifying alert and event criteria?   for specifying alerts:                                            provides authoring of alert criteria for services or
                                          How usable are the tools?                  5 = Deep features.                                                individual operations on a service. Service groups
                                                                                     3 = Basic features.                                               provide a means to apply the same policy to
                                                                                     1 = Minimal features.                                             multiple services. Alerts may be based on XPath
                                                                                     0 = No features.                                                  expressions, and Unicenter WSDM includes its
                                                                                                                                                       SOAP Explorer tool for visually authoring XPath
                                                                                                                                                       expressions based on actual message traffic. In
                                                                                                                                                       addition, the product has a feature to recommend
                                                                                                                                                       alert levels based on historical data. When
                                                                                                                                                       services are auto-discovered, alert specifications
                                                                                                                                                       can be automatically assigned based on defined
                                                                                                                                                       parameters.

          Autoresponse                    How does the product configure             Measured by the depth and breadth of features        30%     4.00 Unicenter WSDM can initiate a Web service or a
                                          automatic responses to exception           for initiating autoresponse actions:                              custom Java component (written to the product's
                                          conditions?                                5 = Deep features.                                                API) in response to an alert, and the Web service
                                                                                     3 = Basic features.                                               can take any available action. The product comes
                                                                                     1 = Minimal features.                                             with a prewritten alert plug-in to shutdown a
                                                                                     0 = No features.                                                  service group, and CA plans to add additional
                                                                                                                                                       prewritten autoresponses in the future.

          Exception management tools      What tools does the product provide   Measured by the depth and breadth of features             20%     1.00 This product provides no features for exception
                                          for displaying request processing     for handling service exceptions and errors:                            processing, but it has the ability to initiate a Web
                                          exceptions, correcting messages,      5 = Deep features.                                                     services call in response to an exception,
                                          and resubmitting them?                3 = Basic features.                                                    providing an integration point for custom
                                                                                1 = Minimal features.                                                  exception management. In addition, an
                                                                                0 = No features.                                                       autoresponse could shut down a service.
      Logging and auditing                How integrable, secure, and auditable This score is a weighted average of its                   10%     3.25 CA has good logging and log integration. It has
                                          are the product's operational logs?   subattributes: Logging levels, Log integration, Log                    strong auditing support and good diagnostic tools.
                                                                                integrity, Audit tools, and Diagnostic tools.
          Logging levels                  How many logging levels does the      Measured by the depth and configurability of              35%     4.00 Unicenter provides four logging levels with
                                          product provide? How detailed can     logging:                                                               customizable log content.
                                          logging be? How configurable is the 5 = Deep features.
                                          content of the log?                   3 = Basic features.
                                                                                1 = Minimal features.
                                                                                0 = No features.




© 2006, Forrester Research, Inc.                                                                                                                                                                  73
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                             > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                               > Back to "Scores and weightings"

 Vendor Scorecard: CA




                                                                                                                                            Forrester
                                                                                                                                                                            Show Criteria and Scale Explanations




                                                                                                                                            Weightin
  Control Level of Criteria Detail
                                                                                                                                                                            Hide Criteria and Scale Explanations




                                                                                                                                                        Score
  Less                     More

 Evaluation Criteria                             Criteria Explanation                    Scale Explanation                                                   Score Explanation




                                                                                                                                            g
          Log integration                        Can the product 1) integrate its        Measured by the range of options for log               20%     4.00 Unicenter WSDM uses log4j for logging and can
                                                 logging with that of other service      integration:                                                        log to any log4j destination, and other log4j
                                                 infrastructure or 2) act as a central   5 = Many options.                                                   sources can log to Unicenter WSDM.
                                                 logging service for other SOA           3 = Some options.
                                                 infrastructure?                         1 = Minimal options.
                                                                                         0 = No options.
          Log integrity                          What does the product provide for       Measured by the depth of features for ensuring         15%     0.00 CA plans to add log signing in a future release.
                                                 ensuring the integrity of individual    log integrity:
                                                 logs and of a series of log files (such 5 = Deep features.
                                                 as signed, chained logs)?               3 = Basic features.
                                                                                         1 = Minimal features.
                                                                                         0 = No features.
          Audit tools                            What capabilities does the product      Measured by the depth of features for log review       15%     4.00 Unicenter WSDM provides a log viewer screen
                                                 provide for auditing and reviewing log and integration of external audit tools:                             with filtering capabilities, and it can produce
                                                 contents (or support for external       5 = Deep features.                                                  reports from log files. Log files are accessible to
                                                 auditing tools)?                        3 = Basic features.                                                 external audit tools.
                                                                                         1 = Minimal features.
                                                                                         0 = No features.
          Diagnostic tools                       What tools does the product provide Measured by the breadth of diagnostic tool                 15%     3.00 Unicenter WSDM provides a message drill-down
                                                 for diagnosing service processing       functions:                                                          function for examining messages that created an
                                                 problems?                               5 = Deep functionality.                                             exception. In addition, it comes with the SOAP
                                                                                         3 = Basic functionality.                                            Explorer tool, which simplifies the viewing and
                                                                                         1 = Minimal functionality.                                          reading of SOAP message content and
                                                                                         0 = No functionality.                                               associated WSDL files.
      Support for standards and specifications   What standards does the product         This score is a weighted average of its                 7%     2.35 CA's standards support is good for core Web
                                                 support?                                subattributes: Core Web services support,                           services and security token types, and fair for
                                                                                         Management support, Security token support,                         other security functions. On management protocol
                                                                                         Security support, Advanced Web services                             standards, CA is committed to future support for
                                                                                         support, and Other standards.                                       both WSDM and WS-Management.
          Core Web services support              What basic Web services                 Measured by the breadth of standards support:          25%     3.00 SOAP (1.0, 1.1, 1.2), UDDI (2.0, 3.0), WS-I Basic
                                                 specifications and standards does       5 = Broad support.                                                  Profile, WSDL (1.0, 1.1), and XML schema.
                                                 the product support (including SOAP, 3 = Average support.
                                                 WSDL, UDDI, WS-I Basic Profile,         1 = Minimal support.
                                                 XML Schema, WS-I Attachments            0 = No support.
                                                 Profile, WS-BPEL, WS-
                                                 Choreography, XSLT, others)?
          Management support                     What management specifications and Measured by the breadth of standards support:               20%     1.00 CA can send SNMP traps and is committed to
                                                 standards does the product support 5 = Broad support.                                                       future support of both WSDM and WS-
                                                 (including WSDM-MOWS, WSDM-             3 = Average support.                                                Management. CA is a co-author of WS-
                                                 MUWS, WS-Management, SNMP,              1 = Minimal support.                                                Management.
                                                 others)?                                0 = No support.



© 2006, Forrester Research, Inc.                                                                                                                                                                        74
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                  > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                    > Back to "Scores and weightings"

 Vendor Scorecard: CA




                                                                                                                                 Forrester
                                                                                                                                                                 Show Criteria and Scale Explanations




                                                                                                                                 Weightin
  Control Level of Criteria Detail
                                                                                                                                                                 Hide Criteria and Scale Explanations




                                                                                                                                             Score
  Less                     More

 Evaluation Criteria                      Criteria Explanation                  Scale Explanation                                                 Score Explanation




                                                                                                                                 g
          Security token support          What security token specifications    Measured by the breadth of standards support:        20%     3.00 Unicenter WSDM supports username, X.509, and
                                          and standards does the product        5 = Broad support.                                                SAML 1.1 tokens via WS-Security 1.0. CA will
                                          support (username-password, x.509,    3 = Average support.                                              upgrade TransactionMinder to SAML 2.0 in a
                                          SAML, Kerberos, XRML, others)?        1 = Minimal support.                                              future release.
                                                                                0 = No support.
          Security protocol support       What security protocol specifications Measured by the breadth of standards support:        20%     2.00 Secure sockets layer/transport layer security, WS-
                                          and standards does the product        5 = Broad support.                                                Security 1.0, XML Signature, and XML Encryption.
                                          support (WS-Security: SOAP            3 = Average support.
                                          Message Security, Liberty ID-FF,      1 = Minimal support.
                                          Liberty ID-WSF, WS-I Basic Security 0 = No support.
                                          Profile, WS-Policy, WS-Trust, WS-
                                          SecurityPolicy, WS-
                                          PolicyAttachments, WS-Federation,
                                          WS-SecureConversation, XML
                                          Encryption, XML Signature, SSL/TLS,
                                          HTTP basic authentication, others)?

          Advanced Web services support   What advanced Web services             Measured by the breadth of standards support:        5%     0.00 CA is committed to supporting WS-Addressing,
                                          specifications and standards does      5 = Broad support.                                               WS-Enumeration, WS-Eventing, WS-
                                          the product support (WS-Reliability,   3 = Average support.                                             MetadataExchange, WS-ResourceFramework,
                                          WS-Addressing, WS-Eventing, WS-        1 = Minimal support.                                             WS-SecureConversation, WS-Transfer, WS-
                                          ReliableExchange, WS-                  0 = No support.                                                  Trust, and many others.
                                          BusinessActivity, WS-
                                          AtomicTransactions, WS-CAF (WS-
                                          CF, WS-TXM, WS-CTX), Fast
                                          Infoset, Message Transmission
                                          Optimization Mechanism (MTOM),
                                          BEEP, WS-MetadataExchange, WS-
                                          Notification, ASAP, WS-Discovery,
                                          others)?
          Other standards                 What other SOA, management, and        Measured by the breadth of standards support:       10%     4.00 JMS, Java Management Extensions (JMX), JAX-
                                          messaging related standards does       5 = Broad support.                                               RPC, Enterprise Java Beans (EJBs).
                                          the product support (Java Message      3 = Average support.
                                          Service, IIOP, Java RMI, JMX,          1 = Minimal support.
                                          others)?                               0 = No support.
      Other product features              What other generally useful features   This score is a weighted average of its              3%     3.00 CA supplements the product's core SOA
                                          does the product have?                 subattributes: Core SOA management features                      management features by its ability to recommend
                                                                                 and Other features.                                              service-level goals based on patterns of
                                                                                                                                                  production operation. Beyond this, it provides a
                                                                                                                                                  tool for examining SOAP and XML content and
                                                                                                                                                  visually authoring management policy.



© 2006, Forrester Research, Inc.                                                                                                                                                             75
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                          > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                            > Back to "Scores and weightings"

 Vendor Scorecard: CA




                                                                                                                                         Forrester
                                                                                                                                                                         Show Criteria and Scale Explanations




                                                                                                                                         Weightin
  Control Level of Criteria Detail
                                                                                                                                                                         Hide Criteria and Scale Explanations




                                                                                                                                                     Score
  Less                     More

 Evaluation Criteria                      Criteria Explanation                    Scale Explanation                                                       Score Explanation




                                                                                                                                         g
          Core SOA management features    Are there additional features that      Measured by the depth and importance of any                70%     3.00 Unicenter WSDM can recommend service-level
                                          relate directly to service management   additional features for SOA management:                                 goals by examining a baseline of service history
                                          and monitoring?                         5 = Deep features.                                                      data through a facility called automatic threshold
                                                                                  3 = Basic features.                                                     analysis (ATA). ATA suggestions are populated in
                                                                                  1 = Minimal features.                                                   the service catalog for follow-up action.
                                                                                  0 = No features.
          Other features                  Are there additional ancillary features Measured by the depth and importance of any                30%     3.00 CA's SOAP Explorer tool is included with
                                          (that is, beyond service management additional product features:                                                Unicenter WSDM. It provides visual
                                          and monitoring)?                        5 = Deep features.                                                      representations of WSDL and SOAP messages
                                                                                  3 = Basic features.                                                     and visual authoring of XPath expressions,
                                                                                  1 = Minimal features.                                                   including using offline analysis of actual logged
                                                                                  0 = No features.                                                        message traffic to speed and enhance authoring.

      Other SOA infrastructure products   What other SOA infrastructure is        Forrester includes this criterion as information for        0%     0.00 CA has a broad line of development tools,
                                          available as part of the vendor's       clients, therefore this line item is weighted at 0%.                    management tools, and security infrastructure.
                                          overall product set?                    To place a value on vendors' other SOA products,
                                                                                  clients may add custom weightings, in which case
                                                                                  this score is a weighted average of its
                                                                                  subattributes: Attack protection, Registry-
                                                                                  repository, SOA life-cycle management,
                                                                                  Application development (design), Application
                                                                                  development (coding), Application integration,
                                                                                  Data integration, and Other SOA-related products.

          Attack protection               What other products does the vendor    This line item is intended to be informational and           0%     0.00 CA has plans for this area that have yet to be
                                          have that provide direct SOA and       is therefore weighted at 0%. A score of five is                          disclosed.
                                          Web services support for the attack    given if a vendor has any products to offer, so that
                                          protection side of security?           Forrester clients can assign a weighting if they
                                                                                 choose to.
          Registry and repository         What products does the vendor have This line item is intended to be informational and               0%     5.00 eTrust Directory (has UDDI 2.0 and X.500
                                          for registry and repository functions? is therefore weighted at 0%. A score of five is                          support).
                                                                                 given if a vendor has any products to offer, so that
                                                                                 Forrester clients can assign a weighting if they
                                                                                 choose to.
          SOA life-cycle management       What products does the vendor have This line item is informational and is therefore                 0%     5.00 AllFusion Harvest Change Manager.
                                          for overall service life-cycle         weighted at 0%. A score of five is given if a
                                          management (that is, end-to-end        vendor has any products to offer, so that Forrester
                                          development life-cycle                 clients can assign a weighting if they choose to.
                                          management)?




© 2006, Forrester Research, Inc.                                                                                                                                                                     76
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                           > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                             > Back to "Scores and weightings"

 Vendor Scorecard: CA




                                                                                                                                          Forrester
                                                                                                                                                                          Show Criteria and Scale Explanations




                                                                                                                                          Weightin
  Control Level of Criteria Detail
                                                                                                                                                                          Hide Criteria and Scale Explanations




                                                                                                                                                      Score
  Less                     More

 Evaluation Criteria                         Criteria Explanation                   Scale Explanation                                                      Score Explanation




                                                                                                                                          g
          Application development (design)   What other products does the vendor    This line item is informational and is therefore           0%     5.00 AllFusion Gen, Plex, and 2E modeling and
                                             have for business modeling, process    weighted at 0%. A score of five is given if a                          application development suites. AllFusion ERwin
                                             modeling, service modeling, and        vendor has any products to offer, so that Forrester                    Data Modeler, Process Modeler, and other related
                                             service design?                        clients can assign a weighting if they choose to.                      tools.

          Application development (coding)   What products does the vendor have This line item is informational and is therefore               0%     5.00 AllFusion Gen, Plex, and 2E modeling and
                                             for detailed service development and weighted at 0%. A score of five is given if a                            application development suites.
                                             administration?                      vendor has any products to offer, so that Forrester
                                                                                  clients can assign a weighting if they choose to.

          Application integration            What products does the vendor have     This line item is informational and is therefore           0%     5.00 AllFusion Gen and Plex have some capabilities in
                                             that provide full application          weighted at 0%. A score of five is given if a                          this area.
                                             integration features and functions     vendor has any products to offer, so that Forrester
                                             (beyond simple transformation that     clients can assign a weighting if they choose to.
                                             the product may inherently support)?

          Data integration                   What products does the vendor have This line item is informational and is therefore               0%     0.00 None.
                                             for data-level integration?        weighted at 0%. A score of five is given if a
                                                                                vendor has any products to offer, so that Forrester
                                                                                clients can assign a weighting if they choose to.

          Other SOA-related products         What other products does the vendor    This line item is informational and is therefore           0%     5.00 Unicenter ServicePlus ServiceDesk provides Web
                                             have that address other major          weighted at 0%. A score of five is given if a                          services interfaces to allow applications to create
                                             requirements for SOA and Web           vendor has any products to offer, so that Forrester                    trouble tickets and escalate issues automatically.
                                             services?                              clients can assign a weighting if they choose to.                      It could be invoked from Unicenter WSDM's
                                                                                                                                                           alerting features. Unicenter Service Management
                                                                                                                                                           provides billing, chargeback, SLA and service-
                                                                                                                                                           goal tracking, accounting and costing functions,
                                                                                                                                                           and more for both services and applications
                                                                                                                                                           through its integration with Unicenter WSDM.


 STRATEGY                                                                                                                                     50%     3.08




© 2006, Forrester Research, Inc.                                                                                                                                                                      77
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                              > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                                > Back to "Scores and weightings"

 Vendor Scorecard: CA




                                                                                                                                             Forrester
                                                                                                                                                                             Show Criteria and Scale Explanations




                                                                                                                                             Weightin
  Control Level of Criteria Detail
                                                                                                                                                                             Hide Criteria and Scale Explanations




                                                                                                                                                         Score
  Less                     More

 Evaluation Criteria                          Criteria Explanation                     Scale Explanation                                                      Score Explanation




                                                                                                                                             g
     Product strategy                         What is the vendor's approach to the     This score is a weighted average of its                   45%     2.60 CA has a deep vision for how SOA management
                                              SOA management market in terms of        subattributes: SOA and Web services                                    needs to have visibility across both service
                                              near-term plans and long-term focus?     management, Broader SOA infrastructure product                         interfaces and service implementations, and it has
                                                                                       directions, and Enterprise focus.                                      SOA initiatives for application development as
                                                                                                                                                              well. It focuses investment on using best
                                                                                                                                                              practices, such as IT Infrastructure Library (ITIL)
                                                                                                                                                              and the need for regulatory compliance. Its
                                                                                                                                                              product investments will focus on policy
                                                                                                                                                              management and deeper integration of
                                                                                                                                                              management and security.
          SOA and Web services management     What future enhancements does the        Measured by Forrester's assessment of the                 80%     2.00 CA plans to pursue deeper integration between
                                              vendor currently plan for the product    product plans and vision stated by the vendor:                         SOA management and security functions and
                                              that would help it score better on       5 = Strong road map in many areas.                                     deeper policy management features.
                                              SOA and Web services management          3 = Strong road map in some areas.
                                              criteria? (That is, all of the Current   1 = Weak road map.
                                              offering criteria above except the       0 = Vendor hasn't disclosed.
                                              "Other SOA infrastructure products"
                                              criterion.)
          Other SOA infrastructure products   What future product directions has       This line item is informational and is therefore           0%     3.00 CA's enterprise IT management vision (see the
                                              the vendor disclosed that would move     weighted at 0%. So that Forrester clients can                          next line item) supports a broad management
                                              it toward broader and more complete      assign a weighting if they choose to, Forrester has                    vision beyond SOA and Web services
                                              SOA infrastructure capabilities          measured the vendor's response based on the                            management. In addition, CA's application
                                              beyond SOA and Web services              breadth of broader SOA categories that the                             development product groups are also providing
                                              management? In other words, how          vendor intends to provide products for.                                SOA features.
                                              will it build its cababilities in the
                                              "Other SOA infrastructure products"
                                              criterion above?




© 2006, Forrester Research, Inc.                                                                                                                                                                         78
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                                > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                                  > Back to "Scores and weightings"

 Vendor Scorecard: CA




                                                                                                                                               Forrester
                                                                                                                                                                               Show Criteria and Scale Explanations




                                                                                                                                               Weightin
  Control Level of Criteria Detail
                                                                                                                                                                               Hide Criteria and Scale Explanations




                                                                                                                                                           Score
  Less                     More

 Evaluation Criteria                            Criteria Explanation                     Scale Explanation                                                      Score Explanation




                                                                                                                                               g
          Enterprise focus                      In the vendor's view, what is the full   Measured by Forrester's assessment of the                 20%     5.00 CA's enterprise IT management vision
                                                scope of enterprise requirements for     vendor's stated understanding of the scope of                          encompasses all aspects of IT and business
                                                SOA management and SOA                   enterprise-class SOA management:                                       security and management, and it also includes
                                                infrastructure?                          5 = Strong view of enterprise SOA management                           ITIL and other best practices, regulatory
                                                                                         requirements.                                                          compliance, utility computing, and more.
                                                                                         3 = Average view of enterprise SOA                                     Refinements to that vision currently being planned
                                                                                         requirements.                                                          include WS-CIM extensions to the CA
                                                                                         1 = Weak view of enterprise SOA requirements.                          Management Database (MDB), an organized
                                                                                         0 = the vendor hasn't disclosed.                                       database of management information that covers
                                                                                                                                                                asset and job management information. This will
                                                                                                                                                                provide Unicenter WSDM and eTrust
                                                                                                                                                                TransactionMinder with access to broader IT
                                                                                                                                                                infrastructure asset and management information.
                                                                                                                                                                The overall goal is to maintain visibility and control
                                                                                                                                                                at all levels of the enterprise and IT.

      Financial resources to support strategy   Is the vendor profitable? Does the       Measured by Forrester's assessment of public              25%     5.00 CA is a market-leading firm with $1.8 billion in
                                                company have sufficient funding,         data (which receives greater weight) and vendor                        cash and marketable securities.
                                                revenues, profits, and cash flow to      claims as to the resources available for product
                                                support its strategies?                  development and the overall stability of the
                                                                                         vendor:
                                                                                         5 = Clearly sufficient resources and stability from
                                                                                         public data.
                                                                                         3 = Reasonable resources and likely stability from
                                                                                         private data.
                                                                                         1 = Questionable resources and stability (or lack
                                                                                         of data).
      Cost                                      What is the cost of the product?         The score is a weighted average of the scores for         30%     2.20 CA's solution has a high entry-point cost, but it
                                                                                         these subattributes: Medium deployment license                         gets more affordable in larger deployments.
                                                                                         cost, Minimum license cost, Maintenance cost,
                                                                                         and Pricing structure.
             Medium deployment license cost     What would be the total license cost     This score is based on the license cost for this          60%     3.00 The total cost would be $375,000 (CA's
                                                for a deployment to manage 100           configuration as reported by the vendor:                               FlexSelect licensing may lower the cost),
                                                separate WSDL interfaces spread          5 = Up to $99,999.                                                     assuming that eTrust TransactionMinder runs on
                                                across 20 servers (four CPUs each)       4 = $100,000 to $199,999.                                              two servers and that those servers have two
                                                with two management consoles?            3 = $200,000 to $399,999.                                              CPUs (rather than the four CPUs in the scenario
                                                                                         2 = $400,000 to $699,999.                                              description). CA states that existing customers
                                                                                         1 = $700,000 or more.                                                  are successfully in production with a configuration
                                                                                         0 = The vendor hasn't disclosed.                                       similar to this.




© 2006, Forrester Research, Inc.                                                                                                                                                                           79
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                    > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                      > Back to "Scores and weightings"

 Vendor Scorecard: CA




                                                                                                                                   Forrester
                                                                                                                                                                   Show Criteria and Scale Explanations




                                                                                                                                   Weightin
  Control Level of Criteria Detail
                                                                                                                                                                   Hide Criteria and Scale Explanations




                                                                                                                                               Score
  Less                     More

 Evaluation Criteria                 Criteria Explanation                Scale Explanation                                                          Score Explanation




                                                                                                                                   g
          Minimum license cost       What would be the total license costThis score is based on the license cost for this              40%     1.00 The total cost is $225,000.
                                     for a deployment to manage one      configuration as reported by the vendor:
                                     WSDL interface on one server (two   5 = Up to $49,999.
                                     CPUs) with one management           4 = $50,000 to $99,999.
                                     console?                            3 = $100,000 to $149,999.
                                                                         2 = $150,000 to $199,999.
                                                                         1 = $200,000 or more.
                                                                         0 = The vendor hasn't disclosed
          Maintenance cost           What is the annual maintenance cost Forrester provides this information to aid our                 0%     0.00 For 24x7 support, the cost is $20,000 per year for
                                     structure for this product?         clients' decisions; we give a default score of 0 to                        Unicenter WSDM and 20% of the list price for
                                                                         the vendor for this attribute.                                             eTrust TransactionMinder.


          Pricing structure          What are the details of the product's   Forrester provides this information to aid our             0%     0.00 As an approximate guide, Unicenter WSDM
                                     pricing structure?                      clients' decisions; we give a default score of 0 to                    Manager is $75,000 per server. Agents range
                                                                             the vendor for this attribute.                                         from $75,000 for a 50-pack up to $150,000 for
                                                                                                                                                    unlimited deployment. TransactionMinder is
                                                                                                                                                    $150,000 for the first four CPUs and $40,000 for
                                                                                                                                                    additional CPUs.

 MARKET PRESENCE                                                                                                                        0%     3.56
    Installed base                   How large is the vendor's installed    This score is a weighted average of its                    30%     3.10 CA has approximately 35 customers total for the
                                     base of customers for this product     subattributes: This product, All SOA products,                          two elements of its SOA management solution,
                                     and for all products?                  New customers, Users on maintenance, and                                most of which are new in the past year.
                                                                            Reference accounts.
          This product               What is the installed base of          This factor is scored on the number of customer            40%     1.00 The install base is more than 10 customers for
                                     customers (separate stock tickers) for installations the vendor reports having:                                Unicenter WSDM and 25-plus customers for
                                     this product?                          5 = 300 or more.                                                        eTrust TransactionMinder.
                                                                            4 = 100 to 299.
                                                                            3 = 60 to 99.
                                                                            2 = 30 to 59.
                                                                            1 = Five to 29.
                                                                            0 = Fewer than five or the vendor hasn't
                                                                            disclosed.




© 2006, Forrester Research, Inc.                                                                                                                                                               80
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                    > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                      > Back to "Scores and weightings"

 Vendor Scorecard: CA




                                                                                                                                   Forrester
                                                                                                                                                                   Show Criteria and Scale Explanations




                                                                                                                                   Weightin
  Control Level of Criteria Detail
                                                                                                                                                                   Hide Criteria and Scale Explanations




                                                                                                                                               Score
  Less                     More

 Evaluation Criteria                 Criteria Explanation                      Scale Explanation                                                    Score Explanation




                                                                                                                                   g
          All SOA products           What is the installed base of             This factor is scored on the number of customer         15%     5.00 CA has thousands of customers overall, and
                                     customers (separate stock tickers) for    installations the vendor reports having:                             many of CA's application development products
                                     all of the vendor's SOA products          5 = 2,000 or more.                                                   can be used for SOA.
                                     (including this product and those         4 = 1,000 to 1,999.
                                     listed in the "Other SOA infrastructure   3 = 500 to 999.
                                     products" criterion above)?               2 = 100 to 499.
                                                                               1 = 10 to 99.
                                                                               0 = Fewer than 10 or the vendor hasn't disclosed.


          New customers              How many customers bought or         This factor is scored on the number of customer              30%     4.00 About 30 (most customers for Unicenter WSDM
                                     upgraded the product during the past installations the vendor reports having:                                  and eTrust TransactionMinder are recent sales).
                                     year?                                5 = 40 or more.
                                                                          4 = 30 to 39.
                                                                          3 = 20 to 29.
                                                                          2 = 10 to 19.
                                                                          1 = Three to nine.
                                                                          0 = Fewer than three or the vendor hasn't
                                                                          disclosed.

          Users on maintenance       What percentage of customers of all This factor is scored on the percentage of                    15%     5.00 100% (most customers are recent additions).
                                     versions of this product are on active customers for all versions of this product that the
                                     maintenance agreements?                vendor reports are on maintenance agreement:
                                                                            5 = 97% or more.
                                                                            4 = 90% to 96%.
                                                                            3 = 80% to 89%.
                                                                            2 = 70% to 79%.
                                                                            1 = 60% to 69%.
                                                                            0 = Less than 60% or the vendor hasn't disclosed.


          Reference accounts         What companies are the major          Forrester provides this information to aid our               0%     0.00 the vendor did not disclose this information.
                                     reference customers for this product? clients' decisions; we don't score or weight this
                                                                           attribute.
      Revenue                        What is the vendor's revenue over     This score is based on overall revenue as                   25%     5.00 CA's revenue over the period from Q4 2004
                                     the period from Q4 2004 through Q3 reported by the vendor:                                                     through Q3 2005 is $3.6 billion.
                                     2005?                                 5 = More than $1 billion.
                                                                           4 = $500 million to $1 billion.
                                                                           3 = $50 million to $499 million.
                                                                           2 = $10 million to $49 million.
                                                                           1 = Less than $10 million.
                                                                           0 = The vendor hasn't disclosed.

© 2006, Forrester Research, Inc.                                                                                                                                                               81
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                  > Back to "Scores and weightings"

 Vendor Scorecard: CA




                                                                                                                               Forrester
                                                                                                                                                               Show Criteria and Scale Explanations




                                                                                                                               Weightin
  Control Level of Criteria Detail
                                                                                                                                                               Hide Criteria and Scale Explanations




                                                                                                                                           Score
  Less                     More

 Evaluation Criteria                 Criteria Explanation                  Scale Explanation                                                    Score Explanation




                                                                                                                               g
     Revenue growth                  What is the vendor's year-over-year   Forrester provides this information to aid our           0%     0.00 CA's year-over-year revenue growth from Q3
                                     revenue growth over the period from   clients' decisions; we don't score or weight this                    2004 through Q3 2005 is 6%.
                                     Q3 2004 through Q3 2005?              attribute.

      Systems integrators            What systems integrator partners      This factor is scored on the number of systems          15%     2.00 No one partner has completed three or more
                                     have completed three or more          integrator partners the vendor reports have                          deployments, but CA has significant relationships
                                     deployments of any version of this    completed three or more deployments of this                          with Electronic Data Systems (EDS), Ernst &
                                     product in the past 18 months?        product in the past 18 months:                                       Young (E&Y), Computer Sciences Corporation
                                                                           5 = Five or more.                                                    (CSC), and most other leading integrators.
                                                                           4 = Four.
                                                                           3 = Three.
                                                                           2 = Two.
                                                                           1 = One.
                                                                           0 = Zero or the vendor hasn't disclosed.
      Services                       How strong are the vendor's           This score is a weighted average of its                 10%     4.50 CA did not disclose the size of its in-house
                                     implementation and training           subattributes: Implementation engineers and                          professional services team for its SOA
                                     services?                             Training.                                                            management solution, but it has a large
                                                                                                                                                professional services team and a full range of
                                                                                                                                                training options.
          Implementation engineers   How many employees provide            This factor is scored on the number of employees        50%     4.00 CA Technical Services offers implementation
                                     implementation services for this      the vendor reports having dedicated to                               services in more than 160 countries, but it did not
                                     product?                              implementation services for this product:                            disclose the number of engineers serving its SOA
                                                                           5 = 100 or more.                                                     management solution.
                                                                           4 = 70 to 99.
                                                                           3 = 40 to 69.
                                                                           2 = 20 to 49.
                                                                           1 = 10 to 19.
                                                                           0 = Fewer than 10 or the vendor hasn't disclosed.

          Training                   Does the vendor offer classroom,      Measured by how many training channels the              50%     5.00 CA offers classroom, Web-based self service, and
                                     Web-based, and on-site training?      vendor offers:                                                       on-site training for its products.
                                                                           5 = All three channels.
                                                                           3 = Two channels.
                                                                           1 = One channel.
                                                                           0 = No training offered.
      Employees                      How many engineers does the           This score is a weighted average of its                 10%     3.75 CA is a large firm with a global presence. It did not
                                     vendor have dedicated to this         subattributes: Total employees, Dedicated                            disclose the size of its engineering staff.
                                     product? How big is the vendor's      engineers, and Sales staff.
                                     sales presence?




© 2006, Forrester Research, Inc.                                                                                                                                                           82
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                  > Back to "Scores and weightings"

 Vendor Scorecard: CA




                                                                                                                               Forrester
                                                                                                                                                               Show Criteria and Scale Explanations




                                                                                                                               Weightin
  Control Level of Criteria Detail
                                                                                                                                                               Hide Criteria and Scale Explanations




                                                                                                                                           Score
  Less                     More

 Evaluation Criteria                 Criteria Explanation                  Scale Explanation                                                    Score Explanation




                                                                                                                               g
          Total employees            How many employees does the           This factor is scored on the total number of            50%     5.00 CA has 15,000 employees.
                                     vendor have?                          employees the vendor reports having:
                                                                           5 = 10,000 or more.
                                                                           4 = 300 to 9,999.
                                                                           3 = 80 to 299.
                                                                           2 = 40 to 79.
                                                                           1 = 25 to 39.
                                                                           0 = Fewer than 25 or the vendor hasn't disclosed.

          Dedicated engineers        How many engineers are dedicated    This factor is scored on the total number of              25%     0.00 the vendor did not disclose the number of
                                     to research and development of this engineers the vendor reports having dedicated to                       engineers dedicated to Unicenter WSDM or
                                     product line?                       this product line:                                                     eTrust TransactionMinder, but it asserts that
                                                                         5 = 300 or more.                                                       hundreds of developers from various product
                                                                         4 = 100 to 299.                                                        groups contribute to the product.
                                                                         3 = 30 to 99.
                                                                         2 = 15 to 29.
                                                                         1 = 5 to 14.
                                                                         0 = Fewer than five or vendor hasn't disclosed.
          Sales staff                How large and how global is the     Measured by size and global footprint of sales            25%     5.00 The vendor did not disclose the number of sales
                                     vendor's sales force? What          organization:                                                          staff, but CA has a global presence.
                                     percentage of the sales force       5 = 100-plus, with global presence.
                                     supports Europe, Asia Pacific, and  3 = 25 to 99, no global presence.
                                     Rest of World?                      1 = Less than 25, no global presence.
      Technology partners            How strongly do technology partners This score is a weighted average of its                   10%     2.50 CA has an initial set of partners for its SOA
                                     support this product?               subattributes: License partners, Resellers, and                        management solution, including some with
                                                                         Other partners.                                                        product-level integration.
          License partners           What vendors license or bundle this This score is the weighted average of the number          50%     0.00 the vendor did not disclose.
                                     product?                            of vendors that the vendor reports license or
                                                                         bundle this product:
                                                                         5 = 10 or more.
                                                                         4 = Seven to nine.
                                                                         3 = Five or six.
                                                                         2 = Three or four.
                                                                         1 = One or two.
                                                                         0 = Zero or the vendor hasn't disclosed.




© 2006, Forrester Research, Inc.                                                                                                                                                           83
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                                        > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                                          > Back to "Scores and weightings"

 Vendor Scorecard: CA




                                                                                                                                                       Forrester
                                                                                                                                                                                       Show Criteria and Scale Explanations




                                                                                                                                                       Weightin
  Control Level of Criteria Detail
                                                                                                                                                                                       Hide Criteria and Scale Explanations




                                                                                                                                                                   Score
  Less                     More

 Evaluation Criteria                                    Criteria Explanation                    Scale Explanation                                                       Score Explanation




                                                                                                                                                       g
          Resellers                                     What firms resell this product?         This score is the weighted average of the number           50%     5.00 CA has relationships with major firms such as
                                                                                                of resellers that the vendor reports offer this                         EDS, E&Y, CSC, and many more.
                                                                                                product:
                                                                                                5 = 20 or more.
                                                                                                4 = 15 to 19.
                                                                                                3 = 10 to 14.
                                                                                                2 = Five to nine.
                                                                                                1 = One to four.
                                                                                                0 = Zero or vendor hasn't disclosed.
          Other partners                                What other vendors have modified        Forrester provides this information to aid our              0%     0.00 Cape Clear Software, IONA Technologies, Forum
                                                        their products to better integrate with clients' decisions; we score this attribute 0 in all                    Systems, JBoss, LogicLibrary, Mindreef, Sun,
                                                        this product (as opposed to having      cases.                                                                  Systinet, and Weblayers (some are still in
                                                        only standards-based interop)?                                                                                  development). A wide number of additional
                                                                                                                                                                        vendors integrate with CA's eTrust SiteMinder
                                                                                                                                                                        product, on which TransactionMinder is based.

 © 2006, Forrester Research, Inc. All rights reserved. Forrester, Forrester Wave, WholeView 2, Technographics, and Total Economic Impact
 are trademarks of Forrester Research, Inc. All other trademarks are the property of their respective companies. Forrester clients may make
 one attributed copy or slide of each figure contained herein. Additional reproduction is strictly prohibited. For additional reproduction rights
 and usage information, go to www.forrester.com. Information is based on best available resources. Opinions reflect judgment at the time




© 2006, Forrester Research, Inc.                                                                                                                                                                                   84
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                     > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                       > Back to "Scores and weightings"

 Vendor Scorecard: Hewlett-Packard




                                                                                                                                    Forrester
                                                                                                                                                                    Show Criteria and Scale Explanations




                                                                                                                                    Weightin
  Control Level of Criteria Detail
                                                                                                                                                                    Hide Criteria and Scale Explanations




                                                                                                                                                Score
  Less                     More

 Evaluation Criteria                 Criteria Explanation                     Scale Explanation                                                      Score Explanation




                                                                                                                                    g
 CURRENT OFFERING                                                                                                                       50%     2.62
     Products included               What is the precise product or set of    This item is for information only and is not scored        0%     0.00 HP offers Hewlett-Packard OpenView SOA
                                     products that the vendor offers as its   or weighted.                                                           Manager 2.0.
                                     service-oriented architecture (SOA)
                                     and Web services management
                                     solution?
      IT-level management            How does the product manage              This score is a weighted average of its                   20%     2.70 HP supports a modest range of service-endpoint
                                     service performance and availability?    subattributes: Endpoint support, Performance                           protocols. It tracks only service-level goals (not
                                                                              management, Availability management, and                               SLAs tied to users). It tracks relationships
                                                                              Service-level management.                                              between services and service containers directly
                                                                                                                                                     and can incorporate operational data from these
                                                                                                                                                     service containers into its monitoring.

          Endpoint support           What access protocols (SOAP,             Measured by the breadth of support for various            20%     3.00 Supported payload-transport combinations are
                                     XML/HTTP, Java Message Service           protocols, payload types, and native agents for                        different for agents and proxies. Agents are
                                     (JMS), Java RMI, WebSphere MQ,           specific products:                                                     available for WebLogic and .NET support
                                     .NET Remoting, others) and service       5 = Broad support.                                                     SOAP/HTTP. Proxies ("brokers" in the vendor's
                                     implementation technologies (Java        3 = Average support.                                                   language) support XML/HTTP, SOAP/HTTP,
                                     EE, .NET, databases, others) does        1 = Minimal support.                                                   XML/JMS, and XML/HTTP, and SOAP with
                                     the product fully monitor? What          0 = No support.                                                        Attachments.
                                     specific products does the product
                                     support?
          Performance management     How does the product gather, report,     Measured by the breadth and depth of                      30%     3.00 Agents and proxies send performance information
                                     and analyze service performance          functionality for gathering, analyzing, and                            to a central management server (which uses an
                                     data, including 1) reporting against     correlating data about service invocations and                         underlying database for persistence). A
                                     performance goals and 2) correlation     service implementations:                                               performance analysis engine dynamically
                                     of performance data across               5 = Deep functionality.                                                compares the data to service-level objectives.
                                     technology layers within service         3 = Average functionality.                                             Correlation of performance data across
                                     implementations?                         1 = Minimal functionality.                                             technology layers is performed by analyzing data
                                                                              0 = No functionality.                                                  against an overall model of the system
                                                                                                                                                     deployment. For deeper service-level
                                                                                                                                                     management (at additional cost), the product can
                                                                                                                                                     integrate with the HP OpenView Internet Services
                                                                                                                                                     measurement server.




© 2006, Forrester Research, Inc.                                                                                                                                                                85
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                                  > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                                    > Back to "Scores and weightings"

 Vendor Scorecard: Hewlett-Packard




                                                                                                                                                 Forrester
                                                                                                                                                                                 Show Criteria and Scale Explanations




                                                                                                                                                 Weightin
  Control Level of Criteria Detail
                                                                                                                                                                                 Hide Criteria and Scale Explanations




                                                                                                                                                             Score
  Less                     More

 Evaluation Criteria                           Criteria Explanation                       Scale Explanation                                                       Score Explanation




                                                                                                                                                 g
          Availability management              How does the product gather, report,       Measured by the breadth and depth of                       30%     2.00 As with performance data, SOA Manager's agents
                                               and analyze service availability data,     functionality for identifying, analyzing, and                           and proxies send availability data to a central
                                               including root cause analysis of           correlating availability issues for services and                        database — except that availability events are
                                               availability issues across technology      service implementations:                                                always sent immediately, whereas performance
                                               layers within service                      5 = Deep functionality.                                                 events may be batched. Deeper root cause
                                               implementations?                           3 = Average functionality.                                              analysis of availability issues across technology
                                                                                          1 = Minimal functionality.                                              layers is available through integration with HP
                                                                                          0 = No functionality.                                                   OpenView Operations (at additional cost). The
                                                                                                                                                                  SOA services model is kept in sync with
                                                                                                                                                                  OpenView Operations where it can be further
                                                                                                                                                                  integrated with infrastructure implementation
                                                                                                                                                                  information.
          Service-level management             How does the product 1) specify            Measured by the breadth and depth of                       20%     3.00 SOA Manager maintains service-level goals
                                               service-level goals, 2) tie service-       functionality for specifying service-level goals and                    manually in the product's user interface. The
                                               level goals to specific users or groups    SLAs and monitoring and managing operations to                          product can report on both real-time and historical
                                               to create service-level agreements         maintain service-level goals:                                           service operations for performance, availability,
                                               (SLAs), 3) monitor and report service-     5 = Deep functionality.                                                 security (authentication failures, etc.), users
                                               level compliance over time, and 4)         3 = Average functionality.                                              (service usage, etc.), and other factors. The
                                               automatically adjust service               1 = Minimal functionality.                                              product does not automatically adjust operations
                                               operations to better achieve SLAs?         0 = No functionality.                                                   to better achieve service-level goals, but an alert
                                                                                                                                                                  could initiate an external action that in turn calls
                                                                                                                                                                  SOA Manager's APIs to reconfigure service
                                                                                                                                                                  operations.
      Business-level management                How does the product provide               This score is a weighted average of its                     5%     2.00 HP can extract business data from messages and
                                               business insight by extracting and         subattributes: Business activity montioring,                            relate the data to its underlying service model.
                                               reporting data from service request-       Usability by business users, and Integration for                        Other HP products provide business-oriented
                                               response flows?                            business monitoring.                                                    portals. Business data is available via database
                                                                                                                                                                  reads and integration APIs.
          Business activity monitoring (BAM)   How do the product's built-in features     Measured by the breadth and depth of                       30%     2.00 SOA Manager provides a foundation for business
                                               provide business insight from service      functionality for capturing business data from                          activity analysis by enabling a service model
                                               operation by extracting, analyzing,        service requests and tying that data to business                        definition that captures relationships between
                                               and reporting on business data             processes:                                                              services and business processes. The product
                                               contained in the flow of service           5 = Deep functionality.                                                 also can extract business data from the payload
                                               requests and responses? What are           3 = Average functionality.                                              of a service request or response and store it in
                                               its capabilities for tying such analysis   1 = Minimal functionality.                                              the central database. The service model would
                                               to an end-to-end business process          0 = No functionality.                                                   then provide for correlation between business
                                               flow?                                                                                                              data and technical service operations data.




© 2006, Forrester Research, Inc.                                                                                                                                                                             86
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                              > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                                > Back to "Scores and weightings"

 Vendor Scorecard: Hewlett-Packard




                                                                                                                                             Forrester
                                                                                                                                                                             Show Criteria and Scale Explanations




                                                                                                                                             Weightin
  Control Level of Criteria Detail
                                                                                                                                                                             Hide Criteria and Scale Explanations




                                                                                                                                                         Score
  Less                     More

 Evaluation Criteria                            Criteria Explanation                    Scale Explanation                                                     Score Explanation




                                                                                                                                             g
          Usability by business users           How understandable to and usable by     Measured by the breadth and depth of                     35%     1.00 SOA Manager does not provide a business-level
                                                business staff are the product's        functionality for creating business-oriented                          dashboard, but the vendor's OpenView
                                                business activity monitoring tools?     displays and the extent to which these are usable                     Dashboard product does (but it is not part of this
                                                                                        by business staff:                                                    evaluation).
                                                                                        5 = Deep functionality.
                                                                                        3 = Average functionality.
                                                                                        1 = Minimal functionality.
                                                                                        0 = No functionality.
          Integration for business monitoring   What are the data capture methods Measured by the breadth of options by which                    35%     3.00 The central database is a relational database and
                                                and configuration options for feeding other products can get business activity data                           therefore accessible to a wide variety of tools. The
                                                data to other analysis tools (BAM,      captured by the product:                                              schema of the database is fixed by SOA
                                                data warehousing, others)?              5 = Deep integration options.                                         Manager. In addition, the product provides Web
                                                                                        3 = Average integration options.                                      services interfaces for access to all data in the
                                                                                        1 = Minimal integration options.                                      central database.
                                                                                        0 = No integration options.
      Product architecture                      How robust is the product's overall     This score is a weighted average of its                  15%     3.60 HP provides both proxies and native agents for
                                                architecture, including its integration subattributes: Deployment styles and                                  WebLogic and .NET. Extensibility is a major
                                                with development life-cycle             requirements, metamodel for services and                              design goal for HP's service model. It has deep
                                                management infrastructure?              processes, Enterprise management integration,                         out-of-the-box enterprise management integration
                                                                                        Metadata and repository integration, Development                      with HP products and focuses on WSDM for other
                                                                                        life-cycle integration, Load balancing and                            products. It has limited development life-cycle
                                                                                        scalability (product), Load balancing and                             integration and basic capabilities for service
                                                                                        scalability (service), Failover (product), Dynamic                    failover and load balancing.
                                                                                        reconfiguration, and Performance-specific
                                                                                        features.
          Deployment styles and requirements    What are the options for deployment Measured by the breadth of deployment options                20%     4.00 The basic architecture consists of agents and
                                                of monitoring elements (such as         and depth of integration with numerous service                        proxies, the central management server, a central
                                                agent, proxy, inline, tool kit for      endpoint technologies:                                                database, and the browser-based management
                                                embedding an agent in an                5 = Broad deployment options.                                         console. An agent is deployed within a service
                                                application, others)? What servers or 3 = Average deployment options.                                         container (such as an application server) and
                                                other infrastructure are required?      1 = Limited deployment options.                                       manages all the services deployed to that
                                                                                                                                                              container. Agents can observe service operations
                                                                                                                                                              without being inserted into the message flow,
                                                                                                                                                              reducing management overhead. SOA Manager
                                                                                                                                                              provides native agents for BEA Systems
                                                                                                                                                              WebLogic and Microsoft .NET. HP partners are
                                                                                                                                                              working to provide built-in agents for their
                                                                                                                                                              products (including application servers, ESBs,
                                                                                                                                                              and XML firewall appliances).




© 2006, Forrester Research, Inc.                                                                                                                                                                         87
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                               > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                                 > Back to "Scores and weightings"

 Vendor Scorecard: Hewlett-Packard




                                                                                                                                              Forrester
                                                                                                                                                                              Show Criteria and Scale Explanations




                                                                                                                                              Weightin
  Control Level of Criteria Detail
                                                                                                                                                                              Hide Criteria and Scale Explanations




                                                                                                                                                          Score
  Less                     More

 Evaluation Criteria                             Criteria Explanation                      Scale Explanation                                                   Score Explanation




                                                                                                                                              g
          Metamodel for services and processes   What is the underlying structure,         Measured by the breadth and extensibility of the       20%     5.00 SOA Manager is designed around an extensible
                                                 extensibility, and integrability of the   product's metamodels for services and their                         service model. The levels within the service model
                                                 product's service and process model,      surrounding context (processes, infrastructure,                     range from business process (at the highest level)
                                                 including 1) the metamodel for            etc.):                                                              to service containers (at the lowest level). The
                                                 defining both services and the            5 = Broad and highly extensible model.                              model is based on ITSM-ITIL best practices (but it
                                                 processes into which they fit and 2)      3 = Basic model with some extensibility.                            is necessarily a proprietary model since there are
                                                 the breadth of different technologies     1 = Narrow model with no extensibility.                             no standards for service models). IT solution
                                                 included in the model?                                                                                        elements within the service model include service
                                                                                                                                                               containers, service intermediaries, and a
                                                                                                                                                               "manager of managers." SOA Manager's service
                                                                                                                                                               model is fully documented, published to UDDI,
                                                                                                                                                               and accessible via Web services APIs.

          Enterprise management integration      How does the product integrate with       Measured by the breadth of options for and the         20%     3.00 SOA Manager can raise Simple Network
                                                 enterprise IT management                  extent of prebuilt integration with enterprise                      Management Protocol (SNMP) traps for other
                                                 infrastructure, particularly to achieve   infrastructure management solutions:                                enterprise management products. Beyond this,
                                                 a correlated view of 1) all technology    5 = Deep standards-based and prebuilt                               the integration strategy is based on open,
                                                 layers of a service implementation        integration.                                                        documented Web services interfaces and WSDM,
                                                 and 2) all technologies that affect the   3 = Basic integration.                                              enabling product's agents and proxies to serve
                                                 health of a given business process?       1 = Minimal integration.                                            other enterprise managers and enabling the
                                                                                           0 = No integration.                                                 product to consume management data from other
                                                                                                                                                               vendors' agents and proxies — and to relate data
                                                                                                                                                               from other agents within the product's service
                                                                                                                                                               model. Within the vendor's enterprise
                                                                                                                                                               management solutions, the product's agents and
                                                                                                                                                               proxies are simply additional management
                                                                                                                                                               endpoints within the overall solution architecture.

          Metadata and repository integration    How does the product share            Measured by the breadth of options for and the              5%     3.00 SOA Manager can import and export XML
                                                 metadata with other products (import, extent of prebuilt integration with service                             documents to and from its repository. It also
                                                 export, common repository)?           repositories (UDDI and others):                                         provides Web services interfaces, all of which are
                                                                                       5 = Deep standards-based and prebuilt                                   published via UDDI.
                                                                                       integration.
                                                                                       3 = Basic integration.
                                                                                       1 = Minimal integration.
                                                                                       0 = No integration.




© 2006, Forrester Research, Inc.                                                                                                                                                                          88
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                                   > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                                     > Back to "Scores and weightings"

 Vendor Scorecard: Hewlett-Packard




                                                                                                                                                  Forrester
                                                                                                                                                                                  Show Criteria and Scale Explanations




                                                                                                                                                  Weightin
  Control Level of Criteria Detail
                                                                                                                                                                                  Hide Criteria and Scale Explanations




                                                                                                                                                              Score
  Less                     More

 Evaluation Criteria                                 Criteria Explanation                      Scale Explanation                                                   Score Explanation




                                                                                                                                                  g
          Development life-cycle integration         How does the product integrate with       Measured by the breadth and depth of feature-           5%     2.00 SOA Manager integrates with Systinet Registry
                                                     development tools, repositories, and      function for development life-cycle integration:                    but only at a basic UDDI level (it does not
                                                     SOA governance solutions? In              5 = Deep integration.                                               implement any of Systinet Registry's proprietary
                                                     particular: 1) for deployment, how        3 = Basic integration.                                              metadata). HP is working with Systinet to foster
                                                     does the product import development       1 = Minimal integration.                                            open SOA metadata standards. Developers can
                                                     tool definitions of service               0 = No integration.                                                 view service history through the product's
                                                     implementation structure and service                                                                          management console and its historical displays.
                                                     relationships and 2) for guiding future                                                                       In addition, SOA Manager can control deployment
                                                     development, how does the product                                                                             of service components to runtime application
                                                     provide developers with an integrated                                                                         platforms.
                                                     view of service configuration and
                                                     operations history?

          Load balancing and scalability (product)   What is the architecture for sharing a Measured by the extent to which all product                5%     3.00 SOA Manager relies on network-level load
                                                     workload across multiple product       elements may participate in a load balancing                           balancing.
                                                     instances?                             architecture:
                                                                                            5 = Deep load balancing abilities.
                                                                                            3 = Basic load balancing abilities.
                                                                                            1 = Minimal load balancing abilities.
                                                                                            0 = No load balancing abilities.
          Load balancing and scalability (service)   How does the product load balance      Measured by the breadth and depth of feature-              5%     2.00 Agents rely on the load balancing capabilities of
                                                     incoming service requests across       function for service load balancing:                                   the container in which they are deployed. Proxies
                                                     multiple underlying instances of a     5 = Deep features.                                                     ("brokers" in the vendor's terminology) can
                                                     service?                               3 = Basic features.                                                    perform round robin load balancing across service
                                                                                            1 = Minimal features.                                                  instances.
                                                                                            0 = No features.
          Failover (product)                         What is the architecture for failing   Measured by the extent to which all product                5%     2.00 The product relies on network-level load balancing
                                                     over a workload from one product       elements may participate in a failover                                 to direct service requests around failed nodes.
                                                     instance to another?                   architecture:                                                          Some SOA Manager deployments use high-
                                                                                            5 = Deep failover abilities.                                           availability infrastructure for failover (such as HP
                                                                                            3 = Basic failover abilities.                                          Serviceguard).
                                                                                            1 = Minimal failover abilities.
                                                                                            0 = No failover abilities.
          Failover (service)                         How does the product manage            Measured by the breadth and depth of feature-              5%     2.00 Agents rely on the failover capabilities of the
                                                     failover from one instance of a        function for service failover:                                         container in which they are deployed. Proxies can
                                                     service to another? Does the product 5 = Deep features.                                                       be configured to failover to a secondary service
                                                     monitor services using heartbeats?     3 = Basic features.                                                    instance.
                                                                                            1 = Minimal features.
                                                                                            0 = No features.




© 2006, Forrester Research, Inc.                                                                                                                                                                              89
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                             > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                               > Back to "Scores and weightings"

 Vendor Scorecard: Hewlett-Packard




                                                                                                                                            Forrester
                                                                                                                                                                            Show Criteria and Scale Explanations




                                                                                                                                            Weightin
  Control Level of Criteria Detail
                                                                                                                                                                            Hide Criteria and Scale Explanations




                                                                                                                                                        Score
  Less                     More

 Evaluation Criteria                         Criteria Explanation                      Scale Explanation                                                     Score Explanation




                                                                                                                                            g
          Dynamic reconfiguration            What product configuration options,       Measured by the product's features and design for        10%     5.00 No service configuration changes require a
                                             when changed, require a product           performing service configuration changes, product                     product restart. Agents and proxies may be
                                             restart (such as performing product       configuration changes, and product upgrades with                      installed and upgraded on the fly and, because
                                             upgrades, adding/removing                 no downtime:                                                          they cache policy and metrics locally, agents and
                                             management server instances or            5 = Deep features.                                                    proxies will continue to run without the central
                                             management consoles, etc.)?               3 = Basic features.                                                   servers. In this way, HP explicitly focuses on the
                                                                                       1 = Minimal features.                                                 design goal of enabling a no-downtime rolling
                                                                                       0 = No features.                                                      upgrade from one SOA Manager version to
                                                                                                                                                             another by first upgrading the agents and then
                                                                                                                                                             upgrading the central servers. HP's stated policy
                                                                                                                                                             is that the central servers will support agents that
                                                                                                                                                             are two versions back.

          Performance-specific features      What product features are specifically Because performance is best measured via direct              0%     0.00 Agents can use store-and-forward batching to
                                             intended as performance-enhancing tests, this item is not scored or weighted, but                               reduce network traffic to the central server.
                                             options (such as persistent network rather simply provided for information.                                     Proxies support persistent network connections
                                             connections)?                                                                                                   and HTTP chunking.

      Trust enablement                       How rich are the product's features    This score is a weighted average of its                     10%     2.80 HP has broad support for different types of
                                             for establishing trust and fitting withsubattributes: Authentication/authorization,                             authentication and some support for external
                                             an overall architecture for trust      Identity management integration, Encryption and                          identity management products. It has fair support
                                             management?                            signatures, Identity propagation, and Application                        for identity propagation.
                                                                                    security integration.
          Authentication and authorization   For managed services, what             Measured by the product's built-in features for             20%     3.00 Transport-level authentication is available via
                                             authentication protocols, token types, authentication and authorization:                                        HTTP basic authentication, two-way SSL, and
                                             and authorization styles and policies 5 = Deep features.                                                        proprietary single sign-on (SSO) tokens (for HP
                                             (such as role-based access control) 3 = Basic features.                                                         Select Access and CA eTrust SiteMinder).
                                             does the product support?              1 = Minimal features.                                                    Message-level authentication is available via WS-
                                                                                    0 = No features.                                                         Security (username, token, SSO tokens, X.509
                                                                                                                                                             token). Product does not have built-in
                                                                                                                                                             authorization-entitlements functions, but its
                                                                                                                                                             integration with HP Select Access and others
                                                                                                                                                             provides access to strong features for
                                                                                                                                                             authorization policy.
          Identity management integration    To what identity management               Measured by the product's breadth and depth of           40%     2.00 SOA Manager can delegate authentication and
                                             infrastructure products can the           integration with identity management platforms for                    authorization decisions to HP Select Access and
                                             product delegate authentication and       authentication and authorization:                                     CA eTrust SiteMinder. In addition, SOA Manager
                                             authorization decisions (including        5 = Deep integration.                                                 provides an interface that customers can use to
                                             LDAP and other directories)?              3 = Basic integration.                                                plug in a custom security provider.
                                                                                       1 = Minimal integration.
                                                                                       0 = No integration.



© 2006, Forrester Research, Inc.                                                                                                                                                                        90
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                             > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                               > Back to "Scores and weightings"

 Vendor Scorecard: Hewlett-Packard




                                                                                                                                            Forrester
                                                                                                                                                                            Show Criteria and Scale Explanations




                                                                                                                                            Weightin
  Control Level of Criteria Detail
                                                                                                                                                                            Hide Criteria and Scale Explanations




                                                                                                                                                        Score
  Less                     More

 Evaluation Criteria                           Criteria Explanation                    Scale Explanation                                                     Score Explanation




                                                                                                                                            g
          Encryption and signatures            What encryption and digital signature   Measured by the product's breadth of options for         20%     4.00 Transport-level encryption is provided via SSL.
                                               options does the product support        providing encryption and signatures using the                         Message-level encryption is provided through WS-
                                               (transport-level, message-level,        product:                                                              Security's support for XML Signature and XML
                                               message element-level, various          5 = Many options.                                                     Encryption.
                                               protocols)?                             3 = Some options.
                                                                                       1 = Few options.
                                                                                       0 = No options.
          Application security integration     What out-of-box support is provided Measured by the product's breadth of options for             20%     3.00 SOA Manager can propagate SSO tokens either
                                               for propagating identity to underlying propagating identity to underlying services:                           as HTTP cookies or as WS-Security binary
                                               service implementations? For            5 = Many options.                                                     tokens, in addition to passing along any identity
                                               integrating the product's security with 3 = Some options.                                                     information in the incoming message.
                                               the native security models of           1 = Few options.
                                               underlying application platforms?       0 = No options.

      Administrative tooling and integration   How functional, usable, integrable,     This score is a weighted average of its                  10%     2.05 HP's tooling for management administration is
                                               and complete are the product's          subattributes: Management administration,                             strong at capturing relationships to underlying
                                               administrative interfaces?              Security administration, Management console,                          service infrastructure, but it does not have role-
                                                                                       Capacity planning, and Administrative integration.                    based access. It has limited security
                                                                                                                                                             administration features, and its management
                                                                                                                                                             console is list-oriented (other HP products provide
                                                                                                                                                             graphical displays). It has full APIs for custom
                                                                                                                                                             management integration.
          Management administration            What service management policies        Measured by the richness, breadth, and overall           30%     2.00 SOA Manager's service configuration features
                                               and service configuration options do usability of the product's service configuration                         focus on monitoring, alerts, and automatic
                                               administrative tools provide for        capabilities and interface and the product's                          responses. It also displays relationships between
                                               controlling service operation? What features for role-based access control to                                 services and related infrastructure. SOA
                                               access control and customization        administrative screens:                                               Manager's administrative tools do not yet have
                                               does the product provide for            5 = Advanced configuration options and access                         strong features for limiting administrative
                                               administration functions (such as role- control.                                                              functions that individual users may access.
                                               based security and customized           3 = Average configuration options and access
                                               displays)?                              control.
                                                                                       1 = Limited configuration options and access
                                                                                       control.
          Security administration              What service security policy            Measured by the richness, breadth, and overall           25%     1.00 SOA Manager's internal security administration
                                               (authentication, authorization,         usability of the product's security configuration                     features are limited because HP's strategy is to
                                               auditing) and security log              capabilities and interface:                                           focus first on strong integration with existing
                                               configuration options do the product's 5 = Advanced configuration options.                                    identity management infrastructure. The product
                                               administrative tools provide? Can       3 = Average configuration options.                                    can log security events to a separate log. When
                                               security events be logged to a          1 = Limited configuration options.                                    used with HP Select Access, security
                                               separate log?                                                                                                 administration is strong.




© 2006, Forrester Research, Inc.                                                                                                                                                                        91
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                           > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                             > Back to "Scores and weightings"

 Vendor Scorecard: Hewlett-Packard




                                                                                                                                          Forrester
                                                                                                                                                                          Show Criteria and Scale Explanations




                                                                                                                                          Weightin
  Control Level of Criteria Detail
                                                                                                                                                                          Hide Criteria and Scale Explanations




                                                                                                                                                      Score
  Less                     More

 Evaluation Criteria                          Criteria Explanation                    Scale Explanation                                                    Score Explanation




                                                                                                                                          g
          Management console                  What range of status and command        Measured by the richness, breadth, and overall          25%     2.00 SOA Manager provides three levels of browser-
                                              displays does the product provide?      usability of the product's status displays:                          based management console displays: business/IT
                                              How usable are they?                    5 = Advanced configuration options.                                  service layer, Web services interface, and SOA
                                                                                      3 = Average configuration options.                                   infrastructure. Status displays may be filtered to
                                                                                      1 = Limited configuration options.                                   show subsets of services (such as those that
                                                                                                                                                           currently have outstanding alerts). SOA Manager
                                                                                                                                                           console displays are list-oriented — the product is
                                                                                                                                                           built as part of HP's larger enterprise
                                                                                                                                                           management solution, and it relies on other
                                                                                                                                                           elements for graphical displays.

          Capacity planning                   What support does the product         Measured by the depth and breadth of features              5%     2.00 For managed services, the product provides its
                                              provide for planning capacity of both and resources for planning capacity of managed                         standard historical reports for use in capacity
                                              underlying services and the product   services and of the product itself:                                    planning.
                                              itself?                               5 = Several features and resources.
                                                                                    3 = Some features and resources.
                                                                                    1 = Limited features and resources.
          Administrative integration          What are the integration interfaces   Measured by the product's breadth and depth of            15%     4.00 One hundred percent of SOA Manager's
                                              for programmatic configuration and    integration APIs and options:                                          configuration and metrics data is available
                                              access to metrics data (that is, for  5 = Full APIs for integration, multiple options.                       through a Web services API.
                                              bypassing the product's user          3 = Basic APIs for integration.
                                              interfaces and integrating with other 1 = Minimal APIs for integration.
                                              tools)?                               0 = No APIs for integration.
      Application integration and mediation   What features does the product have This score is a weighted average of its                      5%     2.60 HP has good features for version resolution,
                                              for mediating between different       subattributes: Version control, Protocol mediation,                    although limited features for protocol mediation.
                                              message formats and protocols used Transformation, Policy-based processing, and                              Its transformation features are good, but policy-
                                              by service requesters and providers? Other integration.                                                      based processing is limited.

          Version resolution                  How can the product route an            Measured by the product's depth of understanding        40%     4.00 SOA Manager's administrative tools capture a
                                              incoming service request to the         of versioning and its built-in (preferred) or                        version number which can be used in routing rules
                                              correct version of an underlying        configurable capabilities for routing requests to                    to match to a version number pulled from an
                                              service (assuming that multiple         different versions:                                                  incoming request using XPath. In addition, it could
                                              versions of a service can run in        5 = Deep version routing features.                                   route to specific versions based on a security
                                              production at the same time)?           3 = Basic routing based on XML Path Language                         context that identifies a particular user or group.
                                                                                      (XPath).
                                                                                      1 = Minimal version routing.
                                                                                      0 = No version routing.




© 2006, Forrester Research, Inc.                                                                                                                                                                      92
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                 > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                   > Back to "Scores and weightings"

 Vendor Scorecard: Hewlett-Packard




                                                                                                                                Forrester
                                                                                                                                                                Show Criteria and Scale Explanations




                                                                                                                                Weightin
  Control Level of Criteria Detail
                                                                                                                                                                Hide Criteria and Scale Explanations




                                                                                                                                            Score
  Less                     More

 Evaluation Criteria                 Criteria Explanation                    Scale Explanation                                                   Score Explanation




                                                                                                                                g
          Protocol mediation         What protocols can the product          Measured by the product's range of support for         20%     2.00 SOA Manager can mediate either direction
                                     mediate between (when an incoming       transport protocol mediation:                                       between HTTP and JMS transports.
                                     service request arrives on a different  5 = Extensive protocol mediation.
                                     protocol than is supported by the       3 = Basic protocol mediation.
                                     underlying service)?                    1 = Minimal protocol mediation.
                                                                             0 = No protocol mediation.
          Transformation             What capabilities does the product      Measured by the product's range of support for         15%     3.00 SOA Manager can apply XSLT-based transforms
                                     provide for resolving between           message transformation:                                             during message processing.
                                     different syntax and semantics of       5 = Extensive transformation features.
                                     incoming request formats and            3 = Basic transformation features.
                                     formats supported by underlying         1 = Minimal transformation features.
                                     services?                               0 = No transformation features.
          Policy-based processing    How can the product process service Measured by the product's features and flexibility         15%     1.00 SOA Manager provides a Java interface for
                                     requests differently based on           for configuring business policy-based routing:                      plugging in a custom routing module.
                                     business parameters for service         5 = Deep features.
                                     policy (for example, priority           3 = Basic features.
                                     processing for premium customers or 1 = Minimal features.
                                     alternate routing for requests from a 0 = No features.
                                     particular source)? How flexible is the
                                     architecture for policy-based
                                     processing?
          Other integration          Does the product provide any            Measured by the depth and importance of any            10%     0.00 No features.
                                     additional application adaptation and additional features for application integration:
                                     integration capabilities?               5 = Deep features.
                                                                             3 = Basic features.
                                                                             1 = Minimal features.
                                                                             0 = No features.
      Deployment management          How does the product control            This score is a weighted average of its                 5%     1.70 Along with its own artifacts, HP can control
                                     deployment of its own artifacts and     subattributes: Deployment artificats, Deployment                    deployment of business logic to underlying
                                     integrate its deployments with other package configuration, Rollback, Environment                           service platforms. It also has APIs for custom
                                     service infrastructure?                 staging, and Deployment integration.                                deployment integration.

          Deployment artifacts       For what application and service         Measured by the depth and breadth of service          15%     5.00 SOA Manager can control deployment of both its
                                     artifacts can the product control        deployment features:                                               own policies and the artifacts that get deployed to
                                     production deployment? Across what       5 = Deep features.                                                 the containers it supports (for example, it can
                                     range of network and infrastructure      3 = Basic features.                                                deploy .NET packages to IIS, deploy .war and .ear
                                     topologies?                              1 = Minimal features.                                              files to WebLogic).
                                                                              0 = No features.




© 2006, Forrester Research, Inc.                                                                                                                                                            93
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                                  > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                                    > Back to "Scores and weightings"

 Vendor Scorecard: Hewlett-Packard




                                                                                                                                                 Forrester
                                                                                                                                                                                 Show Criteria and Scale Explanations




                                                                                                                                                 Weightin
  Control Level of Criteria Detail
                                                                                                                                                                                 Hide Criteria and Scale Explanations




                                                                                                                                                             Score
  Less                     More

 Evaluation Criteria                               Criteria Explanation                     Scale Explanation                                                     Score Explanation




                                                                                                                                                 g
          Deployment package configuration         What are the capabilities for            Measured by the richness of the product's service        30%     0.00 SOA Manager's built-in deployment unit is a
                                                   specifying a group of artifacts to be    packaging structures:                                                 service, and it will deploy, as a group, all policies
                                                   deployed to production as a unit?        5 = Deep features.                                                    and implementation components for the service.
                                                                                            3 = Basic features.                                                   There are no structures for grouping multiple
                                                                                            1 = Minimal features.                                                 services together as a package.
                                                                                            0 = No features.
          Rollback                                 How does the product undo past           Measured by the richness of the product's rollback       20%     1.00 Although SOA Manager itself has no rollback
                                                   production deployments and restore capabilities:                                                               features, rollback can be accomplished by storing
                                                   the prior configuration?                 5 = Deep features.                                                    deployment files in a version control system and
                                                                                            3 = Basic features.                                                   reapplying an earlier version of a service
                                                                                            1 = Minimal features.                                                 specification.
                                                                                            0 = No features.
          Environment staging                      What is the product's support for        Measured by the richness of the product's                15%     1.00 No features beyond import-export from one
                                                   multiple staging environments (such environment staging capabilities:                                          environment to another.
                                                   as test, system test, production),       5 = Deep features.
                                                   including deployment and rollback        3 = Basic features.
                                                   between them?                            1 = Minimal features.
                                                                                            0 = No features.
          Deployment integration                   How can the product's deployment         Measured by the range of options for creating            20%     3.00 SOA Manager's Web services APIs provide for
                                                   capabilities be integrated with other    integrated service deployment solutions:                              deployment integration.
                                                   products' deployment features (to        5 = Deep features.
                                                   achieve a larger-scale unified           3 = Basic features.
                                                   deployment)?                             1 = Minimal features.
                                                                                            0 = No features.
      Alerting, events, and exception management   What range of options does the           This score is a weighted average of its                  10%     2.90 HP has strong alerting features and basic
                                                   product have for responding to           subattributes: Alerting methods, Alert and event                      autoresponse features but limited exception
                                                   events and exceptions?                   specification, Autoresponse, and Exception                            management features.
                                                                                            management tools.
          Alerting methods                         What channels are provided for           Measured by the range of options for sending             30%     4.00 SOA Manager supports notification via SNMP
                                                   notification of IT and business-level alerts and notifications:                                                traps, email, WSDM, WSMF (precursor to
                                                   events, exceptions, and alerts (email, 5 = Many options.                                                       WSDM), and an API for building custom alert
                                                   IM, SNMP trap, event integration         3 = Some options.                                                     methods.
                                                   features, others)?                       1 = Minimal options.
                                                                                            0 = No options.
          Alert and event specification            What tools does the product provide Measured by the depth and breadth of features                 20%     3.00 SOA Manager configures standard performance
                                                   for specifying alert and event criteria? for specifying alerts:                                                alert patterns in a fill-in-the-blank fashion and a
                                                   How usable are the tools?                5 = Deep features.                                                    single selection for availability alerts. SOA
                                                                                            3 = Basic features.                                                   Manager can understand an inbound WSMF alert
                                                                                            1 = Minimal features.                                                 (predecessor to WSDM).
                                                                                            0 = No features.




© 2006, Forrester Research, Inc.                                                                                                                                                                             94
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                      > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                        > Back to "Scores and weightings"

 Vendor Scorecard: Hewlett-Packard




                                                                                                                                     Forrester
                                                                                                                                                                     Show Criteria and Scale Explanations




                                                                                                                                     Weightin
  Control Level of Criteria Detail
                                                                                                                                                                     Hide Criteria and Scale Explanations




                                                                                                                                                 Score
  Less                     More

 Evaluation Criteria                   Criteria Explanation                    Scale Explanation                                                      Score Explanation




                                                                                                                                     g
          Autoresponse                 How does the product configure          Measured by the depth and breadth of features             30%     3.00 SOA Manager can call Web services interfaces to
                                       automatic responses to exception        for initiating autoresponse actions:                                   initiate an autoresponse.
                                       conditions?                             5 = Deep features.
                                                                               3 = Basic features.
                                                                               1 = Minimal features.
                                                                               0 = No features.
          Exception management tools   What tools does the product provide Measured by the depth and breadth of features                 20%     1.00 Request processing exceptions (such as SOAP
                                       for displaying request processing       for handling service exceptions and errors:                            faults) may be displayed and reviewed, but no
                                       exceptions, correcting messages,        5 = Deep features.                                                     facilities exist to correct or resubmit messages.
                                       and resubmitting them?                  3 = Basic features.
                                                                               1 = Minimal features.
                                                                               0 = No features.
      Logging and auditing             How integrable, secure, and auditable This score is a weighted average of its                     10%     2.50 HP has strong logging and log integration. It has
                                       are the product's operational logs?     subattributes: Logging levels, Log integration, Log                    fair auditing support but no diagnostic tools.
                                                                               integrity, Audit tools, and Diagnostic tools.
          Logging levels               How many logging levels does the        Measured by the depth and configurability of              35%     4.00 SOA Manager provides five logging levels: error,
                                       product provide? How detailed can       logging:                                                               warn, info, and trace 1 & 2. Log content is
                                       logging be? How configurable is the 5 = Deep features.                                                         configurable using SOA Manager's Log
                                       content of the log?                     3 = Basic features.                                                    Categories.
                                                                               1 = Minimal features.
                                                                               0 = No features.
          Log integration              Can the product 1) integrate its        Measured by the range of options for log                  20%     4.00 SOA Manager can direct log output to any log4j or
                                       logging with that of other service      integration:                                                           log4j.net destination. It provides a Web services
                                       infrastructure or 2) act as a central   5 = Many options.                                                      API to which other SOA elements could use for
                                       logging service for other SOA           3 = Some options.                                                      logging, allowing some centralization of SOA
                                       infrastructure?                         1 = Minimal options.                                                   logging.
                                                                               0 = No options.
          Log integrity                What does the product provide for       Measured by the depth of features for ensuring            15%     0.00 SOA Manager has no log signing features, but it
                                       ensuring the integrity of individual    log integrity:                                                         can use SSL for secure logging.
                                       logs and of a series of log files (such 5 = Deep features.
                                       as signed, chained logs)?               3 = Basic features.
                                                                               1 = Minimal features.
                                                                               0 = No features.
          Audit tools                  What capabilities does the product      Measured by the depth of features for log review          15%     2.00 SOA Manager captures audit data to a relational
                                       provide for auditing and reviewing log and integration of external audit tools:                                database, making it open to external auditing
                                       contents (or support for external       5 = Deep features.                                                     tools.
                                       auditing tools)?                        3 = Basic features.
                                                                               1 = Minimal features.
                                                                               0 = No features.




© 2006, Forrester Research, Inc.                                                                                                                                                                 95
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                        > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                          > Back to "Scores and weightings"

 Vendor Scorecard: Hewlett-Packard




                                                                                                                                       Forrester
                                                                                                                                                                       Show Criteria and Scale Explanations




                                                                                                                                       Weightin
  Control Level of Criteria Detail
                                                                                                                                                                       Hide Criteria and Scale Explanations




                                                                                                                                                   Score
  Less                     More

 Evaluation Criteria                             Criteria Explanation                  Scale Explanation                                                Score Explanation




                                                                                                                                       g
          Diagnostic tools                       What tools does the product provide   Measured by the breadth of diagnostic tool          15%     0.00 No features beyond the product's logging
                                                 for diagnosing service processing     functions:                                                       capabilities.
                                                 problems?                             5 = Deep functionality.
                                                                                       3 = Basic functionality.
                                                                                       1 = Minimal functionality.
                                                                                       0 = No functionality.
      Support for standards and specifications   What standards does the product       This score is a weighted average of its              7%     2.80 HP's standards support is strong for core Web
                                                 support?                              subattributes: Core Web services support,                        services, good for management protocols and
                                                                                       Management support, Security token support,                      security token types, and fair for other security
                                                                                       Security support, Advanced Web services                          functions.
                                                                                       support, and Other standards.
          Core Web services support              What basic Web services               Measured by the breadth of standards support:       25%     4.00 SOAP 1.1, WSDL 1.1, UDDI 2.0, WS-I Basic
                                                 specifications and standards does     5 = Broad support.                                               Profile 1.0, XML Schema 1.0, WS-Attachments
                                                 the product support (including SOAP, 3 = Average support.                                              Profile 1.0, XSLT 1.0.
                                                 WSDL, UDDI, WS-I Basic Profile,       1 = Minimal support.
                                                 XML Schema, WS-I Attachments          0 = No support.
                                                 Profile, WS-BPEL, WS-
                                                 Choreography, XSLT, others)?
          Management support                     What management specifications and Measured by the breadth of standards support:          20%     3.00 WSDM-MUWS (interim prerelease version),
                                                 standards does the product support 5 = Broad support.                                                  SNMP, and WSMF (predecessor to WSDM).
                                                 (including WSDM-MOWS, WSDM-           3 = Average support.
                                                 MUWS, WS-Management, SNMP,            1 = Minimal support.
                                                 others)?                              0 = No support.
          Security token support                 What security token specifications    Measured by the breadth of standards support:       20%     3.00 Username-password, X.509, and SSO solution
                                                 and standards does the product        5 = Broad support.                                               proprietary binary tokens.
                                                 support (username-password, x.509, 3 = Average support.
                                                 SAML, Kerberos, XRML, others)?        1 = Minimal support.
                                                                                       0 = No support.
          Security protocol support              What security protocol specifications Measured by the breadth of standards support:       20%     2.00 WS-Security, SSL/TLS, XML Encryption 1.0, and
                                                 and standards does the product        5 = Broad support.                                               XML Signature 1.0.
                                                 support (WS-Security: SOAP            3 = Average support.
                                                 Message Security, Liberty ID-FF,      1 = Minimal support.
                                                 Liberty ID-WSF, WS-I Basic Security 0 = No support.
                                                 Profile, WS-Policy, WS-Trust, WS-
                                                 SecurityPolicy, WS-
                                                 PolicyAttachments, WS-Federation,
                                                 WS-SecureConversation, XML
                                                 Encryption, XML Signature, SSL/TLS,
                                                 HTTP basic authentication, others)?




© 2006, Forrester Research, Inc.                                                                                                                                                                   96
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                   > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                     > Back to "Scores and weightings"

 Vendor Scorecard: Hewlett-Packard




                                                                                                                                  Forrester
                                                                                                                                                                  Show Criteria and Scale Explanations




                                                                                                                                  Weightin
  Control Level of Criteria Detail
                                                                                                                                                                  Hide Criteria and Scale Explanations




                                                                                                                                              Score
  Less                     More

 Evaluation Criteria                      Criteria Explanation                   Scale Explanation                                                 Score Explanation




                                                                                                                                  g
          Advanced Web services support   What advanced Web services             Measured by the breadth of standards support:         5%     0.00 None.
                                          specifications and standards does      5 = Broad support.
                                          the product support (WS-Reliability,   3 = Average support.
                                          WS-Addressing, WS-Eventing, WS-        1 = Minimal support.
                                          ReliableExchange, WS-                  0 = No support.
                                          BusinessActivity, WS-
                                          AtomicTransactions, WS-CAF (WS-
                                          CF, WS-TXM, WS-CTX), Fast
                                          Infoset, Message Transmission
                                          Optimization Mechanism (MTOM),
                                          BEEP, WS-MetadataExchange, WS-
                                          Notification, ASAP, WS-Discovery,
                                          others)?
          Other standards                 What other SOA, management, and         Measured by the breadth of standards support:       10%     2.00 JMS 1.1/1.2.
                                          messaging related standards does        5 = Broad support.
                                          the product support (Java Message       3 = Average support.
                                          Service, IIOP, Java RMI, JMX,           1 = Minimal support.
                                          others)?                                0 = No support.
      Other product features              What other generally useful features    This score is a weighted average of its              3%     0.00 HP's SOA management solution has no additional
                                          does the product have?                  subattributes: Core SOA management features                      features beyond those noted above.
                                                                                  and Other features.
          Core SOA management features    Are there additional features that      Measured by the depth and importance of any         70%     0.00 No features.
                                          relate directly to service management additional features for SOA management:
                                          and monitoring?                         5 = Deep features.
                                                                                  3 = Basic features.
                                                                                  1 = Minimal features.
                                                                                  0 = No features.
          Other features                  Are there additional ancillary features Measured by the depth and importance of any         30%     0.00 No features.
                                          (that is, beyond service management additional product features:
                                          and monitoring)?                        5 = Deep features.
                                                                                  3 = Basic features.
                                                                                  1 = Minimal features.
                                                                                  0 = No features.




© 2006, Forrester Research, Inc.                                                                                                                                                              97
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                            > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                              > Back to "Scores and weightings"

 Vendor Scorecard: Hewlett-Packard




                                                                                                                                           Forrester
                                                                                                                                                                           Show Criteria and Scale Explanations




                                                                                                                                           Weightin
  Control Level of Criteria Detail
                                                                                                                                                                           Hide Criteria and Scale Explanations




                                                                                                                                                       Score
  Less                     More

 Evaluation Criteria                         Criteria Explanation                   Scale Explanation                                                       Score Explanation




                                                                                                                                           g
     Other SOA infrastructure products       What other SOA infrastructure is       Forrester includes this criterion as information for        0%     0.00 HP has products for business process monitoring
                                             available as part of the vendor's      clients, therefore this line item is weighted at 0%.                    and a broad product line for IT management.
                                             overall product set?                   To place a value on vendors' other SOA products,
                                                                                    clients may add custom weightings, in which case
                                                                                    this score is a weighted average of its
                                                                                    subattributes: Attack protection, Registry-
                                                                                    repository, SOA life-cycle management,
                                                                                    Application development (design), Application
                                                                                    development (coding), Application integration,
                                                                                    Data integration, and Other SOA-related products.

          Attack protection                  What other products does the vendor    This line item is intended to be informational and          0%     0.00 None.
                                             have that provide direct SOA and       is therefore weighted at 0%. A score of five is
                                             Web services support for the attack    given if a vendor has any products to offer, so that
                                             protection side of security?           Forrester clients can assign a weighting if they
                                                                                    choose to.
          Registry and repository            What products does the vendor have This line item is intended to be informational and              0%     0.00 None.
                                             for registry and repository functions? is therefore weighted at 0%. A score of five is
                                                                                    given if a vendor has any products to offer, so that
                                                                                    Forrester clients can assign a weighting if they
                                                                                    choose to.
          SOA life-cycle management          What products does the vendor have This line item is informational and is therefore                0%     0.00 None.
                                             for overall service life-cycle         weighted at 0%. A score of five is given if a
                                             management (that is, end-to-end        vendor has any products to offer, so that Forrester
                                             development life-cycle                 clients can assign a weighting if they choose to.
                                             management)?
          Application development (design)   What other products does the vendor This line item is informational and is therefore               0%     5.00 HP OpenView Business Process Insight and HP
                                             have for business modeling, process weighted at 0%. A score of five is given if a                              OpenView Service Navigator Value Pack.
                                             modeling, service modeling, and        vendor has any products to offer, so that Forrester
                                             service design?                        clients can assign a weighting if they choose to.

          Application development (coding)   What products does the vendor have This line item is informational and is therefore                0%     0.00 None.
                                             for detailed service development and weighted at 0%. A score of five is given if a
                                             administration?                      vendor has any products to offer, so that Forrester
                                                                                  clients can assign a weighting if they choose to.

          Application integration            What products does the vendor have     This line item is informational and is therefore            0%     0.00 None.
                                             that provide full application          weighted at 0%. A score of five is given if a
                                             integration features and functions     vendor has any products to offer, so that Forrester
                                             (beyond simple transformation that     clients can assign a weighting if they choose to.
                                             the product may inherently support)?



© 2006, Forrester Research, Inc.                                                                                                                                                                       98
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                            > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                              > Back to "Scores and weightings"

 Vendor Scorecard: Hewlett-Packard




                                                                                                                                           Forrester
                                                                                                                                                                           Show Criteria and Scale Explanations




                                                                                                                                           Weightin
  Control Level of Criteria Detail
                                                                                                                                                                           Hide Criteria and Scale Explanations




                                                                                                                                                       Score
  Less                     More

 Evaluation Criteria                        Criteria Explanation               Scale Explanation                                                            Score Explanation




                                                                                                                                           g
          Data integration                  What products does the vendor have This line item is informational and is therefore                 0%     0.00 None.
                                            for data-level integration?        weighted at 0%. A score of five is given if a
                                                                               vendor has any products to offer, so that Forrester
                                                                               clients can assign a weighting if they choose to.

          Other SOA-related products        What other products does the vendor      This line item is informational and is therefore           0%     5.00 As part of HP's broader set of IT management
                                            have that address other major            weighted at 0%. A score of five is given if a                          tools, SOA Manager can bring other multiple HP
                                            requirements for SOA and Web             vendor has any products to offer, so that Forrester                    products to bear on the broader context of SOA
                                            services?                                clients can assign a weighting if they choose to.                      management.


 STRATEGY                                                                                                                                      50%     3.92
    Product strategy                        What is the vendor's approach to the This score is a weighted average of its                       45%     4.20 HP has a deep vision for how SOA management
                                            SOA management market in terms of subattributes: SOA and Web services                                           needs to have visibility across both service
                                            near-term plans and long-term focus? management, Broader SOA infrastructure product                             interfaces and service implementations, and it
                                                                                 directions, and Enterprise focus.                                          sees the foundation for this as model-driven
                                                                                                                                                            automation based on an extensible, integrated
                                                                                                                                                            model of business processes and IT
                                                                                                                                                            infrastructure. It will integrate with products from
                                                                                                                                                            other SOA infrastructure vendors, while its own
                                                                                                                                                            product investments will focus clearly on
                                                                                                                                                            management and security.
          SOA and Web services management   What future enhancements does the        Measured by Forrester's assessment of the                 80%     4.00 For service management, HP's investment and
                                            vendor currently plan for the product    product plans and vision stated by the vendor:                         enhancement plans include deeper JMS protocol
                                            that would help it score better on       5 = Strong road map in many areas.                                     support, richer operational-level monitoring,
                                            SOA and Web services management          3 = Strong road map in some areas.                                     graphical visualization of monitoring data,
                                            criteria? (That is, all of the Current   1 = Weak road map.                                                     enhancement of service brokering capabilities,
                                            offering criteria above except the       0 = Vendor hasn't disclosed.                                           and visibility of long-lived transactions. For the
                                            "Other SOA infrastructure products"                                                                             broader context of end-to-end management of
                                            criterion.)                                                                                                     SOA (infrastructure to business service), HP's
                                                                                                                                                            investment focus includes expansion and
                                                                                                                                                            increased extensibility of its core SOA model,
                                                                                                                                                            more sophisticated resource monitoring, greater
                                                                                                                                                            enterprise service bus (ESB) monitoring,
                                                                                                                                                            simplified integration interfaces, deeper security of
                                                                                                                                                            the management environment itself, and
                                                                                                                                                            centralized policy definition.




© 2006, Forrester Research, Inc.                                                                                                                                                                       99
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                                > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                                  > Back to "Scores and weightings"

 Vendor Scorecard: Hewlett-Packard




                                                                                                                                               Forrester
                                                                                                                                                                               Show Criteria and Scale Explanations




                                                                                                                                               Weightin
  Control Level of Criteria Detail
                                                                                                                                                                               Hide Criteria and Scale Explanations




                                                                                                                                                           Score
  Less                     More

 Evaluation Criteria                            Criteria Explanation                     Scale Explanation                                                      Score Explanation




                                                                                                                                               g
          Other SOA infrastructure products     What future product directions has       This line item is informational and is therefore           0%     2.00 HP is focused strictly on management and
                                                the vendor disclosed that would move     weighted at 0%. So that Forrester clients can                          security (for SOA and the broader IT
                                                it toward broader and more complete      assign a weighting if they choose to, Forrester has                    infrastructure) and has no broader plans beyond
                                                SOA infrastructure capabilities          measured the vendor's response based on the                            integrating well with other players in the SOA
                                                beyond SOA and Web services              breadth of broader SOA categories that the                             ecosystem.
                                                management? In other words, how          vendor intends to provide products for.
                                                will it build its cababilities in the
                                                "Other SOA infrastructure products"
                                                criterion above?

             Enterprise focus                   In the vendor's view, what is the full   Measured by Forrester's assessment of the                 20%     5.00 In accord with the model-driven automation
                                                scope of enterprise requirements for     vendor's stated understanding of the scope of                          elements of HP's adaptive enterprise strategy, HP
                                                SOA management and SOA                   enterprise-class SOA management:                                       sees a strong, extensible underlying model as the
                                                infrastructure?                          5 = Strong view of enterprise SOA management                           core of SOA management. Beyond this, an SOA
                                                                                         requirements.                                                          management solution must integrate
                                                                                         3 = Average view of enterprise SOA                                     management data from disparate sources,
                                                                                         requirements.                                                          including enterprise management data. Managing
                                                                                         1 = Weak view of enterprise SOA requirements.                          Web services levels is an important part but just a
                                                                                         0 = the vendor hasn't disclosed.                                       part. Unless the solution knows how all the layers
                                                                                                                                                                and components of an SOA implementation relate
                                                                                                                                                                to each other, to the underlying infrastructure, and
                                                                                                                                                                to the business services they support, it cannot
                                                                                                                                                                manage a SOA to the extent necessary to ensure
                                                                                                                                                                a significant return on investment.

      Financial resources to support strategy   Is the vendor profitable? Does the       Measured by Forrester's assessment of public              25%     5.00 HP's software business had recent quarterly
                                                company have sufficient funding,         data (which receives greater weight) and vendor                        revenues of $311 million, with $27 million
                                                revenues, profits, and cash flow to      claims as to the resources available for product                       operating profit, while HP as a whole has a cash
                                                support its strategies?                  development and the overall stability of the                           and cash equivalents balance of $14 billion.
                                                                                         vendor:
                                                                                         5 = Clearly sufficient resources and stability from
                                                                                         public data.
                                                                                         3 = Reasonable resources and likely stability from
                                                                                         private data.
                                                                                         1 = Questionable resources and stability (or lack
                                                                                         of data).
      Cost                                      What is the cost of the product?         The score is a weighted average of the scores for         30%     2.60 HP's solution has a moderately high entry-point
                                                                                         these subattributes: Medium deployment license                         cost, but it gets more affordable in larger
                                                                                         cost, Minimum license cost, Maintenance cost,                          deployments.
                                                                                         and Pricing structure.




© 2006, Forrester Research, Inc.                                                                                                                                                                          100
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                          > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                            > Back to "Scores and weightings"

 Vendor Scorecard: Hewlett-Packard




                                                                                                                                         Forrester
                                                                                                                                                                         Show Criteria and Scale Explanations




                                                                                                                                         Weightin
  Control Level of Criteria Detail
                                                                                                                                                                         Hide Criteria and Scale Explanations




                                                                                                                                                     Score
  Less                     More

 Evaluation Criteria                       Criteria Explanation                 Scale Explanation                                                         Score Explanation




                                                                                                                                         g
          Medium deployment license cost   What would be the total license cost This score is based on the license cost for this             60%     3.00 About $300,000.
                                           for a deployment to manage 100       configuration as reported by the vendor:
                                           separate WSDL interfaces spread      5 = Up to $99,999.
                                           across 20 servers (four CPUs each)   4 = $100,000 to $199,999.
                                           with two management consoles?        3 = $200,000 to $399,999.
                                                                                2 = $400,000 to $699,999.
                                                                                1 = $700,000 or more.
                                                                                0 = The vendor hasn't disclosed.
          Minimum license cost             What would be the total license cost This score is based on the license cost for this             40%     2.00 The minimum license cost is $150,000.
                                           for a deployment to manage one       configuration as reported by the vendor:
                                           WSDL interface on one server (two    5 = Up to $49,999.
                                           CPUs) with one management            4 = $50,000 to $99,999.
                                           console?                             3 = $100,000 to $149,999.
                                                                                2 = $150,000 to $199,999.
                                                                                1 = $200,000 or more.
                                                                                0 = The vendor hasn't disclosed
          Maintenance cost                 What is the annual maintenance cost Forrester provides this information to aid our                 0%     0.00 Approximately 20% of actual sales price for 24x7
                                           structure for this product?          clients' decisions; we give a default score of 0 to                       support.
                                                                                the vendor for this attribute.


          Pricing structure                What are the details of the product's   Forrester provides this information to aid our             0%     0.00 Vendor did not disclose its pricing model but
                                           pricing structure?                      clients' decisions; we give a default score of 0 to                    stated that it is moving to a custom, per-
                                                                                   the vendor for this attribute.                                         deployment model.

 MARKET PRESENCE                                                                                                                              0%     2.62
    Installed base                         How large is the vendor's installed    This score is a weighted average of its                    30%     1.80 HP's solution is new, and it is just beginning to
                                           base of customers for this product     subattributes: This product, All SOA products,                          build its customer base.
                                           and for all products?                  New customers, Users on maintenance, and
                                                                                  Reference accounts.
          This product                     What is the installed base of          This factor is scored on the number of customer            40%     0.00 SOA Manager was released in June 2005. There
                                           customers (separate stock tickers) for installations the vendor reports having:                                are four customers and several more prospects
                                           this product?                          5 = 300 or more.                                                        currently evaluating the product.
                                                                                  4 = 100 to 299.
                                                                                  3 = 60 to 99.
                                                                                  2 = 30 to 59.
                                                                                  1 = Five to 29.
                                                                                  0 = Fewer than five or the vendor hasn't
                                                                                  disclosed.




© 2006, Forrester Research, Inc.                                                                                                                                                                    101
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                    > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                      > Back to "Scores and weightings"

 Vendor Scorecard: Hewlett-Packard




                                                                                                                                   Forrester
                                                                                                                                                                   Show Criteria and Scale Explanations




                                                                                                                                   Weightin
  Control Level of Criteria Detail
                                                                                                                                                                   Hide Criteria and Scale Explanations




                                                                                                                                               Score
  Less                     More

 Evaluation Criteria                 Criteria Explanation                      Scale Explanation                                                    Score Explanation




                                                                                                                                   g
          All SOA products           What is the installed base of             This factor is scored on the number of customer         15%     5.00 HP has thousands of management software
                                     customers (separate stock tickers) for    installations the vendor reports having:                             customers overall, although other than SOA
                                     all of the vendor's SOA products          5 = 2,000 or more.                                                   Manager it does not have products that are
                                     (including this product and those         4 = 1,000 to 1,999.                                                  specifically SOA products.
                                     listed in the "Other SOA infrastructure   3 = 500 to 999.
                                     products" criterion above)?               2 = 100 to 499.
                                                                               1 = 10 to 99.
                                                                               0 = Fewer than 10 or the vendor hasn't disclosed.


          New customers              How many customers bought or         This factor is scored on the number of customer              30%     1.00 Four.
                                     upgraded the product during the past installations the vendor reports having:
                                     year?                                5 = 40 or more.
                                                                          4 = 30 to 39.
                                                                          3 = 20 to 29.
                                                                          2 = 10 to 19.
                                                                          1 = Three to nine.
                                                                          0 = Fewer than three or the vendor hasn't
                                                                          disclosed.

          Users on maintenance       What percentage of customers of all This factor is scored on the percentage of                    15%     5.00 One hundred percent of customers are on
                                     versions of this product are on active customers for all versions of this product that the                     maintenance agreements (the product is new, and
                                     maintenance agreements?                vendor reports are on maintenance agreement:                            first year maintenance is included).
                                                                            5 = 97% or more.
                                                                            4 = 90% to 96%.
                                                                            3 = 80% to 89%.
                                                                            2 = 70% to 79%.
                                                                            1 = 60% to 69%.
                                                                            0 = Less than 60% or the vendor hasn't disclosed.


          Reference accounts         What companies are the major          Forrester provides this information to aid our               0%     0.00 The first two customers asked not to be named,
                                     reference customers for this product? clients' decisions; we don't score or weight this                        but HP identifies them as a "large US based
                                                                           attribute.                                                               financial services firm" and a "Large European
                                                                                                                                                    Telecommunication firm."




© 2006, Forrester Research, Inc.                                                                                                                                                              102
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                  > Back to "Scores and weightings"

 Vendor Scorecard: Hewlett-Packard




                                                                                                                               Forrester
                                                                                                                                                               Show Criteria and Scale Explanations




                                                                                                                               Weightin
  Control Level of Criteria Detail
                                                                                                                                                               Hide Criteria and Scale Explanations




                                                                                                                                           Score
  Less                     More

 Evaluation Criteria                 Criteria Explanation                  Scale Explanation                                                    Score Explanation




                                                                                                                               g
     Revenue                         What is the vendor's revenue over     This score is based on overall revenue as               25%     5.00 The vendor's revenue for the period from Q4 2004
                                     the period from Q4 2004 through Q3    reported by the vendor:                                              through Q3 2005 is $80 billion.
                                     2005?                                 5 = More than $1 billion.
                                                                           4 = $500 million to $1 billion.
                                                                           3 = $50 million to $499 million.
                                                                           2 = $10 million to $49 million.
                                                                           1 = Less than $10 million.
                                                                           0 = The vendor hasn't disclosed.
      Revenue growth                 What is the vendor's year-over-year   Forrester provides this information to aid our           0%     0.00 Year-over-year revenue growth is 10% (2004 over
                                     revenue growth over the period from   clients' decisions; we don't score or weight this                    2003).
                                     Q3 2004 through Q3 2005?              attribute.

      Systems integrators            What systems integrator partners      This factor is scored on the number of systems          15%     0.00 To date, HP's consulting unit is the only one to
                                     have completed three or more          integrator partners the vendor reports have                          have implemented the product.
                                     deployments of any version of this    completed three or more deployments of this
                                     product in the past 18 months?        product in the past 18 months:
                                                                           5 = Five or more.
                                                                           4 = Four.
                                                                           3 = Three.
                                                                           2 = Two.
                                                                           1 = One.
                                                                           0 = Zero or the vendor hasn't disclosed.
      Services                       How strong are the vendor's           This score is a weighted average of its                 10%     4.50 HP did not disclose the size of its in-house
                                     implementation and training           subattributes: Implementation engineers and                          professional services team for its SOA
                                     services?                             Training.                                                            management solution, but it has a large
                                                                                                                                                professional services team and a full range of
                                                                                                                                                training options.
          Implementation engineers   How many employees provide            This factor is scored on the number of employees        50%     4.00 The vendor did not disclose its own staff for
                                     implementation services for this      the vendor reports having dedicated to                               implementation, but it noted that, including one of
                                     product?                              implementation services for this product:                            its partners, there are 120 trained engineers. HP
                                                                           5 = 100 or more.                                                     has a large consulting team overall.
                                                                           4 = 70 to 99.
                                                                           3 = 40 to 69.
                                                                           2 = 20 to 49.
                                                                           1 = 10 to 19.
                                                                           0 = Fewer than 10 or the vendor hasn't disclosed.




© 2006, Forrester Research, Inc.                                                                                                                                                          103
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                  > Back to "Scores and weightings"

 Vendor Scorecard: Hewlett-Packard




                                                                                                                               Forrester
                                                                                                                                                               Show Criteria and Scale Explanations




                                                                                                                               Weightin
  Control Level of Criteria Detail
                                                                                                                                                               Hide Criteria and Scale Explanations




                                                                                                                                           Score
  Less                     More

 Evaluation Criteria                 Criteria Explanation                  Scale Explanation                                                    Score Explanation




                                                                                                                               g
          Training                   Does the vendor offer classroom,      Measured by how many training channels the              50%     5.00 HP offers classroom, Web-based self-service,
                                     Web-based, and on-site training?      vendor offers:                                                       and on-site training for its products.
                                                                           5 = All three channels.
                                                                           3 = Two channels.
                                                                           1 = One channel.
                                                                           0 = No training offered.
      Employees                      How many engineers does the           This score is a weighted average of its                 10%     3.75 HP is a very large firm with a global presence. It
                                     vendor have dedicated to this         subattributes: Total employees, Dedicated                            did not disclose the size of its engineering staff.
                                     product? How big is the vendor's      engineers, and Sales staff.
                                     sales presence?
          Total employees            How many employees does the           This factor is scored on the total number of            50%     5.00 HP has 151,000 employees.
                                     vendor have?                          employees the vendor reports having:
                                                                           5 = 10,000 or more.
                                                                           4 = 300 to 9,999.
                                                                           3 = 80 to 299.
                                                                           2 = 40 to 79.
                                                                           1 = 25 to 39.
                                                                           0 = Fewer than 25 or the vendor hasn't disclosed.

          Dedicated engineers        How many engineers are dedicated    This factor is scored on the total number of              25%     0.00 The vendor did not disclose.
                                     to research and development of this engineers the vendor reports having dedicated to
                                     product line?                       this product line:
                                                                         5 = 300 or more.
                                                                         4 = 100 to 299.
                                                                         3 = 30 to 99.
                                                                         2 = 15 to 29.
                                                                         1 = 5 to 14.
                                                                         0 = Fewer than five or vendor hasn't disclosed.
          Sales staff                How large and how global is the     Measured by size and global footprint of sales            25%     5.00 The vendor did not disclose, but HP has a global
                                     vendor's sales force? What          organization:                                                          presence.
                                     percentage of the sales force       5 = 100-plus, with global presence.
                                     supports Europe, Asia Pacific, and  3 = 25 to 99, no global presence.
                                     Rest of World?                      1 = Less than 25, no global presence.
      Technology partners            How strongly do technology partners This score is a weighted average of its                   10%     0.00 HP has yet to develop resellers for its SOA
                                     support this product?               subattributes: License partners, Resellers, and                        management solution, but it has some SOA
                                                                         Other partners.                                                        vendors that have product-level integration with its
                                                                                                                                                solution.




© 2006, Forrester Research, Inc.                                                                                                                                                          104
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                                        > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                                          > Back to "Scores and weightings"

 Vendor Scorecard: Hewlett-Packard




                                                                                                                                                       Forrester
                                                                                                                                                                                       Show Criteria and Scale Explanations




                                                                                                                                                       Weightin
  Control Level of Criteria Detail
                                                                                                                                                                                       Hide Criteria and Scale Explanations




                                                                                                                                                                   Score
  Less                     More

 Evaluation Criteria                                    Criteria Explanation                    Scale Explanation                                                       Score Explanation




                                                                                                                                                       g
          License partners                              What vendors license or bundle this     This score is the weighted average of the number           50%     0.00 HP's services bundles SOA Manager with its
                                                        product?                                of vendors that the vendor reports license or                           Mobile Service Delivery Platform (mSDP) solution
                                                                                                bundle this product:                                                    for the telecom market, but no external partners
                                                                                                5 = 10 or more.                                                         bundle SOA Manager.
                                                                                                4 = Seven to nine.
                                                                                                3 = Five or six.
                                                                                                2 = Three or four.
                                                                                                1 = One or two.
                                                                                                0 = Zero or the vendor hasn't disclosed.
          Resellers                                     What firms resell this product?         This score is the weighted average of the number           50%     0.00 None at this time.
                                                                                                of resellers that the vendor reports offer this
                                                                                                product:
                                                                                                5 = 20 or more.
                                                                                                4 = 15 to 19.
                                                                                                3 = 10 to 14.
                                                                                                2 = Five to nine.
                                                                                                1 = One to four.
                                                                                                0 = Zero or vendor hasn't disclosed.
          Other partners                                What other vendors have modified        Forrester provides this information to aid our              0%     0.00 AmberPoint, Blue Titan Software, DataPower
                                                        their products to better integrate with clients' decisions; we score this attribute 0 in all                    Technology (IBM), and Systinet.
                                                        this product (as opposed to having      cases.
                                                        only standards-based interop)?


 © 2006, Forrester Research, Inc. All rights reserved. Forrester, Forrester Wave, WholeView 2, Technographics, and Total Economic Impact
 are trademarks of Forrester Research, Inc. All other trademarks are the property of their respective companies. Forrester clients may make
 one attributed copy or slide of each figure contained herein. Additional reproduction is strictly prohibited. For additional reproduction rights
 and usage information, go to www.forrester.com. Information is based on best available resources. Opinions reflect judgment at the time




© 2006, Forrester Research, Inc.                                                                                                                                                                                  105
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                  > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                    > Back to "Scores and weightings"

 Vendor Scorecard: IBM




                                                                                                                                 Forrester
                                                                                                                                                                 Show Criteria and Scale Explanations




                                                                                                                                 Weightin
  Control Level of Criteria Detail
                                                                                                                                                                 Hide Criteria and Scale Explanations




                                                                                                                                             Score
  Less                     More

 Evaluation Criteria                 Criteria Explanation                   Scale Explanation                                                     Score Explanation




                                                                                                                                 g
 CURRENT OFFERING                                                                                                                    50%     3.10
     Products included               What is the precise product or set of This item is for information only and is not scored        0%     0.00 IBM offers: IBM Tivoli Access Manager 5.1
                                     products that the vendor offers as its or weighted.                                                          (TAM), IBM Tivoli Business Systems Manager 3.1
                                     service-oriented architecture (SOA)                                                                          (BSM), IBM Tivoli Composite Application Manager
                                     and Web services management                                                                                  for Response Time Tracking 6.0 (ITCAM for RTT),
                                     solution?                                                                                                    IBM Tivoli Composite Application Manager for
                                                                                                                                                  SOA 6.0 (ITCAM for SOA), IBM Tivoli Composite
                                                                                                                                                  Application Manager for WebSphere 6.0 (ITCAM
                                                                                                                                                  for WAS), IBM Tivoli Federated Identity Manager
                                                                                                                                                  6.0 (FIM), IBM Tivoli Service Level Advisor 2.1.1
                                                                                                                                                  (TSLA), IBM WebSphere ESB 6.0 (WESB), Tivoli
                                                                                                                                                  OMEGAMON for WebSphere Business
                                                                                                                                                  Integration 1.1, WebSphere Business Modeler 6.0
                                                                                                                                                  (WBMod) WebSphere Business Monitor 6.0
                                                                                                                                                  (WBMon), WebSphere Integration Developer 6.0
                                                                                                                                                  (WSID), and WebSphere Process Server 6.0
                                                                                                                                                  (WPS).

      IT-level management            How does the product manage           This score is a weighted average of its                   20%     4.00 The service-monitoring elements of IBM's solution
                                     service performance and availability? subattributes: Endpoint support, Performance                           directly support a narrow range of service
                                                                           management, Availability management, and                               endpoint protocols (but indirectly support
                                                                           Service-level management.                                              additional ones), but they have features for deep
                                                                                                                                                  monitoring of the service platforms and service
                                                                                                                                                  latency. It tracks only service-level goals — not
                                                                                                                                                  service-level agreements (SLAs) tied to users.

          Endpoint support           What access protocols (SOAP,           Measured by the breadth of support for various           20%     4.00 For service-monitoring functions, ITCAM for SOA
                                     XML/HTTP, Java Message Service         protocols, payload types, and native agents for                       provides data collectors for SOAP/HTTP and
                                     (JMS), Java RMI, WebSphere MQ,         specific products:                                                    SOAP/JMS. These take the form of a .NET
                                     .NET Remoting, others) and service     5 = Broad support.                                                    system handler and a JAX-RPC handler (that can
                                     implementation technologies (Java      3 = Average support.                                                  run on any JSR-109-compliant application server,
                                     EE, .NET, databases, others) does      1 = Minimal support.                                                  and that provides indirect support for whatever
                                     the product fully monitor? What        0 = No support.                                                       protocols the container supports). ITCAM for WAS
                                     specific products does the product                                                                           provides deeper monitoring for service
                                     support?                                                                                                     implementations on WebSphere. Monitoring for
                                                                                                                                                  other service endpoints and messaging protocols
                                                                                                                                                  is available from other elements of the Tivoli
                                                                                                                                                  product line. For service policy enforcement,
                                                                                                                                                  mediation, and security functions, WESB and
                                                                                                                                                  TAM provide proxy configurations that would be
                                                                                                                                                  deployed in conjunction with ITCAM's data
                                                                                                                                                  collectors.

© 2006, Forrester Research, Inc.                                                                                                                                                            106
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                     > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                       > Back to "Scores and weightings"

 Vendor Scorecard: IBM




                                                                                                                                    Forrester
                                                                                                                                                                    Show Criteria and Scale Explanations




                                                                                                                                    Weightin
  Control Level of Criteria Detail
                                                                                                                                                                    Hide Criteria and Scale Explanations




                                                                                                                                                Score
  Less                     More

 Evaluation Criteria                 Criteria Explanation                     Scale Explanation                                                      Score Explanation




                                                                                                                                    g
          Performance management     How does the product gather, report,     Measured by the breadth and depth of                      30%     5.00 The elements of IBM's solution combine to
                                     and analyze service performance          functionality for gathering, analyzing, and                            provide performance monitoring at the service
                                     data, including 1) reporting against     correlating data about service invocations and                         interface level (ITCAM for SOA) and from multiple
                                     performance goals and 2) correlation     service implementations:                                               layers within service implementations (ITCAM for
                                     of performance data across               5 = Deep functionality.                                                RTT). Performance exceptions (events or
                                     technology layers within service         3 = Average functionality.                                             "situations" in the vendor's terminology) can be
                                     implementations?                         1 = Minimal functionality.                                             triggered based on thresholds, and they can
                                                                              0 = No functionality.                                                  initiate actions ("take actions"). These two
                                                                                                                                                     products are built on common elements of Tivoli's
                                                                                                                                                     overall IT management infrastructure, including
                                                                                                                                                     Tivoli Enterprise Management Server (TEMS),
                                                                                                                                                     Tivoli Data Warehouse, Tivoli Enterprise
                                                                                                                                                     Monitoring Agent, and Tivoli Enterprise Portal (all
                                                                                                                                                     of which are bundled in).

          Availability management    How does the product gather, report,    Measured by the breadth and depth of                       30%     3.00 As with performance management, ITCAM for
                                     and analyze service availability data,  functionality for identifying, analyzing, and                           SOA and ITCAM for RTT combine to provide
                                     including root cause analysis of        correlating availability issues for services and                        availability data for both the overall service and
                                     availability issues across technology   service implementations:                                                layers of a service implementation.
                                     layers within service                   5 = Deep functionality.
                                     implementations?                        3 = Average functionality.
                                                                             1 = Minimal functionality.
                                                                             0 = No functionality.
          Service-level management   How does the product 1) specify         Measured by the breadth and depth of                       20%     4.00 Service-level goals for services are entered
                                     service-level goals, 2) tie service-    functionality for specifying service-level goals and                    through a common Tivoli user interface included
                                     level goals to specific users or groups SLAs and monitoring and managing operations to                          with ITCAM, but this does not support tying goals
                                     to create service-level agreements      maintain service-level goals:                                           to specific users or groups. TSLA adds deeper-
                                     (SLAs), 3) monitor and report service- 5 = Deep functionality.                                                  service-level reporting features. Service
                                     level compliance over time, and 4)      3 = Average functionality.                                              operations may be adjusted by configuring events
                                     automatically adjust service            1 = Minimal functionality.                                              that initiate actions based on service thresholds.
                                     operations to better achieve SLAs?      0 = No functionality.                                                   Future releases of ITCAM for SOA will provide
                                                                                                                                                     SLA-driven routing and load balancing. Additional
                                                                                                                                                     capabilities are available through other products
                                                                                                                                                     that are not part of this Wave, including deeper
                                                                                                                                                     features for response actions, such as bringing
                                                                                                                                                     new processing resources online (via Tivoli
                                                                                                                                                     Provisioning Manager).




© 2006, Forrester Research, Inc.                                                                                                                                                               107
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                               > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                                 > Back to "Scores and weightings"

 Vendor Scorecard: IBM




                                                                                                                                              Forrester
                                                                                                                                                                              Show Criteria and Scale Explanations




                                                                                                                                              Weightin
  Control Level of Criteria Detail
                                                                                                                                                                              Hide Criteria and Scale Explanations




                                                                                                                                                          Score
  Less                     More

 Evaluation Criteria                            Criteria Explanation                       Scale Explanation                                                   Score Explanation




                                                                                                                                              g
     Business-level management                  How does the product provide               This score is a weighted average of its                 5%     4.65 IBM's solution can create a closed-loop cycle of
                                                business insight by extracting and         subattributes: Business activity montioring,                        defining, monitoring, and reporting on business
                                                reporting data from service request-       Usability by business users, and Integration for                    process activity. It provides a portal with key
                                                response flows?                            business monitoring.                                                performance indicators (KPIs), historical data,
                                                                                                                                                               alerts, and process status. Business data (both
                                                                                                                                                               process data and event data) is available via
                                                                                                                                                               database reads and integration APIs.
          Business activity monitoring (BAM)    How do the product's built-in features     Measured by the breadth and depth of                   30%     5.00 Using a combination of WPS, WBMon, and
                                                provide business insight from service      functionality for capturing business data from                      WBMod, the solution can create a closed-loop
                                                operation by extracting, analyzing,        service requests and tying that data to business                    means of defining, instrumenting, and measuring
                                                and reporting on business data             processes:                                                          business processes. To enable this, services
                                                contained in the flow of service           5 = Deep functionality.                                             must be accessed through a process flow that is
                                                requests and responses? What are           3 = Average functionality.                                          executed through WPS.
                                                its capabilities for tying such analysis   1 = Minimal functionality.
                                                to an end-to-end business process          0 = No functionality.
                                                flow?

          Usability by business users           How understandable to and usable by Measured by the breadth and depth of                          35%     5.00 WBMon is designed for business users, and its
                                                business staff are the product's      functionality for creating business-oriented                             portal views include scorecards, KPIs (compared
                                                business activity monitoring tools?   displays and the extent to which these are usable                        to defined limits), historical charts, alerts, and
                                                                                      by business staff:                                                       process status.
                                                                                      5 = Deep functionality.
                                                                                      3 = Average functionality.
                                                                                      1 = Minimal functionality.
                                                                                      0 = No functionality.
          Integration for business monitoring   What are the data capture methods Measured by the breadth of options by which                     35%     4.00 WPS provides an event repository accessible for
                                                and configuration options for feeding other products can get business activity data                            external integration. WBMon provides external
                                                data to other analysis tools (BAM,    captured by the product:                                                 integration access to both process models and
                                                data warehousing, others)?            5 = Deep integration options.                                            historical process execution data.
                                                                                      3 = Average integration options.
                                                                                      1 = Minimal integration options.
                                                                                      0 = No integration options.




© 2006, Forrester Research, Inc.                                                                                                                                                                         108
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                                 > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                                   > Back to "Scores and weightings"

 Vendor Scorecard: IBM




                                                                                                                                                Forrester
                                                                                                                                                                                Show Criteria and Scale Explanations




                                                                                                                                                Weightin
  Control Level of Criteria Detail
                                                                                                                                                                                Hide Criteria and Scale Explanations




                                                                                                                                                            Score
  Less                     More

 Evaluation Criteria                             Criteria Explanation                      Scale Explanation                                                     Score Explanation




                                                                                                                                                g
     Product architecture                        How robust is the product's overall       This score is a weighted average of its                  15%     3.00 IBM's solution consists of 13 products generally
                                                 architecture, including its integration   subattributes: Deployment styles and                                  based on Tivoli and WebSphere as the two design
                                                 with development life-cycle               requirements, metamodel for services and                              foundations. This provides modularity and
                                                 management infrastructure?                processes, Enterprise management integration,                         functional depth when purchasing and
                                                                                           Metadata and repository integration, Development                      implementing individual products for focused
                                                                                           life-cycle integration, Load balancing and                            needs but increases complexity when seeking a
                                                                                           scalability (product), Load balancing and                             broad set of functionality. IBM will be increasing
                                                                                           scalability (service), Failover (product), Dynamic                    the extensibility of its service model. The solution
                                                                                           reconfiguration, and Performance-specific                             has deep out-of-the-box enterprise management
                                                                                           features.                                                             integration with IBM's products but is otherwise
                                                                                                                                                                 limited. Development life-cycle integration is fair. It
                                                                                                                                                                 has above-average capabilities for service failover
                                                                                                                                                                 and load balancing.

          Deployment styles and requirements     What are the options for deployment       Measured by the breadth of deployment options            20%     3.00 The basic architecture of a combined ITCAM for
                                                 of monitoring elements (such as           and depth of integration with numerous service                        SOA and ITCAM for RTT solution consists of
                                                 agent, proxy, inline, tool kit for        endpoint technologies:                                                agents (one per machine), inline data collectors
                                                 embedding an agent in an                  5 = Broad deployment options.                                         (one in each application container, deployed as a
                                                 application, others)? What servers or     3 = Average deployment options.                                       JAX-RPC handler or a .NET system handler), and
                                                 other infrastructure are required?        1 = Limited deployment options.                                       the central monitoring infrastructure (management
                                                                                                                                                                 server, portal server, database, and management
                                                                                                                                                                 console). Additional runtime elements must be
                                                                                                                                                                 installed for added features beyond service
                                                                                                                                                                 monitoring, making configuration of a deployment
                                                                                                                                                                 more complex. These would include WESB (for
                                                                                                                                                                 service mediation), WPS (for process-level
                                                                                                                                                                 context for service analysis), and WBMon (for the
                                                                                                                                                                 business-level dashboard).

          Metamodel for services and processes   What is the underlying structure,         Measured by the breadth and extensibility of the         20%     3.00 For now, the metamodel underlying IBM's solution
                                                 extensibility, and integrability of the   product's metamodels for services and their                           is relatively fixed and not highly extensible.
                                                 product's service and process model,      surrounding context (processes, infrastructure,                       However, because the elements of the solution
                                                 including 1) the metamodel for            etc.):                                                                are built on Tivoli's common management
                                                 defining both services and the            5 = Broad and highly extensible model.                                foundation, the model covers a wide breadth of
                                                 processes into which they fit and 2)      3 = Basic model with some extensibility.                              technologies. IBM's future direction centers
                                                 the breadth of different technologies     1 = Narrow model with no extensibility.                               heavily on a configuration management database
                                                 included in the model?                                                                                          (CMDB) that will increase the overall extensibility
                                                                                                                                                                 of the solution.




© 2006, Forrester Research, Inc.                                                                                                                                                                           109
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                                   > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                                     > Back to "Scores and weightings"

 Vendor Scorecard: IBM




                                                                                                                                                  Forrester
                                                                                                                                                                                  Show Criteria and Scale Explanations




                                                                                                                                                  Weightin
  Control Level of Criteria Detail
                                                                                                                                                                                  Hide Criteria and Scale Explanations




                                                                                                                                                              Score
  Less                     More

 Evaluation Criteria                                 Criteria Explanation                      Scale Explanation                                                   Score Explanation




                                                                                                                                                  g
          Enterprise management integration          How does the product integrate with       Measured by the breadth of options for and the         20%     3.00 The products considered in this Forrester Wave
                                                     enterprise IT management                  extent of prebuilt integration with enterprise                      provide integrated views of multiple layers of
                                                     infrastructure, particularly to achieve   infrastructure management solutions:                                services and their implementations. These
                                                     a correlated view of 1) all technology    5 = Deep standards-based and prebuilt                               products are also part of IBM Tivoli's suite of
                                                     layers of a service implementation        integration.                                                        management products, most of which are built on
                                                     and 2) all technologies that affect the   3 = Basic integration.                                              the same foundational elements. The individual
                                                     health of a given business process?       1 = Minimal integration.                                            elements of the solution are fundamentally
                                                                                               0 = No integration.                                                 designed to work as part of the Tivoli family, and
                                                                                                                                                                   the ability for any individual product to work with
                                                                                                                                                                   non-IBM management solutions is limited.

          Metadata and repository integration        How does the product share            Measured by the breadth of options for and the              5%     2.00 WPS and WESB are the two primary service-
                                                     metadata with other products (import, extent of prebuilt integration with service                             hosting and service-mediation runtimes, with
                                                     export, common repository)?           repositories (UDDI and others):                                         WBMod and WSID, respectively, as the related
                                                                                           5 = Deep standards-based and prebuilt                                   authoring tools. Both tools support import-export
                                                                                           integration.                                                            via related standards like WSDL and BPEL. In the
                                                                                           3 = Basic integration.                                                  future, IBM will deliver WebSphere Business
                                                                                           1 = Minimal integration.                                                Service Registry as a foundational element for
                                                                                           0 = No integration.                                                     managing and sharing service metadata.

          Development life-cycle integration         How does the product integrate with       Measured by the breadth and depth of feature-           5%     3.00 All three ITCAM products feed relevant
                                                     development tools, repositories, and      function for development life-cycle integration:                    information into the Rational tooling environment
                                                     SOA governance solutions? In              5 = Deep integration.                                               where it can give insight into the detailed behavior
                                                     particular: 1) for deployment, how        3 = Basic integration.                                              of composite applications and services to
                                                     does the product import development       1 = Minimal integration.                                            application developers and services architects.
                                                     tool definitions of service               0 = No integration.                                                 Additional life-cycle integration for SOA
                                                     implementation structure and service                                                                          management arises in that, for example,
                                                     relationships and 2) for guiding future                                                                       WebSphere products serve both a development
                                                     development, how does the product                                                                             and a runtime role in service operations. IBM is
                                                     provide developers with an integrated                                                                         also pursuing deeper integration between its
                                                     view of service configuration and                                                                             Rational, WebSphere, and Tivoli product lines.
                                                     operations history?

          Load balancing and scalability (product)   What is the architecture for sharing a Measured by the extent to which all product                5%     4.00 The various elements of IBM's solution have
                                                     workload across multiple product       elements may participate in a load balancing                           different strategies for load balancing of the
                                                     instances?                             architecture:                                                          infrastructure, but in general, there are two
                                                                                            5 = Deep load balancing abilities.                                     primary foundations for IBM's runtime
                                                                                            3 = Basic load balancing abilities.                                    components — IBM Tivoli Monitoring for Web
                                                                                            1 = Minimal load balancing abilities.                                  Infrastructure and WebSphere Application Server
                                                                                            0 = No load balancing abilities.                                       — both of which operate at high volume in current
                                                                                                                                                                   customer deployments.



© 2006, Forrester Research, Inc.                                                                                                                                                                             110
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                                 > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                                   > Back to "Scores and weightings"

 Vendor Scorecard: IBM




                                                                                                                                                Forrester
                                                                                                                                                                                Show Criteria and Scale Explanations




                                                                                                                                                Weightin
  Control Level of Criteria Detail
                                                                                                                                                                                Hide Criteria and Scale Explanations




                                                                                                                                                            Score
  Less                     More

 Evaluation Criteria                                 Criteria Explanation                   Scale Explanation                                                    Score Explanation




                                                                                                                                                g
          Load balancing and scalability (service)   How does the product load balance      Measured by the breadth and depth of feature-            5%     3.00 WESB is the primary element of IBM's solution
                                                     incoming service requests across       function for service load balancing:                                 that provides for service load balancing. Currently,
                                                     multiple underlying instances of a     5 = Deep features.                                                   WESB provides basic load balancing via
                                                     service?                               3 = Basic features.                                                  algorithms such as round robin. In the future, IBM
                                                                                            1 = Minimal features.                                                will integrate ITCAM for SOA with WESB to
                                                                                            0 = No features.                                                     enable algorithms that are based on management
                                                                                                                                                                 configurations, such as service-level goals.

          Failover (product)                         What is the architecture for failing   Measured by the extent to which all product              5%     4.00 IBM Tivoli Monitoring infrastructure provides a hot
                                                     over a workload from one product       elements may participate in a failover                               standby feature that enables a new management
                                                     instance to another?                   architecture:                                                        server to step in for a failed one without losing any
                                                                                            5 = Deep failover abilities.                                         alerts. Data collectors failover with the container
                                                                                            3 = Basic failover abilities.                                        to which they are deployed and will automatically
                                                                                            1 = Minimal failover abilities.                                      reconnect to the new server. WESB and WPS
                                                                                            0 = No failover abilities.                                           inherit built-in clustering capabilities due to their
                                                                                                                                                                 implementation on the WebSphere Application
                                                                                                                                                                 Server foundation.

          Failover (service)                         How does the product manage            Measured by the breadth and depth of feature-            5%     2.00 WESB provides built-in features for routing
                                                     failover from one instance of a        function for service failover:                                       around failed service instances. WPS, as a
                                                     service to another? Does the product   5 = Deep features.                                                   process intermediary, relies on the failover
                                                     monitor services using heartbeats?     3 = Basic features.                                                  architecture of the underlying service. ITCAM, as
                                                                                            1 = Minimal features.                                                a monitoring solution, does not provide failover
                                                                                            0 = No features.                                                     between service instances.
          Dynamic reconfiguration                    What product configuration options, Measured by the product's features and design for          10%     3.00 WESB and WPS use the dynamic reconfiguration
                                                     when changed, require a product        performing service configuration changes, product                    capabilities of the WebSphere Application Server
                                                     restart (such as performing product    configuration changes, and product upgrades with                     foundation on which they are built, including hot
                                                     upgrades, adding/removing              no downtime:                                                         deployment (adding new services without
                                                     management server instances or         5 = Deep features.                                                   restarting) and dynamic reloading (changing an
                                                     management consoles, etc.)?            3 = Basic features.                                                  existing component without restarting it). ITCAM
                                                                                            1 = Minimal features.                                                agents can be added without restarting.
                                                                                            0 = No features.
          Performance-specific features              What product features are specifically Because performance is best measured via direct          0%     0.00 The IBM Tivoli Monitoring and WebSphere
                                                     intended as performance-enhancing tests, this item is not scored or weighted, but                           Application Server foundations on which IBM's
                                                     options (such as persistent network rather simply provided for information.                                 solution are based have both been architected for
                                                     connections)?                                                                                               high performance, although IBM did not list any
                                                                                                                                                                 particular architecture or design features specific
                                                                                                                                                                 to SOA management.




© 2006, Forrester Research, Inc.                                                                                                                                                                           111
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                               > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                                 > Back to "Scores and weightings"

 Vendor Scorecard: IBM




                                                                                                                                              Forrester
                                                                                                                                                                              Show Criteria and Scale Explanations




                                                                                                                                              Weightin
  Control Level of Criteria Detail
                                                                                                                                                                              Hide Criteria and Scale Explanations




                                                                                                                                                          Score
  Less                     More

 Evaluation Criteria                           Criteria Explanation                      Scale Explanation                                                     Score Explanation




                                                                                                                                              g
     Trust enablement                          How rich are the product's features       This score is a weighted average of its                  10%     2.40 IBM has some support for different types of
                                               for establishing trust and fitting with   subattributes: Authentication/authorization,                          authentication but very limited support for external
                                               an overall architecture for trust         Identity management integration, Encryption and                       identity management products. However, it has
                                               management?                               signatures, Identity propagation, and Application                     strong tool kit-level support for federated identity
                                                                                         security integration.                                                 products, although limited built-in support for
                                                                                                                                                               identity propagation.
          Authentication and authorization     For managed services, what              Measured by the product's built-in features for            20%     3.00 WESB supports WS-Security. WESB includes
                                               authentication protocols, token types,  authentication and authorization:                                       TAM, which provides transport-level
                                               and authorization styles and policies   5 = Deep features.                                                      authentication via HTTP basic authentication or
                                               (such as role-based access control)     3 = Basic features.                                                     two-way SSL. FIM provides tool kit-level functions
                                               does the product support?               1 = Minimal features.                                                   to expand support to additional token types.
                                                                                       0 = No features.
          Identity management integration      To what identity management             Measured by the product's breadth and depth of             40%     1.00 TAM and FIM support delegation of authentication
                                               infrastructure products can the         integration with identity management platforms for                      decisions to any LDAP directory. Beyond this,
                                               product delegate authentication and authentication and authorization:                                           there is no integration with other identity
                                               authorization decisions (including      5 = Deep integration.                                                   management products.
                                               LDAP and other directories)?            3 = Basic integration.
                                                                                       1 = Minimal integration.
                                                                                       0 = No integration.
          Encryption and signatures            What encryption and digital signature Measured by the product's breadth of options for             20%     4.00 TAM provides transport-level encryption via SSL.
                                               options does the product support        providing encryption and signatures using the                           WESB provides message-level security through
                                               (transport-level, message-level,        product:                                                                WS-Security's support for XML Signature and
                                               message element-level, various          5 = Many options.                                                       XML Encryption.
                                               protocols)?                             3 = Some options.
                                                                                       1 = Few options.
                                                                                       0 = No options.
          Application security integration     What out-of-box support is provided Measured by the product's breadth of options for               20%     3.00 WESB will pass through any identity tokens that
                                               for propagating identity to underlying propagating identity to underlying services:                             are present in a service request. Beyond this,
                                               service implementations? For            5 = Many options.                                                       custom coding would be required and would use
                                               integrating the product's security with 3 = Some options.                                                       FIM to convert and propagate security tokens. No
                                               the native security models of           1 = Few options.                                                        features are provided to populate native security
                                               underlying application platforms?       0 = No options.                                                         tokens into underlying application platforms.

      Administrative tooling and integration   How functional, usable, integrable,       This score is a weighted average of its                  10%     2.75 IBM's administration tooling is split across multiple
                                               and complete are the product's            subattributes: Management administration,                             products, making configuration more complex.
                                               administrative interfaces?                Security administration, Management console,                          However, the primary display for service operation
                                                                                         Capacity planning, and Administrative integration.                    and status is strong. It has broad, although not
                                                                                                                                                               full, APIs for custom management integration, and
                                                                                                                                                               the APIs vary by product.




© 2006, Forrester Research, Inc.                                                                                                                                                                         112
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                    > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                      > Back to "Scores and weightings"

 Vendor Scorecard: IBM




                                                                                                                                   Forrester
                                                                                                                                                                   Show Criteria and Scale Explanations




                                                                                                                                   Weightin
  Control Level of Criteria Detail
                                                                                                                                                                   Hide Criteria and Scale Explanations




                                                                                                                                               Score
  Less                     More

 Evaluation Criteria                  Criteria Explanation                    Scale Explanation                                                     Score Explanation




                                                                                                                                   g
          Management administration   What service management policies        Measured by the richness, breadth, and overall           30%     2.00 To access the full range of configuration options
                                      and service configuration options do usability of the product's service configuration                         represented by IBM's solution, multiple
                                      administrative tools provide for        capabilities and interface and the product's                          management consoles are required, making
                                      controlling service operation? What features for role-based access control to                                 administration more complex. Within a product
                                      access control and customization        administrative screens:                                               line (WebSphere and Tivoli), most products use a
                                      does the product provide for            5 = Advanced configuration options and access                         common foundation for tooling and thus tend to
                                      administration functions (such as role- control.                                                              have a similar look and feel. The various consoles
                                      based security and customized           3 = Average configuration options and access                          each have role-based controls to limit access by
                                      displays)?                              control.                                                              different administrator groups. Generally, the
                                                                              1 = Limited configuration options and access                          management console functions are cluster-
                                                                              control.                                                              enabled, meaning that one console can propagate
                                                                                                                                                    configuration changes to all servers in a cluster.

          Security administration     What service security policy             Measured by the richness, breadth, and overall          25%     2.00 WESB, TAM, and FIM each have administrative
                                      (authentication, authorization,          usability of the product's security configuration                    tools for configuring security, making unified
                                      auditing) and security log               capabilities and interface:                                          security configuration more complex. Security
                                      configuration options do the product's   5 = Advanced configuration options.                                  events are logged together with administrative
                                      administrative tools provide? Can        3 = Average configuration options.                                   events.
                                      security events be logged to a           1 = Limited configuration options.
                                      separate log?
          Management console          What range of status and command         Measured by the richness, breadth, and overall          25%     4.00 The primary display for real-time management is
                                      displays does the product provide?       usability of the product's status displays:                          based on Tivoli Enterprise Portal (TEP), which is
                                      How usable are they?                     5 = Advanced configuration options.                                  included with ITCAM for SOA. TEP is
                                                                               3 = Average configuration options.                                   implemented as a rich client with a portal-like
                                                                               1 = Limited configuration options.                                   structure (with pluggable, configurable display
                                                                                                                                                    portlets), which enables: 1) a high degree of
                                                                                                                                                    customization and real-time interactive display,
                                                                                                                                                    and 2) the ability to plug in all of the rest of the
                                                                                                                                                    monitoring functions from other Tivoli products
                                                                                                                                                    (including ITCAM for RTT and ITCAM for WAS,
                                                                                                                                                    both of which are part of IBM's SOA management
                                                                                                                                                    solution).
          Capacity planning           What support does the product            Measured by the depth and breadth of features            5%     4.00 For managed services, the combination of IBM
                                      provide for planning capacity of both    and resources for planning capacity of managed                       products provides historical reports for use in
                                      underlying services and the product      services and of the product itself:                                  capacity planning. For the products themselves,
                                      itself?                                  5 = Several features and resources.                                  IBM Redbooks provide guidance for capacity
                                                                               3 = Some features and resources.                                     planning. The monitoring breadth of IBM's solution
                                                                               1 = Limited features and resources.                                  brings insight into capacity issues across
                                                                                                                                                    technology layers.




© 2006, Forrester Research, Inc.                                                                                                                                                              113
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                             > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                               > Back to "Scores and weightings"

 Vendor Scorecard: IBM




                                                                                                                                            Forrester
                                                                                                                                                                            Show Criteria and Scale Explanations




                                                                                                                                            Weightin
  Control Level of Criteria Detail
                                                                                                                                                                            Hide Criteria and Scale Explanations




                                                                                                                                                        Score
  Less                     More

 Evaluation Criteria                          Criteria Explanation                    Scale Explanation                                                      Score Explanation




                                                                                                                                            g
          Administrative integration          What are the integration interfaces     Measured by the product's breadth and depth of            15%     3.00 For WESB and WPS, integration is available via
                                              for programmatic configuration and      integration APIs and options:                                          JMX and an IBM predecessor to JMX: PMI. The
                                              access to metrics data (that is, for    5 = Full APIs for integration, multiple options.                       JMX interfaces provide access to about 80% of
                                              bypassing the product's user            3 = Basic APIs for integration.                                        the configuration options and performance metrics
                                              interfaces and integrating with other   1 = Minimal APIs for integration.                                      of WESB and WPS. The ITCAM products are
                                              tools)?                                 0 = No APIs for integration.                                           based on TEMS, which provides Web services
                                                                                                                                                             APIs for access to real-time and historical
                                                                                                                                                             operations data.
      Application integration and mediation   What features does the product have     This score is a weighted average of its                    5%     3.75 IBM has average features for version resolution.
                                              for mediating between different         subattributes: Version control, Protocol mediation,                    Its features for protocol mediation, transformation,
                                              message formats and protocols used      Transformation, Policy-based processing, and                           and policy-based processing features are very
                                              by service requesters and providers?    Other integration.                                                     strong, and the product set includes deeper
                                                                                                                                                             integration features as well.
          Version resolution                  How can the product route an           Measured by the product's depth of understanding           40%     3.00 WESB can perform content-based routing to
                                              incoming service request to the        of versioning and its built-in (preferred) or                           direct a request to a specific version of a service
                                              correct version of an underlying       configurable capabilities for routing requests to                       based on XPath or XQuery evaluations.
                                              service (assuming that multiple        different versions:
                                              versions of a service can run in       5 = Deep version routing features.
                                              production at the same time)?          3 = Basic routing based on XML Path Language
                                                                                     (XPath).
                                                                                     1 = Minimal version routing.
                                                                                     0 = No version routing.
          Protocol mediation                  What protocols can the product         Measured by the product's range of support for             20%     4.00 WESB can mediate any-to-any connectivity
                                              mediate between (when an incoming transport protocol mediation:                                                between SOAP, HTTP, JMS, IIOP, RMI, and
                                              service request arrives on a different 5 = Extensive protocol mediation.                                       WebSphere MQ.
                                              protocol than is supported by the      3 = Basic protocol mediation.
                                              underlying service)?                   1 = Minimal protocol mediation.
                                                                                     0 = No protocol mediation.
          Transformation                      What capabilities does the product     Measured by the product's range of support for             15%     4.00 WSID provides an authoring environment to
                                              provide for resolving between          message transformation:                                                 create a wide variety of message transformations
                                              different syntax and semantics of      5 = Extensive transformation features.                                  that WESB can execute. These include XSLT,
                                              incoming request formats and           3 = Basic transformation features.                                      message routing, and database lookup. Additional
                                              formats supported by underlying        1 = Minimal transformation features.                                    features allow custom transformations to be
                                              services?                              0 = No transformation features.                                         plugged in.




© 2006, Forrester Research, Inc.                                                                                                                                                                       114
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                             > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                               > Back to "Scores and weightings"

 Vendor Scorecard: IBM




                                                                                                                                            Forrester
                                                                                                                                                                            Show Criteria and Scale Explanations




                                                                                                                                            Weightin
  Control Level of Criteria Detail
                                                                                                                                                                            Hide Criteria and Scale Explanations




                                                                                                                                                        Score
  Less                     More

 Evaluation Criteria                         Criteria Explanation                      Scale Explanation                                                     Score Explanation




                                                                                                                                            g
          Policy-based processing            How can the product process service       Measured by the product's features and flexibility       15%     5.00 WSID's authoring environment allows creation of
                                             requests differently based on             for configuring business policy-based routing:                        simple and complex policy-based processing
                                             business parameters for service           5 = Deep features.                                                    configurations that will run in WESB.
                                             policy (for example, priority             3 = Basic features.
                                             processing for premium customers or       1 = Minimal features.
                                             alternate routing for requests from a     0 = No features.
                                             particular source)? How flexible is the
                                             architecture for policy-based
                                             processing?
          Other integration                  Does the product provide any              Measured by the depth and importance of any              10%     4.00 WESB includes integration with JMS providers
                                             additional application adaptation and     additional features for application integration:                      and WebSphere MQ, enabling access to a
                                             integration capabilities?                 5 = Deep features.                                                    broader set of service endpoints. In addition, it
                                                                                       3 = Basic features.                                                   can use WebSphere adapters that are available
                                                                                       1 = Minimal features.                                                 for an additional cost. WPS provides additional
                                                                                       0 = No features.                                                      features for integration process flows.
      Deployment management                  How does the product control              This score is a weighted average of its                   5%     1.20 Each element of IBM's solution separately
                                             deployment of its own artifacts and       subattributes: Deployment artificats, Deployment                      controls deployment of its own artifacts.
                                             integrate its deployments with other      package configuration, Rollback, Environment
                                             service infrastructure?                   staging, and Deployment integration.

          Deployment artifacts               For what application and service          Measured by the depth and breadth of service             15%     2.00 Each element of IBM's solution (WESB, WPS,
                                             artifacts can the product control         deployment features:                                                  ITCAM for SOA, ITCAM for RTT, etc.) controls
                                             production deployment? Across what        5 = Deep features.                                                    deployment of only the configurations, modules,
                                             range of network and infrastructure       3 = Basic features.                                                   and artifacts that are part of that element's
                                             topologies?                               1 = Minimal features.                                                 domain. There is no overall deployment
                                                                                       0 = No features.                                                      management structure.
          Deployment package configuration   What are the capabilities for             Measured by the richness of the product's service        30%     0.00 There is no overall service packaging mechanism
                                             specifying a group of artifacts to be     packaging structures:                                                 within IBM's solution. Such packaging might be
                                             deployed to production as a unit?         5 = Deep features.                                                    accomplished using import-export functionality
                                                                                       3 = Basic features.                                                   from each product and packaging them together
                                                                                       1 = Minimal features.                                                 with IBM Rational ClearCase (not part of this
                                                                                       0 = No features.                                                      evaluation).
          Rollback                           How does the product undo past            Measured by the richness of the product's rollback       20%     2.00 WESB and WPS inherit WebSphere Application
                                             production deployments and restore        capabilities:                                                         Server's facility to manage profiles, which might
                                             the prior configuration?                  5 = Deep features.                                                    be used to create a profile snapshot of each
                                                                                       3 = Basic features.                                                   deployment stage. Rollback would then be
                                                                                       1 = Minimal features.                                                 accomplished by reactivating a previous profile.
                                                                                       0 = No features.                                                      The Tivoli-based products do not have this type of
                                                                                                                                                             functionality, and rollback would require
                                                                                                                                                             reimporting a prior version of service
                                                                                                                                                             configurations.



© 2006, Forrester Research, Inc.                                                                                                                                                                       115
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                                > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                                  > Back to "Scores and weightings"

 Vendor Scorecard: IBM




                                                                                                                                               Forrester
                                                                                                                                                                               Show Criteria and Scale Explanations




                                                                                                                                               Weightin
  Control Level of Criteria Detail
                                                                                                                                                                               Hide Criteria and Scale Explanations




                                                                                                                                                           Score
  Less                     More

 Evaluation Criteria                               Criteria Explanation                     Scale Explanation                                                   Score Explanation




                                                                                                                                               g
          Environment staging                      What is the product's support for        Measured by the richness of the product's              15%     2.00 For WESB, WSID can move configurations
                                                   multiple staging environments (such      environment staging capabilities:                                   between staging environments. The other
                                                   as test, system test, production),       5 = Deep features.                                                  elements of IBM's solution require import-export
                                                   including deployment and rollback        3 = Basic features.                                                 functionality to move between environments.
                                                   between them?                            1 = Minimal features.
                                                                                            0 = No features.
          Deployment integration                   How can the product's deployment         Measured by the range of options for creating          20%     1.00 The WebSphere products can share a common
                                                   capabilities be integrated with other    integrated service deployment solutions:                            console to assist with integrated deployment. The
                                                   products' deployment features (to        5 = Deep features.                                                  Tivoli products do not provide for integrated
                                                   achieve a larger-scale unified           3 = Basic features.                                                 deployment. IBM's response did not discuss
                                                   deployment)?                             1 = Minimal features.                                               deployment integration using APIs.
                                                                                            0 = No features.
      Alerting, events, and exception management   What range of options does the           This score is a weighted average of its                10%     2.80 IBM has average alerting and autoresponse
                                                   product have for responding to           subattributes: Alerting methods, Alert and event                    features and some exception management
                                                   events and exceptions?                   specification, Autoresponse, and Exception                          features.
                                                                                            management tools.
          Alerting methods                         What channels are provided for           Measured by the range of options for sending           30%     3.00 ITCAM supports alerting via email, SNMP traps,
                                                   notification of IT and business-level alerts and notifications:                                              and direct integration to Tivoli Enterprise Console.
                                                   events, exceptions, and alerts (email, 5 = Many options.
                                                   IM, SNMP trap, event integration         3 = Some options.
                                                   features, others)?                       1 = Minimal options.
                                                                                            0 = No options.
          Alert and event specification            What tools does the product provide Measured by the depth and breadth of features               20%     3.00 Tivoli Enterprise Portal (included with ITCAM for
                                                   for specifying alert and event criteria? for specifying alerts:                                              SOA) provides alert specification features that
                                                   How usable are the tools?                5 = Deep features.                                                  include the ability to tie response actions to alert
                                                                                            3 = Basic features.                                                 events.
                                                                                            1 = Minimal features.
                                                                                            0 = No features.
          Autoresponse                             How does the product configure           Measured by the depth and breadth of features          30%     3.00 Through the included Tivoli Enterprise Portal,
                                                   automatic responses to exception         for initiating autoresponse actions:                                ITCAM for SOA can initiate actions to reconfigure
                                                   conditions?                              5 = Deep features.                                                  agents, send events, or invoke operating system
                                                                                            3 = Basic features.                                                 scripts to perform other types of dynamic
                                                                                            1 = Minimal features.                                               reconfiguration.
                                                                                            0 = No features.
          Exception management tools               What tools does the product provide Measured by the depth and breadth of features               20%     2.00 ITCAM for SOA includes limited features for
                                                   for displaying request processing        for handling service exceptions and errors:                         review of messages, and it can be configured to
                                                   exceptions, correcting messages,         5 = Deep features.                                                  reject messages meeting defined criteria.
                                                   and resubmitting them?                   3 = Basic features.                                                 Correction and resubmission of messages is not
                                                                                            1 = Minimal features.                                               supported.
                                                                                            0 = No features.




© 2006, Forrester Research, Inc.                                                                                                                                                                          116
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                  > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                    > Back to "Scores and weightings"

 Vendor Scorecard: IBM




                                                                                                                                 Forrester
                                                                                                                                                                 Show Criteria and Scale Explanations




                                                                                                                                 Weightin
  Control Level of Criteria Detail
                                                                                                                                                                 Hide Criteria and Scale Explanations




                                                                                                                                             Score
  Less                     More

 Evaluation Criteria                 Criteria Explanation                  Scale Explanation                                                      Score Explanation




                                                                                                                                 g
     Logging and auditing            How integrable, secure, and auditable This score is a weighted average of its                   10%     2.55 IBM has good logging and log integration, and it
                                     are the product's operational logs?   subattributes: Logging levels, Log integration, Log                    also has good auditing support and good
                                                                           integrity, Audit tools, and Diagnostic tools.                          diagnostic tools.
          Logging levels             How many logging levels does the      Measured by the depth and configurability of              35%     3.00 ITCAM for SOA supports three logging levels:
                                     product provide? How detailed can     logging:                                                               metric only, metrics plus SOAP headers, and
                                     logging be? How configurable is the 5 = Deep features.                                                       metrics plus SOAP headers and body. Logging
                                     content of the log?                   3 = Basic features.                                                    levels can be specified at the service-operation
                                                                           1 = Minimal features.                                                  level. Logs containing data are retained on the
                                                                           0 = No features.                                                       machine that they were collected on in a
                                                                                                                                                  wraparound log cache whose size is configurable.
                                                                                                                                                  WESB and WPS have additional logging
                                                                                                                                                  capabilities separate from ITCAM's. However, all
                                                                                                                                                  of these logs can be directed to Tivoli Data
                                                                                                                                                  Warehouse (TDW), which is included with ITCAM
                                                                                                                                                  for SOA.
          Log integration            Can the product 1) integrate its        Measured by the range of options for log                20%     3.00 Metrics logs can be archived to TDW where they
                                     logging with that of other service      integration:                                                         can be extracted by any suitable tool.
                                     infrastructure or 2) act as a central   5 = Many options.
                                     logging service for other SOA           3 = Some options.
                                     infrastructure?                         1 = Minimal options.
                                                                             0 = No options.
          Log integrity              What does the product provide for       Measured by the depth of features for ensuring          15%     0.00 This product has no features for signed logs.
                                     ensuring the integrity of individual    log integrity:
                                     logs and of a series of log files (such 5 = Deep features.
                                     as signed, chained logs)?               3 = Basic features.
                                                                             1 = Minimal features.
                                                                             0 = No features.
          Audit tools                What capabilities does the product      Measured by the depth of features for log review        15%     3.00 Archived logs in TDW (a relational database) may
                                     provide for auditing and reviewing log and integration of external audit tools:                              be accessed by external auditing tools. Also,
                                     contents (or support for external       5 = Deep features.                                                   ITCAM for SOA's Web Services Navigator
                                     auditing tools)?                        3 = Basic features.                                                  provides a browsing mechanism for reviewing
                                                                             1 = Minimal features.                                                Web services log files.
                                                                             0 = No features.
          Diagnostic tools           What tools does the product provide Measured by the breadth of diagnostic tool                  15%     3.00 ITCAM for SOA's Web Services Navigator is an
                                     for diagnosing service processing       functions:                                                           Eclipse-based tool. It can read data from the TDW
                                     problems?                               5 = Deep functionality.                                              to create topology and sequence diagrams, as
                                                                             3 = Basic functionality.                                             well as aggregate patterns over time. In addition,
                                                                             1 = Minimal functionality.                                           it provides inspection of XML message headers
                                                                             0 = No functionality.                                                and body text. WESB and WPS have some built-
                                                                                                                                                  in debugging features.




© 2006, Forrester Research, Inc.                                                                                                                                                            117
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                        > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                          > Back to "Scores and weightings"

 Vendor Scorecard: IBM




                                                                                                                                       Forrester
                                                                                                                                                                       Show Criteria and Scale Explanations




                                                                                                                                       Weightin
  Control Level of Criteria Detail
                                                                                                                                                                       Hide Criteria and Scale Explanations




                                                                                                                                                   Score
  Less                     More

 Evaluation Criteria                            Criteria Explanation                   Scale Explanation                                                Score Explanation




                                                                                                                                       g
     Support for standards and specifications   What standards does the product        This score is a weighted average of its              7%     3.05 IBM's standards support is very strong for core
                                                support?                               subattributes: Core Web services support,                        Web services, good for general security functions,
                                                                                       Management support, Security token support,                      fair for security token types, and weak for
                                                                                       Security support, Advanced Web services                          management protocols. IBM also has support for
                                                                                       support, and Other standards.                                    some advanced Web services standards.

          Core Web services support             What basic Web services                Measured by the breadth of standards support:       25%     5.00 WESB supports SOAP 1.1, WSDL 1.1, UDDI (2.0,
                                                specifications and standards does      5 = Broad support.                                               3.0), SAAJ 1.2, WS-I Basic Profile 1.1, XML
                                                the product support (including SOAP,   3 = Average support.                                             Schema 1.0, WS-I Attachments Profile 1.0, and
                                                WSDL, UDDI, WS-I Basic Profile,        1 = Minimal support.                                             XSLT 1.0. WPS supports WS-BPEL 1.1.
                                                XML Schema, WS-I Attachments           0 = No support.
                                                Profile, WS-BPEL, WS-
                                                Choreography, XSLT, others)?
          Management support                    What management specifications and    Measured by the breadth of standards support:        20%     1.00 ITCAM for SOA supports sending of SNMP traps.
                                                standards does the product support    5 = Broad support.
                                                (including WSDM-MOWS, WSDM-           3 = Average support.
                                                MUWS, WS-Management, SNMP,            1 = Minimal support.
                                                others)?                              0 = No support.
          Security token support                What security token specifications    Measured by the breadth of standards support:        20%     2.00 FIM supports username-password and SAML
                                                and standards does the product        5 = Broad support.                                                tokens. IBM's response did not itemize the token
                                                support (username-password, x.509,    3 = Average support.                                              types supported by WESB or WPS.
                                                SAML, Kerberos, XRML, others)?        1 = Minimal support.
                                                                                      0 = No support.
          Security protocol support             What security protocol specifications Measured by the breadth of standards support:        20%     3.00 FIM supports Liberty ID-FF, WS-Federation, WS-
                                                and standards does the product        5 = Broad support.                                                Security, and WS-Trust. WESB supports WS-
                                                support (WS-Security: SOAP            3 = Average support.                                              Security 1.0, including XML Signature and XML
                                                Message Security, Liberty ID-FF,      1 = Minimal support.                                              Encryption.
                                                Liberty ID-WSF, WS-I Basic Security 0 = No support.
                                                Profile, WS-Policy, WS-Trust, WS-
                                                SecurityPolicy, WS-
                                                PolicyAttachments, WS-Federation,
                                                WS-SecureConversation, XML
                                                Encryption, XML Signature, SSL/TLS,
                                                HTTP basic authentication, others)?




© 2006, Forrester Research, Inc.                                                                                                                                                                  118
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                  > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                    > Back to "Scores and weightings"

 Vendor Scorecard: IBM




                                                                                                                                 Forrester
                                                                                                                                                                 Show Criteria and Scale Explanations




                                                                                                                                 Weightin
  Control Level of Criteria Detail
                                                                                                                                                                 Hide Criteria and Scale Explanations




                                                                                                                                             Score
  Less                     More

 Evaluation Criteria                      Criteria Explanation                   Scale Explanation                                                Score Explanation




                                                                                                                                 g
          Advanced Web services support   What advanced Web services             Measured by the breadth of standards support:        5%     2.00 WESB supports WS-AtomicTransactions and WS-
                                          specifications and standards does      5 = Broad support.                                               BusinessActivity, as part of WS-Coordination.
                                          the product support (WS-Reliability,   3 = Average support.
                                          WS-Addressing, WS-Eventing, WS-        1 = Minimal support.
                                          ReliableExchange, WS-                  0 = No support.
                                          BusinessActivity, WS-
                                          AtomicTransactions, WS-CAF (WS-
                                          CF, WS-TXM, WS-CTX), Fast
                                          Infoset, Message Transmission
                                          Optimization Mechanism (MTOM),
                                          BEEP, WS-MetadataExchange, WS-
                                          Notification, ASAP, WS-Discovery,
                                          others)?
          Other standards                 What other SOA, management, and        Measured by the breadth of standards support:       10%     5.00 WESB supports JMS 1.1, IIOP, RMI, and JMX.
                                          messaging related standards does       5 = Broad support.                                               ITCAM for SOA supports JMS 1.1.
                                          the product support (Java Message      3 = Average support.
                                          Service, IIOP, Java RMI, JMX,          1 = Minimal support.
                                          others)?                               0 = No support.
      Other product features              What other generally useful features   This score is a weighted average of its              3%     3.40 IBM's full SOA management solution provides
                                          does the product have?                 subattributes: Core SOA management features                      deep process monitoring features. Beyond this, it
                                                                                 and Other features.                                              provides federated identity infrastructure for Web
                                                                                                                                                  applications.
          Core SOA management features    Are there additional features that      Measured by the depth and importance of any        70%     4.00 WPS and WESB provide features to construct a
                                          relate directly to service management additional features for SOA management:                           closed-loop process management solution with
                                          and monitoring?                         5 = Deep features.                                              end-to-end service visibility.
                                                                                  3 = Basic features.
                                                                                  1 = Minimal features.
                                                                                  0 = No features.
          Other features                  Are there additional ancillary features Measured by the depth and importance of any        30%     2.00 FIM's federated identity functions enable
                                          (that is, beyond service management additional product features:                                        federation for Web applications.
                                          and monitoring)?                        5 = Deep features.
                                                                                  3 = Basic features.
                                                                                  1 = Minimal features.
                                                                                  0 = No features.




© 2006, Forrester Research, Inc.                                                                                                                                                            119
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                            > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                              > Back to "Scores and weightings"

 Vendor Scorecard: IBM




                                                                                                                                           Forrester
                                                                                                                                                                           Show Criteria and Scale Explanations




                                                                                                                                           Weightin
  Control Level of Criteria Detail
                                                                                                                                                                           Hide Criteria and Scale Explanations




                                                                                                                                                       Score
  Less                     More

 Evaluation Criteria                         Criteria Explanation                   Scale Explanation                                                       Score Explanation




                                                                                                                                           g
     Other SOA infrastructure products       What other SOA infrastructure is       Forrester includes this criterion as information for        0%     0.00 IBM has the broadest line of SOA infrastructure
                                             available as part of the vendor's      clients, therefore this line item is weighted at 0%.                    products of any of the vendors in this Wave.
                                             overall product set?                   To place a value on vendors' other SOA products,
                                                                                    clients may add custom weightings, in which case
                                                                                    this score is a weighted average of its
                                                                                    subattributes: Attack protection, Registry-
                                                                                    repository, SOA life-cycle management,
                                                                                    Application development (design), Application
                                                                                    development (coding), Application integration,
                                                                                    Data integration, and Other SOA-related products.

          Attack protection                  What other products does the vendor    This line item is intended to be informational and          0%     5.00 IBM is in the process of buying DataPower
                                             have that provide direct SOA and       is therefore weighted at 0%. A score of five is                         Technology, whose XS40 XML Security Gateway
                                             Web services support for the attack    given if a vendor has any products to offer, so that                    product provides attack protection.
                                             protection side of security?           Forrester clients can assign a weighting if they
                                                                                    choose to.
          Registry and repository            What products does the vendor have This line item is intended to be informational and              0%     5.00 IBM Rational ClearCase is the development time
                                             for registry and repository functions? is therefore weighted at 0%. A score of five is                         repository. WebSphere Application Server
                                                                                    given if a vendor has any products to offer, so that                    includes a UDDI registry.
                                                                                    Forrester clients can assign a weighting if they
                                                                                    choose to.
          SOA life-cycle management          What products does the vendor have This line item is informational and is therefore                0%     5.00 IBM Rational Portfolio Manager (governance),
                                             for overall service life-cycle         weighted at 0%. A score of five is given if a                           IBM Rational ClearCase (version and
                                             management (that is, end-to-end        vendor has any products to offer, so that Forrester                     configuration management), IBM Rational
                                             development life-cycle                 clients can assign a weighting if they choose to.                       ClearQuest (change and development workflow
                                             management)?                                                                                                   management), and IBM Rational Method
                                                                                                                                                            Composer/Rational Unified Process (process
                                                                                                                                                            management).
          Application development (design)   What other products does the vendor    This line item is informational and is therefore            0%     5.00 IBM WebSphere Business Modeler, IBM Rational
                                             have for business modeling, process    weighted at 0%. A score of five is given if a                           Software Architect, and IBM WebSphere
                                             modeling, service modeling, and        vendor has any products to offer, so that Forrester                     Integration Developer.
                                             service design?                        clients can assign a weighting if they choose to.

          Application development (coding)   What products does the vendor have This line item is informational and is therefore                0%     5.00 IBM Rational Software Architect, IBM Rational
                                             for detailed service development and weighted at 0%. A score of five is given if a                             Application Developer, and IBM WebSphere
                                             administration?                      vendor has any products to offer, so that Forrester                       Integration Developer.
                                                                                  clients can assign a weighting if they choose to.




© 2006, Forrester Research, Inc.                                                                                                                                                                      120
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                     > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                       > Back to "Scores and weightings"

 Vendor Scorecard: IBM




                                                                                                                                    Forrester
                                                                                                                                                                    Show Criteria and Scale Explanations




                                                                                                                                    Weightin
  Control Level of Criteria Detail
                                                                                                                                                                    Hide Criteria and Scale Explanations




                                                                                                                                                Score
  Less                     More

 Evaluation Criteria                   Criteria Explanation                   Scale Explanation                                                      Score Explanation




                                                                                                                                    g
          Application integration      What products does the vendor have     This line item is informational and is therefore           0%     5.00 WebSphere Message Broker for advanced
                                       that provide full application          weighted at 0%. A score of five is given if a                          transformation and protocol support, WebSphere
                                       integration features and functions     vendor has any products to offer, so that Forrester                    Partner Gateway for business-to-business
                                       (beyond simple transformation that     clients can assign a weighting if they choose to.                      interactions, and WebSphere DataStage TX for
                                       the product may inherently support)?                                                                          embeddable transformation capability.

          Data integration             What products does the vendor have This line item is informational and is therefore               0%     5.00 WebSphere Data Integration Suite.
                                       for data-level integration?        weighted at 0%. A score of five is given if a
                                                                          vendor has any products to offer, so that Forrester
                                                                          clients can assign a weighting if they choose to.

          Other SOA-related products   What other products does the vendor    This line item is informational and is therefore           0%     5.00 WebSphere Adapters, WebSphere Application
                                       have that address other major          weighted at 0%. A score of five is given if a                          Server, WebSphere Everyplace Deployment,
                                       requirements for SOA and Web           vendor has any products to offer, so that Forrester                    WebSphere MQ, and Workplace Collaboration
                                       services?                              clients can assign a weighting if they choose to.                      Services.


 STRATEGY                                                                                                                               50%     3.50
    Product strategy                   What is the vendor's approach to the This score is a weighted average of its                     45%     5.00 IBM has a broad, deep, and comprehensive vision
                                       SOA management market in terms of subattributes: SOA and Web services                                         for SOA development, deployment, and
                                       near-term plans and long-term focus? management, Broader SOA infrastructure product                           management platform, including a broad range of
                                                                            directions, and Enterprise focus.                                        service implementation styles and infrastructures.
                                                                                                                                                     It will be investing broadly across a wide breadth
                                                                                                                                                     of SOA requirements and pushing deeper
                                                                                                                                                     integration within its own product lines. Its SOA
                                                                                                                                                     management initiatives will fit within IBM's broader
                                                                                                                                                     IT service management initiative, which is
                                                                                                                                                     centered on a configuration management
                                                                                                                                                     database that tracks relationships between
                                                                                                                                                     business processes and many types of IT assets
                                                                                                                                                     and infrastructure.




© 2006, Forrester Research, Inc.                                                                                                                                                               121
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                              > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                                > Back to "Scores and weightings"

 Vendor Scorecard: IBM




                                                                                                                                             Forrester
                                                                                                                                                                             Show Criteria and Scale Explanations




                                                                                                                                             Weightin
  Control Level of Criteria Detail
                                                                                                                                                                             Hide Criteria and Scale Explanations




                                                                                                                                                         Score
  Less                     More

 Evaluation Criteria                          Criteria Explanation                     Scale Explanation                                                      Score Explanation




                                                                                                                                             g
          SOA and Web services management     What future enhancements does the        Measured by Forrester's assessment of the                 80%     5.00 In 2006, ITCAM for SOA will build on WESB's
                                              vendor currently plan for the product    product plans and vision stated by the vendor:                         mediation framework to provide additional
                                              that would help it score better on       5 = Strong road map in many areas.                                     management mediations, including service
                                              SOA and Web services management          3 = Strong road map in some areas.                                     versioning and QoS-based routing. Additionally,
                                              criteria? (That is, all of the Current   1 = Weak road map.                                                     monitoring and management support will be
                                              offering criteria above except the       0 = Vendor hasn't disclosed.                                           provided for the recently acquired DataPower
                                              "Other SOA infrastructure products"                                                                             XML appliances. IBM is pursuing a broader
                                              criterion.)                                                                                                     framework for service development called service-
                                                                                                                                                              component architecture (SCA). ITCAM for SOA
                                                                                                                                                              will be enabled for monitoring SCA-based service
                                                                                                                                                              traffic in WESB and WPS. Tivoli is making major
                                                                                                                                                              investments in its IT service management (ITSM)
                                                                                                                                                              initiative, which will provide a strong foundation for
                                                                                                                                                              integration of all of IBM's management functions,
                                                                                                                                                              enable a stronger means of tying infrastructure
                                                                                                                                                              issues to their business-level impact, and foster
                                                                                                                                                              the implementation of ITIL and other best
                                                                                                                                                              practices for process-based IT infrastructure
                                                                                                                                                              management. This will also provide a stronger
                                                                                                                                                              foundation for integration of external management
                                                                                                                                                              products.

          Other SOA infrastructure products   What future product directions has       This line item is informational and is therefore           0%     5.00 IBM already has one of the broadest product sets
                                              the vendor disclosed that would move     weighted at 0%. So that Forrester clients can                          for SOA infrastructure. Additional directions for
                                              it toward broader and more complete      assign a weighting if they choose to, Forrester has                    this base of products include implementation of
                                              SOA infrastructure capabilities          measured the vendor's response based on the                            SCA (noted in the previous line item), integration
                                              beyond SOA and Web services              breadth of broader SOA categories that the                             with services registries, and deeper integration
                                              management? In other words, how          vendor intends to provide products for.                                with Rational tooling.
                                              will it build its cababilities in the
                                              "Other SOA infrastructure products"
                                              criterion above?




© 2006, Forrester Research, Inc.                                                                                                                                                                        122
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                                > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                                  > Back to "Scores and weightings"

 Vendor Scorecard: IBM




                                                                                                                                               Forrester
                                                                                                                                                                               Show Criteria and Scale Explanations




                                                                                                                                               Weightin
  Control Level of Criteria Detail
                                                                                                                                                                               Hide Criteria and Scale Explanations




                                                                                                                                                           Score
  Less                     More

 Evaluation Criteria                            Criteria Explanation                     Scale Explanation                                                      Score Explanation




                                                                                                                                               g
          Enterprise focus                      In the vendor's view, what is the full   Measured by Forrester's assessment of the                 20%     5.00 IBM's vision of the full scope for managing SOA
                                                scope of enterprise requirements for     vendor's stated understanding of the scope of                          includes integrated monitoring and management
                                                SOA management and SOA                   enterprise-class SOA management:                                       of services, transactions, application platforms,
                                                infrastructure?                          5 = Strong view of enterprise SOA management                           and other IT resources; Web services and XML
                                                                                         requirements.                                                          security management and identity federation; life-
                                                                                         3 = Average view of enterprise SOA                                     cycle management of SOA-based applications,
                                                                                         requirements.                                                          including tooling for design and development,
                                                                                         1 = Weak view of enterprise SOA requirements.                          support for SOA in the runtime and deployment,
                                                                                         0 = the vendor hasn't disclosed.                                       and management; and policy-based management
                                                                                                                                                                of services, service registries and enforcement of
                                                                                                                                                                service-level agreements. These are all tied
                                                                                                                                                                together through process integration using ITIL-
                                                                                                                                                                based best practices executed on standards-
                                                                                                                                                                based workflow engines. Included in this initiative
                                                                                                                                                                is a federated change and configuration
                                                                                                                                                                management database. This scope of definition is
                                                                                                                                                                represented by the IBM SOA Foundation and IBM
                                                                                                                                                                Tivoli Service Management initiatives.

      Financial resources to support strategy   Is the vendor profitable? Does the       Measured by Forrester's assessment of public              25%     5.00 IBM is a market-leading firm with stable financials
                                                company have sufficient funding,         data (which receives greater weight) and vendor                        and $14 billion in cash and cash equivalents.
                                                revenues, profits, and cash flow to      claims as to the resources available for product
                                                support its strategies?                  development and the overall stability of the
                                                                                         vendor:
                                                                                         5 = Clearly sufficient resources and stability from
                                                                                         public data.
                                                                                         3 = Reasonable resources and likely stability from
                                                                                         private data.
                                                                                         1 = Questionable resources and stability (or lack
                                                                                         of data).
      Cost                                      What is the cost of the product?         The score is a weighted average of the scores for         30%     0.00 IBM did not disclose its pricing, but Forrester
                                                                                         these subattributes: Medium deployment license                         believes that buying all elements of its solution at
                                                                                         cost, Minimum license cost, Maintenance cost,                          one time would be very expensive.
                                                                                         and Pricing structure.
             Medium deployment license cost     What would be the total license cost     This score is based on the license cost for this          60%     0.00 IBM did not disclose pricing for its SOA
                                                for a deployment to manage 100           configuration as reported by the vendor:                               management solution, but Forrester believes that
                                                separate WSDL interfaces spread          5 = Up to $99,999.                                                     licensing all of the various products in the solution
                                                across 20 servers (four CPUs each)       4 = $100,000 to $199,999.                                              would cost in excess of $1 million.
                                                with two management consoles?            3 = $200,000 to $399,999.
                                                                                         2 = $400,000 to $699,999.
                                                                                         1 = $700,000 or more.
                                                                                         0 = The vendor hasn't disclosed.

© 2006, Forrester Research, Inc.                                                                                                                                                                          123
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                      > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                        > Back to "Scores and weightings"

 Vendor Scorecard: IBM




                                                                                                                                     Forrester
                                                                                                                                                                     Show Criteria and Scale Explanations




                                                                                                                                     Weightin
  Control Level of Criteria Detail
                                                                                                                                                                     Hide Criteria and Scale Explanations




                                                                                                                                                 Score
  Less                     More

 Evaluation Criteria                 Criteria Explanation                Scale Explanation                                                            Score Explanation




                                                                                                                                     g
          Minimum license cost       What would be the total license costThis score is based on the license cost for this                40%     0.00 IBM did not disclose pricing for its SOA
                                     for a deployment to manage one      configuration as reported by the vendor:                                     management solution, but Forrester believes that
                                     WSDL interface on one server (two   5 = Up to $49,999.                                                           licensing all of the various products in the solution
                                     CPUs) with one management           4 = $50,000 to $99,999.                                                      would cost in excess of $500,000.
                                     console?                            3 = $100,000 to $149,999.
                                                                         2 = $150,000 to $199,999.
                                                                         1 = $200,000 or more.
                                                                         0 = The vendor hasn't disclosed
          Maintenance cost           What is the annual maintenance cost Forrester provides this information to aid our                   0%     0.00 IBM did not disclose the annual maintenance cost
                                     structure for this product?         clients' decisions; we give a default score of 0 to                          structure.
                                                                         the vendor for this attribute.


          Pricing structure          What are the details of the product's     Forrester provides this information to aid our             0%     0.00 IBM did not disclose these details.
                                     pricing structure?                        clients' decisions; we give a default score of 0 to
                                                                               the vendor for this attribute.

 MARKET PRESENCE                                                                                                                          0%     3.16
    Installed base                   How large is the vendor's installed    This score is a weighted average of its                      30%     0.60 IBM did not disclose how many customers it has
                                     base of customers for this product     subattributes: This product, All SOA products,                            for its SOA management solution, but it has
                                     and for all products?                  New customers, Users on maintenance, and                                  thousands of customers for its products.
                                                                            Reference accounts.
          This product               What is the installed base of          This factor is scored on the number of customer              40%     0.00 IBM did not disclose this number.
                                     customers (separate stock tickers) for installations the vendor reports having:
                                     this product?                          5 = 300 or more.
                                                                            4 = 100 to 299.
                                                                            3 = 60 to 99.
                                                                            2 = 30 to 59.
                                                                            1 = Five to 29.
                                                                            0 = Fewer than five or the vendor hasn't
                                                                            disclosed.

          All SOA products           What is the installed base of             This factor is scored on the number of customer           15%     4.00 IBM did not provide a response, but it is known to
                                     customers (separate stock tickers) for    installations the vendor reports having:                               have thousands of customers for its WebSphere
                                     all of the vendor's SOA products          5 = 2,000 or more.                                                     and Tivoli products.
                                     (including this product and those         4 = 1,000 to 1,999.
                                     listed in the "Other SOA infrastructure   3 = 500 to 999.
                                     products" criterion above)?               2 = 100 to 499.
                                                                               1 = 10 to 99.
                                                                               0 = Fewer than 10 or the vendor hasn't disclosed.




© 2006, Forrester Research, Inc.                                                                                                                                                                124
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                   > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                     > Back to "Scores and weightings"

 Vendor Scorecard: IBM




                                                                                                                                  Forrester
                                                                                                                                                                  Show Criteria and Scale Explanations




                                                                                                                                  Weightin
  Control Level of Criteria Detail
                                                                                                                                                                  Hide Criteria and Scale Explanations




                                                                                                                                              Score
  Less                     More

 Evaluation Criteria                 Criteria Explanation                   Scale Explanation                                                      Score Explanation




                                                                                                                                  g
          New customers              How many customers bought or           This factor is scored on the number of customer           30%     0.00 IBM did not disclose this number.
                                     upgraded the product during the past   installations the vendor reports having:
                                     year?                                  5 = 40 or more.
                                                                            4 = 30 to 39.
                                                                            3 = 20 to 29.
                                                                            2 = 10 to 19.
                                                                            1 = Three to nine.
                                                                            0 = Fewer than three or the vendor hasn't
                                                                            disclosed.

          Users on maintenance       What percentage of customers of all This factor is scored on the percentage of                   15%     0.00 IBM did not disclose this percentage.
                                     versions of this product are on active customers for all versions of this product that the
                                     maintenance agreements?                vendor reports are on maintenance agreement:
                                                                            5 = 97% or more.
                                                                            4 = 90% to 96%.
                                                                            3 = 80% to 89%.
                                                                            2 = 70% to 79%.
                                                                            1 = 60% to 69%.
                                                                            0 = Less than 60% or the vendor hasn't disclosed.


          Reference accounts         What companies are the major          Forrester provides this information to aid our              0%     0.00 Vendor did not provide key reference names.
                                     reference customers for this product? clients' decisions; we don't score or weight this
                                                                           attribute.
      Revenue                        What is the vendor's revenue over     This score is based on overall revenue as                  25%     5.00 IBM's revenue was $94 billion from Q4 2004 to
                                     the period from Q4 2004 through Q3 reported by the vendor:                                                    Q3 2005.
                                     2005?                                 5 = More than $1 billion.
                                                                           4 = $500 million to $1 billion.
                                                                           3 = $50 million to $499 million.
                                                                           2 = $10 million to $49 million.
                                                                           1 = Less than $10 million.
                                                                           0 = The vendor hasn't disclosed.
      Revenue growth                 What is the vendor's year-over-year Forrester provides this information to aid our                0%     0.00 IBM year-over-year growth was 4% from Q3 2004
                                     revenue growth over the period from clients' decisions; we don't score or weight this                         to Q3 2005.
                                     Q3 2004 through Q3 2005?              attribute.




© 2006, Forrester Research, Inc.                                                                                                                                                             125
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                               > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                 > Back to "Scores and weightings"

 Vendor Scorecard: IBM




                                                                                                                              Forrester
                                                                                                                                                              Show Criteria and Scale Explanations




                                                                                                                              Weightin
  Control Level of Criteria Detail
                                                                                                                                                              Hide Criteria and Scale Explanations




                                                                                                                                          Score
  Less                     More

 Evaluation Criteria                 Criteria Explanation                 Scale Explanation                                                    Score Explanation




                                                                                                                              g
     Systems integrators             What systems integrator partners     This factor is scored on the number of systems          15%     5.00 IBM did not list ISVs with specific implementation
                                     have completed three or more         integrator partners the vendor reports have                          of the key elements of its SOA management
                                     deployments of any version of this   completed three or more deployments of this                          solution. However, IBM claims relationships with
                                     product in the past 18 months?       product in the past 18 months:                                       4,500 systems integrators.
                                                                          5 = Five or more.
                                                                          4 = Four.
                                                                          3 = Three.
                                                                          2 = Two.
                                                                          1 = One.
                                                                          0 = Zero or the vendor hasn't disclosed.
      Services                       How strong are the vendor's          This score is a weighted average of its                 10%     3.50 IBM did not disclose the size of its in-house
                                     implementation and training          subattributes: Implementation engineers and                          professional services team for its SOA
                                     services?                            Training.                                                            management solution, but it has a large
                                                                                                                                               professional services team and a full range of
                                                                                                                                               training options.
          Implementation engineers   How many employees provide           This factor is scored on the number of employees        50%     4.00 IBM did not list the number of engineers with
                                     implementation services for this     the vendor reports having dedicated to                               specific implementation of the key elements of its
                                     product?                             implementation services for this product:                            SOA management solution. However, IBM has
                                                                          5 = 100 or more.                                                     75,000 consulting staff.
                                                                          4 = 70 to 99.
                                                                          3 = 40 to 69.
                                                                          2 = 20 to 49.
                                                                          1 = 10 to 19.
                                                                          0 = Fewer than 10 or the vendor hasn't disclosed.

          Training                   Does the vendor offer classroom,     Measured by how many training channels the              50%     3.00 IBM provides training for all of its SOA-related
                                     Web-based, and on-site training?     vendor offers:                                                       products, noting that the particular training
                                                                          5 = All three channels.                                              channels that are available vary by product and
                                                                          3 = Two channels.                                                    customer requirements.
                                                                          1 = One channel.
                                                                          0 = No training offered.
      Employees                      How many engineers does the          This score is a weighted average of its                 10%     3.75 IBM is a very large firm with a global presence. It
                                     vendor have dedicated to this        subattributes: Total employees, Dedicated                            did not disclose the size of its engineering staff.
                                     product? How big is the vendor's     engineers, and Sales staff.
                                     sales presence?




© 2006, Forrester Research, Inc.                                                                                                                                                         126
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                  > Back to "Scores and weightings"

 Vendor Scorecard: IBM




                                                                                                                               Forrester
                                                                                                                                                               Show Criteria and Scale Explanations




                                                                                                                               Weightin
  Control Level of Criteria Detail
                                                                                                                                                               Hide Criteria and Scale Explanations




                                                                                                                                           Score
  Less                     More

 Evaluation Criteria                 Criteria Explanation                  Scale Explanation                                                    Score Explanation




                                                                                                                               g
          Total employees            How many employees does the           This factor is scored on the total number of            50%     5.00 329,000 employees.
                                     vendor have?                          employees the vendor reports having:
                                                                           5 = 10,000 or more.
                                                                           4 = 300 to 9,999.
                                                                           3 = 80 to 299.
                                                                           2 = 40 to 79.
                                                                           1 = 25 to 39.
                                                                           0 = Fewer than 25 or the vendor hasn't disclosed.

          Dedicated engineers        How many engineers are dedicated    This factor is scored on the total number of              25%     0.00 The vendor did not disclose this number.
                                     to research and development of this engineers the vendor reports having dedicated to
                                     product line?                       this product line:
                                                                         5 = 300 or more.
                                                                         4 = 100 to 299.
                                                                         3 = 30 to 99.
                                                                         2 = 15 to 29.
                                                                         1 = 5 to 14.
                                                                         0 = Fewer than five or vendor hasn't disclosed.
          Sales staff                How large and how global is the     Measured by size and global footprint of sales            25%     5.00 IBM has a sales and support presence in more
                                     vendor's sales force? What          organization:                                                          than 165 countries.
                                     percentage of the sales force       5 = 100-plus, with global presence.
                                     supports Europe, Asia Pacific, and  3 = 25 to 99, no global presence.
                                     Rest of World?                      1 = Less than 25, no global presence.
      Technology partners            How strongly do technology partners This score is a weighted average of its                   10%     2.50 IBM did not list specific technology partners for its
                                     support this product?               subattributes: License partners, Resellers, and                        SOA management solution, but it generally
                                                                         Other partners.                                                        develops strong partnerships (both resellers and
                                                                                                                                                product-level integration).
          License partners           What vendors license or bundle this   This score is the weighted average of the number        50%     0.00 IBM did not list vendors that license or bundle the
                                     product?                              of vendors that the vendor reports license or                        key elements of its SOA management solution.
                                                                           bundle this product:
                                                                           5 = 10 or more.
                                                                           4 = Seven to nine.
                                                                           3 = Five or six.
                                                                           2 = Three or four.
                                                                           1 = One or two.
                                                                           0 = Zero or the vendor hasn't disclosed.




© 2006, Forrester Research, Inc.                                                                                                                                                          127
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                                        > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                                          > Back to "Scores and weightings"

 Vendor Scorecard: IBM




                                                                                                                                                       Forrester
                                                                                                                                                                                       Show Criteria and Scale Explanations




                                                                                                                                                       Weightin
  Control Level of Criteria Detail
                                                                                                                                                                                       Hide Criteria and Scale Explanations




                                                                                                                                                                   Score
  Less                     More

 Evaluation Criteria                                    Criteria Explanation                    Scale Explanation                                                       Score Explanation




                                                                                                                                                       g
          Resellers                                     What firms resell this product?         This score is the weighted average of the number           50%     5.00 IBM has more than 500 business partners in the
                                                                                                of resellers that the vendor reports offer this                         IBM SOA Business Partner Community.
                                                                                                product:
                                                                                                5 = 20 or more.
                                                                                                4 = 15 to 19.
                                                                                                3 = 10 to 14.
                                                                                                2 = Five to nine.
                                                                                                1 = One to four.
                                                                                                0 = Zero or vendor hasn't disclosed.
          Other partners                                What other vendors have modified        Forrester provides this information to aid our              0%     0.00 IBM did not list vendors that have modified their
                                                        their products to better integrate with clients' decisions; we score this attribute 0 in all                    products to better integrate with the key elements
                                                        this product (as opposed to having      cases.                                                                  of its SOA management solution.
                                                        only standards-based interop)?


 © 2006, Forrester Research, Inc. All rights reserved. Forrester, Forrester Wave, WholeView 2, Technographics, and Total Economic Impact
 are trademarks of Forrester Research, Inc. All other trademarks are the property of their respective companies. Forrester clients may make
 one attributed copy or slide of each figure contained herein. Additional reproduction is strictly prohibited. For additional reproduction rights
 and usage information, go to www.forrester.com. Information is based on best available resources. Opinions reflect judgment at the time




© 2006, Forrester Research, Inc.                                                                                                                                                                                  128
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                     > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                       > Back to "Scores and weightings"

 Vendor Scorecard: Infravio




                                                                                                                                    Forrester
                                                                                                                                                                    Show Criteria and Scale Explanations




                                                                                                                                    Weightin
  Control Level of Criteria Detail
                                                                                                                                                                    Hide Criteria and Scale Explanations




                                                                                                                                                Score
  Less                     More

 Evaluation Criteria                 Criteria Explanation                     Scale Explanation                                                      Score Explanation




                                                                                                                                    g
 CURRENT OFFERING                                                                                                                       50%     2.44
     Products included               What is the precise product or set of    This item is for information only and is not scored        0%     0.00 Infravio offers X-Registry Platform 5.
                                     products that the vendor offers as its   or weighted.
                                     service-oriented architecture (SOA)
                                     and Web services management
                                     solution?
      IT-level management            How does the product manage              This score is a weighted average of its                   20%     2.90 Infravio directly supports only SOAP/HTTP (but
                                     service performance and availability?    subattributes: Endpoint support, Performance                           indirectly supports other protocols). It can tie
                                                                              management, Availability management, and                               service-level goals to particular users to create
                                                                              Service-level management.                                              SLAs. It does not directly provide visibility into
                                                                                                                                                     service implementations.
          Endpoint support           What access protocols (SOAP,             Measured by the breadth of support for various            20%     3.00 SOAP/HTTP is supported directly. Via wrapper
                                     XML/HTTP, Java Message Service           protocols, payload types, and native agents for                        plug-ins and transport plug-ins, the product can
                                     (JMS), Java RMI, WebSphere MQ,           specific products:                                                     be extended to support XML/HTTP, JMS, and
                                     .NET Remoting, others) and service       5 = Broad support.                                                     RMI (RMI for EJB only). Infravio's product
                                     implementation technologies (Java        3 = Average support.                                                   provides no native agents. Its JAX-RPC agents
                                     EE, .NET, databases, others) does        1 = Minimal support.                                                   can indirectly support whatever protocols the
                                     the product fully monitor? What          0 = No support.                                                        container supports.
                                     specific products does the product
                                     support?
          Performance management     How does the product gather, report,   Measured by the breadth and depth of                        30%     2.00 Brokers and agents store performance data
                                     and analyze service performance        functionality for gathering, analyzing, and                              locally and then forward it on to a central
                                     data, including 1) reporting against   correlating data about service invocations and                           database. The product provides no visibility to
                                     performance goals and 2) correlation   service implementations:                                                 performance within service implementations,
                                     of performance data across             5 = Deep functionality.                                                  although integration with enterprise management
                                     technology layers within service       3 = Average functionality.                                               tools can provide some such visibility.
                                     implementations?                       1 = Minimal functionality.
                                                                            0 = No functionality.
          Availability management    How does the product gather, report, Measured by the breadth and depth of                          30%     3.00 Brokers and agents store availability data locally
                                     and analyze service availability data, functionality for identifying, analyzing, and                            and then forward it on to a central database. It
                                     including root cause analysis of       correlating availability issues for services and                         can send heartbeats to services to proactively
                                     availability issues across technology service implementations:                                                  check for service availability. The product
                                     layers within service                  5 = Deep functionality.                                                  provides no visibility to availability issues within
                                     implementations?                       3 = Average functionality.                                               service implementations, although integration with
                                                                            1 = Minimal functionality.                                               enterprise management tools can provide some
                                                                            0 = No functionality.                                                    such visibility.




© 2006, Forrester Research, Inc.                                                                                                                                                               129
 Forrester SOA And Web Services Management Wave, Q1 2006
  0                                                                                                                                                                   > View Forrester Wave graphic and custom scores
 by Randy Heffner                                                                                                                                                     > Back to "Scores and weightings"

 Vendor Scorecard: Infravio




                                                                                                                                                  Forrester
                                                                                                                                                                                  Show Criteria and Scale Explanations




                                                                                                                                                  Weightin
  Control Level of Criteria Detail
                                                                                                                                                                                  Hide Criteria and Scale Explanations




                                                                                                                                                              Score
  Less                     More

 Evaluation Criteria                            Criteria Explanation                       Scale Explanation                                                       Score Explanation




                                                                                                                                                  g
          Service-level management              How does the product 1) specify            Measured by the breadth and depth of                       20%     4.00 Service-level goals are entered manually through
                                                service-level goals, 2) tie service-       functionality for specifying service-level goals and                    the X-Registry Platform's user interface and may
                                                level goals to specific users or groups    SLAs and monitoring and managing operations to                          be specified for individual service operations or for
                                                to create service-level agreements         maintain service-level goals:                                           the service as a whole. Goals may be tied to
                                                (SLAs), 3) monitor and report service-     5 = Deep functionality.                                                 specific service consumers to create SLAs. The
                                                level compliance over time, and 4)         3 = Average functionality.                                              product's console can display real-time or
                                                automatically adjust service               1 = Minimal functionality.                                              historical performance against SLA goals. There
                                                operations to better achieve SLAs?         0 = No functionality.                                                   are no built-in features for automatically adjusting
                                                                                                                                                                   service operations, but alerts can initiate defined
                                                                                                                                                                   actions via scripts.

      Business-level management                 How does the product provide               This score is a weighted average of its                     5%     1.65 Infravio can extract business data from messages
                                                business insight by extracting and         subattributes: Business activity montioring,                            (via XPath) and perform basic reporting on
                                                reporting data from service request-       Usability by business users, and Integration for                        business activity. Business data is available by
                                                response flows?                            business monitoring.                                                    having Infravio push the data to other products via
                                                                                                                                                                   SOAP.
          Business activity monitoring (BAM)    How do the product's built-in features     Measured by the breadth and depth of                       30%     2.00 Using XPath queries, X-Registry Platform can pull
                                                provide business insight from service      functionality for capturing business data from                          business data from XML payloads. The product
                                                operation by extracting, analyzing,        service requests and tying that data to business                        can then report on the data using its built-in SLA
                                                and reporting on business data             processes:                                                              reporting capabilities.
                                                contained