Instructions

Document Sample
Instructions Powered By Docstoc
					Nodal Program Update




Technical Advisory Committee
     2 September 2010
Agenda


  • Program Status

  • LFC Test Overview


  • Certification Updates


  • Cut-Over Certification – Primer for Remaining Systems




         2 September 2010         2               Technical Advisory Committee
Integrated Nodal Timeline – Go-Live December 1, 2010




       2 September 2010        3             Technical Advisory Committee
2010 Market Trials Timeline – Go-Live December 1, 2010




       2 September 2010        4             Technical Advisory Committee
2010 Cut Over Timeline – 4 month outlook




       2 September 2010        5           Technical Advisory Committee
                     89 Days to Go-Live
                  Market Trials has been running for 31 weeks
Upcoming Milestones for Market Trials:
•   LFC Tests
     •   168 hour Test will include 48 hrs of closed loop testing between Sept 12 th – Sept 14th
     •   Special NATF on September 17th to discuss exit criteria successes and issues
     •   Additional 36 Hr LFC Test dates is scheduled for late September
     •   Additional 24Hr LFC Test dates is scheduled for mid-October


•   168 Hour Test: DAM/RUC/ SASM
     •   DAM will run continuously for 7 consecutive days starting on 9/8/2010 through 9/15/2010
          •   HRUC ran 24x7 all 7 days
          •   DRUC run after each DAM all 7 days
          •   WRUC ran twice to exercise internal ERCOT processes
     •   ERCOT‟s focus for DAM and RUC going forward will be on the quality of solution

•   An October CRR Monthly auction will begin in mid-September

•   REP Training/Panel discussion hosted at the MET center in Austin on October 6, 2010

•   System Cut-Over / Go-Live
     •   Sept/Oct 2010 – Network Modeling, Outage Scheduling
     •   October 19, 2010 – Board of Directors Sign Off
     •   November 2010 – Go-Live CRR Auction
     •   November 30th DAM
     •   December 1st – First Operating Day




         2 September 2010                                   6                              Technical Advisory Committee
168-Hour Test Breakdown of Activities: Objective / Participation
Requirements

   •   Objective
        •    Conduct a full rehearsal of the Nodal Day-Ahead Market (DAM), Reliability Unit
             Commitment (RUC), Real Time Market and Load Frequency Control (LFC)

        •    Continuous seven day period of Market Systems and 48 hours of Closed Loop
             LFC

        •    Components required and to be exercised during the 168-Hour test:
              – The Day Ahead functions including DAM, DRUC, HRUC and WRUC
              – The Real Time systems performing SCADA, Network Security Analysis,
                Transmission Constraint Management, SCED, and LFC
              – The Nodal support systems including Network Model Management, Outage
                Scheduler, Outage Evaluation tools
              – Credit Monitoring and Management (CMM)
              – Settlements and Billing
              – Posting of applicable Reports and Extracts




            2 September 2010                    7                  Technical Advisory Committee
168-Hour Test Breakdown of Activities: Objective / Participation
Requirements


   • Participation Requirements:

      – The value of the 168-Hour Test is dependent on participation by the Market.

      – The 168-Hour Test is required by all registered Market Participants intending to be
        involved in the Nodal Market

      – Participation data and metrics will be published and made readily available to the
        ERCOT Board, Independent Market Monitor and the related Market Participant
        Forums (NATF, TAC)

      – Metrics will also include comparisons of Zonal Resource Plans to Nodal COPs.

      – Participation should be reasonably reflective of post Go-Live behavior



      Market Readiness Seminar #6: http://nodal.ercot.com/readiness/golive/index.html




        2 September 2010                           8                       Technical Advisory Committee
168-Hour Test Breakdown of Activities: Entry / Exit Criteria

   • Entry Criteria for the 168-Hour test will be as follows:

       – All defined Market Trials Testing up until the 168-Hr test has been completed in
         accordance with the Market Trials Handbooks published to the Nodal Readiness
         Center

       – ERCOT declares readiness for initiating the 168-Hour test to TAC and the Board and
         obtains director level sign off from ERCOT management.


   • Exit Criteria:

       – 168 hours of continuous Nodal systems testing have been completed without
         encountering any major system issues that would prevent the Nodal Market from
         going live while maintaining system security and reliability as required by the ERCOT
         Protocols, Operating Guides, other binding documents, and NERC Reliability
         Standards.

       – ERCOT provides a test summary report to TAC and the Board outlining the
         successful testing processes.


         2 September 2010                      9                     Technical Advisory Committee
Full System Market and Reliability Test


   •   The following tests have been completed:


            – 2-Hour Test – Completed May 20, 2010

            – 8-Hour Test – Completed June 17, 2010

            – 5-Hour Test – Completed July 21, 2010

            – 24-Hour Test #1 – Completed August 5, 2010

            – 24-Hour Test #2 – Completed August 20, 2010

            – 40-Hour Test – Completed August 28, 2010




          2 September 2010                  10              Technical Advisory Committee
August 26th 40 Hr LFC Test Overview


           Kenneth Ragsdale
             Market Trials
40-Hour Test Update

 40 - Hour Full-System Market and Reliability Test

 •   Very few issues encountered during the test

 •   Non-Spin deployed from 16:30 – 18:00 on 8/26/2010
      – This being the first non-spin, ERCOT has requested all deployed QSEs confirm their
        deployment receipt


 •   Low prices in Zonal
      –   02:30 AM – 04:15 AM
      –   Incorrect offset used in Zonal
      –   Prices as low as -999.99 for 3 intervals (3:30, 3:45, 4:00)
      –   Prices will be adjusted prior to settlements per Zonal price correction procedures




           2 September 2010                      12                     Technical Advisory Committee
Approximate 40-Hour Test Timeline – Aug 26

  Date        Time                                        Event
             (CDT)
  8/26        7:30          • Pre-test meeting for Nodal Support Staff
              8:00          • Hotline call by ERCOT Operators to announce the 12:00 test
                              start time
                            • Kick-off of the Market WebEx
                            • Market Notice to be sent out with the test start time
                            • Operators to start using OC3s to manage congestion
                            • Start troubleshooting period with QSEs

             10:00             • Hotline call to QSEs/TOs to announce the start of the test

                            • ERCOT Operators begin switching QSEs to Nodal control
             10:02          • First participating QSE completed switching to Nodal control
             10:38          • Final participating QSE switched to Nodal control
                            • Hotline call to announce that all participating QSEs are on Nodal
                              control

         18:00-18:30        • ERCOT nodal staff transition to night staff


         2 September 2010                        13                      Technical Advisory Committee
Approximate 40-Hour Test Timeline – Aug 27 – 28

  Date            Time                                     Event
                 (CDT)
  Aug 27      06:00-06:30     • ERCOT nodal staff transition back to day shift

              18:00-18:30     • ERCOT nodal staff transition back to night shift

  Aug 28                      • Hotline call to announce that ERCOT will begin switching
                                QSEs back to Zonal control
                              • ERCOT Operators begin switching QSEs back to Zonal
                                control

                 01:14        • First participating QSE switched back to Zonal control
                 01:46        • Final participating QSE switched back to Zonal control
                 02:00        • All QSEs on Zonal control
                              • Hotline call to QSEs/TOs to announce that the test has
                                concluded




           2 September 2010                     14                     Technical Advisory Committee
40-Hour Test Completion Criteria – Initial Assessment
 Overview – Completion Criteria
 • ERCOT will communicate an initial assessment of the following completion criteria upon
    conclusion of the test :
    – The rolling CPS1 one minute average score must equal or exceed 100% during the test
       period
        • Note that the CPS1 average will not take into account the periods where ERCOT is transitioning
          to Nodal and then back to Zonal
        • Note that the CPS1 average will not take into account the periods where ERCOT is performing
          system tuning
          – Hourly CPS1 Scores:
                » Max: 180, Min: 84, Average: 146
          – There was only one hour in which the CPS1 score was less than 100 (HE 0100 on
              Aug 28th)
    – Zonal Commercially Significant Constraints (CSCs) and Closely Related Elements (CREs)
      managed below thermal limits.
           –   West-North stability constraint was active in nodal during final 1 ½ hours of testing
               and was active in zonal during the transition period from nodal to zonal control
    – Local Congestion managed below thermal limits
           –   Yes
    – Stability limits managed below transfer limits
    – No NERC Disturbance Control Standard (DCS) failure if applicable.
           –   No DCS failures during the test
    – No LFC-SCED system issues that result in termination of the test.
           –   No LFC / SCED failures
    – Procedural and software fixes have been verified to address lessons learned from previous
      rounds of testing


          2 September 2010                         15                        Technical Advisory Committee
Full System Market and Reliability Test Update: CP1 Score
Update
                                           Highest Hourly CPS1 Score:              180
                                           Average Hourly CPS1 Score:              146
                                           Lowest Hourly CPS1 Score:                84

        Hour Ending      Hourly CPS1 Score   Comments                    Hour Ending      Hourly CPS1 Score   Comments
       8/26/2010 11:00          137        Transition Hour              8/27/2010 7:00           146
       8/26/2010 12:00          117                                     8/27/2010 8:00           128
       8/26/2010 13:00          148                                     8/27/2010 9:00           179
       8/26/2010 14:00          165                                     8/27/2010 10:00          144
       8/26/2010 15:00          174                                     8/27/2010 11:00          141
       8/26/2010 16:00          180                                     8/27/2010 12:00          141
       8/26/2010 17:00          178                                     8/27/2010 13:00          154
       8/26/2010 18:00          120                                     8/27/2010 14:00          154
       8/26/2010 19:00          160                                     8/27/2010 15:00          158
       8/26/2010 20:00          167                                     8/27/2010 16:00          167
       8/26/2010 21:00          140                                     8/27/2010 17:00          140
       8/26/2010 22:00          146                                     8/27/2010 18:00          162
       8/26/2010 23:00          103                                     8/27/2010 19:00          169
       8/27/2010 0:00           101                                     8/27/2010 20:00          156
       8/27/2010 1:00           119                                     8/27/2010 21:00          144
       8/27/2010 2:00           157                                     8/27/2010 22:00          119
       8/27/2010 3:00           150                                     8/27/2010 23:00          126
       8/27/2010 4:00           167                                     8/28/2010 0:00           144
       8/27/2010 5:00           144                                     8/28/2010 1:00            84
       8/27/2010 6:00           150                                     8/28/2010 2:00           119        Transition Hour

 •   08/28/2010 CPS1 scores dropped to 84 due to Generators not following the
     process for shutting down

             2 September 2010                                     16                                 Technical Advisory Committee
Nodal Go-Live Update
  Certified Systems


   Kenneth Ragsdale
     Market Trials
NMMS Overview
                                  Recommendation of Certification
                                    ERCOT

                                    NATF

                                    TAC

                                    BOD


Status / Other Issues:
• Stability issue resolved as of July 1 (ERCOT continues to monitor production)
• Navigation performance issues improved Aug 1st (43% reduction in response time measured)
• Validation performance improvement patch was added on Friday, August 27 th (expected a 20-40%
reduction in validation time). Improvement on validation times were tested as follows:
     •    Average:       45.18%
     •    Median:        66.41%
     •    Max:           97.46%




Open Defects:                                               Deferred Defects:
         Sev 1       0                                         Deferred         11
         Sev 2       0
         Sev 3-5     0

              2 September 2010                      18                    Technical Advisory Committee
OS Overview
                                 Recommendation of Certification
                                     ERCOT

                                     NATF

                                     TAC

                                     BOD


Status / Other Issues:
• No defects reported in the Outage Scheduler
     –   Outage Scheduler transition tasks were completed on 8/13 and the system was ready for dual entry and validation
         on 8/16
     –   Market Notice for dual entry and validation was sent on August 16 th
• All Outage scheduler issues within the TSP Issues list have either been addressed or are
  resolved



Open Defects:                                                            Deferred Defects:
      Sev 1       0                                                          Deferred                              119
      Sev 2       0
      Sev 3-5     0

            2 September 2010                                 19                           Technical Advisory Committee
CRR Overview
                                 Recommendation of Certification
                                     ERCOT

                                     NATF

                                     TAC

                                     BOD


Status / Other Issues:
• Working with Siemens on automated processor fix. Expectation is to receive fix before Go-Live
     –   Incorrect Loadzone Designation from Topology Processor Output file
     –   Resource Nodes missing from Settlement Point output file produced by Topology Processor
     –   Topology Processor cannot consume outages information for CRR modeling
     –   CRR MUI requires a system reboot for Bid Limit to take effect (internal to ERCOT) workaround is nuisance -
         targeting 09/13/2010 resolution




Open Defects:                                                            Deferred Defects:
      Sev 1       0                                                          Deferred           4
      Sev 2       0
      Sev 3-5         4

            2 September 2010                                 20                           Technical Advisory Committee
          Nodal Go-Live Update
Review of Full Nodal Operations Go-Live Items


              Kenneth Ragsdale
                Market Trials
Nodal Program Communications
  Readiness Signoff Schedule

                              06/30   ERCOT Management Readiness Signoff
                              07/01   TAC Approval
  Network Operations
                              07/20   Board of Directors Approval
  Modeling
                              07/30   30 Day Market Notice sent
                              09/01   Nodal Protocol Section 3.10 goes into effect

                              08/04   ERCOT Management Readiness Signoff
                              08/05   TAC Approval
  Congestion Revenue
                              08/17   Board of Directors Approval
  Rights
                              09/13   30 Day Market Notice sent
                              10/13   Nodal Protocol Section 7 goes into effect

                              08/04   ERCOT Management Readiness Signoff
                              08/05   TAC Approval
  Outage Scheduling           08/17   Board of Directors Approval
                              10/01   30 Day Market Notice sent
                              11/01   Nodal Protocol Section 7 goes into effect

                              10/01   ERCOT Management Readiness Signoff
                              10/07   TAC Approval
                              10/19   Board of Directors Approval
  Full Nodal Operations
                              10/23   30 Day Market Notice sent
                              11/23   Nodal Protocol Sections 3,4,5,6 go into effect as well as all other
                                      unimplemented Protocol Sections


           2 September 2010                           22                              Technical Advisory Committee
Nodal Cutover Communications – Zonal Protocol 21.12.3


   21.12.3 Notice to Market Participants of Effective Date for Nodal Protocol
      Provisions and Retirement of Zonal Protocol Provision
      No part of the nodal market design may start operation until all the Market Readiness Criteria
      for that part of the nodal market design have been met. Certification that all Market
      Readiness Criteria have been met must be made at least by each of the following: the
      Technical Advisory Committee (TAC), ERCOT and the ERCOT Board. Upon such
      certification, ERCOT shall issue two Notices alerting Market Participants to the effective date
      of Nodal Protocol sections and the retirement of Zonal Protocol sections, as applicable.
      ERCOT shall issue the first Notice no less than thirty (30) days prior to the effective date or
      retirement date, as applicable, and the second Notice no less than ten (10) days prior to the
      effective date or retirement date, as applicable. The Notice shall include:
        (1) The Nodal Protocol Sections to become effective; and
        (2) The Zonal Protocol Sections to be retired, if any




          2 September 2010                         23                        Technical Advisory Committee
Readiness Methodology


  ERCOT will measure readiness by the following categories:
     • System Readiness – an evaluation of a particular system
       needed to support identified market activities
     • Process Readiness – an evaluation of the Processes and
       Procedures necessary to support identified market activities
     • People Readiness – an evaluation of ERCOT and Market
       Participant capabilities to support identified market activities

  ERCOT plans to review the Market Readiness Criteria at NATF and
    subsequently request a vote from TAC per Section 21.12.3,
    Notice to Market Participants of Effective Date for Nodal
    Protocol Provisions and Retirement of Zonal Protocol Provision




        2 September 2010               24                 Technical Advisory Committee
Readiness Methodology


  System Readiness – evaluation of the Nodal system to support the
    market design
     – Core system functionality delivered
         • Protocol required system functionality available for market testing
     – System Integration delivered
         • System to system integration delivered to support Market Timeline
           and Business Processes
     – Known defects resolution plan
         • All „Must fix prior to go-live‟ defects have a resolution plan in place
     – Active Readiness Metrics
         • Current status of Readiness Metrics




       2 September 2010                   25                   Technical Advisory Committee
Readiness Methodology


  Process Readiness – evaluation of the Processes and Procedures
    necessary to support the market design
     – Procedures complete
         • ERT project procedures to support business processes complete
     – System cutover transition plan established
         • ERCOT and Market Participant business activities required for
           transitioning into Go-Live have been established and
           communicated.
     – Market rules transition communicated
         • Nodal and Zonal Protocol effective / retirement dates identified and
           communicated for Market Participant review




       2 September 2010                 26                  Technical Advisory Committee
Readiness Methodology


  People Readiness – evaluation of ERCOT employee readiness and
    Market Participant knowledge to support the market design
     – ERCOT staff supporting Market Trials
         • ERCOT Business teams supporting system execution, problem
           resolution, and market questions
     – ERCOT staff trained on System and Processes
         • ERCOT Business teams training status based on identified ERT
           training metrics
     – Market Participant Training delivered
         • ERT external training classes and web based training provided by
           the Nodal training project




       2 September 2010                27                 Technical Advisory Committee
MMS – Day Ahead, Adjustment Period, RT Market Overview
                                       Recommendation of Certification
                                           ERCOT

                                           NATF

                                           TAC

                                           BOD


Status / Other Issues:
• DAM performance issue concerning CRR PTP options being investigated

• MMS currently has 58 Open defects in Test targeted to be fixed by September 3.
• MMS currently has 24 Open defects in development targeted to be fixed by October 1.
     • 6 DAM, 4 RUC, 4 SCED, 3 MI, 7 GUI
• MMS remaining 13 (7 performance, 3 MOI, 3 MI) defects are being reviewed by business for final disposition




Open Defects*:                                                                    Deferred Defects*:
        Sev 1        0                                                                 Deferred                44
        Sev 2                        43
                                                                                                                 * As of August 31, 2010
        Sev 3-5                       52

               2 September 2010                                      28                              Technical Advisory Committee
MMS – Day Ahead, Adj. Period, RT Market – Readiness Update

  System Readiness                                                  Planned          Status
                                                                    Completion
  MMS System release to Market Trials                                   2/1/10         Complete
  Market Submission Connectivity Qualification (MP3)                   Ongoing           Green
  Real-Time Market Daily Participation (MP15A)                         Ongoing           Green
  Generate LMP‟s for 6 months (MO5)                                    Ongoing           Green
  Verify SCED Price Validation (MO4)                                   Ongoing           Green
  DAM Participation (MP16)                                             Ongoing           Amber
  Generate Day-Ahead LMPs (MO9)                                        Ongoing           Green
  Verify DAM Price Validation (MO8)                                    Ongoing           Green
  DRUC Execution (MO10)                                                Ongoing           Green
  Verify Supplemental Ancillary Services Market (MO3)                  Ongoing           Green

  Process Readiness
  Day Ahead, Adjustment Period and RTM Procedures                       8/31/10        In Process
  MMS Day Ahead & Real Time Price Validation Procedures                8/31/10         In Process
  Nodal Protocol Transition Plan Updated for DAM, RUC, SASM, SCED      7/29/10         Complete

  People Readiness
  ERCOT Staff Support of Market Trials                                  2/1/10         In Process
  ERCOT Staff Trained on System and Processes                          8/27/10         Complete
  Market Participant Training Delivered                                Ongoing         In Process




             2 September 2010                                29         Technical Advisory Committee
CRR PTP Offers: ERCOT’s Action Plan

     For Go-Live: Immediate Mitigation                                  Post Go-Live: Long Term Solution
•   Potential software based improvements:                          •   Potential long term software based
                                                                        improvement
     •   Make changes to the software which could
         allow the NSM processes to run faster by                        •   Further enhance parallel computation
         enabling parallelization                                            capability of Network Analysis Module
           – DAM - Network Analysis Module                                   (NSM)
           – Three to four weeks are required to determine the               – Design change:
             performance improvement of this option                             •   Allow network analysis for each hour of the study
                                                                                    period to be done in parallel
           – Additional time will be required to fully verify the               •   Introduce new process controller that manages
             functional results                                                     these parallel network analysis modules
                                                                                •   Manage the interface of passing transmission
     •   Utilize newer math libraries in the software                               constraints after network analysis for all 24 hours
                                                                                    back to the unit commitment engine
         that may improve performance                                        – Long term option, not viable before go live
           – DAM – Unit Commitment, Dispatch and Pricing
           – At least four weeks are required to determine the
             performance improvement of this option
           – Additional time will be required to fully verify the
             functional results

•   Potential hardware based improvements:
     •   Upgrade to faster processors. This is being
         tested at ERCOT this week to determine the
         magnitude of performance improvement
           – Six to eight weeks required to migrate the ERCOT
             production environments to this processor se t if
             this option is pursued




            2 September 2010                                   30                             Technical Advisory Committee
CRR PTP Offers: Going Forward



   •   Current Resources represented by NOIEs translates into 157 unique
       source-sink pairs

   •   ERCOT is vigorously investigating the possible software and hardware
       solutions prior to Go-Live

   •   NOIE allocation eligibility due to ERCOT on September 8, 2010

   •   NOIEs to submit expected CRR offer paths on or before September 8,
       2010

   •   ERCOT to analyze expect offer path to current CRR capabilities

   •   Follow up meeting with NOIEs during the week of September 13, 2010
       to discuss allocation results and possible actions




          2 September 2010              31                Technical Advisory Committee
EMS – Real-Time Operations
                                Recommendation of Certification
                                     ERCOT

                                     NATF

                                     TAC

                                     BOD

 Status / Other Issues:
 • EMS currently has 20 Open defects in development targeted to be fixed by October 1.
      • 1 EMS Interface, 1 CIM Importer, 1 PSSE export
      • 6 STNET/SMTNET/OE
      • 1 VSAT
      • 3 RLC
      • 1 SE
      • 2 TCM
      • 3 LFC/Generation

Open Defects*:                                                  Deferred Defects*:
       Sev 1     0                                                  Deferred                        321
       Sev 2                    12
                                                                                           * As of August 31, 2010
       Sev 3-5            8

             2 September 2010                         32                       Technical Advisory Committee
EMS – Real-Time Operations Readiness Update

  System Readiness                                                Planned          Status
                                                                  Completion
  EMS System Release to Market Trials                                 2/1/10         Complete
  Verify ACE Performance (EMO5)                                     4/21/2008        Complete
  Individual LFC Testing (EMO6)                                     5/31/2010        Complete
  Telemetry / ICCP System Failover (N2)                              Ongoing           Green
  Telemetry Compliance (MP6)                                         6/2/2010        Complete
  Validate Telemetry / SE ISM / Data Accuracy (E3)                   Planned          Planned
  State Estimator Standards Performance (EMO9)                       Ongoing           Green
  RTCA Zonal to Nodal Modeling Differences (EMO9)                    Ongoing           Green
  RTCA CSC Zonal to Nodal Comparison (EMO9)                          Ongoing           Green
  Verify Voltage Support Functionality (EM02)                        9/8/2010         Planned
  Anomalous/Auto-Disabled Telemeted Points (EMO10)                   Ongoing           Green
  Verify Load Forecast Accuracy (EMO7)                               Planned          Planned

  Process Readiness
  RT Operations Business Procedures                                  8/31/10         In Process
  Nodal Protocol Transition Plan Updated for RT Operations           7/29/10         Complete

  People Readiness
  ERCOT Staff Support of Market Trials                               9/30/10         In Process
  ERCOT Staff Trained on System and Processes                         9/3/10         In Process
  Market Participant Training Delivered                              Ongoing         In Process


             2 September 2010                                33       Technical Advisory Committee
COMS – Settlement & Billing, Metering, and Data Aggregation -
Overview
                                Recommendation of Certification
                                   ERCOT

                                   NATF

                                   TAC

                                   BOD


 Status / Other Issues:
 •  There are only 5 Open defects related to Core Systems at this time that are scheduled to be resolved by
 09/03/2010.
        -Adjustment to queries in Appworx Scheduling Job
        -IDR Staging Performance Enhancement
        -Adjustment to DAM Start Logic
        -Adjustment to Data Aggregation to prevent file aborts from missing data
        -Adjustment for AIEC calculation logic when RTPERFIP missing
 • There are 11 Commercial System Integration (CSI) defects related to transfer of data

Open Defects*:                                                    Deferred Defects*:
       Sev 1      0                                                   Deferred               45
       Sev 2           6
                                                                                              * As of August 31, 2010
       Sev 3-5             9

             2 September 2010                           34                        Technical Advisory Committee
S&B – Settlements and Billing, Metering, and Data Aggregation
Readiness Update
  System Readiness                                                       Planned          Status
                                                                         Completion
  S&B System release to Market Trials                                        5/1/10         Complete
  Verify RTM Settlement Statements (CO5)                                    Ongoing           Green
  Verify RTM Settlement Invoices (CO6)                                      Ongoing           Green
  Verify DAM Settlement Statements (CO3)                                    Ongoing           Green
  Verify DAM Settlement Invoices (CO7)                                      Ongoing           Green
  Verify CRR Auction Invoices (CO8)                                         Ongoing           Green
  Settle Market for 7 days and provide appropriate extracts (CO1)          8/25/2010        Complete
  Verify Dispute Process (CO2)                                             9/22/2010         Planned
  Zonal/Nodal Coordinated Settlement Operations (CO4)                      8/25/2010        Complete

  Process Readiness
  Settlements and Billing Procedures                                        8/24/10         Complete
  Nodal Protocol Transition Plan Updated for Settlements and Billing        7/29/10         Complete

  People Readiness
  ERCOT Staff Support of Market Trials                                      9/30/10         In Process
  ERCOT Staff Trained on System and Processes                               7/30/10         In Process
  Market Participant Training Delivered                                     Ongoing         In Process




             2 September 2010                                       35       Technical Advisory Committee
CMM – Credit Overview
                                    Recommendation of Certification
                                        ERCOT

                                        NATF

                                        TAC

                                        BOD


 Status / Other Issues:
 • Open issues related to an intermittent performance issue and reporting and notifications. All items are
 internal ERCOT fixes targeting a 09/03/2010 resolution date.
      –   NPRR 241 - CMM:FCE Detail reports runs long
      –   Exposure calculation engine processes hanging (intermittent)
      –   EAL Detail Report - In the OIA Section the corresponding Invoice data display
      –   Efactors- Email notification about e-factors values to the counter-parties is not working correctly
      –   Entity Name field is missing from the Enter CP Estimates screen
      –   AIL Report- if the RTM Estimated data is missing for an Operating Date the report is not displaying data correctly

Open Defects*:                                                              Deferred Defects*:
       Sev 1       0                                                             Deferred                    45
       Sev 2             5
       Sev 3-5                                                                                               * As of August 31, 2010
                   1
             2 September 2010                                   36                             Technical Advisory Committee
CMM – Credit Management and Monitoring – Go Live

  System Readiness                                                    Planned          Status
                                                                      Completion
  Credit Management Integrated in Market Trials                           5/3/10         Complete
  Verify Credit Calculations (CO10)                                      9/8/2010         Planned

  Process Readiness
  Credit Management Procedures                                           8/24/10         Complete
  Nodal Protocol Transition Plan Updated for Credit Management           7/29/10         Complete

  People Readiness
  ERCOT Staff Support of Market Trials                                    9/30/10        In Process
  ERCOT Staff Trained on System and Processes                            8/13/10         Complete
  Market Participant Training Delivered                                  Ongoing         In Process




             2 September 2010                                    37       Technical Advisory Committee
MIS – Market Information System Overview
                                    Recommendation of Certification
                                        ERCOT

                                        NATF

                                        TAC

                                        BOD


 Status / Other Issues:
 • MIS defects of highest priority are around Extract Subscriber and LMP Contour Map and are targeting a
 resolution date by 10/11/2010. Fixes for most of these are already developed and will be tested during the
 MIS reconfiguration downtime. Examples are:
      –   Extract Subscriber – No choice to select the extract format
      –   Extract Subscriber – Unable to unsubscribe the subscribed extract.
      –   Extract Subscriber – „Help‟ icon is not being displayed in Extract Subscriber application
      –   LMP Contour Map Dashboard does not allow for alternate dates



Open Defects*:                                                               Deferred Defects*:
       Sev 1       0                                                              Deferred             7
       Sev 2                9
                                                                                                            * As of August 31, 2010
       Sev 3-5         3

             2 September 2010                                    38                             Technical Advisory Committee
MIS – Market Information System – Go Live

  System Readiness                                      Planned          Status
                                                        Completion
  MIS System release to Market Trials                       2/1/10         Complete
  MIS Compliance Test (E12)                                9/8/2010         Planned

  Process Readiness
  MIS Procedures                                           8/25/10         Complete
  Nodal Protocol Transition Plan Updated for MIS           7/29/10         Complete

  People Readiness
  ERCOT Staff Support of Market Trials                      9/30/10        In Process
  ERCOT Staff Trained on System and Processes              8/20/10         Complete
  Market Participant Training Delivered                    Ongoing         In Process




             2 September 2010                      39       Technical Advisory Committee
                   Questions ?




2 September 2010        40       Technical Advisory Committee
                   Appendix




2 September 2010       41     Technical Advisory Committee
Defects, Issues, Quality of Solution: Definitions

  •    Defects:
      –    A technical error or problem between ERCOT‟s internal system or between
           ERCOT and the market
      –    Deferred defects are Severity 3 defects, that have been deferred until after Go-
           Live, but have a confirmed workaround in place

  •    Quality of Solution:
      –   Data Issues:
          •    Heavily dependant on inputs
          •    No significant software issues
          •    On-going analysis of results and inputs
      –    Performance Issues:
          •    ERCOT is constantly looking to improve performance
          •    Monitoring in place to detect issues


  •    Known Issues / Market Facing Issues
      –   Issues uncovered during internal or market trials that impact Market Participants




          2 September 2010                          42                 Technical Advisory Committee
Nodal Program Risks & Issues: Definitions

  Definitions for Category, Probability and Severity of Risks & Issues:

  •    Category
      –    Scope : Will require a scope change
      –    Schedule: Will require a schedule change
      –    Budget: Will require a budget change

  •    Probability
      –    High : Probability to occur is ≥ 90%; perceived impact would require a Change
           Request over the next 1-3 months
      –    Medium: Probability to occur is between 31 – 89%; perceived impact would
           require a Change Request over the next 4 -10 months
      –    Low: Probability to occur is ≤ 30 %; not expected to require a Change Request

  •    Severity
      –   High: Milestone impact, or budget impact >$250,000
      –   Medium: Milestone impact - but expected to be mitigated, or budget impact
          between $0 - $250,000
      –   Low: No milestone impact, or no budget impact

          2 September 2010                     43                    Technical Advisory Committee
Readiness Criteria – Metrics by Area (Planned, Active, or
Complete)

                Area                         Active               Complete   Planned        Total
   Credit                                                                           1                 1
   CRR                                                                   3                            3
   EMS                                                        1          5                            6
   MIS                                                                              1                 1
   MMS                                                        9                     1                10
   Network Model                                                         3                            3
   OS                                                                    2                            2
   Readiness                                                  3          6         11                20
   Readiness (Cutover)                                                   3         12                14
   Readiness (Quality)                                       5           2          1                 8
   Settlements                                               5           2                            7
   Grand Total                                              23          26         26                75
   75 metrics are considered to be Readiness Criteria for TAC, BOD Go-Live votes
        • All of these metrics are considered as “Readiness Criteria” that will be included in
        TAC/BOD Go-Live votes.
        • Once a Readiness Area is approved for Go-Live, metrics falling within that Readiness Area
        will be considered complete

   * 26 Complete include the 19 newly completed metrics on Slide 3


           2 September 2010                                 44                   Technical Advisory Committee
Readiness Criteria – Completed Metrics
 Metric ID   Metric Name                          Area               Applies To      Comments
             MP EDS-2, Release 4 Trials
 MP14B       Participation (NOMCR Trials)         Network Model      TSPs          Reviewed as Complete at NATF on 1/5/2010
 MP14C       Network Model Validation             Network Model      TSPs          Network Model Validation confirmations from TSPs received in April/May 2010.
 N4          Network Modeling Single Entry        Network Model      ERCOT         Reviewed as Complete at NATF on 1/5/2010
 CRR2        Develop TCR to CRR Transition Plan   CRR                ERCOT         Plan completed on 11/3/2008. Reviewed as Complete at NATF on 6/1/2010
             Operation of CRR Auctions and                                         Complete as of Outage Scheduler BOD approval on 8/17/2010. However, will be
 CRR3        Allocations                          CRR                ERCOT, CRRAHs tracked until the September Auction is complete (final Market Trials auction).
 MP15B       CRR Connectivity Qualification       CRR                ERCOT, CRRAHs Same as CRR3
             Outage Scheduler Connectivity                           ERCOT, QSERs,
 MP20        Qualification                        OS                 TSPs          Complete as of Outage Scheduler BOD approval on 8/17/2010.
             Verify Outage Evaluation System
 EMO3        Functionality                        OS                 ERCOT           Complete as of Outage Scheduler BOD approval on 8/17/2010.
 MP6(SCED)   Telemetry Compliance 3.10.7.5        EMS                QSERs           Telemetry outreach for missing telemetry was completed in June of 2010.
                                                                                     Telemetry outreach for telemetry in the network model, but with no ICCP being
 MP6(SE)     Telemetry Compliance 3.10.7.5        EMS                QSERs           received was completed in June of 2010.
 EMO6        Individual LFC Testing               EMS                QSERs           Individual LFC tests were conducted in May in preparation
 MP6 (TSP)   Telemetry Compliance 3.10.7.5        EMS                TSPs            Same a MP6(SCED)
                                                                                     1st Zonal/Nodal Coordinated Settlement test performed in I-Test from End of June to
                                                                                     End of July. Defects were raised in data aggregation and in Appworx jobs. 2nd
             Zonal/Nodal Coordinated Settlement                                      Zonal/Nodal Coordinated Settlement test began on 8/9/2010 and completed on
 CO4         Operations                         Settlements          ERCOT           08/27/2010. All previous defects were resolved and no new defects were raised.
                                                                                     The Day-Ahead Market was run consecutively form 8/10/2010 through 8/21/2010.
             Settle Market for 7 Days and provide                                    DAM statements have already been posted for all of those days. RTM Initial
 CO1         appropriate extracts                 Settlements        ERCOT           Statements for were posted on 8/25/2010.
                                                                                     Include RARF registration, submission of decision making authority, and Genmap
 MP11        Resource Registration                Readiness          REs             validation. Effort completed in July 2010.                   ERCOT has 19
             ERCOT Operating Personnel and        Readiness                                                                                    newly completed
 MO7         Facilities Readiness                 (Cutover)          ERCOT           DAM control room already setup with Nodal equipment.
                                                                                                                                               nodal metrics
             Operating Personnel and Facilities   Readiness
 EMO13       Readiness                            (Cutover)          ERCOT                                                                     - 7 Metrics related to
                                                                                     Taylor and Austin control rooms already setup with Nodal equipment.
             ERCOT Staffed for Texas Nodal        Readiness                                                                                    TAC/Board have
                                                                                     Market Reform report completed in June. ERCOT management has implemented an
 E8          Operations                           (Cutover)          ERCOT           action plan to address recommendations.                   signed off (NMMS,
             Mapping of Resource and Loads in
 MP18        Private Area Networks                Readiness (Quality) QSERs          All Resource and Load PUNs mapped in the model.           OS, and CRR).
                                                                                                                                               - 5 EMS metrics
                                                                                                                                               - 7 Metrics for general
                                                                                                                                               readiness


              2 September 2010                                                     45                                        Technical Advisory Committee
Readiness Criteria – From now to Go-Live

  Metric ID   Metric Name                 Area     Applies To      Comments
              Verify Voltage Support
  EM02        Functionality               Readiness ERCOT, QSERs   If Operations decides this is an operational scenario to be tested, this metric would be fulfilled.
                                                                   Plan exists in Nodal Operating Guide Section 9. Updates added by NOGRR25 and approved by TAC. Differing
              Verify TSP Performance                               expectations between TAC/Market and ERCOT on what's in scope for Nodal Go-Live. Need an update on the
  E15         Monitoring Test Plan        Readiness ERCOT          status of the grey boxes.
                                                                   Plan exists in Nodal Operating Guide Section 9. Updates added by NOGRR25 and approved by TAC. Differing
              Verify QSE Performance                               expectations between TAC/Market and ERCOT on what's in scope for Nodal Go-Live. Need an update on the
  E14         Monitoring Test Plan        Readiness ERCOT          status of the grey boxes.
                                                                   Plan exists in Nodal Operating Guide Section 9. Updates added by NOGRR25 and approved by TAC. Differing
              Verify ERCOT Performance                             expectations between TAC/Market and ERCOT on what's in scope for Nodal Go-Live. Need an update on the
  E2          Monitoring Test Plan     Readiness ERCOT             status of the grey boxes.
              ERCOT Nodal Readiness
  R1          Declaration                 Readiness ERCOT          Covered in Readiness Criteria/Go-Live presentations to TAC/BOD
  R3          168-Hour Test Completion Readiness ERCOT             Use exit criteria from the 168 Hour Test Hand Book.
                                                                   Operating guides reviewed and approved by stakeholder groups including TAC. Meeting tomorrow to get a
              Develop Nodal Operating                              completion justification
  E6          Guides                    Readiness ERCOT
              Validate ISM, CDR, and
              Lodestar Source Reporting
              Access & Accuracy for
  E10         internal ERCOT use        Readiness ERCOT            Group this into the EMIL Reports Nodal Readiness Sign-off.
  EMO8        Conduct EECP Test         Readiness ERCOT            If Operations decides this is an operational scenario to be tested, this metric would be fulfilled.
              Market Participant Nodal
  R0          Readiness Declaration       Readiness ERCOT, MP      Covered in Readiness Criteria/Go-Live presentations to TAC/BOD
                                                                                                                                                     24 Metrics not yet
              Market Monitor Systems                                                                                                                 active, but still
  IMM1        Capability                  Readiness IMM            To be included in the IMM declaring Readiness for Go-Live.                        planned to be
              Verify Single Point of
              Failure Recovery
                                                                                                                                                     measured before
              EMS/MMS/NMMS/CRR/C          Readiness                                                                                                  Go-Live.
  C10         OMS                         (Cutover) ERCOT          ERCOT has been performing regular site failovers throughout Market Trials.
              Contingency Plan for Site   Readiness
  C9          Unavailability              (Cutover) ERCOT          Same at C10




                  2 September 2010                                                      46                                            Technical Advisory Committee
Readiness Criteria – From now to Go-Live (continued)

                                                             Readiness
  Metric ID   Metric Name          Area         Applies To   Criteria?   Comments
                                                                         PwC has completed an assessment of new control objectives. Internal Audit is going to sample the
              Nodal SAS 70          Readiness                            control objectives and do audit testing around the 168 hour test. Metric will be completed once ERCOT
  E5          Preparedness          (Cutover)   ERCOT        Yes         addressed an issues raised by the Internal Audit group.
              Contingency Plan for Readiness
  C8          Portal/API Failure    (Cutover)   ERCOT        Yes         Part of cutover scope.
              Develop Plan for SE Readiness
  C6          Failure               (Cutover)   ERCOT        Yes         Part of cutover scope.
              Contingency Plans for                                                                                                       Metrics will be
              Key Settlement and
              Financial Transfer    Readiness                                                                                             closed as TAC/BOD
  C5          Processes             (Cutover)   ERCOT        Yes         Part of cutover scope.                                           signoff is garnered
              Contingency Plan for Readiness                                                                                              for various systems
  C4          SCED Failure          (Cutover)   ERCOT        Yes         Part of cutover scope.
              Contingency Plan for Readiness                                                                                              and readiness areas
  C3          ICCP Data Failure     (Cutover)   ERCOT        Yes         Part of cutover scope.
              Contingency Plan for Readiness
  C2          DAM / LMP Failure (Cutover)       ERCOT        Yes         Part of cutover scope.
              Contingency Plan for
              Weekly, Daily and     Readiness
  C1          Hourly RUC Failure (Cutover)      ERCOT        Yes         Part of cutover scope.
              Develop Texas Nodal Readiness                              Planned completion when the final cutover plan is released after the last Market Readiness Seminar in
  R2          Market Launch Plan (Cutover)      ERCOT        Yes         September.
              Verify Load Forecast Readiness
  EMO7        Accuracy              (Quality)   ERCOT        Yes         Bring more in line with performance reporting requirement in Section 8.2 (2)(c).
                                                                         7/14/2010 - March 2010, Security Compass did a pen test to verify the integrity digital certificates to
                                                                         access MIS public, secure, certified. Small # of vulnerabilities were found that have been addressed.
                                                                         Security Compass is coming back in July 2010 to make sure all items have been addressed. Need final
  E12         MIS Compliance Test MIS           ERCOT        Yes         agreement that this metric is complete.
              Verify Credit                                              Through MT5, we have posted credit and have calculated credit limits throughout Market Trials. Full
  CO10        Calculations         Credit       ERCOT, MP    Yes         justification needed.
              Validate ISM Access
              & Accuracy of
              Postings Required by
  E7          the IMM              MMS          ERCOT, IMM Yes           To be included in the IMM declaring Readiness for Go-Live.




                   2 September 2010                                                     47                                            Technical Advisory Committee
Next 60-days of Nodal Classes/Workshops

              Course               Start Date                   Location
  Economics of LMP                September 13        ERCOT Met Center (Austin)
  ERCOT 101 for Wind Generation   September 13           Optim Energy (Dallas)
  ERCOT Nodal 101                 September 14          StarTex Power (Houston)
  Generation 101                  September 15        Hilton Austin Airport (Austin)
  Basic Training Program          September 20               LCRA (Austin)
  Load Serving Entity 201         September 27        ERCOT Met Center (Austin)
  Congestion Revenue Rights       September 29           Suez Energy (Houston)
  ERCOT Nodal 101                  October 5          RBS Sempra (Stamford, CT)
  Basic Training Program           October 18            Suez Energy (Houston)




  Enrollment at: http://nodal.ercot.com/training/courses/index.html


          2 September 2010                 48                   Technical Advisory Committee
RED/AMBER Metrics Summary – Market Participant Metrics

 Market Participant Metrics
                         Current            Applies                                                            Not
     Metric Name                                          Weight        Green % Yellow % Red %                               Primary Criteria                Notes
                          Score               to                                                             Scored %
Market Participant Metrics
    MP15(B) CRR                                                                                                                                        80/90 CRRAHs
                                                          Even                                                            Successful submission
     Connectivity          Red             CRRAHs                          89%         0.0%         11%         0.0%                               qualified. Greater than
                                                         weighting                                                           CRR transactions
     Qualification                                                                                                                                         5% RED.
                                                                                                                          Participation in 50% of
     MP16 DAM                                            Even                                                                                        126/187 QSEs w/o
                               Amber         QSEs                         67.4%        13.9%      16.0%         2.7%      the Day-Ahead Market
     Participation                                      Weighting                                                                                         Resources
                                                                                                                                   runs
  MP21 WGRs ICCP                             REs    Registered                                                               WGRs must meet < 5% RED, so the metric
   Meteorological              Amber         (only MW Capacity            66.0%         32.3        1.7         N/A        reasonability tests for  is currently listed at
     Telemetry                              WGRs) Ratio Share                                                                   MET ICCP                   AMBER

 MP15(B)
     • 10 CRRAHs working towards qualification *
     • Minimal risk to running the December 2010 Auction
 MP16
     • QSEs w/o Resources DAM participation between 65%-80% since measurement started in April.
     • These QSEs represent 1% of Load.
     • Minimal risk to Go-Live
 MP21
     • 67 WGRs – 55 passed reasonability test, 9 working with ERCOT to resolve, 3 with no response
     • 55 up from 42 from the previous two-week measurement



 * 5 new CRRAHs added prior to 8/13 deadline. Not included in MP15B because they have a 30 day window before ERCOT publishes their CRRAH qualified status.



                   2 September 2010                                                      49                                        Technical Advisory Committee
CRR Metrics

                         Current   Applies                                          Not
    Metric Name                              Weight      Green % Yellow % Red %                 Primary Criteria              Notes
                          Score      to                                           Scored %
Market Participant Metrics
    MP15(B) CRR                                                                                                           80/90 CRRAHs
                                              Even                                           Successful submission
     Connectivity          Red     CRRAHs                 89%     0.0%    11%      0.0%                                qualified. Greater than
                                             weighting                                         CRR transactions
     Qualification                                                                                                             5% RED.
                                                                                             Participation in at least 63/77 CRRAHs with
  CRR3 Operation of
                                              Even                                           1of the last 2 auctions adequate participation in
  CRR Auctions and       Green     CRRAHs                 81.2%    0%     18.8%    0.0%
                                             weighting                                       or allocations. > 80% June or July auction or
     Allocations
                                                                                                total participating            allocation
ERCOT Metrics
                                                                                                 Auction results          8/10/2010 Annual
                                                                                                  distributed to       Auction results posted
                         Green     ERCOT       N/A         N/A     N/A     N/A      N/A          participants per        (delayed 1 day due
                                                                                                schedule in CRR         additional validation
  CRR3 Operation of
                                                                                                   Handbook                    needed)
  CRR Auctions and
                                                                                                                            Source – Sink
     Allocations                                                                               Allocated Revenue
                                                                                                                        price/clearing prices
                         Green                                                                 Rights in statistical
                                   ERCOT       N/A        100%     0%      0%       0%                                quality check performed
                                                                                                 sample = 100%
                                                                                                                        successfully by CRR
                                                                                                    accurate
                                                                                                                      team after each auction
                                                                                                                       S&B validated invoices
                                                                                                                        reflected awards for
                                                                                             CRR Auction Result for
                         Green                                                                                          each CRRAH in the
                                   ERCOT       N/A        100%     0%      0%       0%        MP(n) – CRR Auction
                                                                                                                      March, April, May, June,
                                                                                             Invoices for MP(n) = 0$
   CO8 Verify CRR                                                                                                         July, and August
   Auction Invoices                                                                                                           auctions, .
                                                                                                                     Annual CRR auction
                                                                                               System Generated
                         Green                                                                                       invoices submitted to all
                                   ERCOT       N/A        100%     0%      0%       0%        CRR Auction Invoices
                                                                                                                     40 CRRAHs who
                                                                                                  not posted = 0
                                                                                                                     participated




                2 September 2010                                   50                                Technical Advisory Committee
Real-Time Metrics
                         Current   Applies                                            Not
     Metric Name                               Weight      Green % Yellow % Red %                 Primary Criteria              Notes
                          Score      to                                             Scored %
Market Participant Metrics
    MP3 Market                               Generation
                          Green    QSERs                    99.0%   1.0%    0.0%     0.0%      Successful submission 79/81 QSERS qualified
    Submissions                              Ratio Share
                                                                                                  of RT and DAM
    Connectivity                                Even
                          Green    QSEs                     97.3%   0.0%    0.5%     2.2%           transactions     182/187 QSEs qualified.
    Qualification                             weighting
                                                                                               80% of generation has
                                                                                                                      69/79 QSERs completed
 EMO6 Individual LFC                         Generation                                         completed individual
                         Green     QSERs                    93.0%    0%      0%      7.0%                              their individual LFC test
      Testing                                Ratio Share                                        test LFC prior to the
                                                                                                                        or provided attestation
                                                                                               system-wide LFC tests
                                                                                                 Weekly average of       78/79 QSERs above
  MP15-A Real-time                           Generation
                         Green     QSERs                    98.8%   1.2%    0.0%     0.0%            daily SCED       95% weekly average for
  Market Participation                       Ratio Share
                                                                                                    submissions          SCED submissions.
ERCOT Metrics
                                                                                                                      SASMs successfully run
                                                                                                Multiple SASMs are
                                                                                                                      on 4/28, 4/30, 5/4, 5/6,
                                                                                               successfully executed
   MO3 Verify SASM       Green     ERCOT        N/A         100%     N/A     N/A      N/A                             5/7, 5/12, 5/14, 6/9, and
                                                                                                during Market Trials
                                                                                                                          6/10. No issues
                                                                                               and the 168 hour test.
                                                                                                                              reported.
                                                                                                All successful SCED     7/27 – 8/9 period –
   MO4 Verify SCED                                                                             executions passed the 4,027 Price Validation
                         Green     ERCOT        N/A         100%     0%      0%       0%
   Execution Quality                                                                            post-execution price      runs with no rule
                                                                                                     validations.             violations
                                                                                                   95% of SCED
                                                                                                                    7/27 – 8/9 period, 4,015
   MO5 Generate 6                                                                              executions completed
                         Green     ERCOT        N/A        99.5%.    0%     .5%       0%                            out of 4,037 SCED runs
   Months of LMPs                                                                              with LMPs posted on
                                                                                                                       with LMPs posted.
                                                                                                       MIS.
                                                                                               System Generated RT         7/1 – 7/30 RTM
                                                                                                 Statement Dollars- Statements and Invoices
    CO5 Verify RTM
                         Green     ERCOT        N/A         100%     0%      0%       0%           Independently       validated $$ = system
      Settlement
                                                                                                   Generated RT        generated (with some
 Statements/CO6 Verify
                                                                                               Calculation Dollars =$0 rounding differences)
    RTM Settlement
                                                                                               System Generated RT         7/1 – 7/30 RTM
       Invoices
                         Green     ERCOT        N/A         100%     0%      0%       0%        Statements/Invoices Statements and Invoices
                                                                                                   not posted = 0        All posted on time

                  2 September 2010                                   51                               Technical Advisory Committee
Day-Ahead Market Metrics
                         Current      Applies                                               Not
     Metric Name                                  Weight      Green % Yellow % Red %                    Primary Criteria             Notes
                          Score         to                                                Scored %
Market Participant Metrics
                                                Generation                                                                      77/80 QSEs with
                           Green      QSERs                    98.6%       1.4%   0.0%     0.0%      Participation in 50% of
      MP16 DAM                                  Ratio Share                                                                        Resources
                                                                                                     the Day-Ahead Market
      Participation                                Even                                                                        126/187 QSEs w/o
                           Amber       QSEs                    67.4%      13.9%   16.0%    2.7%               runs
                                                 Weighting                                                                         Resources
ERCOT Metrics
                                                                                                        95 percent DAM       7/27 – 8/9 – 10/10 DAM
  MO9 Generate DAM
                           Green      ERCOT         N/A          N/A        N/A    N/A      N/A      execution as evidenced runs execute(doesn‟t
       LMPs
                                                                                                     by DAM LMP postings         measure quality)
                                                                                                                              7/27 – 8/9 - 7 out of 7
     MO10 DRUC                                                                                         95 percent DRUC        DRUC runs executed
                           Green      ERCOT         N/A          N/A        N/A    N/A      N/A
      Execution                                                                                             execution            (DRUC was not
                                                                                                                             scheduled for everyday)
                                                                                                                                  7/1 – 7/30 DAM
                                                                                                     System Generated RT
                                                                                                                             Statements and Invoices
                                                                                                       Statement Dollars-
                                                                                                                                 All validated $$ =
    CO3 Verify DAM         Green      ERCOT         N/A         100%        0%     0%       0%           Independently
                                                                                                                             system generated (with
      Settlement                                                                                         Generated RT
                                                                                                                                  some rounding
 Statements/CO7 Verify                                                                               Calculation Dollars =$0
                                                                                                                                    differences)
     DAM Invoices
                                                                                                     System Generated RT          7/1 – 7/30 DAM
                           Green      ERCOT         N/A         100%        0%     0%       0%        Statements/Invoices Statements and Invoices
                                                                                                         not posted = 0         All posted on time

  1. MP16 – Metric is based on a 2 week rolling average (8/9 – 8/20 12 runs).
  2. MP16 – 96% Load participating.




                  2 September 2010                                          52                               Technical Advisory Committee
Network Modeling Metrics

                         Current    Applies                                             Not
     Metric Name                                Weight      Green % Yellow % Red %                  Primary Criteria              Notes
                          Score       to                                              Scored %
Market Participant Metrics
                                                                                                       Expected State
                                              Generation                                                                    78/78 complete. 3502
                          Green     QSERs                    100%    0.0%      0.0%     0.0%        Estimator telemetry
                                              Ratio Share                                                                 total SE points provided
                                                                                                         submitted.
    MP6 Telemetry
                                              Generation                                              Expected SCED         78/78 complete. 7629
 Compliance with Nodal    Green     QSERs                    100%    0.0%      0.0%     0.0%
                                              Ratio Share                                          telemetry submitted. SCED points provided
   Protocols 3.10.7.5
                                                                                                       Expected TSP       14/17 TSPs above 98%
                                              Ownership
                          Green      TSPs                    99.3%   0.0%      0.0%      .7%        telemetry per ICCP      threshold for GREEN.
                                              Ratio Share
                                                                                                  Handbook submitted 143 points outstanding
                                                                                                     ICCP Failover test
                                                                                                                          64/79 QSERs completed
  N2 Telemetry ICCP                           Generation                                         completed successfully
                         9/1/2010   QSERs                    89.5%    0%       0%       10.5%                              ICCP telemetry failover
   System Failover                            Ratio Share                                            prior to the 8-hour
                                                                                                                                     test.
                                                                                                         LFC test.
  MP21 WGRs ICCP                     REs    Registered                                               WGRs must meet < 5% RED, so the metric
   Meteorological        Amber       (only MW Capacity       82%     13.5%     4.5%      N/A      reasonability tests for    is currently listed at
     Telemetry                      WGRs) Ratio Share                                                    MET ICCP                  AMBER

  1. MP6 does not include 405 QSE CB and DSC points from TSP outreach. ERCOT is determining whether these rollback into the QSER MP6
     measurement.




                2 September 2010                                       53                                Technical Advisory Committee
Network Model Metrics
                        Current   Applies                                       Not
    Metric Name                             Weight   Green % Yellow % Red %                 Primary Criteria               Notes
                         Score      to                                        Scored %
ERCOT Metrics
 Network Modeling Metrics
   EMO9(A) State                                                                              State Estimator      98.4% Convergence for
 Estimator Standards    Green     ERCOT      N/A       N/A     N/A     N/A      N/A       converges 97% during State Estimator for the
     Performance                                                                            monthly test period           month of July.
                                                                                                                        97.9% match for
                                                                                            95% of impedance         impedances for lines
                        Green     ERCOT      N/A      96.8%    N/A     N/A      N/A          values matched       and transformers. 6718
                                                                                           between Zonal/Nodal lines and transformers in
                                                                                                                             Nodal.
  EMO9(B) RTCA
                                                                                           95% of dynamic line 99.2% match for ratings
 Modeling Differences
                        Green     ERCOT      N/A      96.8%    N/A     N/A      N/A          ratings matched        for lines. 5288 lines in
                                                                                           between Zonal/Nodal               Nodal.
                                                                                          95% of load tap setting       98.6% Match for
                        Green     ERCOT      N/A       N/A    98.6%    N/A      N/A          values matched       transformer tap settings.
                                                                                           between Zonal/Nodal       1430 xfrms in Nodal.
                                                                                           The % of Anomalous          April Nodal 2.58%
 EMO10 Anomalous /
                                                                                            and Auto-Disabled          May Nodal 1.92%
   Auto-Disabled        Green     ERCOT      N/A      1.91%    N/A     N/A      N/A
                                                                                         Measurements < 2% of          June Nodal 1.91%
 Telemetered Points
                                                                                           Total Measurements          July Nodal 1.44%
                                                                                                                          Measurement
                                                                                         CSC Pre-contingency          establishes baseline
 EMO9(C) RTCA CSC
                        Green     ERCOT      N/A      99.6%    N/A     N/A      N/A      SE Flows within 5%          flows on Commercial
    Comparison
                                                                                         (Hourly snapshot)        lines between Zonal and
                                                                                                                       Nodal (7/27 – 8/9)




                2 September 2010                               54                                Technical Advisory Committee
Other Readiness Metrics

                         Current   Applies
     Metric Name                              Weight       Green % Yellow % Red % Not Scored % Primary Criteria             Notes
                          Score      to
 Market Participant Metrics
    MP20 Outage                              Generation
                          Green    QSERs                    98.9%    0.0%    0.0%      1.1%        Successful    78/79 QSERS qualified.
      Scheduler                              Ratio Share
                                                                                                submission of OS
     Connectivity                            Ownership
                          Green     TSPs                    99.7%     0%      0%        .3%       transactions    20/23 TSPs qualified.
     Qualification                           Ratio Share
                                                                                                 Decision Making
                                             Registered
                                                                                                  Authority form
    MP11 Resource                                MW                                                                  154/157 Resources
                         Green      REs                     99.6%    0.0%     .4%      0.0%       submitted, and
     Registration                             Capacity                                                                   completed.
                                                                                                    GENMAP
                                             Ratio Share
                                                                                                    validated
 ERCOT Metrics
                                                                                                  Training plans
                                                                                                                      15 out of 15 highly
                                                                                                 must be adhered
  E1 ERCOT Staff                                                                                                   impacted departments
                         Green     ERCOT        N/A         100%      N/A     N/A       N/A        to for highly
  Completes Training                                                                                               are up to date with their
                                                                                                     impacted
                                                                                                                        training plans.
                                                                                                   departments
                                                                                                   Procedures
                                                                                                   developed 1
                                                                                                                     All MT5 procedures
   E9 Develop Nodal                                                                               month prior an
                         Green     ERCOT        N/A         100%      N/A     N/A       N/A                        exercised as scheduled
   Procedures                                                                                    exercised in the
                                                                                                                            in MT5.
                                                                                                appropriate Market
                                                                                                   Trials Phase
                                                                                                   A test of the
                                                                                                                    OS to OE integration
 EMO3 Verify Outage                                                                                   Outage
                                                                                                                      tested throughout
  Evaluation System      Green     ERCOT        N/A          N/A      N/A     N/A       N/A       Management
                                                                                                                      Market Trials and
    Functionality                                                                                   Process is
                                                                                                                   reviewed at 6/23 NATF
                                                                                                    completed




                 2 September 2010                                      55                             Technical Advisory Committee

				
DOCUMENT INFO
Shared By:
Categories:
Stats:
views:6
posted:10/11/2010
language:English
pages:55