Get documents about "industry data reports
W
Description
industry data reports. Business Information and Advice
Document Sample
NRIC V – October 30, 2001
Web-centric Business
Focus Group 2.B1
Network Reliability - Data Reporting & Analysis
NRIC V Council Meeting - October 30, 2001
NRIC V – October 30, 2001 Agenda
•Governance
•Charter
•Membership
•Key Deliverables
•Reliability Reporting
2
NRIC V – October 30, 2001
Governance
Focus Group 2
Network Reliability
Chair: Brian Moir,
ICA
(202) 331-9852
Focus Group 2.A1 Focus Group 2.B1
on Best Practices on Data Reporting
Chair: Rick Harrison and Analysis
Telcordia Chair: P.J. Aduskevicz,
(732) 758-2013 AT&T
(908) 234-5790
Focus Group 2.B2
Focus Group 2.A2
on Data Reporting
on Best Practices
and Analysis for
Packet Switching
Packet Switching
Chair: Karl Rauscher
Chair: Paul Hartman
Lucent Technologies
Hartman Associates
(908) 582-5306
(913) 893-9722
3
NRIC V – October 30, 2001
Charter
I. Implement a voluntary one year trial with participation by Internet Service Providers,
CMRS, satellite, cable, and data networking service providers to alert National
Communications System/National Coordinating Center for Telecommunications
(NCS/NCC) of outages that are likely to have significant public impact.
• Criteria for determining types of outages to be reported will be developed by each industry
segment building on the recommendations from NRIC IV.
• The process for reporting data during the voluntary trial will be documented and implemented.
• Analysis of the data from the trial will be conducted by a neutral third party.
• Industry associations will be requested to encourage participation by their constituents.
• At the completion of the trial period, an evaluation of its effectiveness will be conducted and a
recommendation made.
II. Evaluate outage-reporting requirements and guidelines currently used by wireline
carriers to improve the quality of outage reporting.
III. Evaluate and report on the reliability and availability of the PSTN utilizing NRSC
quarterly reports.
4
NRIC V – October 30, 2001
Membership
2.B1 - Data Reporting and Analysis Team
PJ Aduskevicz AT&T Norb Lucash USTA
Ed Ballington BellSouth Spilios Makris Telcordia
Brad Beard AT&T Archie McCain BellSouth
Ken Biholar Alcatel USA Art Menko Telcodata
Rick Canaday AT&T Denny Miller Nortel
Wayne Chiles Verizon Brian Moir ICA
Alberto De Gamboa PCIA Clayton Mowry SIA
Bernie Farrell NCS Ahmed Patel WorldCom
Perry Fergus Booz Allen & Hamilton Gary Pellegrino CommFlow
Judy Glatz AT&T Bonnie Petti Verizon Wireless
Brian Goemmer Western Wireless Karl Rauscher Lucent
Ed Hall ATIS Arthur Reilly Cisco Systems
Rick Harrison Telcordia Ira Richer Telesis Group
John Healy Telcordia Harold Salters PCIA
Dean Henderson Nortel Networks Andy Scott NCTA
Lynn Johnson Boeing Pete Shelus Telcordia
Rick Kemper CTIA John Todd NCS
Bill Klein ATIS Rachel Torrence Qwest
Jim Lankford SBC Operations Angela Wehmeyer AT&T Broadband
Rosemary Leffler SBC
5
NRIC V – October 30, 2001
Key Deliverables
I. Implement a voluntary one year trial with participation by Internet Service Providers, CMRS,
satellite, cable, and data networking service providers to alert National Communications System/National
Coordinating Center for Telecommunications (NCS/NCC) of outages that are likely to have significant
public impact.
Voluntary Trial Status
Recommendation to NRIC IV to proceed with trial predicated on FOIA exemption
• NRIC V Chairman sent letter to industry association representatives reinforcing commitment to
voluntary trial and explaining MOU (Memorandum of Understanding) signed by NCS/NCC and
FCC ensuring that proprietary information provided under the agreement is protected against
unauthorized use or disclosure
• Industry associations have reviewed the Chairman’s letter and the MOU with their members
Flowchart of reporting process and criteria for data scrubbing by NCS/NCC have been validated
and refined
• Trialed process
• Handed off data to Best Practices Team
Overarching trial goals and data analysis options have been documented by the team and
distributed to industry association representatives
6
NRIC V – October 30, 2001
Key Deliverables
I. Implement a voluntary one year trial with participation by Internet Service Providers, CMRS,
satellite, cable, and data networking service providers to alert National Communications System/National
Coordinating Center for Telecommunications (NCS/NCC) of outages that are likely to have significant
public impact.
Voluntary Trial Status
Progress has been made through the industry associations and outreach activities in identifying
trial participants and obtaining positive reports when no outages have occurred.
Outreach activities have been initiated to increase participation
• ATIS Teleconference Series (INFOSYNC) presentation
• Contact Campaign
Process work has been completed
7
NRIC V – October 30, 2001
Key Deliverables
I. Implement a voluntary one year trial with participation by Internet Service
Providers, CMRS, satellite, cable, and data networking service providers to alert National
Communications System/National Coordinating Center for Telecommunications (NCS/NCC)
of outages that are likely to have significant public impact.
Voluntary Trial Status
NCS/NCC has received five outage reports to date (one additional report was received under the
mandatory reporting process, per CFR 63.100, that is more appropriately reported under the
voluntary trial)
Limited participation remains an issue, however the amount of participation is increasing
Percent participation by industry segment is shown on the following chart
8
NRIC V – October 30, 2001
Key Deliverables
I. Implement a voluntary one year trial with participation by Internet Service
Providers, CMRS, satellite, cable, and data networking service providers to alert National
Communications System/National Coordinating Center for Telecommunications
(NCS/NCC) of outages that are likely to have significant public impact.
INDUSTRY SEGMENT PARTICIPATION
Satellite Telephony No participants
CMRS CMRS participants represents
approximately 43% of the market by
subscribers
Paging No participants
Cable Telephony All qualified NCTA members
participating (representing > 99% of the
market by subscribers)
ISPs ISP participants represent approximately
20% of the market by traffic volume
Data Networking Data Networking participants represent
approximately 40% of the market by
traffic volume
9
NRIC V – October 30, 2001
Key Deliverables
I. Implement a voluntary one year trial with participation by Internet Service
Providers, CMRS, satellite, cable, and data networking service providers to alert National
Communications System/National Coordinating Center for Telecommunications (NCS/NCC)
of outages that are likely to have significant public impact.
Voluntary Trial Status
Final report structure has been established, relevant points have been developed in
key sections, and outage report data will be analyzed.
The team is considering the following options for the final recommendation:
1. Extend the voluntary trial due to the time required to implement the reporting process in
participating companies
2. Termination of the trial on November 15, 2001 and report on trial processes and data analysis
3. Termination of the trial on November 15, 2001, report on trial processes/data analysis and gather
data through other forums. Many entities have been extensively involved in information sharing,
reliability issues, and security, post 9/11. It might be more appropriate for these forums to be the
focal point for this type of activity.
10
NRIC V – October 30, 2001
Key Deliverables
II. Evaluate outage-reporting requirements and guidelines currently
used by wireline carriers to improve the quality of outage reporting.
Revised Network Reliability Steering Committee Charter to Reflect intent to
“improve” reliability verses previous charter to “monitor”
Changed baseline for FCC Reportable Service Outages from first year to
cumulative going forward
Began conducting special analysis on detected trends (for example, single failure
affecting large geographic areas)
Began performing analysis on Emergency Services Outages
FCC working to implement 63.100 electronic filing and putting template into “user
friendly” format.
NRSC recommendations to improve outage reporting template are being
implemented
11
NRIC V – October 30, 2001
Key Deliverables
III. Evaluate and report on the reliability and availability of the PSTN
utilizing NRSC quarterly reports.
• Utilize NRSC to report data analysis from 63.100 process
• Outage results assembled and analyzed by Network Reliability Steering Committee
• Quarterly and annual results for overall outages and sub categories available on web site:
http://www.atis.org/atis/nrsc/nrschome.htm
• Will incorporate analytics from Voluntary Outage Reporting Trial for cable,
satellite, wireless, ISPs to extend Network Reliability Reporting based on the
Voluntary Trial Data Analysis Options
Work is progressing on the mechanized reporting process for mandatory outage reporting
Study group to review CCS outages and identify possible causes of the recent increase and
initiated an awareness program completed its analysis
2000 Annual Report complete
Special recognition of September 11 th reports
12
Reliability Reporting
NRSC – 2Q01 Results
FCC Reportable Service Outages
(by number of events)
65 Red
Yellow
Number of Outages
55 Green 52 52 55 52
48 47 48 47 48 48 47
45 46
44 44 44
45
38 42 42 43 43
40 41 40 41 38
40 35
35 34 38 39
35
28 29
25
15
1Q93
3Q93
1Q94
3Q94
1Q95
3Q95
1Q96
3Q96
1Q97
3Q97
1Q98
3Q98
1Q99
3Q99
1Q00
3Q00
1Q01
Quarter
Reliability Reporting
NRSC – 2Q01 Results
FCC Reportable Service Outages
(by outage index)
800
Red
700 675 Yellow
618
600 Green 622
553 510519
Outage Index
470
500 440 458
439 427
412 401 422 414 411 481
400 346 345
376 362
376 364
300 287301 331 246 326
300 223 286 305 299
249
200
100
0
93
93
94
94
95
95
96
96
97
97
98
98
99
99
00
00
01
1Q
3Q
1Q
3Q
1Q
3Q
1Q
3Q
1Q
3Q
1Q
3Q
1Q
3Q
1Q
3Q
1Q
Quarter
Reliability Reporting
NRSC – 2Q01 Results
Failure Category - Common Channel Signaling
(by number of events)
16
14
14 Red
Number of Outages
12 Yellow
10 9
Green
8 10 8 10 8 8
8 7 7 7 7 7
6 6
6
4 5 5 3 5 5 5 5
2 2 2 2 4 2 4 4 4
2 1 1 1
0
93
93
94
94
3Q 5
95
96
96
97
97
98
98
99
99
00
00
01
9
1Q
3Q
1Q
3Q
1Q
1Q
3Q
1Q
3Q
1Q
3Q
1Q
3Q
1Q
3Q
1Q
Quarter
Reliability Reporting
NRSC – Annual Control Chart
FCC Reportable Service Outages
(by number of events)
220
RED
YELLOW
200
Number of Outages
GREEN
185 184
181
180 174 176
169
160
160
157
140
120
1993 1994 1995 1996 1997 1998 1999 2000
Year
Reliability Reporting
NRSC – Annual Control Chart
FCC Reportable Service Outages
(by outage index)
2400
RED
2200
Aggregated Outage Index
YELLOW
2000 GREEN
1978
1800
1653 1628 1608
1600
1580 1566
1400
1330 1335
1200
1000
1993 1994 1995 1996 1997 1998 1999 2000
Year
Reliability Reporting
NRSC – Annual Control Chart
FCC Reportable Service Outages
Procedural Error Root Cause Category
(by number of events)
90
RED
80
YELLOW 75 76 76
Number of Outages
70 GREEN
63
60
56
47 49
50
44
40
30
1993 1994 1995 1996 1997 1998 1999 2000
Year
NRSC Significant Results
NRIC V – October 30, 2001
Through 2Q01
• Outage frequency overall was in the “Green” region. Within failure categories, all
outage frequencies were within the “Green” region.
• While the aggregated outage index overall was in the “Green” region, it is the third
highest ever (618), and the aggregated outage index for Procedural Error (349) is the
highest ever and in the “Red” region.
• The frequency of Facility outages (51) and Local Switch outages (17) over the last four
quarters were the lowest of any four consecutive quarters.
• The frequency of CCS outages (40) and CO Power outages (26) over the last four
quarters were the greatest of any four consecutive quarters.
19
NRSC Significant Results
NRIC V – October 30, 2001
Through 2Q01
Based upon analysis of all outages reported from 1Q93 through 2Q01, the NRSC notes:
• There is an increasing trend in the number of Tandem Switch, CO Power, CCS, and DCS
outages.
• There is an increasing trend in the frequency and aggregated outage index of
Procedural Errors as the root cause of outages.
• There is a decreasing trend in the number of Facility and Local Switch outages.
20
NRSC Significant Results
NRIC V – October 30, 2001
Through 2Q01
NRSC alert to the Industry
As noted above, CCS outages over the last four consecutive quarters
are the highest of any four consecutive quarters since the beginning
of the Baseline Period. In this regard, earlier this year, the NRSC
formed a study group to review CCS outages and to identify possible
causes of the recent increase. The findings of this group indicate that
these outages could have been prevented, or their impact mitigated,
had previously identified Best Practices been followed. These
findings further highlight the need to increase industry awareness of
CCS outages and application of Best Practices. These Best Practices
may be found at http://www.atis.org/pub/nrsc/fg3sc1final310.PDF.
21
NRIC V – October 30, 2001
September 11th Outages Reported to the FCC
• Nine initial reports
• Size of service providers covered wide range
• One report appears more appropriately reported
under the voluntary trial
• Demonstrates willingness of industry to share
appropriate information on impacts of this
significant event
22
NRIC V – October 30, 2001
Web-centric Business
BACK-UP
NRIC V – October 30, 2001
Voluntary Trial Process
Service Provider Subcommittee
NCS/NCC NRIC V
2.B 1
Handoff scrubbed
Outage Occurs NCS/NCC data required by
Logs Report 2.A1 and 2.A2
(Best Practices)
Initial Final
Scrub Data per
Determine if Criteria Established Does 2.B2 want
Outage Meets Vol. by 2.B1 to use data?
Trial Criteria
Initial Final
If no Local Root
Cause Aggregate
If yes Analysis And Analyze Scrubbed
Send Data Data:
•By Type/Segment
Create Initial Report •Impact
within 3 Days – •Frequency
Mark Company •Root cause for
Proprietary Commonality
Fax to NCS/NCC
On (703-607-4998) Provide status at
NRIC V Council Monitor Progress
meetings
Conduct
Root Cause
Analysis Determine
Concur or Provide
whether request to Make
Input on
share data should Recommendations
Identify Recommendations
be made
Best Practices
If no
Fax Final Report
If yes
with in 30 Days
Take No
Grant
If no Further
Permission
to Share Action Develop Final
Data? Report to Include File Final Report
If yes Share Scrubbed Recommendations
Data (i.e. NIPC)
• Service Provider – Companies who provide CMRS, Satellite, Cable Telephony, ISP and Data Services
• NCS/NCC (National Communication System/National Coordinating Center) - Joint industry-government
organization and mechanism by which the federal government and telecommunications industry respond
to national security and emergency preparedness (NS/EP) telecommunications service requirements.
• Subcommittee 2.B1 – A subcommittee of the NRIC V Network comprised of representatives of
industry associations, consultants, and providers for wireline and non-wireline services and equipment.
• NRIC V – A federal advisory committee that is chartered to evaluate and report on the reliability of 24
public telecomm network services in the US including the reliability of packet switched networks.
NRIC V – October 30, 2001 Template
NON-WIRELINE VOLUNTARY NETWORK OUTAGE
INITIAL REPORTING TEMPLATE
Box a: Reporting Carrier/Service Provider Box b: Contact Person
Box c: Telephone Number of Contact Person Box d: Start Date (mm/dd/yy of Incident)
Box e: Start Time of Impact (at outage location; 24-hour clock) Box f: Geographic Area Affected
Box g: Estimated Number of Customers Affected Box h: Types of Services Affected (if applicable)
Box i: Duration of Outage
Hrs. ____ Min. ____
Box j: Apparent or Know n Cause
Box k: Name of Equipment Involved [OPTIONAL FIELD] Box l: Type of Equipment Involved [OPTIONAL FIELD]
Box m: Specific Part of Netw ork Involved
Box n: Methods Used to Restore Service [OPTIONAL FIELD]
Box o: Steps Taken to Prevent Recurrence
25
NRIC V – October 30, 2001
Voluntary Trial Outage Report - Scrubbed Data Criteria
Agreement with Team – For Data Handoff
Final Report field Scrub Action
Delete and create outage tag
(Industry segment identifier, i.e.,
Reporting Carrier/Service Provider CMRS, Satellite,Cable Telephony,
Data Services, and ISPs, plus a
unique numerical identifier)
Contact Person Scrub Out
Start Date Unchanged
Start Time of Impact Unchanged
Geographic area affected Scrub Out
Estimated number of customers affected Unchanged
Types of Services Affected (if applicable) Unchanged
Duration of Outage (hours and minutes) Unchanged
Apparent or known cause Unchanged
Name of Equipment Involved [OPTIONAL] Scrub Out
Type of Equipment Involved [OPTIONAL] Scrub Out
Specific Part of Network Involved Unchanged
Methods Used to Restore Service [OPTIONAL] Unchanged
Steps Taken to Prevent Recurrence Unchanged
Root Cause and Trouble Found [OPTIONAL] Unchanged
Applicable Best Practice [OPTIONAL] Unchanged 26
NRIC V – October 30, 2001 Potential Analysis Options
Scrubbed Final Report field Sample Analysis Action Potential Product or Conclusion
Outage Tag Filter data by industry segment Comparison of outage frequencies by industry segment
in conjunction with other fields Identification of any industry segment-specific anomalies
Start Date Aggregate outages by unit time Outage frequency graphs by week, quarter, time, etc.
Date- or time-specific conclusions (e.g.,weekend vs
Start Time of Impact
weekday, holidays, rush hour outages)
Estimated number of customers affectedApply outage index Outage Index graphs (characterizing outage severity)
Identify new outage index Verification of /Additions to T1A1.2 outage index method
New industry segment-specific outage indices
Comparison of outage severity trends; recommendations on
appropriate thresholds for reporting by industry segment
Types of Services Affected (if applicable) Identify new services affected Recommendation on outage index weightings for new
within industry segments services
Duration of Outage (hours and minutes) Apply outage index Outage Index graphs (characterizing outage severity)
Identify new outage index Verification of /Additions to T1A1.2 outage index method
New industry segment-specific outage indices
Recommendations onappropriate thresholds for reporting
by industry segment
Apparent or known cause Identify existing and new causes Graphs focusing on key causes by industry segment
Aggregate outages by cause Recommendation of new causes to track/monitor/mitigate
Root Cause and Trouble Found [OPT] (e.g., DNS, cell site, head end, transponder)
Specific Part of Network Involved Aggregate outages by network Industry segment-specific graphs showing susceptible
part; Identify “new” parts network parts (e.g., access vs transport): Conclusions on
(e.g.,radio access segment) industry-wide “reliability” of network access, etc.
Methods Used to Restore Service [OPT] Identify existing/new methods New best practices/Validation of existing practices
Recommendations on restoral and prevention methods by
Steps Taken to Prevent Recurrence
industry segment.
Applicable Best Practice [OPTIONAL] Recommendations on “crossover” methods (i.e., practices 27
in one segment that may be of use in others)
NRIC V – October 30, 2001
Overarching Trial Goals
• Enable a general characterization of reported outages’ impact on the public
• Address effectiveness of trial
• Identify outage reporting similarities or differences across industry segments
• Show that industry has the initiative to gather “outage” information without government
involvement
• Identify what data should/should not be reported
• Provide an opinion on the “State of Reliability” of the examined networks
• Address next steps (e.g., continue/stop trial)
• Identify the Root Cause(s) (i.e., chain(s) of events that led to an outage) for Best Practices
review
• Allow Best Practices to be identified for entire industry benefit
• Allow unregulated voluntary outage reporting to assist national communications security
and awareness
• Enable carrier and vendor service improvement for all consumers
28
Related docs
