Get documents about "Power Consumption Data Volume Fiber Optic Network
Description
Power Consumption Data Volume Fiber Optic Network document sample
Document Sample
10G and Beyond in the Data
Center with OM3 Fiber
Doug Coleman, Manager Technology and
Standards
doug.coleman@corning.com
Overview
• Optical Trends in Data Center Networks
• The time is NOW for 10G optical connectivity
– 10GBASE-SR compared to 10GBASE-T
• A 10G Link Connectivity Comparison
• What’s next?
– Ethernet
– Fibre Channel
– Infiniband
• MTP Connectivity Solutions For Today and the Future
• Summary
Data Center Environment - Today
• Higher Speeds
• Higher Density
• Higher Reliability
• Lower CAPEX
• Lower OPEX
Optical Trends in Data Center Networks
Standards have evolved to meet increasing bandwidth requirements with cost-effective solutions
Standards Roadmap
10Gb/s required new OM3 fiber specifications and measurement methods
100000 40/100G
Below 10 Gb/s, application standards IEEE
used then-current multimode fibers 20/40G
to design network solutions… InfiniBand
10000 10G 8G
FC
10 GbE
2G Sonet/SDH
4G
1000 1G FC InfiniBand
FC
GbE
Data Fiber
rate Channel We expect next
(mb/s) 100
100M
Fast Ethernet step in data rates
ATM to primarily use
10 10M current fiber
Ethernet
Token Ring LEDs Lasers specifications
FDDI
1
1985 1995 1999 2002 2005 2010
Optical Trends in Data Center Networks
• MultimodeFiber Nomenclature
• TIA-568 Rev C adoption
Optical Trends in Data Center Networks (=< 300m)
Expect lower-cost solutions in data center networks will remain at 850 nm
• 850 nm VCSELs have won the 1G 3.5 10G Transceivers
premises market 3.0 850 nm optics
1300 nm optics
• 850 nm 10G VCSELs just entering
2.5
high-volume manufacturing cycle
Relative Cost
– Will continue to be low-cost 2.0
solution for 10G 1.5
• 1300 nm solutions will capture 1.0
some market share in premises
with legacy systems 0.5
(10GBASE-LX4 and10GBASE-LRM) 0.0
2004 2005 2006 2007 2008 2009
Optical Trends in Data Center Networks
80%
70%
60%
50% OM3
40% OM2
30% OM1
SMF
20%
10%
0%
2004 2005 2006 2007
Source: CCS
Optical Trends in Data Center Networks
Laser-Optimized 50 Micron Fiber (OM3)
• Core Size: 50 Micron
• Attenuation: 3.0/1.5 dB/km @ 850/1300 nm
• Bandwidth:
– OFL 1500/500 MHz•km @ 850/1300 nm
– EMBc 2000 MHz•km @ 850 nm
• Distance:
– Gigabit Ethernet 1000/600 meters @ 850/1300 nm
– Serial 10 Gigabit Ethernet: 300 meters @ 850 nm
– CWDM 10 Gigabit Ethernet: 300 meters @ 1300 nm
The Time Is NOW for 10G Optical Connectivity
10 Gigabit Ethernet
• 10GBASE-S
– Multimode fiber, serial transmission at 850 nm
– Lowest cost for new installs (=<300/550 m)
– Data centers and building/campus backbones
• 10GBASE-LX4
– Multimode or single-mode fiber, WWDM transmission in the
1300 nm region (300 m)
– Multimode fiber solution intended for legacy systems
• 10GBASE-L
– Single-mode fiber, serial transmission at 1300 nm (10 km)
– Campus backbones
• 10GBASE-E
– Single-mode fiber, serial transmission at 1550 nm (30-40 km)
– Metro area networks
The Time Is NOW for 10G Optical Connectivity
10 Gigabit Ethernet
• 10GBASE-CX4
– Twin axial coax cable (15m)
• 10GBASE-LRM
– Multimode fiber, EDC, FDDI fiber, 1300 nm, 220 m
– Multimode fiber solution intended for legacy systems
The Time Is NOW for 10G Optical Connectivity !!!!!
• 10GBASE-S optical connectivity is the choice solution when
compared to 10GBASE-T copper connectivity
– Premier transmission performance
– Data rate scalability
– Pathway and space utilization
– Electronics port density, power and cooling efficiencies
– Ease of installation and testing
The Time Is NOW for 10G Optical Connectivity !!!!!
Copper Cable Raw Material Costs Increasing
• Raw Materials
– Copper $ 3.86/lb (3/31/08)
– Hydrocarbon base plastic Copper $$$/pound
raw materials Copper $$$/pound
– $100+ per barrel of oil
• Drives higher copper
connectivity cable $$$$
• Optical fiber cable prices
trending down
4 day average 9 day average 18 day average
The Time Is NOW for 10G Optical Connectivity !!!!!
Lower the total cost of network ownership
• Fiber optic cabling is less
expensive to operate
10 Gb/s Operating Cost
– Less power Fiber v. Copper
consumption
Fiber Copper
– Decreased cooling ~1-4 W ~8-15W
Power Consumption
requirements
– Smaller transceiver size Cooling Requirements
– Higher electronic port
densities Transceiver Size
Some estimates blame up to Data Center Area
$ $$$$
60% of all data center downtime
on heat-related issues
-- IDC
The Time Is NOW for 10G Optical Connectivity !!!!!
Bandwidth headroom for what’s now and what’s next
Design & Installation Complexity versus Bandwidth • Copper cabling
– Increasingly complex
p per engineering and
Co
installation to keep up
with bandwidth
demands
Complexity
Fi b
Cost and
er
O pti
cs • Fiber optic cabling is
trending the other way
Bandwidth Demand and Time – Becoming easier and
easier to install while
effortlessly keeping up
with bandwidth demand
The Time Is NOW for 10G Optical Connectivity
10GBASE-T Transmission Issues
• Operates across 500 MHz frequency spectrum
– Increased insertion loss
• Extensive data encoding and signal processing required to
achieve acceptable BER 10-12
• Complex electronic digital signal processing (DSP) for
internal noise impairments
– Contributes significantly to inherent time delay known as
latency
– External noise such as alien cross-talk and EMI cannot be
corrected with electronics due to random nature
The Time Is NOW for 10G Optical Connectivity
10GBASE-T Transmission Issues
• 10G optical has 1000 times better latency performance than
copper
– Typical 10G optical physical (PHY) latency in the nanosecond
range (10-9 sec.)
– Typical10G copper PHY latency in microseconds (10-6 sec.)
• “A one-millisecond advantage in trading applications can be worth
$100 million a year to a major brokerage firm,” Information Week, April
2007
Copper’s Road LATENCY!!!
Fiber’s Road
The Time Is NOW for 10G Optical Connectivity
10GBASE-T Electronics Issues
• Significant switch power requirements
– 10G copper 10-15 watts per port
• Major silicon chip development
required to reduce power
– Expect 3-4 watts to be lowest
achievable power level per port
independent of distance
– 10G optical switches 1-4 watts per
port
• Significant server adapter card power
requirements
– 10G copper 25 watts per server
adapter card
• 30m service distance
– 10GBASE-SR optical <9 watts per
server adapter card
• 300m service distance
The Time Is NOW for 10G Optical Connectivity
10GBASE-T Power Requirements
• High power requirements Total Electronics and Cooling Energy Cost and
result in higher generated Savings Comparison for 10GBASE-SR and 10GBASE-T
heat, contributing to higher $80,000 87%
86%
cooling needs $70,000 84%
84%
85%
85%
– EPA states that for $60,000 82% 83%
Yearly Energy Cost
every KW of
Energy Savings
81%
$50,000
electronics power, an 79%
$40,000
equal unit of power is 76% 77%
required for cooling $30,000
75%
$20,000
• Higher power 73%
requirements result in $10,000 71%
higher CO2 emissions $0 69%
48 96 144 192 240 288
– 1.6 lbs CO2 per KW-Hr Port Count
• The result is significantly Copper Switch Fiber Switch % Energy Reduction
higher energy costs –
operation and cooling -- OPTICAL CONNECTIVITY
with 10GBASE-T
electronics Enables
The Green Data Center !!!
The Time Is NOW for 10G Optical Connectivity
10GBASE-T Reduced Switch Port Density
• Projected 4-8 ports per 10G copper card
– Maximum 100m distance
– Low density drives need for more line cards and chassis, driving up
power and space utilization
• 10G optical switch density
– X2: 16 ports, XFP: 36 ports, SFP+ 48 ports per line card
– 10GBASE-SR 300m distance
One Fiber Line Card = 48 Ports Six Copper Line Cards = 48 Ports
The Time Is NOW for 10G Optical Connectivity
Emerging Optical Electronics
• 10G Transceiver Trends
– Move signal processing from
module to the line card
– Reduce module size
– Reduce power
– Reduce price
Source: Intel
Source: CMP Media
XFP
XENPAK & X2 SFP+
The Time Is NOW for 10G Optical Connectivity
10GBASE-T Pathway and Space Issues
• Larger cable OD and heavier
– 1 CAT6A UTP -- 0.354 inch
diameter and 46 lbs/1000ft weight
– A 216-fiber ribbon cable, 0.76
inch OD, 200 lbs/1000ft
• 108 circuits at 200ft
– 108 CAT6A cables, 1000lbs,
typical effective diameter 5.0 inch
– 216-fiber optical cable, 40 lbs,
effective diameter 0.76 inch
Let’s Build a Link!
Scenario: CAT6A UTP Copper and 10G Electronics
Scenario: 108 10G Copper Ports
• This will require 6U of rack space per
rack dedicated to patch panels…
• 14 copper 10G line cards per rack, with a
maximum port line card density of 8…
• Next, 108 jumpers per rack…
• And finally, 108 CAT6A UTP cables to
connect it all (at 200 ft, that’s 1000 lbs!)
Cross-section of 12”x4” cable tray
(to scale) – 40% filled
Now a 10G Optical Link!
Scenario: OM3 Fiber and 10G Electronics
Scenario: 108 10G Optical Ports
• This will require 1U of rack space per
rack dedicated to patch panels…
• 3 optical 10G line cards per rack with a
maximum port line card density of 48…
• Next, 18 MTP®-to-single-fiber
connector harnesses per rack…
• And finally, 1 216-fiber cable to
connect it all (at 200 ft, that’s 40 lbs!)
Cross section of 12”x4” cable tray
(to scale) – 2% filled
Let’s Compare:
10G Copper UTP Network v. 10G Optical Network
• CAT6A UTP 10G Network • OM3 10G Network
– Electronics operating power – Electronics operating power
• 96,500 kw-hr per year • 20,100 kw-hr per year
• $14,184 per year / rack • $2,950 per year / rack
– Electronics cooling power – Electronics cooling power
• 96,500 kw-hr per year • 20,100 kw-hr per year
• $14,184 per year / rack • $2,950 per year / rack
– Total power cost – Total power cost
• $28,369 per year / rack • $5,910 per year / rack
– Total CO2 emissions – Total CO2 emissions
• 155 tons • 32 tons
79% overall energy savings!
Ethernet – What’s Next?
• IEEE 802.3 HSSG Approved Motions
– 40 and 100 Gbps
– At least 100 m on OM3 multimode fiber
– At least 10 km on single-mode fiber
– At least 40 km on single-mode fiber (100G only)
– At least 10 m on copper cable assembly
• Key project dates
– Study group formed in July 2006
– Project authorization in December 2007
– Task force formed in January 2008
– 100G standard complete mid 2010
Ethernet – What’s Next?
• Recent history suggests that 700
Ethernet and LAN Port Sales (MM units)
standards (and initial fiber 1Gb/s 100Gb/s
600 Standard Standard
sales) will lead actual port 10Mb/s 100Mb/s 10Gb/s
500
sales by ~3 years Standard Standard Standard
'100Gbps'
10Gbps
• Given port sale historical 400
1Gbps
trends, we can project initial 300 100Mbps
10Mbps
applications ~2011 200
– Most applications not 100
expected until >2013
0
85
88
91
94
97
00
03
06
09
12
15
19
19
19
19
19
20
20
20
20
20
20
Year
10Mb-10Gb data from Dell’Oro
Premises Cable Market – Length Distribution of Cable
Supplied to Customers
100 100%
Cumulative Frequency
80 80%
Relative Frequency
60 60%
40 40%
20 20%
0 0%
0 50 100 150 200 250
Cable Length(m)
Length Distribution Cumulative Frequency
Ethernet – What’s Next?
• Several possible optical solutions are all currently
being discussed in IEEE
– Parallel MTP Optical Connectivity
– CWDM
– DSP
– Hybrid
40G Ethernet Parallel Optics
12F MTP
Interface
QSFP 40G Optical Transceiver
• Uses standard ribbon fiber
cable with MTP® Connector
Source: Zarlink
100G Ethernet Parallel Optics
24F MTP
Or
Two 12F MTP
Interface
Source: Sumitomo
Fiber Skew
Certain optical cables and terminations Skew = difference in propagation time between
may not be suitable for parallel optics lanes of a parallel transmission system.
applications
IEEE 40/100G skew requirement not defined
to date.
InfiniBand QDR 0.75ns skew requirement Δ propagation speed or distance
now exists
CCS has performed skew testing
demonstration compliance to 0.75 ns up to
300m
Infiniband Skew Requirements:
Need to understand skew capability
today for existing and future cable
deployments
SAN Fibre Channel Road Map
T11 Spec Market
Product Throughput Line Rate Technically
Completed
Availability
Naming (MBps) (GBaud)†
(Year)‡ (Year)‡
1GFC 200 1.0625 1996 1997
Base2
2GFC 400 2.125 2000 2001
4GFC 800 4.25 2003 2005
8GFC 1600 8.5 2006 2008
16GFC 3200 17 2009 2011
32GFC 6400 34 2012 Market Demand
64GFC 12800 68 2016 Market Demand
Parallel Optics
128GFC 25600 136 2020 Market Demand
SAN Fibre Channel Road Map
T11 Spec Market
Product Throughput Line Rate Technically
Completed
Availability
Naming (MBps) (GBaud)†
(Year)‡ (Year)‡
Base10 10GFC 2400 10.52 2003 2004
20GFC 4800 21.04 2007 2008
40GFC 9600 42.08 TBD Market Demand
80GFC 19200 84.16 TBD Market Demand
Parallel Optics 160GFC 38400 168.32 TBD Market Demand
Fiber Channel over Ethernet (FCoE)
• Activity initiated at T11 Fiber
Channel, April 2007
• Encapsulate Fiber Channel Packet
into a Ethernet Frame
– Lossless Packet Performance
• Supports utilization of low cost
Ethernet electronics up to the SAN
switch
– FCoE Server Adapter Card
– FCoE Gateway Line Card
• Designed to operate at 10G
• Large data centers focus
• Standard completion mid-2008
• Commercial products 2009
InfiniBand
• Applications
– HPC Supercomputers
– Financial data center focus
• Electronic trading and algorithm
modeling
– High BW with low latency
• Media Types
– Optical fiber
• Multimode and single-mode fiber
• MTP Connectivity
• Twin axial copper cable
– Factory-terminated only
– 15-20m distance capability
• Not adequate for structured wiring
InfiniBand Architecture: Server Area Network (HPC)
InfiniBand Data Rates
Parallel Optics !!!
InfiniBand Electronics
Optical Media Converter
• Copper to optical media converter (OMC)
– Converts a power-enabled InfiniBand copper
port to an optical port
– Uses standard ribbon fiber cable with MTP®
Connector
– Data rate specific (4X-SDR,DDR) Emcore OMC
– Perfect match to fixed-port CX4 socket
• Active optical cable (Zarlink, Intel)
– Integrated media converter
• Specified distances (10, 25, 50 … 100 m)
– Data rate specific (4X-SDR,DDR)
Zarlink
– Perfect match to fixed-port CX4 socket
QSFP Optical Transceiver 2008
• Hot pluggable
• 12 Fiber MTP Interface
• Data rate specific
(4X SDR, DDR, QDR
(10G, 20G, 40G))
• Zarlink, Luxtera, QLOGIC
and other manufacturers
Source: Zarlink
MTP Connectivity Solutions in the Data Center
Server Racks
Server
Main Distribution Area
(MDA)
Server Ports
Storage
Switch Ports
Switch Racks
Storage Ports
Ribbon Cable
• High-density ribbon design in a
small-form-factor package
• 12-fiber ribbons
• Data center and LAN backbones
• MTP connectivity
– 12 fibers connectorized
simultaneously
• Riser and plenum flame ratings
• Interlocking armor
96-Fiber Cable with eight MTP Connectors
MTP Connectorization
• Factory or field termination
– Terminate 12 fibers in one step
with MTP connectors
• Expedites cable installation and
MACs
• Minimizes errors
• Reduces congestion in patch
panels
• Footprint similar to SC Connector
Ribbon Cable Field Termination
No-Epoxy/No-Polish Connector
• TIA/EIA 604-5 (FOCIS)
• Installs in less than
4 minutes
• Fiber type
– OM1 62.5/125 µm
(beige housing)
– OM2 50/125 µm
(black housing)
– OM3 LOMMF
(aqua housing)
– SMF OS2
(green housing)
MTP Connector Modules
• Used to break out the 12-fiber MTP
connectors terminated on trunk cables
into simplex or duplex style connectors
– SC, LC, ST compatible …
• MDA cross-connect and EDA
interconnect
• Support easy migration to parallel optics
Main Distribution Area Housing
Back Panel
PnP training4
Main Distribution Area Housing
Front Panel
LAN490
MTP Connector Harnesses
• Hardware interconnection to
backbone cable
• Break out 12-fiber MTP
connector into simplex or
duplex connectors
• Transitions plug & play system
MTP connector trunks straight
into electronics
• Support easy migration to
parallel optics
MTP Connector Harness SAN Director Termination
The Time Is NOW for Optical Connectivity
• Silicon and electronic industry focused on optical solutions
• 10GBASE-SR OM3 fiber optical connectivity is the choice
solution when compared to 10GBASE-T copper connectivity
• OM3 fiber supports migration to established Fibre Channel,
Ethernet, and InfiniBand roadmap high data rates
• MTP Connectivity Solutions available today for legacy serial
and future parallel optics transmission schemes
– 1G, 10G, 16G… 40G… 100G
Contact Info
• Doug Coleman
• E-mail: doug.coleman@corning.com
• Phone: 828-901-5580
• Fax: 828-901-5488
• Address: 800 17th Street NW Hickory, NC 28601
Related docs
Other docs by veg21665
