Enterprise Consolidation x64 Servers and Solaris 10
Bob Netherton Solaris Adoption Sun Microsystems, Inc. http://blogs.sun.com/bobn
Page 1
1
Agenda:
• Why x64 ? • Sun and AMD • New x64 rack mount servers • Solaris 10 • Questions ?
Page 2
What do you look for in a consolidation platform ?
• Flexibility
> Must run many applications (and Operating Systems)
• Reliability
> Platform outages have larger impact
• Efficiency
> Find the sweet spot in the price/performance curve > Power and cooling impact > Rack efficiency
Page 3
Why We're Here
To show you a better alternative for industry standard computing: Sun x64
Page 4
Why Sun Makes x64 Products
5 Years Ago 2–3 Years Ago
NOW CIOs Discover Reality
• Real estate, power, and cooling costs • Management complexity • Server reliability • Limited scalability • Administration
32-bit “Wintel” Servers
Low Cost Linux Promise Migration of Mission Critical Apps to x86 Systems
Sun’s x64 Systems Solve These Problems
Page 5
Sun and AMD Collaboration
● ● ● ●
Optimizing Solaris, Linux and the Sun Java™ platforms for AMD Opteron processors Scalability above 4-way AMD Opteron processors Coherent HyperTransport technology implementations Creating an industry ecosystem for ISV and IHV support
TOGETHER, DELIVERING A WORLD-CLASS PORTFOLIO OF PRODUCTS
Page 6
CPU Architecture Matters
IA32, IA64, and EM64T
CPU CPU CPU CPU CPU CPU
Northbridge Northbridge Southbridge
● ● ●
CPU
CPU
PCI/E PCI/E Bridge Bridge
● ● ●
●
4 CPU architectures 11 Chipset architectures No CPU has integrated memory controller All CPUs share the FSB performance bottleneck
●
1 CPU architecture 1 Chipset architecture CPU has integrated memory controller Glue-less multiprocessor without FSB bottleneck
Page 7
Dual-Core AMD Opteron vs. Xeon MP
+
OPTERON XEON
Single-Core Dual-Core
2.8 GHz 2.4 GHz
3.6 GHz 2.8 GHz
•The performance drop for Dual-Core is more substantial with Xeon than with Opteron •Dual-Core Xeon still suffers from FSB bottleneck and off-chip memory controller •Dual-Core Xeon scales poorly: About 20-40% improvement compared to Single-Core
Page 8
Dual-Core AMD Opteron vs. Xeon MP
+
OPTERON XEON
Processor Cores Power
2 CPU Cores 95W/120W
2 CPU Cores 240W
It takes up to 60% less power to drive one Dual-Core AMD processor than the two Intel Xeon MP processors required to provide the same amount of CPU core resources. To obtain a total of 2 CPU cores worth of processing it will require up to 2.5 times more power to drive the two Intel XEON MP processors than the one Dual-Core AMD processor.
Page 9
Sun's Design, Industry's Standard for the Modern Enterprise
Sun Fire x64
Modernize Your Data Center: Optimized Technology Integration with No Legacy Constraints
Page 10
Innovative Sun Design
• 100% industry standard
> Run Solaris, Linux, and Windows OSs > Strong partnerships with AMD, Microsoft
• Sun designed components working together
> Servers > Application switches > Software
• Backed by Sun's proven expertise in deploying distributed, grid environments
Investment protection Cost savings
Page 11
What Sun Fire x64 Brings
Sun's Design, Industry's Standard
Lower Power and Cooling Costs
Enterprise-Class Features
Advanced Remote Management
Sun Fire x64 is the industry’s premier x64 enterprise server family.
Flexible Choice of Multiple OSes
Fastest Products in their Class
Page 12
Complete, Scalable Product Line
New Rack Servers
Future Galaxy Systems 16 way Sun Fire x2100 Sun Fire x4100 Sun Fire x4200
X64 Rack Servers
V20z Single/Dual Core
V40z Single/Dual Core
X64 Workstations
W1100z W2100z Sun Ultra 20 Workstation
TM
Sun Secure Application Switches
Page 13
N1000
N2100
Sun Fire x64 Server Family
Sun Fire X2100: 1U, 1S, 4 DIMM, 4GB, 1 PCI-E slot, 2disks Sun Fire X4100: 1U, 2S, 8 DIMM, 16GB, 2 PCI-X slots, 2/4 disks Sun Fire X4200: 2U, 2S, 8 DIMM, 16GB, 5 PCI-X slots, 4 disks
Page 14
Innovative Sun Design
4 DIMM slots per socket for maximum performance Highest performance single and dual core Opteron processors Integrated management with remote console, KVM included as standard
Redundant, hot-plug fans under front access panel for feasible in-rack servicing
Fault light diagnostics guide you to failed component
Large opening for good airflow and air divider for separate cooling zones
Page 15
Hot-plug SAS disks RAID controller
Scale Computing, Not Complexity
• Sun's clean slate design runs industry standard applications
> Solaris, Linux, and Windows
• Management architecture designed first • Common design for entire system • Remote automation • Complete secure zero touch remote management
Page 16
ILOM – Integrated Lights Out Manager
Service Processor Technology for Sun Fire X Servers
• Lights Out Management for Sun Fire x64 servers • Provides full local or remote access for setup, maintenance and on-going monitoring/management of a single system • Full remote KVM functionality
> Including remote media support
• Browser-based UI and full CLI • Access via Management Ethernet port, Serial port or Host OS (with suitable driver) • Standards supported include LDAP, SSH 2.0, SNMP v1, v2c, v3, IMPI 2.0, DMTF 'SMASH' CLI
Page 17
Best Performance
Quite simply, the fastest on Earth 45 World Records
Page 18
SPECint_Rate
80 75 70 65 60 55 50 45 40 35 30 25 20
SPEC FP_Rate
90
76.7
87.1
72.7
85 80 75 70 65 60 55 50 45 40 35 30 25 20
56.4
52.6 34.4
Opteron Xeon-MP Xeon-MP 2.6GHz 3.33 GHz 3.6 GHz 1MB$ 8MB$ 1MB$ Potomac Cranford
Simply The Fastest
Over 35 performance records on Sun Fire x64 systems
Opteron 2.6GHz 1MB$
Xeon-MP Xeon-MP 3.33 GHz 3.6 GHz 1MB$ 8MB$ Cranford Potomac
SPEC Int_Rate 4 Processor
140 130 120 110 100 90 80 70 60 50 40 30
SPEC FP_Rate 4 Processor
140 130 120 110 100 90 80 70 60 50 40 30
132
138
76.7
72.7 56.4
87.1 52.6 34.4
AMD 8C 2.2GHz 1MB$ AMD 4C 2.6GHz 1MB$ Xeon-MP 4C 8MB$ Potomac Xeon-MP 4C 1MB$ Cranford
AMD 8C 2.2GHz 1MB$
AMD 4C 2.6GHz 1MB$
Page 19
Xeon 4C 3.3GHz 8MB$ Potomac
Xeon 4C 3.6GHz 1MB$ Cranford
Sun's x64 Momentum...
22% Average Enterprise Customer Growth/Quarter
Cumulative x86-64 Customers x86-64 Customers Billed/Quarter
1,194 385
Q104
62% Repeat Business
Repeat Customers
1,453
1,635
1,936
Repeat Customers New Customers New Customers
694 564
834 627
541
599
737
985
385
397
342
Q204
Q304
Q404
Q105
Q205
Q305
Q405
Q104
Q204
Q304
Q404
Q105
Q205
Q305
Q405
Based on Sun Fiscal Calendar, July –June
Page 20
Operating Systems
Sun Fire X2100, X4100, X4200
Sun Qualified and Supported
Solaris 10 RHEL 3.0, 4.0 SLES 9
Sun Qualified but Supported by Partners
Windows Server 2003 32 and 64-bit
Page 21
Sun Grid Rack System
Updated for Sun Fire X Series and N1400 • Easy-to-use web configurator
> Sample Configurations for industry
applications
• New server nodes
> Sun Fire x64 server family > Solaris™, or Linux
• Infrastructure:
> Interconnect: 3rd Party (Cisco and others) > Software : N1™ System Manager, N1 Grid
Engine > Web Services option: N1400 switches, N1 Service Provisioning System, Java Enterprise System
Page 22
http://sun.com/servers/sungridracksystem/configtool
Total Annual Cost* Per Year/1,000 CPU Core Compute Farm when Considering Total Power Consumption & HVAC
$156,000
Sun Fire X4100 Servers Annual Savings of $204,800 per 1,000 CPU core worth of x4100 servers!
Dell PE2850 Servers
$360,800
106.3 kW/1,000 CPU Cores Total (8 Racks, 250 x4100 Servers)
243.8 kW/1,000 CPU Cores Total (16 Racks, 500 Dell PE1850 Servers)
* Based on World Wide average cost of 13 cents per kWhr. Assuming a typical .3xPower Cost, HVAC cost is required to remove the heat generated by these systems.
Page 23
Savings Is In The System
$1,083,900
Sun Java Web Infrastructure Suite: App, Web, Directory, Developer Tools and More! Solaris 10 OS and Three-Year Premium Support
Power and Cooling Costs Remote KVM KVM Management Management Infrastructure Sun Java Web Standard Suite: App, Web, Directory, Developer Tools and More! 4 GBE ports Standard Solaris 10 OS and Three-Year Premium Support 100 Sun Sun Fire X2: 2x252, 4GB 16 x Fire X4200 Servers Memory, 1x73GB disk, 2PSU, DVD, 4GBE, Remote Management
Source: Current estimated pricing on Sun components Page 24
$0
Page 25
Solaris Investment Protection
Guaranteed Binary Compatibility for 7 Years
Solaris 2.6 to Solaris 10
http://www.sun.com/software/solaris/programs/binary_guarantee.xml
Page 26
Solaris 10 License Growth
Thousands
2750 2500 2250 2000 1750 1500 1250 1000 750 500 250 0
x64, x86
3/05
Page 27
4/05
5/05
6/05
7/05
8/05
9/05
ISVs Offering Solaris 10 Support
1100 1000 900 800 700 600 500 400 300 200 100
0
9/04
Page 28
11/04
1/05
3/05
5/05
7/05
9/05
OS Flexibility and Innovation
INTEROPERABILITY, SUPPORT
+
Page 29
Hundreds of Systems
Page 30
Thousands of ISVs and Partners
Page 31
Solaris Containers
Limitless partitioning – One license Thousands of applications on one system Fault & Security Isolation Instant restart Accelerate Consolidation Multi-core aware
Page 32
Solaris Containers
• Run multiple applications on one system
> Improve utilization
Network
by up to 4x
129.30.9.1
10.6.40.5
10.6.40.6
• Isolate applications from:
> Faults > Intrusion > Resource contention
group.dba
oracl1 192.9.9.4
oracl2 76.32.129.155 users
Java AS
System/Domain
Independent Users Separate Networks Independent Storage Isolated Containers
• No performance impact
Page 33
Disk Storage and File Systems
Solaris Containers: Scenarios
• “Shrink wrap” applications
> Fault, security, resource isolation > Customize environments > Run mutually hostile applications on same system
• SOA mobility
> Predefine environment (node name, addr, users...) > Stop app on server “A,” restart on server “B”
• Safe, rapid, duplicatable prototyping • Resource allocation—and chargeback
Page 34
Extreme Observability
DTrace is designed for use on production systems Problems solved in minutes not days Instrument every line in every application Massive performance opportunities No code changes required
Page 35
Scenario: System calls
• Use quantize() on read()/write(). Look for 1-byte I/O's
# dtrace value 0 1 2 4 8 16 32 64 128 256 512 1024 2048 4096 8192 16384 -n 'syscall::write:entry {@ = quantize(arg2)}' ------------- Distribution ------------- count | 0 |@ 48 | 1 |@ 26 |@ 43 |@@@ 115 |@@ 82 | 13 | 7 |@@ 73 | 5 | 16 | 7 | 0 |@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ 1280 | 0
# dtrace -n 'syscall::write:entry /arg2 == 1/ {trace(execname);ustack()}' 0 13 write:entry gnome-terminal libc.so.1`_write+0x15 libvte.so.4.4.0`vte_terminal_io_write+0x73 libglib-2.0.so.0.400.1`g_source_callback_funcs libvte.so.4.4.0`vte_terminal_io_write
Page 36
DTrace in Action in Production by Humans
+267% in 2 Days
+300% in 5 Hours
+32% Before Lunch
Financial Database
+35% in an Afternoon
Online Parcel Tracking System
+80% in a Day
Futures Forecasting Application
Message Handing Benchmark
Data Routing Application
PageSource: Sun Microsystems, Inc. 37
Predictive Self-Healing
Stops problems before they happen Self-diagnosis in milliseconds Fine-grained recovery Zero source code changes required Solaris Fault Manager
Page 38
Before Solaris 10
[AFT0] errID 0x0000004d.23105c04 Corrected Memory Error on U1004 is Intermittent [AFT0] errID 0x0000004d.23105c04 ECC Data Bit 14 was in error and corrected WARNING:/io-unit@fe0200000/sbi@0,0/dma@0,81000/ esp@0,8000000 (esp0): Connected command timeout for Target 0.0 NOTICE: correctable error detected by pci0 (upa mid 1f) during DVMA read transaction AFSR=40f40000.1f800000 AFAR=00000000.a25b4000 ...
SYNC┼°└┼┌▒┌┤┤├┼┴┴┤┬┼┌▒├┤┬▒°° ° ┌┌├├±│├≤▒┼┐┼├┼┤±° ±┼┼▒ ├ └└▒┼ ┌├ EOF C ┌┌├ 1┌ ┴ ≤┼ ┴ ° CL ┐┼ └▒┌ ┌ ┼ ± ┴└┴├┤┌┐└▒┐▒└├┬┼├└├≤±┴┼┴├┬▒┼┼├▒├┤┼├▒┌U├└°±TTY ° ┌┌├┴└▒│┤├┌▒├└├┤┐┼┴┬S┼°±±°64 ° ▒┌├├≤┼├┼┤┌┌≤┴┼▒└└C└≤├┤▒┴≤┼┬┐┼▒┴├└│├1 ┌└▒┐┤├┴▒├±┴└▒┤┬┼┬┴┌┼RP▒├┴┼┤┌°±°°° ±├├┼├┌▒├┌▒│┤├┌▒┐┼└├┤SR┼°├┐±≤├├▒
° └
┌▒ ├ ▒ ┬▒ ├
┌├┴┼┼ 0▒┼┼┤├┤├│├└├▒├┼°└▒├│├├▒┌├┤┴┌┌┼┼≥°├▒┌└▒└▒┌┌┌┤±±±..1SUNW 0.7..1SUNW 1.1SUNW┴▒├┌ 1.1┼┌≤±├┌..1 ..1..1SUNW 1.19 (= ^.end-core
Page 39
With Solaris 10
Systems and Applications Keep Running
SUNW-MSG-ID:SUN4U-8000-AC,TYPE:Fault,VER:1,SEVERITY:Major EVENT-TIME:Tue Mar 15 17:17:42 PST 2005 PLATFORM:SUNW,Sun-Fire-V240,CSN:-,HOSTNAME:blingtop SOURCE:cpumem-diagnosis,REV:1.0 EVENT-ID:16c1f33a-fa77-0b6-9eff-938f0c25a02 DESC:The number of errors associated with this CPU has exceeded acceptable levels. Refer to http://sun.com/msg/SUN4U-8000-AC for more information. AUTO-RESPONSE:An attempt will be made to remove the affected CPU from service. IMPACT:Performance of this system may be affected. REC-ACTION:Schedule a repair procedure to replace the affected CPU. Use fmdump-v -u to identify the CPU.
Page 40
Solaris Fault Manager
• Automated error handling
> > > > >
Detect errors Aggregate errors, root-cause to fault(s) Diagnose faults Report faults Mitigate faults
> Take failing or suspect CPU / cores, memory, or I/O components offline > Migrate load to remaining, known-good components
Page 41
Solaris 10 Security
Digital Certificates Everywhere Secure Execution User Rights Management Process Rights Management Cryptographic Infrastructure IPFilter Solaris Trusted Extensions
Page 42
Solaris 10 Optimized for Opteron
• Performance
> Platform specific optimizations > MPO, threading libraries, 20 years of MP-tuning > Near-linear scalability > DTrace for massive performance opportunities
• Consolidation
> Limitless partitioning with one license
• Multi-Core Support
> Tools, Predictive Self-Healing, Scheduler
• Compatibility Guaranteed
Page 43
sun.com/solaris/news
In the Press...
“Sun's Linux Killer Shows Promise”
Page 44
sun.com/solaris/news
In The Press...
“Now, Something Completely Different”
“Solaris 10 is a very high performance operating system, and because it's based on the Unix System V kernel, it's proven and rock solid. And while it pains me to say this, Solaris 10 is far more scalable than the current Linux 2.6 kernel.” Jason Perlow risked his karma for this column.
Page 45
Internal Application Migration
Between platforms
Guaranteed Source Compatibility
Page 46
SPARC to x86/AMD64 x86/AMD64 to SPARC
Systems & Availability Management
Solutions for Galaxy, Amazon+ and Niagara with Solaris 10
Sun N1 System Manager 1.1
Advanced System Management for Solaris 10 and heterogeneous platforms
TM
Sun Cluster 3.1 8/05
Solaris 10 support SPARC & x64, Solaris 10 container support
SunMC 3.6
In depth monitoring for new SPARC HW and advanced Solaris 10 features
Sun Cluster Geo Edition
Disaster Recovery across multiple Sun Clusters
Page 47
This is cool, so how do I get started ???
Page 48
What can you do ?
• Download Solaris 10 – it's free!!!
> Have a spare system, set up a dual boot environment > Use Live Upgrade to preserve customizations > http://sun.com/solaris
• If you want to see where this may be going
> > > > > > >
Page 49
Download Software Express for Solaris It's free too! http://sun.com/softwareexpress See the new Solaris boot environment Lots of new DTrace probes ZFS soon! One step to convert to OpenSolaris community edition
Sun Fire x64 and SPARC servers for revenue transaction processing
Overture uses hundreds of Sun Fire V20z servers for a global deployment to support ongoing organic growth and SPARC servers for back-end revenue processing.
Page 50
50% performance improvement with 1/3 power consumption
"[We've seen] 50% increase in speed relative to what they were able to do on Opteron before [Galaxy]. 1/3 the power consumption. Very interesting for us. We see these as competing with Xeon. And not only is it faster, but it is multi-OS. And it is really nice to see Sun bring its engineering talent to x86. Adds to what they have with SPARC."
Larry Lozon, Vice President, Hosting and Storage Services, EDS
Page 51
What do you look for in a consolidation platform ?
• Flexibility
> Sun x64 servers run Solaris, Linux, Windows, VMware*
• Reliability
> x64 servers designed for enterprise reliability > Solaris Predictive Self-Healing extends these capabilities
• Efficiency
* coming soon
Page 52
Cost and Energy Efficiency
Sun Fire X4100 Dell HP IBM
1½ times the Horsepower! Less than 1/2 the Power Use!
1/4 the Size! 1/2 the Cost!
Page 53
Q&A
Page 54
THANK YOU
• bob.netherton@sun.com • http://blogs.sun.com/bobn
Page 55