CONSOLIDATION THROUGH VIRTUALIZATION
Pavel Anni Product Marketing Manager Sun Microsystems, SEE region
DC Utilization & Complexity 2007
High OPEX: Complexity & Overhead caused by redundant DC Components High CapEX: Resources are only 20% utilized (Source: Gartner)
35%
Average Utilization 15%
5%
Virtualization - the (only) way to increase Efficiency & do 'More with Less'
1/1/1 Deployment leads to Server Sprawl, Low Utilization, Redundancy & ... and add significantly Complexity to DC Cost - TCA (CapEX) as well as TCO (OpEX)
1/1/1 Deployment ... ... Effects N Instances of an Application
will bring
App. Instance OS Instance Server
N redundant OS Instances
and
N additional Servers
into your DC !
The root of the problem
Single application per server Server sprawl is hard to manage. Deployment takes too much time
Client
Developer
App Server
NETWORK
App Server
Mail Server
Service
Database Database
OS Server
Average server utilization between 5 to 15%
Storage
Data Center Management
Application
Why Consolidate?
Development servers Test servers Production servers
FreeBSD
FreeBSD
Infrastructure servers
Why Consolidate?
Increasing operational and mangement costs
Web Server
DNS Server
Email Server
App Server
DB Server
Dir Server
One application per server
Average utilization rate is 5%-20%
Sun Confidential: Sun Employees and Authorized Partners Only
Why don't we run all applications on one server?
• Applications will compete for CPU, Memory, I/O • Applications will compete for system resources
> specific files: logs, temporary file, configuration etc. > devices: network ports
• Lack of security isolation • Lack of fault isolation • Different OS requirements
> versions, patch levels, configs
Different virtualization technologies to solve different problems
IT Megatrend 'Virtualization'
Press
Virtualization Articles double Y/Y, now #1, Security #2 (Source.:Heise Online, Computerweek Online) THE Topic 2006: IDC + Forrester + Gartner + D.H. Brown + Morgan Stanley + .... 75% of large companies (5000+ employees) are in process of deploying a virtual servers 45% of new server purchases in CY2006 are expected to be virtualized In 2009 1m+ server will be virtualized annually ~15B$ TAM (HW, SW and Services) Virtualized server Business: 172,000 units in 2004, 1,209,000 units in 2009, i.e. CAGR of 47.7%. Virtualized system images in partitions: 778,000 in 2004 , 5,107,000 in 2009, i.e. CAGR of 45.7%. Unix images CAGR of 34.7%., Windows images CAGR 51.4% , Linux images CAGRs of 55.3%
Analysts
Customers (Source: IDC)
System Virtualization Categories
Hard Partitions Virtual Machines OS Virtualization Resource Mgmt.
App OS Server
Trend to flexibility
> Very High RAS > Very Scalable > Mature Technology > Ability to run different OS
Multiple OS's
Single OS
Trend to isolation
> Very scalable and low
> Ability to live migrate an
versions
OS > Ability to run different OS versions and types > De-couples OS and HW versions
overhead overhead > Single OS to manage > Single OS to manage > Ability to live migrate Apps > Fine grained resource management > Cleanly divides system and application administration > Fine grained resource management
> Very scalable and low
Sun Solaris OS Virtualization
Minimum Overhead & Redundancy, Maximum OpEX Reduction,
Hard Partitions
Virtual Machines
OS Virtualization
Resource Mgmt.
App OS Server
Server Virtualisation SPARC x64
SMP: Dynamic System Domains CMT: logical Domains VMware Xen
OS Virtualization Solaris 10 Solaris 8+
Solaris Containers Solaris Containers for Linux Solaris 'Flying' Containers Solaris Resource Manager
Solaris Resource Manager
Increasing CPU utilization through CPU shares
App A 30%
App C 20%
App A 20%
App D 33%
App B 50%
App B 33%
App C 14%
App A (3 shares) App B (5 shares)
App C (2 shares) App D (5 shares)
Solaris Resource Pools
• CPUs can be assigned to application or group of applications • Granularity:
> 1 CPU core for UltraSPARC IV+ or x64 > 1 virtual CPU (hardware thread) for UltraSPARC T1, up to
32
• Administrator can set pool boundaries
> min 2 CPUs, max 8 CPUs > CPUs will be distributed according to workload > sum of max can be more than total number of CPUs
Resource Management
• Benefits:
> low overhead > great flexibility, automated resource reassignment > can assign [virtual] CPUs (hardware threads in
UltraSPARC T1) or CPU shares
• Drawbacks:
> Lack of isolation (security, faults, filesystems)
• Recommended:
> if applications can coexist (don't access the same file for
writing etc.) > if no security isolation requirements
Sun Solaris OS Virtualization
Minimum Overhead & Redundancy, Maximum OpEX Reduction,
Hard Partitions
Virtual Machines
OS Virtualization
Resource Mgmt.
App OS Server
Server Virtualisation SPARC x64
SMP: Dynamic System Domains CMT: logical Domains VMware Xen
OS Virtualization Solaris 10 Solaris 8+
Solaris Containers Solaris Containers for Linux Solaris 'Flying' Containers Solaris Resource Manager
Solaris Containers for Virtualization
Isolating Operating Environments: files, processes, users, network
Strong isolation between App and System Administrators OS Virtualization built into the kernel
Calendar Server Database Web Server
Application
OS
Very lightweight and scales with any Solaris system
Server
Solaris 10 Containers
Review
global zone
global zone root: /
(v1280-room3-rack12-2; 129.76.4.24)
web zone zone root: /zone/web 15 app_server zone zone root: /zone/app 60 0 database zone zone root: /zone/mysql 70 20 10
(mysqld)
(patrol)
(Apache 1.3.22)
(j2se)
audit services
(auditd)
10 crypto project (ssl) 5 proxy project (proxy)
hme0:1 ce0:1 zcons /usr
app users proj
(sh, bash, prstat)
dba users proj
(sh, bash, prstat)
security services
(login, BSM) console /usr
20 system project (inetd, sshd)
hme0:2 ce0:2 zcons /usr
system project
(inetd, sshd) zcons /usr hme0:3 ce0:3
10
60
default pool (1 CPU; 4GB)
zoneadmd
zoneadmd
zoneadmd
pool1 (7 CPU; 3GB), FSS
pool2 (4 CPU; 5GB), FSS
zone management (zonecfg(1M), zoneadm(1M), zlogin(1), ...) core services
(inetd, rpcbind, sshd, ...)
remote admin/monitoring
(SNMP, SunMC, WBEM)
platform administration
(syseventd, devfsadm, ifconfig, metadb,...)
storage complex network device (hme0) network device (ce0) network device (ce1)
Virtual Platform
ce0
ce1
Application Environment
system services
web service project
jes project
mysql project
8 Cores = 32 Hardware threads Apache 1.3
Solaris Containers + CMT
Apache 2.0
Mail
(App. Migration)
OS Virtualization across System Boundaries
Solaris 10 'Flying' Container
Solaris Containers
• Benefits
> > > > >
Strong security isolation Software fault isolation Can be copied and moved between servers Low overhead Only one OS instance to manage
• Drawbacks
> No hardware isolation
• Recommended
> Development, test, production (but not on the same
server)
Sun x64 Server Virtualization
The Multi OS Choice
Hard Partitions
Virtual Machines
OS Virtualization
Resource Mgmt.
App OS Server
Server Virtualization SPARC x64
SMP: Dynamic System Domains CMT: Logical Domains VMware Xen
OS Virtualization Solaris 10 Solaris 8+
Solaris Containers Solaris Containers for Linux Solaris 'Flying' Containers Solaris Resource Manager
VMware ESX: Windows Increasing Server Utilization Virtualization through Hardware virtualization
Solaris, Linux and Windows support
File Server Web Server Mail Server
Application
OS
Integrated Control Domain and Hypervisor
Server Sun Fire x64 Servers
Sun Fire X4600 50+ VM in 4 RU
• CPU/Memory > 8 AMD Opteron CPUs > Single- or Dual-Core > 128 GB RAM • I/O
> 2x PCI-X, 6x PCI-E Slots > 4x Gigabit Ethernet Ports > 4x SAS 2.5” HDD, DVD
• Availability > redundant Power supply (n+1) > redundant Fan > RAID 0,1 • Management and OS
> IPMI 2.0, HTTP, remote KVMS over
10/100 Ethernet Port > Solaris (pre-installed), Linux, Windows, and VMware
Suns HighEnd x64 Systems – perfect for Virtualization 1 Sun Fire 2 Racks of Installed X4600
x86 Servers
(Older Models)
51 : 1
• Virtualized 1 app per server • Simplified management • Much less rack space • Power consumption and heat savings
VWware Virtual Machines
• Benefits
> > > > >
Real hardware emulation Several OS instances Different OSs can be installed Resource management VMotion
• Drawbacks
> Hardware overhead > Administrative overhead
• Recommended
> Windows/Linux consolidation (but not on the same system
Xen: Sun Fire x64 Virtualization
Solaris, Linux and Windows support Solaris stability and functionality enhances Xen Leverage Xen community Hypervisor
File Server Web Server Mail Server
Application
Predictive SelfHealing OS Dtrace Security
Server Sun Fire x64 Servers
Sun SPARC Server Virtualization
Hard Partitions Virtual Machines OS Virtualization
The Ultimate in RAS & Security, various Solaris SPARC Versions, ideal for Solaris 10 Containers
Resource Mgmt.
App OS Server
Server Virtualization SPARC x64
SMP: Dynamic System Domains CMT: logical Domains VMware Xen
OS Virtualization Solaris 10 Solaris 8+
Solaris Containers Solaris Containers for Linux Solaris 'Flying' Containers Solaris Resource Manager
Server Virtualization: Logical Domains
Workloads
• A hardware virtualization solution for T1000, T2000 and Netra T2000 and future CMT processors • Partitions a single physical system into one or more fully isolated “logical domains” • Enables fine-grained “physical to virtual” resource mapping and physical resource sharing • Physical resource can be dynamically reassigned without impact on running OS images • Exploits CMT properties for effective, efficient partitioning
Logical Domain Manager
Guest OS Image
Guest OS Image
Guest OS Image
Service Processor
Logical Domain 0 Logical Domain 1 ... Logical Domain n
Hypervisor Physical / Virtual Resources
(CPUs, LANs, Storage, OS Images, Patches, Firmware)
Logical Domains: UltraSPARC CMT Virtualization
Solaris or Linux guest domains
File Web Server Server Mail Server
Application
Solaris or Linux Control Domain Ultra lightweight Hypervisor in the firmware
OS
Server Sun Fire CoolThreads Servers
Sun SPARC CMT: Virtualized by Design
Memory L2 Cache Crossbar Switch PCI-Express I/O
CMT = SMP System on a Chip SPARC SMP Style Partitioning:
CPU #2
CPU #3
CPU #5
CPU #1
CPU #4
CPU #6
CPU #7
LDoms -> efficient HW Partitioning Solaris 10 Container -> finegrained SW Partitioning
Unmatched Efficiency for multiple UNIX Services in one system
Today: Network centric Unix Svcs. Tomorrow: Data centric Unix Svcs.
Container 1 Container 2 Container 3 Webserver Appserver Database
CPU #8
Solaris Logical Domains (LDoms)
• Benefits
> > > >
Several OSs on one machine (on one chip!) Low overhead Solaris or Linux Can be dynamically adjusted
• Drawbacks
> Hypervisor – single point of failure > Administrative overhead
• Recommended
> If you have to have different patch levels or versions of
Solaris
Dynamic System Domains: UltraSPARC SMP Virtualization (since 1997)
Virtualization Technology for ultimate Security & Availability
Dynamic System Domains
• Benefits
> > > >
100% HW (!) Isolation Dynamic Reconfiguration Zero Overhead No Downtime, No Reboot
• Drawbacks
> Finest Granularity is Boards (will be 1 CPU in the next
generation)
• Recommended
> If no real-time flexibility is needed (twice a day is OK) > If customer has Solaris 8 or 9
Server Virtualization: Reduce CapEx
Less Servers, highly utilized ... - Available for all professional System Platforms
N
App. Instance App. Instance App. Instance App. Instance
N App. Instance ... App. Instance N OS Instance ... OS Instance 1 Virtualized Server
OS Instance N OS Instance OS Instance OS Instance N
Server Server Server Server
(providing virtual Systems for OS Instances)
OS Virtualization: Reduce CapEX+OPEX Solaris ... 10 Containers: Less OS Instances to maintain & Less Servers, highly utilized !!
N App. Instance App. Instance App. Instance App. Instance N App. Instance ... App. Instance 1 1 OS Instance Server
OS Instance N OS Instance OS Instance OS Instance N
(providing virtual OS Containers for App. Instances)
Server Server Server Server
Server plus OS Virtualization
Minimal Maintenance & Overhead for OS Instances, optimal Utilization of Servers Full Resource Flexibility on Server & OS Level Application X N N N App. Instance Application X N+M App. Instance
Server Server Server Server
Application Y
OS Instance
...
Application Y
App. App. Instance Instance
...
App. Instance
1+1
(providing virtual OS Containers for App. Instances)
OS Instance
(providing virtual OS Containers for App. Instances)
OS Instance
M M M
App. Instance
Server Server Server Server
OS Instance
1
(providing virtual Systems for OS Instances)
Server
Suns System Virtualization Options
4 Ways to run 2 Instances of an App 'A' - most efficient Solutions are Sunonly
Inst (A) OS (A) Sys (A) Inst (A) OS (A) Sys (A)
No Virtualization OS Overhead Low Utilization
Sun only
Inst (A) Inst (A) Inst (A') Inst (A')
OS(A) System (A)
OS(A')
Sun only
Inst (A) Inst (A)
Sun & Others
Inst (A) OS (A) Inst (A) OS (A)
OS (A) System (A)
Server & OS Virtualization Solaris 10 Container good on HighEnd x86/64 (VMWare, XEN) very good on CMT (LDoms, 9/2006) perfect on HE SPARC SMP (Dynamic Domains)
System (A)
Server Virtualization SPARC SMP: Dyn. Domains (1998) other UNIX/RISC: l/v/xPARs (2000) x86/64: VMWare (2004), XEN (2006) SPARC CMT: LDOMs (2006)
OS Virtualisation Solaris 10 Container (x86/64, SPARC)
The Ideal Virtualization Platforms
Sun Servers and Solaris
Next Gen AMD Now Shipping
10+ Years Binary Compatibility 20+ Years System Compatibility
Summary: Virtualization Everywhere
Only Sun Puts It All Together
Faster application Efficient energy usage (re)deployment
Strong disaster recovery capabilities
Client
OS Server Storage
Data Center Management
Tools for configuration, provisioning, deployment & tuning Optimized system resources
Web
ERP App Server
EMAIL Mail Server
CRM Database
ERP Database
Service Application
Developer
Network
App Server
Suns End-to-End System Virtualization
Server Virtualization PLUS OS Virtualization for all Sun Platforms
Solaris 10 Container
OS Virtualization Solaris 10 Container Solaris 10 Container Solaris 10 Container VMWare (XEN) Sun Fire x64 Servers Server Virtualization Dynamic Domains
gical Domains Sun Fire CoolThreadsTM Servers
Dynamic Domains Sun Fire FF/DC Servers
Sun Fire Enterprise Servers
Get in Touch with Sun Virtualization
Virtualize your DC - Today !
Raise Resource Utilization to 75%, simplify Application Lifecycle Management
• Define Application Stacks
> x86/64 - non Solaris: VMWare Objects (OS+App) > x86/64 or SPARC Solaris: Container Objects (App)
• Automate DC Management
> Provisioning > Automated Load Distribution > HA/Disaster Recovery
• Evolution in Billing, Revolution in Cost
> Resource (Container) Usage billed, not HW (CPU/Svr.) > significantly lower Costs (or higher Margin) ....
How Sun Delivers Virtualization
Sun Offers Repeatable Best Practices and Expertise
Step 4 Step 3 Step 2 Step 1
Virtualization Workshop Define project scope, evaluate TCO (high level) Virtualization Justification Review Perform indepth TCO analysis Virtualization Architecture Architect new, consolidated environment Implementation Deploy solution, train staff and manage the new environment
THANK YOU! WHAT DO YOU THINK?
Pavel Anni Pavel.Anni@sun.com
Sun: End-to-End System Virtualization
Server & OS Virtualization on all Platforms
Hard Partitions
Virtual Machines
OS Virtualization
Resource Mgmt.
App OS Server
Server Virtualization SPARC x64
SMP: Dynamic System Domains CMT: logical Domains VMware Xen
OS Virtualization Solaris 10 Solaris 8+
Solaris Containers Solaris Containers for Linux Solaris 'Flying' Containers Solaris Resource Manager
x64 Line
x86/64: Virtualization on the Rise
Gartner: Virtualized Servers need scalability, significant I/O and RAS
Non virtualised (1-2CPU) Pot. virtualised (2+CPU) Virtualised 2+CPU,Top I/O,RAS
Sun Ultra 20 Sun Ultra 40 SunFire X2100
$
SunFire X4100 SunFire X4200
$$ $$$
SunFire V40z SunFire X4600 SunFire X8000
Solaris 10 - Key Feature OS Virtualization
Solaris unique Selling Points - DC Efficiency Enablers
Performance
Availability
Virtualisation
Security
Platform Choice
Predictive Self ynamic)Trace & new TCP/IP Healing & ZFS
SPARC Solaris 10 Crypto Framework & Rights Mgmt. & x86/x64 Containers
500 Mio. $ R&D, 3000 MY, 100% indemnified, 100% Open Source, 600 new Features 11/2006: 6,5 Mio. Downloads (80% x86), > 650 certified HW-Plattforms, > 1500 Apps on x86 (SAP, Oracle, IBM, EMC, ...)
Solaris 10: Containers
Benefits above and • Whats new: beyond Server Virtualization
OS Virtualization with Solaris 10
> Multiple autonomous Servers on top of just one OS Instance > App.Instances (ideally of same Type) live in those Servers
• Whats better:
> > > > >
Less Overhead: one OS instead of multiple 'redundant' OSs Less Maintenance: Less OSs to patch, 'Life Update' further simplifies Patching Less Complexity & Cost: Part of Sol.10, no additional Virtualization SW & Administration More Governance: App.Instances gathered on few servers, no 'Image Sprawl' Infinite Scalability: up to 8191 Servers on a single Solaris 10 Instance
• Who uses it:
> 1st official reference: UGS (large PLM Provider): Solaris 10 Containers for mySAP, SAP ERM &
SAP ERP Core & Enterprise Portal