Get documents about "Cloud Computing - PowerPoint
Shared by: HC120808003416
-
Stats
- views:
- 98
- posted:
- 8/7/2012
- language:
- English
- pages:
- 58
Document Sample
Manjrasoft
Manjrasoft
Cloud Computing:
The Next Revolution in Information Technology
1
Manjrasoft
Manjrasoft
2
Green Cloud Computing
Energy-Efficient Cloud Computing:
Opportunities and Challenges
Dr. Rajkumar Buyya
Cloud Computing and Distributed Systems (CLOUDS) Lab Manjrasoft
Dept. of Computer Science and Software Engineering Innovative Solutions for Cloud Computing
The University of Melbourne, Australia Dr Rajkumar Buyya
www.cloudbus.org Chief Executive Officer
Manjrasoft Pty Ltd
www.buyya.com
Room 5.31, ICT Building, 111, Barry Street, Carlton,
Melbourne, VIC 3053, Australia
P: +61-3-8344 1344 | F : +61-3-9348 1184
www.manjrasoft.com
E: raj@manjrasoft.com
http://www.manjrasoft.com
Major Sponsors/Supporters
Manjrasoft
Outline
Manjrasoft
Cloud Computing at a Glance
Cloud Benefits and Challenges
Powering Cloud Infrastructure
Energy Consumption, Costs, Implications
Power-Aware Computing
Trends, Foundations, Issues, Taxonomy
Green Cloud Computing: Framework
Energy-Efficient Resource Management
Within a Cloud Data Center
Across Multiple Data Centers (InterCloud)
Summary and Thoughts for Future
4
Clouds offer Subscription-Oriented IT
Services: {compute, apps, data,..} as a
Manjrasoft Service (..aaS)
Public Cloud
Cloud
Manager
Private
Clients Cloud
Other Govt.
Cloud Services Cloud Services
5
Cloud Computing
Manjrasoft
3 Main Types or Personalities
Software-as-a-Service (SaaS): A wide range of
application services delivered via various business
models normally available as public offering
Platform-as-a-Service (PaaS): Application development
platforms provides authoring and runtime environment
Infrastructure-as-a-Service (IaaS): Also known as elastic
compute clouds, enable virtual hardware for various uses
6
Animoto, Sales Force, Google
Document
Scientific Computing, Enterprise ISV, Social
User Applications Networking, Gaming
Cloud Economy
Google AppEngine, MapReduce,
Aneka, Microsoft Azure
SaaS
Cloud Programming Environment and Tools:
Web 2.0, Mashups, Concurrent and Distributed
Programming, Workflow
User-level and Cloud Hosting Platforms: QoS Negotiation
infrastructure level Admission Control, Pricing, SLA Management,
Platform Monitoring
PaaS
IaaS
Amazon EC2, GoGrid, RightScale,
Jovent
Cloud Physical Resources: Storage, virtualized
clusters, servers, network.
Infrastructure
Public Cloud
(IaaS)
Manjrasoft
User
User
Middleware
Master Node
Private Cloud
(Heterogeneous Resources) Hybrid Cloud
Slave Nodes
Slave Nodes
(Cluster)
8
Several Benefits……
Manjrasoft
Service
Oriented
Elastic
Virtualized
Cloud Dynamic
Computing (& Distributed)
Autonomic
Market Shared
Oriented (Economy of
(Pay As You Go) Scale)
9
Dark side…..
Manjrasoft
• Gartner Report 2007: IT industry contributes
2% of world's total CO2 emissions
• U.S. EPA Report 2007: 1.5% of total U.S.
power consumption used by data centers which
has more than doubled since 2000 and costs
$4.5 billion
10
Outline
Manjrasoft
Cloud Computing at a Glance
Cloud Benefits and Challenges
Powering Cloud Infrastructure
Energy Consumption, Costs, Implications
Power-Aware Computing
Trends, Foundations, Issues, Taxonomy
Green Cloud Computing: Framework
Energy-Efficient Resource Management
Within a Cloud Data Center
Across Multiple Data Centers (InterCloud)
Summary and Thoughts for Future
11
Powering Cloud Infrastructure
Manjrasoft
• Modern data centers, operating under the Cloud
computing model, are hosting a variety of
applications ranging from those that run for a few
seconds (e.g. serving requests of web applications
such as e-commerce and social networks portals) to
those that run for longer periods of time (e.g.
simulations or large dataset processing).
• However, Cloud Data Centers consume
excessive amount of energy:
• According to McKinsey report on “Revolutionizing Data
Center Energy Efficiency” :
• A typical data center consumes as much energy as 25,000 households.
• The total energy bill for data centers in 2010 was over $11
billion and energy costs in a typical data center doubles
every five years.
12
Where Does the Power Go?
Manjrasoft
Server/Storage 50%
Power Consumption in the Datacenter
Computer Rm. AC 34%
Conversion 7%
Network 7%
Lighting 2%
Compute resources and
particularly servers are at
the heart of a complex,
evolving system!
Source: APC
13
Clouds Impact on the
Manjrasoft
Environment
Data centers are not only expensive to
maintain, but also unfriendly to the
environment.
Carbon emission due to Data Centers worldwide is
now more than both Argentina and the Netherlands
emission.
High energy costs and huge carbon footprints are
incurred due to the massive amount of electricity
needed to power and cool the numerous servers
hosted in these data centers.
14
Outline
Manjrasoft
Cloud Computing at a Glance
Cloud Benefits and Challenges
Powering Cloud Infrastructure
Energy Consumption, Costs, Implications
Power-Aware Computing
Trends, Foundations, Issues, Taxonomy
Green Cloud Computing: Framework
Energy-Efficient Resource Management
Within a Cloud Data Center
Across Multiple Data Centers (InterCloud)
Summary and Thoughts for Future
15
Background
Manjrasoft
Traditionally, HPC (commodity clusters) & Data center
community has focused on performance (speed).
At the same time, microprocessor vendors have not
only doubled the number of transistors (and speed)
every 18-24 months, but
they have also doubled
the power densities.
Moore’s Law for
Power Consumption:
16
Research Motivations of Power
Aware/Energy Efficient Computing
Manjrasoft
Rapid uptake of Cloud Data Centers for hosting industrial
applications
Reducing the operational costs of powering and cooling Data
Centers:
The tremendous increase in computer performance has come with an even
grater increase in power usage.
According to Eric Schmit, CEO of Google, what matter most to Google is
“not speed but power, because data centers can consume as much
electricity as a city.”
Improving reliability
As a rule of thumb, for every 10°C increase in temperature, the failure rate
of a system doubles.
Computing environment affected the correctness of the results.
The 18-node Linux cluster produced an answer outside the residual (i.e., a silent error)
when running in dusty 85°F warehouse but produced the correct answer when running
in a 65°F machine-cooled room.
17
Reliability/Implications
Manjrasoft
Reliability of
Leading Edge
Supercomputer
(D. Reed, 2004)
Estimated Cost of
An hour of system
downtime (W.
Feng, (ACM
Queue, 2003):
18
Power Aware Computing
Manjrasoft
Power Aware (PA) computing/communication:
The objective of PA computing/communications is to improve power
management and consumption using the awareness of power
consumption of devices.
Power consumption is one of the most important considerations in mobile
devices due to the limitation of the battery life.
System level power management
Recent devices (CPU, disk, communication links, etc.) support multiple
power modes.
Resource Management and Scheduling Systems can use these
multiple power modes to reduce the power consumption.
19
DVS (Dynamic Voltage Scaling)
Manjrasoft
DVS (Dynamic Voltage Scaling) technique
Reducing the dynamic energy consumption by lowering the supply voltage at
the cost of performance degradation
Recent processors support such ability to adjust the supply voltage
dynamically.
The dynamic energy consumption = * Vdd2 * Ncycle
Vdd : the supply voltage
Ncycle : the number of clock cycle
An example
Power deadline Power deadline
5.02
2.02
10 msec 25 msec 10 msec 25 msec
(a) Supply voltage = 5.0 V (b) Supply voltage = 2.0 V
20
DVS-based Power Aware Scheduling
Manjrasoft
Motivation:
Develop Resource Management and Scheduling Algorithms
that aim at minimizing the energy consumption at the same
meet the job deadline.
Exploit industrial move towards Utility Model / SLA-based
Resource Allocation for Cloud Computing
21
Taxonomy of Power Management
Techniques
Manjrasoft
Power Management Techniques
Static Power Management (SPM) Dynamic Power Management (DPM)
Hardware Level Software Level Hardware Level Software Level
Circuit Level Logic Level Architectural Level Single Server Multiple Servers, Data
Centers and Clouds
OS Level Virtualization Level
22
Data Center Level
Manjrasoft
Yes
Virtualization
No
Single resource
System resources
Multiple resources
Homogeneous
Target systems
Heterogeneous
Minimize power / energy
consumption
Minimize performance
Data center level Goal
loss
Meet power budget
DVFS
Power saving techniques Resource throttling
DCD
Workload consolidation
Arbitrary
Workload Real-time applications
23 HPC-applications
Outline
Manjrasoft
Cloud Computing at a Glance
Cloud Benefits and Challenges
Powering Cloud Infrastructure
Energy Consumption, Costs, Implications
Power-Aware Computing
Trends, Foundations, Issues, Taxonomy
Green Cloud Computing: Framework
Energy-Efficient Resource Management
Within a Cloud Data Center
Across Multiple Data Centers (InterCloud)
Summary and Thoughts for Future
24
Cloud Providers Measures
Manjrasoft
Cloud service providers need to adopt measures to
ensure that their profit margin is not dramatically
reduced due to high energy costs.
Amazon.com’s estimate the energy-related costs of its data centers
amount to 42% of the total budget that include both direct power
consumption and the cooling infrastructure amortized over a 15-year
period.
Google, Microsoft, and Yahoo are building large data centers in
barren desert land surrounding the Columbia River, USA to exploit
cheap hydroelectric power.
There is also increasing pressure from Governments
worldwide to reduce carbon footprints, which have a
significant impact on climate change.
Carbon Tax (July 2012 in Australia) on industries
25
Green Cloud: “performance”
Manjrasoft
“energy efficiency”
As energy costs are increasing while availability
dwindles, there is a need to shift focus from
optimising data center resource management for pure
performance alone to optimising for energy
efficiency while maintaining high service level
performance.
We propose Green Cloud computing model that
achieves not only efficient processing and utilisation of
computing infrastructure, but also minimise energy
consumption.
26
Green Cloud Computing
Manjrasoft
Revenue
Power
Consumption
27
Cloud Usage Model
Manjrasoft
Cloud
Datacenter A
LAN and Gateway
router
End User (Network Devices)
Cloud
Computing
VM and Storage
Cloud (Server)
Datacenter B
Air Conditioning, and
Internet Chiller
Service Routers (Cooling Devices)
Provider
UPS, PDU, lighting
(Electrical Devices)
Cloud
Datacenter C Datacenter
Internet
28
Green Cloud Computing
Manjrasoft
Architecture
29
Outline
Manjrasoft
Cloud Computing at a Glance
Cloud Benefits and Challenges
Powering Cloud Infrastructure
Energy Consumption, Costs, Implications
Power-Aware Computing
Trends, Foundations, Issues, Taxonomy
Green Cloud Computing: Framework
Energy-Efficient Resource Management
Within a Cloud Data Center
Across Multiple Data Centers (InterCloud)
Summary and Thoughts for Future
30
Case Study 2: Dynamic VM
Manjrasoft
Consolidation
User User User
VM provisioning SLA negotiation Application requests
Global resource managers
Virtual Consumer, scientific and business
Machines applications
and
users’
applications
Virtualization layer
(VMMs, local resources managers)
Pool of
physical
computer
31 nodes Power On Power Off
Three Sub-Problems
Manjrasoft
When to migrate VMs?
• Host overload detection algorithms
• Host underload detection algorithms
Which VMs to migrate?
• VM selection algorithms
Where to migrate VMs?
• VM placement algorithms
32
Proposed “Power-Aware” Algorithms
Manjrasoft
• Host overload detection
• Adaptive utilization threshold based algorithms
• Median Absolute Deviation algorithm (MAD)
• Interquartile Range algorithm (IQR)
• Regression based algorithms
• Local Regression algorithm (LR)
• Robust Local Regression algorithm (LRR)
• Host underload detection algorithms
• Migrating the VMs from the least utilized host
• VM selection algorithms
• Minimum Migration Time policy (MMT)
• Random Selection policy (RS)
• Maximum Correlation policy (MC)
• VM placement algorithms
• Heuristic for the bin-packing problem – Power-Aware Best Fit
Decreasing algorithm (PABFD)
33
Performance Metrics
Manjrasoft
• SLA violation metrics
• Overloading Time Fraction (OTF) - the time fraction, during
which active hosts experienced the 100% CPU utilization
• Performance Degradation due to VM Migrations (PDM)
• A combined SLA Violation metric (SLAV):
SLAV = OTF * PDM
A combined metric that captures both energy
consumption and the level of SLA violations, Energy
and SLA Violation (ESV):
ESV = Energy * SLAV:
34
Simulation Setup
Manjrasoft
• CloudSim with a power package
• A Data Center consisting:
• 800 heterogeneous physical servers containing HP
ProLiant ML110 G4 and HP ProLiant ML110 G5
servers.
• More than 1000 Heterogeneous VMs
corresponding to Amazon EC2 instance types
Workload traces from more than 1000 VMs from
servers located in more than 500 places around
the world.
The data were obtained from the CoMon project, a
monitoring infrastructure for PlanetLab
35
Best Algorithm Combinations and
Manjrasoft
Benchmark Algorithms
Dynamic VM consolidation significantly reduces energy consumption compared to non-power aware
allocation and static allocation policies, like DVFS, NPA (non-power aware)
36
Case Study 1: Key Observations
Manjrasoft
Dynamic VM consolidation algorithms significantly outperforms
static allocation policies.
Heuristic-based dynamic VM consolidation algorithms substantially
outperform the optimal online deterministic algorithm (THR-1.0) due
to a vastly reduced level of SLA violations.
The MMT policy produces better results compared to the MC and
RS policies, meaning that the minimization of the VM migration time
is more important than the minimization of the correlation between
VMs allocated to a host.
Dynamic VM consolidation algorithms based on local regression
outperform the threshold-based and adaptive-threshold based
algorithms due to better predictions of host overload, and therefore
decreased SLA violations and the number of VM migrations.
37
Outline
Manjrasoft
Cloud Computing at a Glance
Cloud Benefits and Challenges
Powering Cloud Infrastructure
Energy Consumption, Costs, Implications
Power-Aware Computing
Trends, Foundations, Issues, Taxonomy
Green Cloud Computing: Framework
Energy-Efficient Resource Management
Within a Cloud Data Center
Across Multiple Data Centers (InterCloud)
Summary and Thoughts for Future
38
Green Cloud or Brown Cloud?
Manjrasoft
• Ideally, for every server virtualized, save
– ~$700 and ~7,000 kWh / year
– 4 tons of CO2 emissions / year
• Plus
– Power down underutilized physical servers, saving 40%
– Desktop management, saving 35% / year
• But currently
Cloud Location Estimated power % of Dirty % of Renewable
datacenters usage Energy Electricity
Effectiveness Generation
Google Lenoir 1.21 50.5% Coal, 3.8%
38.7% Nuclear
Apple Apple, NC 50.5% Coal, 3.8%
38.7% Nuclear
Microsoft Chicago, IL 1.22 72.8% Coal, 1.1%
22.3% Nuclear
Yahoo La Vista, NE 1.16 73.1% Coal, 7%
14.6% Nuclear
39
Some Observations
Manjrasoft
Datacenters has heterogeneous properties
– Geographically distributed datacenters (different
environmental factors and electricity prices)
– Each resource site has different CPU configurations
– Each site has different energy efficiency
– Different Carbon-footprint
40
Source: Best Practices for Data Centers: Lessons Learned from Benchmarking 22 Data Centers by Lawrence Berkeley National Laboratory’s report 40
Green Cloud Architecture
Manjrasoft
End User
d) Allocate
service
Private
a) Request Cloud
a cloud
service
Green Broker c) Request
energy
efficiency
information
b) Request Carbon Emission
any green
Routers offer Directory
Internet
e) Request
service
allocation
Green Offer
Public Cloud A Directory
41 Public Cloud B
Third Party: Green Offer and Carbon
Manjrasoft
Emission Directory
Carbon Emission Directory
Contains data on Power Usage Effectiveness (PUE), cooling
efficiency, carbon footprint, network cost
Helps user to select cloud services with minimum carbon
footprint
Incentive for providers
Advertising tool to increase the market share, e.g. Google
Require more carbon transparency from providers
Government role by enforcing policies such as Carbon Tax
Green Offer Directory
Incentive for users
Choosing more carbon efficient hours
Lists services with their discounted prices and green hours
42
User: Green Broker
Manjrasoft
• A typical Cloud broker
– Lease Cloud services
User
– Schedule applications
Green Broker
Cloud Request Services
QoS
Application
Profiling
Cloud
Offers
• Green Broker
CO2 Analysis Services
– 1st layer: Analyze user
Cost
Calculator
CO2 Emission
Calculator
Green
Information
requirements
System
Brokering Services such as
– 2nd layer: Calculates cost
scheduling, monitoring and carbon footprint of
Green Cloud
Policies Leasing
Scheduler services
– 3rd layer: Carbon aware
scheduling
Private Cloud Public Cloud
43
Provider: Green Middleware
Manjrasoft
44
Case Study: IaaS Cloud
Manjrasoft
Carbon Emission Directory: Stores all carbon
emission rates for each IaaS provider
Green Offer Directory: Receives number of
VMs that can be initiated at a particular time for
maximum energy efficiency
Green Broker: Computes schedule with the
lowest carbon emission based on application
requirements
45
Carbon Efficient Green Policy
Manjrasoft
(CEGP)
Collect resource requests from user and
resource site information such as VMs, carbon
emission rate, DCiE, CPU power efficiency
Sort jobs based on deadline
Sort resource sites based on carbon footprint:
Carbon Datacenter Energy
Emission Efficiency Efficiency of VM
Schedule greedily the most urgent deadline jobs
on the most power efficient resource site.
46
Simulation Setup
Manjrasoft
Parallel Workload: first week of LLNL Thunder
trace from Parallel Workload Archive (PWA)
Deadline generated based methodology proposed by
Irwin et al. (2004)1
Configuration of Cloud resource sites2:
1D. Irwin, L. Grit, and J. Chase, “Balancing risk and reward in a market-based task service,” in Proc. of the 13th IEEE International Symposium on High
Performance Distributed Computing, Honolulu, USA, 2004.
47 2 L. Wang and Y. Lu, “Efficient Power Management of Heterogeneous Soft Real-Time Clusters,” in Proc. of the 2008 Real-Time Systems Symposium,
EDF: Carbon-Efficient (CEGP) VS EST
(Early Start-time) Algorithm (EST)
Manjrasoft
48
Case Study 2: Summary
Manjrasoft
• Presented a Carbon Aware Green Cloud Framework to
improve the carbon footprint of Cloud computing.
• Proposed framework provides incentives to both users
and providers to utilize and deliver the most “Green"
services.
• Proposed a Carbon Efficient Green Policy (CEGP) for
IaaS providers.
• Green Policy CEGP can save up to 23% energy while
reducing the carbon footprint by about 25%.
49
Outline
Manjrasoft
Cloud Computing at a Glance
Cloud Benefits and Challenges
Powering Cloud Infrastructure
Energy Consumption, Costs, Implications
Power-Aware Computing
Trends, Foundations, Issues, Taxonomy
Green Cloud Computing: Framework
Energy-Efficient Resource Management
Within a Cloud Data Center
Across Multiple Data Centers (InterCloud)
Summary and Thoughts for Future
50
Conclusions
Manjrasoft
Clouds are essentially Data Centers hosting application
services offered on a subscription basis. However, they
consume high energy to maintain their operations.
high operational cost + environmental impact
Proposed heuristics for energy-efficient dynamic VM
consolidation that significantly reduce energy
consumption, while providing a low level of SLA
violations.
Presented a Carbon Aware Green Cloud Framework to
improve the carbon footprint of Cloud computing
Open Issues:
EE Data Structures + Algorithms
EE Resource Management for other workloads (e.g., workflows)
51
References
Manjrasoft
Keynote Paper
R. Buyya, A. Beloglazov, J. Abawajy, Energy-
Efficient Management of Data Center Resources
for Cloud Computing: A Vision, Architectural
Elements, and Open Challenges, Proceedings of
the 2010 International Conference on Parallel
and Distributed Processing Techniques and
Applications (PDPTA2010), Las Vegas, USA,
July 12-15, 2010.
Taxonomy + EE InterClouds:
A. Beloglazov, R. Buyya, Y. Lee, A. Zomaya, A
Taxonomy and Survey of Energy-Efficient Data
Centers and Cloud Computing Systems,
Advances in Computers, Volume 82, 47-111pp,
M. Zelkowitz (editor), Elsevier, Amsterdam, The
Netherlands, March 2011.
S. Garg, C. Yeo, A Anandasivam, R. Buyya,
Environment-Conscious Scheduling of HPC
Applications on Distributed Cloud-oriented Data
Centers, Journal of Parallel and Distributed
Computing, 71(6):732-749, Elsevier Press, Wiley Press, New York, USA,
Amsterdam, The Netherlands, June 2011. Feb 2011
52
Thanks for your attention!
Manjrasoft
Are there any
Questions?
Comments/Suggestions
Manjrasoft
We welcome you to:
Study/Research with Us | Do Business with us!
http:/www.cloudbus.org | www.Manjrasoft.com
rbuyya@unimelb.edu.au | raj@manjrasoft.com
53
Manjrasoft
Manjrasoft
54
Green Cloud Computing
Simulation Results: ESV
Manjrasoft
7
6
5
ESV, x0.001
4
3
2
1
0
8 8 8 5 5 5 5 5 5 3 2 2 3 3 2
0. 0. 0. 1. 1. 1. 2. 2. 2. 1. 1. 1. 1. 1. 1.
RS MC M T R S MC MT RS MC MT RS MC MT RS MC MT
R R R R
H HR R M I Q IQR R M AD AD D M L R RR R M L L R R M
T T M M L
TH IQ M
A LR L
55
Simulation Results: Energy
Manjrasoft
130
120
110
Energy, kWh
100
90
80
70
60
8 8 8 5 5 5 5 5 5 3 2 2 3 3 2
0. 0. 0. 1. 1. 1. 2. 2. 2. 1. 1. 1. 1. 1. 1.
S S S S S
R MC M T R MC MT R MC MT R MC MT R MC MT
R R R R
H HR R M I Q IQR R M AD AD D M L R RR R M L L R R M
T T M M L L
TH IQ M
A LR
56
Simulation Results: SLAV
Manjrasoft
9
8
7
SLAV, x0.00001
6
5
4
3
2
1
0
8 8 8 5 5 5 5 5 5 3 2 2 3 3 2
0. 0. 0. 1. 1. 1. 2. 2. 2. 1. 1. 1. 1. 1. 1.
S S S S S
R MC M T R MC MT R MC MT R MC MT R MC MT
R R R R
H HR R M I Q IQR R M AD AD D M L R RR R M L L R R M
T T M M L L
TH IQ M
A LR
57
Simulation Results: the Number of
Manjrasoft
VM Migrations
22.5
VM Migrations, x1000
20.0
17.5
15.0
12.5
10.0
7.5
5.0
8 8 8 5 5 5 5 5 5 3 2 2 3 3 2
0. 0. 0. 1. 1. 1. 2. 2. 2. 1. 1. 1. 1. 1. 1.
S S S S S
R MC MT R MC M T R MC MT R M C MT R MC MT
R R R R
H HR R M I Q IQR R M AD AD D M LR RR R M L LR R M
T T M M L L
TH IQ M
A LR
58
