Cloud Computing and the iDataPlex Platform Web 2.0 Expo

Cloud Computing and the iDataPlex Platform Web 2.0 Expo September 18, 2008 Scott Gerard (sgerard@us.ibm.com) Lab Services, Senior Consultant IBM Worldwide STG Lab Services Delivery Teams Yorktown Heights, NY Poughkeepsie, NY Mainframe Data Center Services Speech Technology Hursley, UK HPC 68 Countries Worldwide IBM Training for Systems Dublin, Ireland Data Center Services, Mainframe Rochester, MN Power, Modular Data Center Services LaGaude, France Montpellier, France Mainframe, Power, Modular, Data Center Services West, Central, East IT Consolidation/Virtualization Services (Scorpion) Beijing, China Mainz, Germany Storage Mainframe, Power, Modular, Storage Beaverton, OR Kirkland, WA Modular Tucson, AZ Storage Austin, TX Power RTP, NC Modular, Storage A 600 person group delivering Systems implementation, I/T consulting services, and skills development… Taiwan, Taipei Mainframe, Power, Modular, Storage Bangalore, India Mainframe, Power, Storage Boca Raton, FL Speech Technology Latin America Mainframe, Power, Modular, Storage …part of a team of 25,000 engineers and programmers in 35 labs in 16 countries 2 IBM New Enterprise Data Center Strategy Leveraging the Best of Traditional and New Practices  Virtualization  Consolidation  Business resiliency and security Traditional Data Centers Web 2.0 Data Centers  Rapid service delivery  Software resiliency  Pooled shared environment New Enterprise Data Centers • New economics • Rapid service delivery • Aligned with business goals 3 What is driving Cloud Computing • Technology advances that support massive scalability & accessibility • Emergence of data intensive applications & new types of workloads Large scale information processing, i.e. parallel computing using Hadoop Web 2.0 rich media interactions Light weight run anywhere web apps Explosion of data intensive applications on the Internet Skyrocketing costs of power, space, maintenance, etc. Advances in multi-core computer architecture Fast growth of connected mobile devices Growth of Web 2.0enabled PCs, TVs, etc. 4 Industry Trends Leading to Cloud Computing A • • • “cloud” is an IT service delivered to users that has: A user interface that makes the infrastructure underlying the service transparent to the user Near-zero incremental management costs when additional IT resources are added A service management platform 2008 2000 1990 Grid Computing 1998 Utility Computing Cloud Computing Software as a Service • Solving large problems with parallel computing • Offering computing resources as a metered service • Network-based subscriptions to applications • Gained momentum in 2001 • Next-Generation Internet computing • Next-Generation Data Centers • Introduced in late • Made mainstream by 1990s Globus Alliance 5 Some Characteristics of Cloud Computing • Virtual – Physical location and underlying infrastructure details are transparent to users • Scalable – Able to break complex workloads into pieces to be served across an incrementally expandable infrastructure • Efficient – Services Oriented Architecture for dynamic provisioning of shared compute resources • Flexible – Can serve a variety of workload types – both consumer and commercial 6 IBM Cloud Computing Gaining Momentum May 2008 April 2008 March 2008 February 2008 2007 Wuxi China Cloud Computing Center PACES on cloud announced at IMPACT VIP/SSME in production on Cloud First Cloud Computing Center in Europe Academic Initiative Joint research initiative with 13 European partners Blue Cloud Sogeti Online Idea Brainstorm a “terrific success” out of Dublin Cloud Wuxi in production Cloud for iDataPlex announced at Web 2.0 expo Vietnam Innovation Portal Partner to enhance academic research opportunities 7 Worldwide Centers to Serve Clients Dublin, Ireland Seattle, WA Beijing, China San Jose, CA Tokyo, Japan US, East Coast Middle East Bangalore, India Hanoi, Vietnam Singapore São Paulo, Brazil South Africa Announced Seoul, S Korea Planned 8 Dynamic Enterprise Data Center – Enabling Virtual Classrooms Dynamic Scheduling Monitoring Cloud Services Google/IBM Academic Initiative • Promote open standards & Hadoop parallel computing model • Jointly provide compute platform of the future MIT Carnegie Mellon University of Washington Workloads Virtual Virtual Virtual Application Application Application Server Server Server; Benefits • Trains students with next generation computing skills • Optimizes emerging Internet scale workloads such as search, video, audio, 3D Internet, machine learning, mobile computing Virtualization Physical Hardware 9 Academic Initiative University Participants • From Fall 2007 – 2008, over 10 classes taught between 6 universities • Over 500 students trained on next generation parallel computing techniques Projects • Inverted Index • PageRank on Wikipedia • Clustering NetFlix Movie Data • Language Modeling in the Clouds • Large-data Statistical Machine Translation • Collective Resolution of Identity in Email Archives • Parallel Automatic Text-Background Separation in Picture Books • Large-Scale Network Analysis to Improve Retrieval in the Biomedical Domain Students and professors are saying: •“Very cool” •“Job that takes a week now only takes hours” •“Closes the gap between how industry and academia think about computing” 10 Wuxi China Cloud Computing Center IBM establishes the first Cloud Computing Center for software companies in China at the new Wuxi Tai Hu New Town Science and Education Industrial Park in Wuxi, China • Offers emerging Chinese software companies the ability to tap into a virtual computing environment to support their development activities. • A shared facility, providing each company in the Wuxi Software Park with its own virtual data center • Enabled by IBM technology and service • • Managed with IBM Tivoli systems management products Hardware – IBM System x, System p and BladeCenter • Benefits – Fast deployment of Rational software development environments – Up to 200K software developers, 100 companies – Cost efficient shared infrastructure "The China Cloud Computing Center represents a milestone in service-oriented computing," said T. W. Liu, the chairman and CEO of iSoftStone. "It will allow companies in the Wuxi Software Park to leapfrog to the newest computing models and will provide an efficient IT platform for software development." 11 Cloud Computing in the New Enterprise Data Center Software Development Workload Solution Patterns Deploys development tools for immediate use Technology Incubation Reduces time to launch new offerings Innovation Enablement Expands sources of innovation, increases competitiveness Large Scale Information Processing Optimizes emerging Internet scale workloads Cloud Computing Management Services Self-service Admin Portal Workload Pattern Templates Administration Workflows SLA and Capacity Planning Workload Management Virtualized Physical Servers (Ensembles) Provisioning Monitoring iDataPlex, BladeCenter, System x, System p, System z 12 Mashups FOR Cloud Management • Data Center much more than just CPUs, storage & networks – Multiple “layers” and multiple types of data/models – Classic system mgmt data doesn’t cover everything – Some models still evolving – Non-standard, client-specific models – Multiple sources: client, vendor, internet, … • Different users have different needs – Needs: user ≠ operator ≠ manager ≠ CIO – Classic system mgmt tools address only a fraction of needs – “Long tail” of needs – Day or less development time. Else too costly 13 Mashups FOR Cloud Management • Integrate multiple data sources – Traditional data center information – Other kinds of information – Social/organizational – Spatial – Thermal/Energy – Vendor product data, documentation/training/background info, … – Internet 14 Enterprise Environment • Draw data from – Intranet – Internet • Keep results inside firewall – Security concerns – Will be difficult to use externally hosted services • Governance – Can enforce compliance with enterprise standards • Minimize risk – Incrementally include more kinds of data – No completely new paradigms 15 Example: Who needs to be notified about server maintenance? Social CI App Components Virtual Servers MR Physical Servers Spatial 16 Layout of Servers in Data Center Annotated with • Server name • Other attributes 17 Mashup Prototype 18 Heat Map Overlaid on Data Center 19 Technologies • Mashup Infrastructure – Lotus Mashup Center – InfoSphere Mashup Hub – Lotus Widget Factory • Other technologies – Scalable Vector Graphics (SVG, Firefox, Batik) – Semantic Web (RDF, RDFS, SPARQL, OWL) – Integration of “ragged” data – Taxonomies/folksonomies 20 iDataPlex • New Technologies: Blade inspired innovation • New Economics: Easy to buy, easy to own • Adaptive Business Model: Aligned End-to-End IBM approach • Business Goal Aligned: Laser vision on achieving our clients’ success 21 Technology Approach Single-Point Management Internet Scale Data Center • Custom design layout consulting • Data center-level management software Integrated Rack Deployment Narrow Depth Rack • Side-by-side chassis • Holistic rack design • Multiple node/chassis combinations Customized Solutions Flex Node Technology • Shared power and cooling • High-efficiency power supply • Blade-like technology Efficient Power & Cooling Green Components • Low-voltage processors and memory • Component elimination • High-efficiency fans 22 Flexible -- Efficient Form and Design 42U Enterprise Rack 1 42U Enterprise Rack 2 Top-down view Optional Rear Door Heat Exchanger High Impedance air flow path Typical Enterprise Rack Low impedance air flow path iDataPlex Rack 23 New Depth Rack Improves Density No Change to Data Center Layout Sized by floor tiles 400 CFM per tile Cold Isle Cold Isle Std Std Rack Rack w/ 1U’s w/ 1U’s 2.4X Server Density Cold Isle iDataPlex Hot Aisle iDataPlex Hot Aisle Hot Aisle Rear Door Heat eXchanger X sq. ft Air Cooling 0.79X sq. ft Air Cooling 0.42X sq. ft Liquid Cooling 24 A More Intelligent Approach • • • • 40 servers per rack 4 network leaf switches 2 enterprise racks Configured onsite Traditional Rack Servers Internet-Scale iDataPlex • • • • • • • 138% better density 50%+ less floor space 75% fewer fans 66% less fan power consumption $10,148 energy savings /rack /year $1.2M data center energy savings* Ships complete, ready to deploy Optional Rear Door Heat eXchanger for even greater data center power and cooling efficiency * For typical Data Center 25 Innovative Cooling Solution 15% more Servers 58% less CRACs Only 12% racks are equal to or below 77F 100% racks are equal to or below 77F 1U Air cooled 224 Racks,9.4K Servers (42 / Rack) iDataPlex - Rear Door Heat eXchanger 128 Racks, 10.7K Servers (84 / Rack) 26 IBM Leadership in Dynamic Enterprise Data Centers • Converging Web-centric clouds and enterprise data centers • Establishing worldwide cloud computing centers to drive adoption • IBM leads the way in bringing cloud computing benefits to enterprises 27 Questions 28