Customer: University of California, San Diego
Technology: 10 Gigabit Ethernet
GreenLight: Getting more computational work done for fewer watts of energy
Evolution of Information Technology and the increasing energy demands that go with higher creasing computational power have historically been an obstacle to sustainability. Recent IDC research shows that over the past ten years the average cost to power and cool an instal installed base of servers has 1 doubled . A project run by the University of California, San Diego aims to measure the energy oject efficiency of new technologies such as 10 Gigabit Ethernet (10 GigE) and their impact on cluster capacity and efficiency - and reduction of energy costs.
View of GreenLight racks inside the Modular Datacenter Container
How to enable green IT computer science cience
A green strategy requires various steps: monitoring and controlling the use of electricity of network networkconnected devices, design innovative ways to reduce energy consumption and then more monitoring and measuring to refine the process. Academia and enterprise often collaborate in this research, looking for ademia ways to get more computational work done for fewer watts of energy. This is the scope of GreenLight, a 2 project run by the scientists and engineers of UC San Diego, one of the greenest universities in the US. When it is built, the GreenLight Instrument will measure, monitor and help optimize the energy hen consumption of large-scale scientific applications from many different disciplines disciplines. What makes the project exemplary is that the cluster used to run the measurements and the monitoring has been designed to use less energy than most data centers: GreenLight consists of an eco eco-friendly Sun Modular Datacenter container with 8 racks of servers. When fully populated, the servers will connect to 7 edge switches via 1 Gbps links and the edge switches will connect with 10 GigE uplinks to the Quadrics TG201-XA switch, which maintains low latency and high bandwidth and ensures the end users quality of XA service.The immediate advantage, as Tom DeFanti, GreenLight principal investigator, explains, is that “GreenLight uses 10 Gbps over dedicated optical fiber links so end users move their clusters out of their 3 faculty closets and into much greener configurations.”
Quadrics TG201-XA 10 GigE Switch TG201
Quadrics TG201: Maximum Data Throughput, Minimum Latency and Minimum Power Consumption
Quadrics TG201-XA is a 1U, 10 GigE switch with 12 CX4 and 12 XFP ports. TG201 switches have the lowest XA latency in the 10 GigE market. Low latency (200ns) combined with high throughput (480Gbps) and fully non-blocking layer-2 switching make it an ideal solution for the ever 2 ever-demanding needs of the Data Centres, high utilization virtualized servers, Campus network core switching and storage consolidation. In the GreenLight cluster the TG201 switch aggregates 10GE links from each of the edge switches. Five GE 4 additional channel-bonded links provide a 50 Gbps connection to the OptIPuter Core. In the quest to bps improve GreenLight energy efficiency the choice of Quadrics’ TG201 TG201-XA answered requirements for both higher performance and lower energy consumption. TG201 switches use between 20% and 80% less 5 power per port than other products in the 10 GigE market .
10GE Link Aggregation: When complete, the servers will connect to edge switches via 1 Gbps links, and the edge switches will connect to each other via the 10 Gbps links of the Quadrics TG201 Switch.
"Service-Based Approaches to Improving Data Center Efficiencies IDC, 2007 Based Efficiencies", The GreenLight project gets its name from its plan to connect scientists and thei labs to more energy-efficient their 'green' computer processing and storage systems using photonics - light over optical fiber. 3 “The UCSD/Calit2 GreenLight Project: Greening Universal Communication Tom DeFanti, 2008 The Communication”, 4 OptIPuter, so named for its use of Optical networking and Internet Protocol, is a Grid of computational, storage and visualization resources between eight US Universities. 5 Power usage obtained from vendors’ published material.
“The Quadrics TG201 24-port 10GiGE switch is a full-bisection bandwidth switch that enables us to richly connect the Greenlight Instrument into campus research networks. We are driving DWDM optics directly from the switch to support as much as 80Gbit/sec on a single fiber pair." - Philip Papadopoulos, GreenLight Project
Better Power Usage Effectiveness for Full Scale applications
The GreenLight project is testing the energy efficiency of computing systems under real-world efficiency real conditions. Applications as diverse as bioinformatics, digital media, metagenomics, microscopy and ocean observing will be running on full-scale computing platforms. Tom DeFanti: “We have selected 5 scale computation computationally–intensive application projects from a broad range of disciplines, each of which can intensive benefit from the GreenLight Instrument. For each project, we first measure the current energy use, then use GreenLight to devise strategies for evolving each to a more energy efficient mode, in the process giving our team critical end user feedback on improving the instrument .” The target is to improve end-user 6 Power Usage Effectiveness , by a combination of best practices adoption and efficient equipment. equipment "The Quadrics TG201 24-port 10 GigE switch is a full-bisection bandwidth switch that enables us to bisection richly connect the Greenlight Instrument into campus research networks. We are driving DWDM optics directly from the switch to support as much as 80Gbit/sec on a single fibe pair." fiber - Philip Papadopoulos, GreenLight Project
Above: UCSD campus (courtesy of W.Parson). Below: view of the two Modular Datacenter Containers at UCSD
Reducing costs and improving operational efficiency with 10 Gig GigE
Academia and enterprise alike are looking for greener technology in order to reduce running costs, lessen IT impact on earth and increase the long term returns. Business owners are always looking to the reduce the cost in power consumption. The GreenLight project shows how 10 GigE technology reduces the running costs and improves operational efficiency in three ways: • Scalability: 10 GigE pr provides computationally-intensive applications room to scale; intensive • Network bandwidth: Servers are better utilized as the high bandwidth provided by 10 GigE reduces the inefficiencies of network bottlenecks ; • Power Consumption: 10 GigE reduces the number of connections required to obtain high bandwidth, s plus the switch itself has been designed for minimum power consumption. "The ICT sector and universities can play an important role in reducing carbon emissions to fight global warming," said Calit2 director Larry Smarr, a professor of computer science in UCSD's Jacobs School of " Engineering. "A whole new generation of equipment is being designed to build out the rapidly growing Internet economy, and that equipment has to be much greener than what we have today." Luigi Lavorgna, Quadrics Director: “Thanks to the UC San Diego the technology sector will acquire valuable insights to reduce the costs of running a business and boost efficiency. The private sector can benefit enormously from efficient products that the evolution of information technology has made now efficient available, and in particular with the adoption of 10 Gigabit Ethernet products such as Quadrics TG201 Switches.”
University of California, San Diego Founded in 1960, the University of California, San Diego is one of the most accomplished research universities in the US, widely acknowledged for its local impact, national influence and global reach. UC San Diego is one of the leading universities investigating energy efficiency in information technology and data centers. It is the only university member of Green Grid, an international consortium dedicated to reducing energy usage at data centers. UC San Diego has one of the largest and most advanced university renewable energy programs. http://www.ucsd.edu Quadrics Quadrics is a leading supplier and developer of high performance networking products and resource management software. Quadrics’ goal is to improve customer productivity by providing trusted performant technology. Hardware and software that makes more efficient use of a cluster of nodes will lower the electrical power required to solve a given problem. Quadrics integrates environmental considerations into its business strategy because this results in better products. http://www.quadrics.com
E: firstname.lastname@example.org email@example.com T: +44 (0)117 9075375 Address: One Bridewell Street, Bristol, BS1 2AA, UK
Power usage effectiveness (PUE) is a metric used to determine the energy efficiency of a data centre, PUE is defined the as total facility power / IT equipment power. Overall efficiency improves as the quotient decreases toward 1. Example: PUE of 2.5 means that for every 2.5 watts in at the utility meter, one watt is delivered out to the IT load.