Proof of Concept Test Configuration by linzhengnd

VIEWS: 23 PAGES: 5

									Proof of Concept Test Configuration



         Raymond L. Paden, Ph.D.
         HPC Technical Architect
  High Performance Technical Computing

               10 Nov 10
                version 0.3



                                         raypaden@us.ibm.com
                                         512-286-7055
                                            Special Notices from IBM Legal
This presentation was produced in the United States. IBM may not offer the products, programs, services or features discussed herein in other countries, and the
information may be subject to change without notice. Consult your local IBM business contact for information on the products, programs, services, and features
available in your area. Any reference to an IBM product, program, service or feature is not intended to state or imply that only IBM's product, program, service or
feature may be used. Any functionally equivalent product, program, service or feature that does not infringe on any of IBM's intellectual property rights may be used
instead of the IBM product, program, service or feature.

Information in this presentation concerning non-IBM products was obtained from the suppliers of these products, published announcement material or other publicly
available sources. Sources for non-IBM list prices and performance numbers are taken from publicly available information including D.H. Brown, vendor
announcements, vendor WWW Home Pages, SPEC Home Page, GPC (Graphics Processing Council) Home Page and TPC (Transaction Processing Performance
Council) Home Page. IBM has not tested these products and cannot confirm the accuracy of performance, compatibility or any other claims related to non-IBM
products. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products.

IBM may have patents or pending patent applications covering subject matter in this presentation. The furnishing of this presentation does not give you any license to
these patents. Send license inquires, in writing, to IBM Director of Licensing, IBM Corporation, New Castle Drive, Armonk, NY 10504-1785 USA.

All statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only. Contact your
local IBM office or IBM authorized reseller for the full text of a specific Statement of General Direction.

The information contained in this presentation has not been submitted to any formal IBM test and is distributed "AS IS". While each item may have been reviewed by
IBM for accuracy in a specific situation, there is no guarantee that the same or similar results will be obtained elsewhere. The use of this information or the
implementation of any techniques described herein is a customer responsibility and depends on the customer's ability to evaluate and integrate them into the
customer's operational environment. Customers attempting to adapt these techniques to their own environments do so at their own risk.

IBM is not responsible for printing errors in this presentation that result in pricing or information inaccuracies.

The information contained in this presentation represents the current views of IBM on the issues discussed as of the date of publication. IBM cannot guarantee the
accuracy of any information presented after the date of publication.

IBM products are manufactured from new parts, or new and serviceable used parts. Regardless, our warranty terms apply.

Any performance data contained in this presentation was determined in a controlled environment. Therefore, the results obtained in other operating environments may
vary significantly. Some measurements quoted in this presentation may have been made on development-level systems. There is no guarantee these measurements
will be the same on generally-available systems. Some measurements quoted in this presentation may have been estimated through extrapolation. Actual results
may vary. Users of this presentation should verify the applicable data for their specific environment.

Microsoft, Windows, Windows NT and the Windows logo are registered trademarks of Microsoft Corporation in the United States and/or other countries.

UNIX is a registered trademark in the United States and other countries licensed exclusively through The Open Group.

 LINUX is a registered trademark of Linus Torvalds. Intel and Pentium are registered trademarks and MMX,Itanium, Pentium II Xeon and Pentium III Xeon are
trademarks of Intel Corporation in the United States and/or other countries.

Other company, product and service names may be trademarks or service marks of others.
                                              POC Test Configuration

                          Ethernet Switch

                   NSD Server              2 x TbE
                                                     2
                                                         SAS
                                                               3    2 x GbE 2 x SAS     Out SAS 2 x GbE 2 x SAS     Out SAS
                  x3650 M2
                                                         SAS
                                                               3    DS3512 Turbo
        4 x GbE   8 cores, 6 DIMMs1

                   NSD Server              2 x TbE
                                                     2
                                                         SAS
                                                               3              2 x SAS   Out SAS           2 x SAS   Out SAS
                  x3650 M2                                     3
                                                         SAS        EXP3512
        4 x GbE   8 cores, 6 DIMMs1

Operating System:                                                             2 x SAS   Out SAS           2 x SAS   Out SAS
- x86_64 (i.e., 64 bit)
                                                                    EXP3512
- RHEL 5.5, kernel 2.6.18-194

Storage:                                                                      2 x SAS   Out SAS           2 x SAS   Out SAS
- 96 Near-line SAS disks, 2 TB per disk, 7200 RPM                   EXP3512
 configured as 8 x 8+2P RAID arrays + 44 x 2+2 RAID 10 arrays
- Raw Capacity = 192 TB using 2 TB disks
- Usable Capacity < 144 TB using 2 TB disks                                   2 x SAS   Out SAS           2 x SAS   Out SAS
- Best Measured Performance                                         EXP3512
 write streaming rate < 2.3 GB/s
 read streaming rate < 3.1 GB/s
 write IOP rate = TBD5                                                        2 x SAS   Out SAS           2 x SAS   Out SAS
 read IOP = TBD5
                                                                    EXP3512

Footnotes:
1. 2 GB DIMMs                                                                 2 x SAS   Out SAS           2 x SAS   Out SAS
2. Chelsio dual port TbE adapters; they are channel bonded.
3. 6 Gbit/s SAS HBA, 4 lanes. A dual port adapter may be            EXP3512
   used in place of 2 single port adapters.
4. Due to a disk failure, there were only 3 x 2+2 RAID 10 arrays.
5. These tests still need to be completed. Note that marketing                2 x SAS   Out SAS           2 x SAS   Out SAS
   literature quoting write < 3500 IOP/s and read < 16,000 IOP/s    EXP3512
   are inflated and based on unrealistic tuning assumptions. A
   more realistic expectation ~= 1000 IOP/s to 4500 IOP/s.
                               Disk to Array Mapping #1
                              Mixed RAID 6/10 Configuration
Tray #

  01     A1     A1     A1     A1     A1     A1     A1     A1      A1     A1     A9     A9
  1      B2     B2     B2     B2     B2     B2     B2     B2      B2     B2    B10 B10
  2      A3     A3     A3     A3     A3     A3     A3     A3      A3     A3     A9     A9
  3      B4     B4     B4     B4     B4     B4     B4     B4      B4     B4    B10 B10
  4      A5     A5     A5     A5     A5     A5     A5     A5      A5     A5    A11 A11
  5      B6     B6     B6     B6     B6     B6     B6     B6      B6     B6    N/A2 N/A2
  6      A7     A7     A7     A7     A7     A7     A7     A7      A7     A7    A11 A11
  7      B8     B8     XX2    B8     B8     B8     B8     B8      B8     B8    B82 N/A2


Controller A LUNs: 1, 3, 5, 7, 9, 11
Controller B LUNs: 2, 4, 6, 8, 10
Blue = 8+2 RAID 6, Green = 2+2 RAID 10, XX = bad disk, N/A = unassigned disk
Optimizing the Disk to Array Mapping
- Be sure number of disks in each array are distributed uniformly between even and odd slots.
  (n.b., This can not be done perfectly for 4+P or 8+P RAID 5.)

Footnotes:
1. Tray 0 contains the DS3512 ESMs (i.e., controller); trays 1-7 contain the EXP3512 ESMs (i.e., expansion trays)
2. Disk 3 in tray #7 failed. Therefore one of the disks from an RAID 6 array was re-provisioned and its other disks were
unused.
   This was done temporarily to avoid RAID rebuild overhead during the benchmark testing.
                              Disk to Array Mapping #2
                             Mixed RAID 5/10 Configuration
Tray #

 01      A1     A1     A1     A1     A1     A2     A2     A2     A2     A2    N/A    N/A
  1      B3     B3     B3     B3     B3     B4     B4     B4     B4     B4    N/A    N/A
  2      A5     A5     A5     A5     A5     A6     A6     A6     A6     A6    N/A    N/A
  3      B7     B7     B7     B7     B7     B8     B8     B8     B8     B8    N/A    N/A
  4      A9     A9     A9     A9     A9    A10 A10 A10 A10 A10                N/A    N/A
  5      B11 B11 B11 B11 B11 B12 B12 B12 B12 B12                              N/A    N/A
  6      A13 A13 A13 A13 A13 A14 A14 A14 A14 A14                              N/A    N/A
  7      B15 B15 XX2 B15 B15 B16 B16 B16 B16 B16 B152 N/A


Controller A LUNs: 1, 2, 5, 6, 9, 10, 13, 14
Controller B LUNs: 3, 4, 7, 8, 11, 12, 15, 16
Blue = 4+1 RAID 5, XX = bad disk, N/A = unassigned disk
Optimizing the Disk to Array Mapping
- Be sure number of disks in each array are distributed uniformly between even and odd slots.
  (n.b., This can not be done perfectly for 4+P or 8+P RAID 5.)

Footnotes:
1. Tray 0 contains the DS3512 ESMs (i.e., controller); trays 1-7 contain the EXP3512 ESMs (i.e., expansion trays)
2. Disk #3 in tray #7 failed. In order to preserve even/odd balance, disk #11 in tray #7 was re-provisioned in B15

								
To top