Draft V1.6
April 8, 2002
RS/6000 Native Fibre Installation Non-HACMP 2105 Enterprise Storage Server As of April 8, 2002 This checklist provides the steps to do initial attach of RS/6000 native fibre to the ESS. This checklist assumes a new install of both the RS/6000 and the ESS.
Preparation - Call IBM AIX Software Support, 1-800-CALL-AIX, and order the following maintenance: 1. Service Refresh Release 09 or later for AIX 4.3.3. This should fit on a single CD-ROM. Optionally, this can be downloaded from the RS/6000 support website listed below. 2. Obtain the PTF fixes for the list of attached APARs for AIX 4.3.3. SP customers should also obtain the fixes listed for PSSP 3.1.1 and RVSD 3.01. The PTFs should fit on a single CD-ROM. These APAR’s can be optionally downloaded from the RS/6000 support website listed below. 3. Download the AIX Host Script for the ESS, fileset ibm2105.rte, from the following website: http://ssddom01.storage.ibm.com/techsup/swtechsup.nsf/support/sddhostupdates 4. If you are planning on multipathing support, please download SDD (Subsystem Device Driver) Version 1.3.1.3 and corresponding documentation from the website: http://ssddom01.storage.ibm.com/techsup/swtechsup.nsf/support/sddupdates 5. A utility program is available that will document the AIX vpath/hdisk to ESS lun layout. This utility can be downloaded from the website: http://ssddom01.storage.ibm.com/techsup/swtechsup.nsf/support/sddutil 6. Notes: a. PSSP, RVSD and GPFS APARs apply only to RS/6000-SP systems. b. RS/6000 APARs, PTFs and microcode are available under the Preventative Maintenance option at the following IBM website: http://techsupport.services.ibm.com/server/support?view=pSeries c. The ESS Host Attachment Guide, SG26-7296-05, Chapter 6, provides additional information and can be downloaded from the following IBM website: http://ssddom02.storage.ibm.com/disk/ess/documentation.html Implementation - The following steps should be accomplished on each RS/6000 System or RS/6000-SP Node to support attachment to the ESS: 1. If not already installed, install AIX 4.3.3 base, be sure to include fibre channel support: a. devices.pci.df1000f7 for FC6227 and FC6228 fibre adapter. b. devices.pci.df1000f9 for FC6228 fibre adapter. c. devices.fcp.disk. d. devices.fcp.disk.array. e. devices.common.IBM.fc.rte. Note: The base support for fibre adapter FC6228 is available through AIX APAR IY20367. 2. For SDD multipathing users, install the following from the AIX 4.3.3 base: a. perfagent.tools b. bos.adt c. bos.adt.prof
AIX-FC New Install Checklist.rtf
Draft V1.6
April 8, 2002
d. bos.up or bos.mp depending on whether you have single or multiple processors in your RS/6000. 3. Install the ibm2105.rte fileset on each RS/6000 Server. The most current version of this fileset and it’s install script can be downloaded from the SDD website above. Optionally, the fileset and install script can be found on a CD-ROM provided with the ESS subsystem. 4. Download and install current microcode for fibre channel adapter. FC6227 uses firmware level SF322A1 or later, FC6228 uses firmware level SF382A1 or later. 5. Install AIX Service Refresh Release 09 or later. 6. Install the fixes for the AIX 4.3.3 APARs on the attached list and verify that the fibre filesets on the attachment are at or above the level indicated. If necessary, install individual PTF's to bring the filesets up to the indicated level. 7. Need to obtain fibre cables locally if distance from RS/6000 to ESS exceeds 30 meters. 8. Need to establish back up procedures for the RS/6000 disks and the ESS. 9. 2109 Fibre Channel Switch should be at firmware level 2.2.1 or later. 10. ESS should be upgraded to microcode level V1.5.1.16 or later. 11. Ensure that paths to the shared luns from host use ESS I/O bays 1 and 4 or I/O bays 2 and 3 as pairs. 12. Obtain WWPN’s for fibre adapters. These can be obtained by issuing the AIX command, lscfg -vl fcsx, for each fibre adapter. The WWPN is the field labeled Network Address. 13. Define hosts for each fibre adapter using the WWPN’s from above. 14. Set ESS fibre adapters to: Arbitrated Loop for RS/6000 to ESS direct attach. Point to Point for RS/6000 SAN fabric attach to ESS. 15. Confirm RS/6000 adapters have appropriate setting: AL or PT-to-PT. If not correct, run the following commands to reset the adapter: rmdev -dl fscsix where x is the fcs number. rmdev -dl fcsx -R where x is the fcs number. 16. Attach RS/6000 fibre to the ESS, perform cfgmgr -l fcsx for each fibre adapter and ensure all hdisks are available. 17. For SDD users, download SDD V1.3.1.3 code and documentation for AIX V4.3.3 and install SDD. SDD does not currently support SAN Data Gateways or RVSD. 18. To complete the installation of SDD follow the instructions in the SDD manual for using SMITTY to Define the Data Path Devices. Make sure you have all file systems unmounted. Optionally, you can reboot the RS/6000 to complete this step. 19. Run the lsvpcfg command to verify vpaths are available and configured correctly, i.e., correct number of hdisks per vpath and that both vpaths and hdisks are available. 20. Volume groups must now be made up of vpaths instead of hdisks. Reference the SDD manual for details. 21. Verify RS/6000 and ESS operations. 22. Information for Oracle Data Base users using asynchronous I/O to raw volumes: a. Apply Oracle defect number 866200 throttling asynchronous I/O which is included in Oracle base code version 8.1.6 and above. b. Tune AIX asynchronous I/O handler on AIX (aio0). Raise default value of 4096 to 16384, 32768 or 65536. To view the current setting, type 'lsattr -El aio0'. The value can be changed via 'smitty aio0'. Also adjust 'miniservers' to 10 and 'maxservers' to 80.
AIX-FC New Install Checklist.rtf
Draft V1.6
April 8, 2002
Recommended APARs for AIX 4.3.3 for Fiber Channel and ESS Support As of April 8, 2002
Component AIX 4.3.3 APAR PTF Description AIX 4.3.3 Service Refresh Release 09 or later. Asynchronous I/O on data base raw volumes. FC I/O hang after Shark warmstart or cable pull error inject. cfmgr fails to add a device. heavy fc i/o and large queue depth devices.pci.df1000f7.com.4.3.3.80 devices.pci.df1000f7.diag.4.3.3.77 devices.pci.df1000f7.rte.4.3.3.76 devices.fcp.disk.rte.4.3.3.76 devices.fcp.disk.array.diag.4.3.3.50 devices.fcp.disk.array.rte.4.3.3.79 devices.common.IBM.fc.rte.4.3.3.75 devices.pci.df1000f9.diag.4.3.3.75 if using fibre adapter FC6228 devices.pci.df1000f9.rte.4.3.3.76 if using fibre adapter FC6228
AIX 4.3.3
IY15138 IY17902 IY18070 IY23369 U481918 U480886 U480809 U481895 U474275 U481919 U475697 U478411 U480808
The maintenance below is for SP customers only. PSSP 3.1.1 IY03104 IY07130 IY09260 IY04782
SSD Not Supported For SP FC2054 POWER3 SMP High Node and FC2055 SP Expansion I/O Unit only. For SP FC2054 POWER3 SMP High Node and FC2055 SP Expansion I/O Unit only. For SP FC2054 POWER3 SMP High Node and FC2055 SP Expansion I/O Unit only.
IY04804
IY04819
RVSD 3.01
IY04249 IY11783 IY05124
GPFS 2.1
AIX-FC New Install Checklist.rtf