manualshive.com logo in svg

IBM RS/6000 SP, Handbook

The IBM RS/6000 SP handbook offers detailed instructions on how to maximize the performance of your system. Download the manual for free from 88.208.23.73:8080 to learn about the innovative features and functionalities of this powerful product. Get all the information you need to optimize your IBM RS/6000 SP experience.

Share
Download
background image

 Contents 

xi

9.1.4  IBM Virtual Shared Disk (VSD) . . . . . . . . . . . . . . . . . . . . . . . . . . . . 264
9.1.5  Security . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 264
9.1.6  Performance Toolbox Parallel Extensions for AIX (PTPE) . . . . . . . 265
9.1.7  Subsystem communications support  . . . . . . . . . . . . . . . . . . . . . . . 265
9.1.8  Network Time Protocol (NTP) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 265
9.1.9  System availability. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 265
9.1.10  Other convenient services. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 266
9.1.11  New in PSSP 3.2. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 266
9.1.12  Software requirements  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 267

9.2  General Parallel File System (GPFS) . . . . . . . . . . . . . . . . . . . . . . . . 267

9.2.1  Administration and operation  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 268
9.2.2  Higher performance/scalability  . . . . . . . . . . . . . . . . . . . . . . . . . . . . 268
9.2.3  Recoverability . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 268
9.2.4  Migration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 269
9.2.5  New in GPFS 1.4  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 269
9.2.6  Software requirements  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 269

9.3  LoadLeveler . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 270

9.3.1  Administration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 270
9.3.2  Capabilities . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 271
9.3.3  New in LoadLeveler 2.2  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 272
9.3.4  Software requirement  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 272

9.4  Mathematical Subroutine Libraries (PESSL) . . . . . . . . . . . . . . . . . . . 272

9.4.1  Operations. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 274
9.4.2  New in ESSL 3.2 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 275
9.4.3  New in Parallel ESSL 2.2  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 275
9.4.4  New in OSLp 1.3 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 276
9.4.5  Software requirement  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 276

9.5  Parallel Environment (PE)  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 277

9.5.1  Operation  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 278
9.5.2  New in PE 3.1 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 278
9.5.3  Software requirements  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 280

9.6  IBM High Availability Cluster Multi-Processing for AIX (HACMP)  . . . 281

9.6.1  Administration and operation  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 281
9.6.2  Features  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 282
9.6.3  New in HACMP 4.4 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 283
9.6.4  Software requirements  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 284

Chapter 10.  Clustering configurations  . . . . . . . . . . . . . . . . . . . . . . . . . . . 285
10.1  Configurations rules . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 286

10.1.1  Placement rules for nodes, frames, and switches. . . . . . . . . . . . . 287
10.1.2  Numbering rules for frames, slots, nodes, and switch ports . . . . . 299

10.2  SP universal clustering capabilities  . . . . . . . . . . . . . . . . . . . . . . . . 304

10.2.1  SP system in non-switched and switched environments  . . . . . . . 305

Summary of Contents for RS/6000 SP

Page 1: ...an Willis C White III RS 6000 SP and Clustered IBM pSeries Systems Handbook Overview of the RS 6000 SP and pSeries servers configurations Information on available machine types models and feature code...

Page 2: ......

Page 3: ...RS 6000 SP and Clustered IBM pSeries Systems Handbook September 2001 International Technical Support Organization SG24 5596 02...

Page 4: ...ed Program product number 5765 D51 and AIX Version 4 Release 3 Licensed Program product number 5765 C34 Comments may be addressed to IBM Corporation International Technical Support Organization Dept J...

Page 5: ...ons on page 195 Clustering configurations are discussed in Chapter 10 Clustering configurations on page 285 Changed information Overview of the RS 6000 SP and Clustered pSeries is discussed in Chapter...

Page 6: ...iv RS 6000 SP and Clustered IBM pSeries Systems Handbook...

Page 7: ...es 12 1 4 2 Frames 15 1 4 3 Extension nodes 16 1 4 4 Switches 17 1 4 5 Control workstations 17 1 5 RS 6000 SP and AIX clustering 18 Chapter 2 SP internal processor nodes 25 2 1 SP internal node 26 2 2...

Page 8: ...Node F C 2056 48 2 5 1 Bus description 48 2 5 2 Requirements 48 2 5 3 Options 49 2 5 4 Processor requirements and options 49 2 5 5 Memory requirements and options 50 2 5 6 Hard disk drive requirements...

Page 9: ...75 Chapter 3 SP attached servers and Clustered Enterprise Servers 77 3 1 Overview 78 3 2 SP attached servers CES M T 7017 supported models 79 3 2 1 pSeries 680 Model S85 7017 S85 79 3 2 2 RS 6000 Ente...

Page 10: ...550 single stage SP Switch and SP Switch2 configuration 147 4 3 4 Model 550 two stage SP Switch and SP Switch2 configuration 147 4 4 Model 555 standalone switch for clustered nodes 148 4 5 Expansion f...

Page 11: ...workstation 190 6 4 2 Connecting to multiple SP systems 191 6 4 3 Connecting to the SP Switch 192 Chapter 7 Control workstations 195 7 1 Overview 196 7 2 Installation requirements 198 7 2 1 Supported...

Page 12: ...ter FC 2975 245 8 2 22 TURBOWAYS 100 ATM adapter F C 2984 245 8 2 23 Ethernet LAN PCI adapters F C 2985 and 2987 245 8 2 24 ATM 155 MMF adapter F C 2988 246 8 2 25 Four Port 10 100 BASE TX Ethernet PC...

Page 13: ...in LoadLeveler 2 2 272 9 3 4 Software requirement 272 9 4 Mathematical Subroutine Libraries PESSL 272 9 4 1 Operations 274 9 4 2 New in ESSL 3 2 275 9 4 3 New in Parallel ESSL 2 2 275 9 4 4 New in OS...

Page 14: ...ention 362 Naming convention 362 Appendix B Hardware 365 SP Communication adapter requirements 366 PCI bus I O adapter requirements for SMP nodes 366 MCA bus adapter requirements 381 Evaluating SP Sys...

Page 15: ...eler 423 Supported Levels 423 Migration considerations 424 Coexistence 424 Appendix E SP CES Tools 425 Network Installation Manager 426 Differences with SP CES versus R S6000 NIM 426 Service Director...

Page 16: ...xiv RS 6000 SP and Clustered IBM pSeries Systems Handbook...

Page 17: ...M80 server 101 3 3 System architecture for 7026 6H1 server 106 3 4 SP attached servers connectivity diagram 128 3 5 Clustered Enterprise Servers connectivity diagram 137 4 1 SP frame model 550 141 4...

Page 18: ...SP attached servers 304 10 12 Non switched SP environment 305 10 13 Switched SP environment 309 10 14 Switched SP environment with SP attached servers 315 10 15 Pure CES system environment 325 10 16 C...

Page 19: ...ers 78 3 2 Publications for the 7017 S85 server 84 3 3 Publications for the 7017 S80 server 88 3 4 Publications for the 7017 S7A server 92 3 5 Publications for the 7017 S70 server 95 3 6 SP attached s...

Page 20: ...ansion I O Units 370 B 4 PCI adapters weighting factors 376 B 5 Micro Channel Adapter requirements 381 B 6 SP system frame power computation worksheet 385 B 7 Legacy SP nodes 389 B 8 Legacy models by...

Page 21: ...pdated information on the supported communication adapters for the RS 6000 SP and clusted pSeries systems Updated information on the SP Switch SP Switch2 and the SP Switch Router Updated information o...

Page 22: ...He has IBM Certification for RS 6000 Solutions Sales and IBM Qualification for RS 6000 SP Solutions Sales Willis C White III is a software engineer in the Functional Verification Test department of th...

Page 23: ...o be product documentation IBM trademarks The following terms are trademarks of the International Business Machines Corporation in the United States and or other countries Comments welcome Your commen...

Page 24: ...xxii RS 6000 SP and Clustered IBM pSeries Systems Handbook ibm com redbooks Send your comments in an Internet note to redbook us ibm com Mail your comments to the address on page ii...

Page 25: ...system for performance scalability reliability availability serviceability and management this system makes feasible the processing of applications characterized by large scale data handling and comp...

Page 26: ...ontains its own copy of the AIX operating system The 222 MHz 375 MHz POWER3 SMP nodes are powered by the same POWER3 processor technology introduced with the RS 6000 43P model 260 270 workstation Henc...

Page 27: ...he RS 6000 SP system as a cluster of SP processor nodes managed by the AIX operating system and PSSP management software from the CWS is the first step to universal clustering Managed by the AIX and P...

Page 28: ...structural analysis and seismic modeling to circuit simulation and molecular modeling Multiple users can run complex queries against very large amounts of data and obtain results interactively This m...

Page 29: ...m administrators greater control over how the scheduler and Virtual Memory Manager VMM allocate CPU and physical memory resources to processes This can be used to prevent different classes of jobs fro...

Page 30: ...wn monitoring and partitioning In addition the SP CES system offers a wide range of open system management software tools for operation and administration availability deployment and security manageme...

Page 31: ...sing power required for large complex applications It also allows the flexibility to configure the system for optimum commercial or technical computing application performance Multistage packet switch...

Page 32: ...ssues associated with the addition of new servers to support the increasing number of Internet services and the complex dynamic workloads characteristic of network computing Additionally flexible node...

Page 33: ...follows Processor nodes include SP nodes SP attached servers Clustered Enterprise Servers Frames with integral power subsystem Extension nodes include SP Switch Routers SP switches Control Workstatio...

Page 34: ...SP nodes and SP Switch Router are connected to the SP Switch The SP nodes and the SP Switch Router are connected to the SP Ethernet interface of the CWS The frame with the SP nodes and the SP Switch...

Page 35: ...M T 7026 are housed in their own frames The SP node and the SP attached servers are connected to the SP Switch The SP node and the SP attached servers are connected to the SP Ethernet interface of th...

Page 36: ...ch The servers are connected to the SP Ethernet interface and to the RS 232 interface of the CWS 1 4 1 Processor nodes The IBM RS 6000 SP system is scalable from 1 to 128 processor nodes which can be...

Page 37: ...O units These nodes are compatible with the SP Switch and the SP Switch2 but they are not compatible with the SP Switch 8 and the High Performance Switch The following high nodes are supported 375 MH...

Page 38: ...ries or an RS 6000 Enterprise Server supported to be configured to operate with an RS 6000 SP system The Table 1 1 shows the list with the pSeries and RS 6000 Enterprise Servers supported as an SP att...

Page 39: ...cs For more information refer to Chapter 2 SP internal processor nodes on page 25 and Chapter 3 SP attached servers and Clustered Enterprise Servers on page 77 1 4 2 Frames The IBM RS 6000 SP system f...

Page 40: ...r node support 2 A dependent node adapter A communication card mounted in the physical dependent node This card provides a mechanical interface for the cable connecting the physical dependent node to...

Page 41: ...ds on the type of switch you order The SP switches are available as either the 16 port SP Switch or the 8 port SP Switch 8 SP Switch2 F C 4012 16 port switch in SP systems exclusively with POWER3 high...

Page 42: ...anageability This aggregation or clustered computing include servers operating systems storage networks applications racks and stacks The emergence of Web serving and e business as mainstream applicat...

Page 43: ...tive configurations Fail over of resources to backup node nodes when primary node fails Figure 1 5 illustrates a high availability cluster Figure 1 5 High availability cluster WebSphere Application Se...

Page 44: ...high performance technical computing cluster Figure 1 6 High performance technical computing cluster High Performance Commercial Computing Parallel Database Cluster Extreme database scalability Share...

Page 45: ...nsolidation of different workloads Heterogeneous building blocks Central management point of control Consolidated simplified management interface for multiple servers Figure 1 8 on page 22 illustrates...

Page 46: ...r can implement any type of the mentioned cluster computing models separately or together Referring the RS 6000 SP systems and the AIX clusters evolution we mention that The original AIX cluster was b...

Page 47: ...Manageable Management of the aggregated computing facility do not require detailed actions per individual components but instead present a system view of a unified structure that can be effectively u...

Page 48: ...24 RS 6000 SP and Clustered IBM pSeries Systems Handbook...

Page 49: ...s chapter presents the supported nodes In 375 MHz POWER3 architecture The 375 POWER3 SMP High Node F C 2058 or Nighthawk II node The 375 POWER3 SMP Wide Node F C 2057 or Winterhawk II Wide Node The 37...

Page 50: ...sk drives and PCI expansion slots for I O and connectivity such as any other server There are three types of internal SP nodes Thin wide and high They may be mixed in a system and are housed in a fram...

Page 51: ...neral purpose chip set that controls memory and I O for systems such as the 375 MHz POWER3 SMP node which implement the PowerPC MP System bus 6xx bus This chip set consists of two semi custom CMOS chi...

Page 52: ...plemented with external SRAM modules The 375 MHz POWER3 microprocessor has a dedicated external interface separate from 6xx bus interface for the level 2 cache accesses Access to the 6xx bus and the l...

Page 53: ...ory bus 512 bit 62 5MHz 5 RIO MX bus 64 bit 66MHz 6 6XX MX bus 64 bit 33MHz 7 RIO bus 8 bit 250MHz DUPLEX Bus features 6 I5 I4 RIO MX Integrated ethernet 10 100 Mb s Integrated U SCSI I1 I3 I2 SPS MX2...

Page 54: ...I O controller chip set implements a 64 bit plus parity multiplexed address and data bus 6xx MX bus for attaching up to three PCI bridge chips and the SP Switch MX2 Adapter The 6xx MX bus runs at 60 M...

Page 55: ...ction is for initialization system error recovery and diagnostics The service processor supports system diagnostics by saving the state of the system in a 128 KB non volatile memory NVRAM The service...

Page 56: ...cessor that has been determined to be operating below an acceptable level of reliability To accomplish this the system monitors processor status in real time to determine when the number of recoverabl...

Page 57: ...s to support mirroring Maximum internal storage 946 4 GB with SP Expansion I O Unit PCI bus speed 33 MHz PCI slots 5 PCI one 32 bit and four 64 bit and 8 PCI in the Expansion Unit 53 max Adapters Inte...

Page 58: ...34 RS 6000 SP and Clustered IBM pSeries Systems Handbook Figure 2 4 375 MHz POWER3 High Node packaging...

Page 59: ...essor 8 MB 8 MB Standard RAM 256 MB 256 MB Maximum RAM 16 GB 16 GB Disk media bays Two Four Storage Internal external boot disks Internal disks installed in pairs to support mirroring Internal externa...

Page 60: ...36 RS 6000 SP and Clustered IBM pSeries Systems Handbook Figure 2 5 375 Mhz POWER3 SMP Wide Node packaging...

Page 61: ...f a frame without requiring additional nodes 2 3 1 PCI bus description The 375 MHz POWER3 SMP High Node PCI bus contains one 32 bit and four 64 bit PCI slots for I O adapters Additional PCI adapters c...

Page 62: ...r cable is included with the node Node to node HACMP cable F C 3124 Frame to frame HACMP cable F C 3125 2 3 4 Processor requirements and options 375 MHz POWER3 SMP High Nodes require a minimum of four...

Page 63: ...elds 35 5 48 5 of peak 4 to 64 GB mounted on four cards yields 67 97 of peak Table 2 4 shows the memory features for the 375 MHz POWER3 SMP High Node Table 2 4 375 MHz POWER3 SMP High Node F C 2058 me...

Page 64: ...disk pair F C 3820 External storage devices can be accessed through optional Ultra SCSI adapter F C 6207 and SSA adapter F C 6230 2 3 7 Switch and communication adapter requirements and options If you...

Page 65: ...er hot plug capability is supported for the SP Expansion I O Unit with AIX 4 3 3 software loaded on the node Up to six expansion units can be connected to each processor node in one to three loops of...

Page 66: ...apter F C 6206 18 2 GB Ultra SCSI disk pair F C 3803 requires adapter F C 6206 9 1 GB SSA disk pair F C 3802 requires adapter F C 6230 9 1 GB Ultra SCSI 10K RPM disk pair F C 3805 requires adapter F C...

Page 67: ...ed Once the power system upgrade is done these nodes are fully compatible with all existing SP system hardware except High Performance switches 2 4 1 Bus description The 375 MHz POWER3 SMP Wide Node P...

Page 68: ...k drive bays supporting up to 109 2 GB of Storage 54 6 GB mirrored Integrated Ultra SCSI Standard service processor External nine pin RS232 on the planar S2 port supported only for HACMP serial heartb...

Page 69: ...he memory features for the 375 MHz POWER3 SMP Wide Nodes Table 2 6 375 MHz POWER3 SMP Wide Nodes memory features Feature Code Description Minimum Node Requirement Maximum Features Per Node 4098 Base M...

Page 70: ...isk pair F C 2918 9 1 GB Ultra SCSI 10K RPM disk pair F C 3804 18 2 GB Ultra SCSI 10K RPM disk pair F C 3810 36 4 GB Ultra SCSI 10K RPM disk pair F C 3820 available only for I O side hard disk drive b...

Page 71: ...ceed at higher bandwidths and lower latencies In switch configured systems 375 MHz POWER3 SMP Wide Nodes require SP Switch MX2 adapter F C 4023 Switch restrictions 375 MHz POWER3 SMP Wide Nodes are no...

Page 72: ...des are housed in an enclosure F C 9930 If you order a single node a cover plate F C 9931 is included to fill the even numbered slot opening If you plan to install a 375 MHz POWER3 SMP Thin Node into...

Page 73: ...45 Two hard disk drive bays supporting up to 36 4 GB of Storage 18 2 GB mirrored Integrated Ultra SCSI Standard service processor External 9 pin RS232 on the planar S2 port supported only for HACMP se...

Page 74: ...the memory features for the 375 MHz POWER3 SMP Thin Nodes Table 2 8 375 MHz POWER3 SMP Thin Nodes F C 2056 memory features Feature Code Description Minimum Node Requirement Maximum Features Per Node...

Page 75: ...pter requirements If you are planning to use a switch in your SP system you need switch adapters to connect each RS 6000 SP node to the switch subsystem SP switch adapters have several characteristics...

Page 76: ...e processor node that utilizes the POWER3 64 bit microprocessor The floating point performance of the POWER3 microprocessor makes this node an excellent platform for compute intensive analysis applica...

Page 77: ...oprocessor The POWER3 design contains a superscalar core which is comprised of eight execution units supported by a high bandwidth memory interface capable of performing four floating point operations...

Page 78: ...ory is controlled by the memory I O chip set via the memory bus The memory bus consists of a 128 bit data bus and operates at 100 MHz clock cycle This bus is separated from the System bus 6xx bus whic...

Page 79: ...de requires a tall deep frame Model 550 or F C 1550 they are supported in the withdrawn 2 01 m frame or in the 1 25 m frame 2 7 1 PCI bus description The 222 MHz POWER3 SMP High Node PCI bus contains...

Page 80: ...for an optional switch adapter Integrated Ethernet with BNC and RJ45 ports only one port can be used at a time 10Base2 Ethernet BNC 10BaseT or 100BaseTX Ethernet RJ45 Support for up to six SP Expansio...

Page 81: ...oss four memory cards The following list illustrates this 1 to 4 GB memory mounted on one card yields 16 8 24 3 of peak bandwidth 2 to 8 GB mounted on two cards yields 33 5 48 5 of peak 4 to 16 GB mou...

Page 82: ...cessed through optional Ultra SCSI adapter F C 6207 and SSA adapter F C 6230 2 7 7 Switch and communication adapter requirements and options If you are planning to use a switch in your SP system you n...

Page 83: ...disk drive bays PCI adapter hot plug capability is supported for the SP Expansion I O Unit with AIX 4 3 3 software loaded on the node Up to six expansion units can be connected to each processor node...

Page 84: ...d disk drive pairs for SP Expansion I O Units are available as follows 9 1 GB Ultra SCSI disk pair F C 3800 requires adapter F C 6206 18 2 GB Ultra SCSI disk pair F C 3803 requires adapter F C 6206 9...

Page 85: ...roller generates an independent separately clocked mezzanine I O bridge bus to which multiple chips can be attached to implement various architected I O buses for example PCI that also operate indepen...

Page 86: ...equential ordering requirement and each operation is tagged with an 8 bit tag which allows a maximum of up to 256 transactions to be in progress in the 256KB ECC X5 L2 Cache Processor Card Memory I O...

Page 87: ...l cache designs The cache controller is inline and totally contained in one chip Integrated on the same silicon die as the controller itself are dual tag directories and 256 KB of SRAM cache The dual...

Page 88: ...p to eight increments of synchronous dynamic RAM SDRAM memory on each card Each increment is a pair of dual in line memory modules DIMMs There are two types of DIMMs supported 32 MB DIMMs that contain...

Page 89: ...data bus bandwidth does not This means that concurrent memory or cache to cache data can be sent on the SMP data bus while the memory controller is using the I O bridge bus to transfer data or from I...

Page 90: ...onsequently acceptance of processor Load Store operations which target the PCI bus only depend upon buffer availability and not the availability of the target bus or completion of DMA operations Likew...

Page 91: ...ible with all existing SP hardware except for High Performance Switches 2 9 1 Bus description The 332 MHz SMP wide node PCI bus is divided into three logical groups of PCI slots The first slot group s...

Page 92: ...SI DE F C 6207 To avoid performance degradation the following adapters should not be placed in slots I5 I6 I7 or I8 in 332 MHz SMP Wide Nodes FDDI SK NET LP SAS F C 2741 FDDI SK NET LP DAS F C 2742 FD...

Page 93: ...ated 10BaseT 10Base2 Ethernet only one port may be used at one time Four disk bays supporting up to 72 8 GB of disk storage 36 4 GB mirrored Integrated SCSI 2 Fast Wide Standard Service Processor Exte...

Page 94: ...9 7 Disk requirements and options 332 MHz SMP wide nodes can have up to four internal disks attached through an integrated SCSI 2 network The 332 MHz SMP wide node can have either no internal disk wit...

Page 95: ...he I O planar with the system planar Placing the switch adapter in the MX bus enables switch traffic to proceed at higher bandwidths and lower latencies In switch configured systems 332 MHz SMP wide n...

Page 96: ...ntains two 32 bit slots PCI slots slots I2 and I3 The I1 slot is reserved for the optional SP Switch MX2 Adapter Previously installed 332 MHz SMP thin nodes may have a withdrawn SP Switch MX Adapter i...

Page 97: ...up nodes and processor node Two processors mounted in one slot 256 MB of memory 4 5 GB of hard disk drive with internal booting An upgraded power system on older frames 2 10 4 Options Each 332 MHz SMP...

Page 98: ...ot required to be configured symmetrically Each card has the capacity to mount 2 GB of DIMMs however only 3 GB are addressable per node Table 2 14 provides the available memory features for the 332 MH...

Page 99: ...nodes does not occupy a PCI slot Instead the switch adapter for these nodes is installed into the Mezzanine bus MX The MX bus connects the I O planar with the system planar Placing the switch adapter...

Page 100: ...76 RS 6000 SP and Clustered IBM pSeries Systems Handbook...

Page 101: ...P from the CWS pSeries and RS 6000 Enterprise Servers can function as SP attached servers on an SP system Also managed by the AIX and PSSP from CWS all the possible SP attached servers to an SP system...

Page 102: ...M T 7026 Models up to 32 mixed servers in total can be integrated on an SP system as SP attached servers The Clustered Enterprise Server CES is an pSeries or an RS 6000 Enterprise Server supported to...

Page 103: ...silicon on insulator technology and larger memory capacity with a proven system architecture to give you reliability you can count on Scalability is enhanced by increasing the amount of memory to 96...

Page 104: ...red with all the internal adapters and devices already installed and configured Highlights The 7017 S85 delivers a cost efficient growth path to the future through these attributes 64 bit system scala...

Page 105: ...stom tailor your solution Choose from multiple SCSI and SSA Storage Media Communication Drawer options Open industry standards such as Open Firmware based on IEEE P1275 standard Enhanced processor spe...

Page 106: ...ieved by the four independent PCI buses per rawer providing up to 500 MB per second aggregate bandwidth per drawer A high performance ECC L2 cache of 16 MB per 600 MHz processor RAID support SSA The o...

Page 107: ...4 bit 66MHz 7 PCI bus 64 bit 33MHz Bus features 1 CEC unit I10 I9 I12 I14 I13 I11 PCI Ctrl PCI Ctrl 32 bit 33MHz RS64 VI 600 MHz RS64 VI 600 MHz RS64 VI 600 MHz RS64 VI 600 MHz RS64 VI 600 MHz RS64 VI...

Page 108: ...for handling today s complex mission critical applications For more information on this model refer to the redbooks RS 6000 Systems Handbook 2000 Edition SG24 5120 and IBM eserver pSeries 680 Handbook...

Page 109: ...software and services the 7017 S80 provides the power capacity reliability and expandability to help move you into the mission critical commercial computing The 7017 S80 is packaged as a Central Elec...

Page 110: ...nd communication subsystems The RS 6000 Enterprise Server 7017 S80 is shipped and delivered with all the internal adapters and devices already installed and configured AIX Version 4 3 3 software is in...

Page 111: ...solution Choose from multiple SCSI and SSA Storage Media Communication Drawer options Open industry standards such as Open Firmware based on IEEE P1275 standard Processor and memory growth beyond any...

Page 112: ...with Choice of power from 6 12 18 or 24 processors Extensive memory options up to 96 GB Up to 56 PCI expansion slots Up to 45 TB of disk storage The 7017 S80 server is designed from the ground up for...

Page 113: ...ill support 32 bit and 64 bit standard PCI adapters Highlights The 7017 S7A delivers a cost efficient growth path to the future through these attributes 64 bit system scalability 4 8 or 12 way process...

Page 114: ...also be used for additional storage and communication drawers This helps to protect your existing investment in SSA or SCSI DASD A fully configured system would be a 12 way processor with 32 GB of sys...

Page 115: ...nfigurations Internal I O system scalability and expandability that supports Up to four system I O drawers with up to 56 PCI slots Up to 436 8 GB internal disks Eight media bays for tape and optical d...

Page 116: ...3 4 Publications for the 7017 S7A server The publications are available for download from the Internet http www ibm com servers eserver pseries library 3 2 4 RS 6000 Enterprise Server 7017 Model S70...

Page 117: ...SMP that utilizes the new 64 bit 125 MHz RS64 processor with 4 MB of Level 2 L2 cache per processor The standard 4 way SMP can be expanded to 12 way SMP the system memory can be expanded to 32 GB The...

Page 118: ...P1275 standard Processor and memory growth beyond any previous Enterprise Server The base configuration 4 way SMP processors can be expanded up to 12 way Memory can be expanded up to 32 GB in 512 MB...

Page 119: ...Publications for the 7017 S70 server The publications are available for download from the Internet http www ibm com servers eserver pseries library 3 2 5 Summary features of the SP attached servers CE...

Page 120: ...yes PCI slots available 53 53 53 53 PCI bus speed MHz 33 33 33 33 Disk Media bays 48 8 48 8 48 8 48 8 Minimum maximum internal disk storage GB 9 1 873 6 9 1 873 6 9 1 436 8 4 5 436 8 I O Drawer 4 4 4...

Page 121: ...porate the power of the Web and 64 bit computing into your environment while still supporting existing 32 bit applications Highlights The 7026 M80 delivers a cost efficient growth path to the future t...

Page 122: ...dant cooling The CEC drawer incorporates the system processors memory and supporting systems logic The primary first I O drawer features 14 available hot plug PCI slots System support service processo...

Page 123: ...at take advantage of the rack packaging to custom tailor your solution Choose from multiple SCSI SSA and Fibre Channel attached Storage Media Communication Open industry standards such as Open Firmwar...

Page 124: ...stem supporting 32 bit and 64 bit adapters Greater application throughput is achieved via independent PCI buses for each of the 14 PCI slots in the I O drawer This design provides up to 1 GB per secon...

Page 125: ...2 way or 4 way processor cards to create configurations of two four six or eight processors as required offering outstanding scalability as your business needs dictate Memory octals 1 to 64 GB ECC me...

Page 126: ...026 M80 as data storage internal to the drawers is not provided however optional boot bays are available in the first I O drawer The internal boot disk option requires the space of two PCI slots leavi...

Page 127: ...r more information on this model refer to the redbook RS 6000 Systems Handbook 2000 Edition SG24 5120 Table 3 7 provides the publications for the 7026 M80 server Table 3 7 Publications for the 7026 M8...

Page 128: ...to the future through such attributes as 64 bit system scalability with the following processor options 1 way 450 MHz RS64 III with 2 MB L2 cache 1 way 600 MHz RS64 IV with 2 MB L2 cache 2 way 450 MH...

Page 129: ...and functions to the Enterprise Server The optional N 1 power subsystem provides redundancy in case of power supply failure Hot plugged power supplies in the CEC and I O drawers allow concurrent repai...

Page 130: ...cooling The incorporation of hot plug PCI I O slots brings new and increased levels of availability for this system The need to power down and reboot when adding or replacing most PCI adapters is Memo...

Page 131: ...e CEC drawer and one I O drawer provides 14 available hot plug PCI slots with up to six processors and 32 GB of memory External disk storage is required for the 7026 6H1 as data storage internal to th...

Page 132: ...neup 3 3 3 pSeries 660 Model 6H0 7026 6H0 The 7026 6H0 server is a member of the 64 bit family of symmetric multiprocessing SMP servers from IBM It delivers a cost efficient growth path to the future...

Page 133: ...bit and 64 bit standard PCI adapters The 7026 H80 has 1 2 and 4 way processors that operate at 450 MHz while the 6 way processor operates at 500 MHz The 1 way processor provides 2 MB of L2 cache with...

Page 134: ...rt Keyboard port Mouse port Four serial ports and one parallel port System storage is provided via remotely attached SCSI SSA or Fibre Channel storage subsystems A fully configured H80 system would in...

Page 135: ...he minimum configuration 1 way processor can be increased to a 2 way 4 way or 6 way SMP Memory can be expanded up to 16 GB in 256 MB 512 MB or 1 GB increments Industry standard hot plug PCI slots allo...

Page 136: ...ctronics Complex CEC drawer containing the processors and memory connected to another rack mounted drawer containing the media hot plug I O slots and optional boot bays Both drawers have redundant pow...

Page 137: ...unctionality of the PCI I O subsystem brings new levels of up time to your system for the replacement or addition of I O adapters The design of this function shows a concern for the usability convenie...

Page 138: ...library 3 3 5 Summary features of the SP attached servers CES M T 7026 A summary of the features of the SP attached servers Clustered Enterprise Servers M T 7026 is shown in Table 3 9 Table 3 9 Featu...

Page 139: ...yes yes yes Hot plug slots yes yes yes Redundant hot plug power yes Optionally Optionally Redundant hot plug cooling yes yes yes PCI slots available 56 28 28 PCI bus speed MHz 33 66 33 66 33 66 Disk M...

Page 140: ...54 F C 3154 uses no signal or power from the PCI bus F C 3154 has a ribbon cable which attaches to the J12 port The J12 port is a direct and dedicated pathway to the service processor which gives grea...

Page 141: ...appear nearly identical to nodes to the SP system The SP attached servers M T 7026 supported Models use F C 9122 F C 9123 and F C 3154 to appear nearly identical to nodes to the SP system How the SP s...

Page 142: ...umber nine your system could still be scaled using other switch configured frames and non switched expansion frames The SP attached server can be inserted between two switch configured frames Server a...

Page 143: ...tem In this case you need to add an additional SP frame to your SP system Only the first SP frame is required to have at least one node additional SP frames can be empty 5 Each SP attached server coun...

Page 144: ...erver requires the following 1 One valid unused switch port on the SP Switch corresponding to a legitimate node slot in your SP configuration A legitimate node slot can be empty the second half of a w...

Page 145: ...e Ethernet adapter in slot en0 is a supported Ethernet adapter the adapter must be de configured and then reconfigured as an SP LAN Ethernet adapter M T 7017 Boot device SCSI adapter relocation overvi...

Page 146: ...hed server M T 7026 requires an SP system operating with the following software levels PSSP 3 2 with APAR IY16350 or later AIX 4 3 3 with ML 08 or later Notes 1 Coexistence features provided by PSSP s...

Page 147: ...en0 and must reside in slot 5 of the server primary I O drawer The supported adapters for this system LAN are For Twisted pair cable connection 10 100 Ethernet 10BaseTX adapter F C 2968 10 MB AUI RJ...

Page 148: ...ce for the switch adapter heat sinks The SP Attachment Adapter uses an SP Switch cable to connect to an unused switch port on the current SP configuration There are some SP attached server placement l...

Page 149: ...0 and must reside in slot 1 of the server primary I O drawer The supported adapter for this system LAN is the 10 100 Ethernet 10BaseTX adapter F C 2968 You must install a frame to frame 10 m 33 ft ele...

Page 150: ...trol workstation 3 4 3 SP attached server configurator rules Ordering the SP attached server requires the ordering of both SP features cables and installation instructions as well as tracking for virt...

Page 151: ...tem Ethernet Twisted Pair network but it provides no twisted pair cable F C 9310 or F C 9320 Switch Connection Cable This feature is required only if the SP attached server is switch attached It resul...

Page 152: ...s used as an SP attached server the modem supplied with the server is not used In this installation the SP attached server acts like a Service Director client and forwards its Service Director message...

Page 153: ...terprise Servers use RS 6000 feature codes not RS 6000 SP feature codes The RS 6000 feature codes associated with the Clustered Enterprise Server refer to the cable connections that attach the servers...

Page 154: ...BU power supply and SP Switch F C 4011 but no processor nodes This frame provides node interconnectivity in a CES system having configurations of 2 to 16 servers By adding a second SP Switch F C 4011...

Page 155: ...ou are attaching to the CES system 2 Follow standard AIX procedures to change the boot device a Change device codes b Change device address 3 Take the Enterprise Server down 4 Move SCSI card from slot...

Page 156: ...stalled adapters do not appear in this list they must be removed before it can be attached to the Clustered Enterprise Server Clustered Enterprise Server software requirements The Clustered Enterprise...

Page 157: ...pair cable connection 10 100 Ethernet 10BaseTX adapter F C 2968 10 MB AUI RJ 45 Ethernet adapter F C 2987 For BNC cable connection 10 MB BNC RJ 45 Ethernet adapter F C 2985 The interconnection betwee...

Page 158: ...o more than 12 m 40 ft from the control workstation Note With F C 9122 RS 6000 Server Attached Node and F C 9123 RS 6000 Server Frame Attachement two 15 m 49 ft RS 232 cables and a frame to frame elec...

Page 159: ...ecognized by the clustered server as en0 and must reside in slot 1 of the server primary I O drawer The supported adapter for this system LAN is the 10 100 Ethernet 10BaseTX adapter F C 2968 The inter...

Page 160: ...ed Enterprise Servers connectivity diagram Figure 3 5 on page 137 shows Clustered Enterprise Servers connectivity diagram Note With F C 9122 RS 6000 Server Attached Node and F C 9123 RS 6000 Server Fr...

Page 161: ...forwards its Service Director messages to the local Service Director server The local Service Director server can be the CWS of the CES system or any workstation connected to that LAN When the local...

Page 162: ...not used 3 Configure Service Director on the local Service Director server to forward messages received from the Clustered Enterprise Server The Service Director modem for the CES system is attached t...

Page 163: ...the SP system and to provide nodes interconnectivity in Clustered Enterprise Servers CES configuration There are two frames sizes each size is designed to fit different system configurations Tall fram...

Page 164: ...ch in the frame Frames get equipped with the optional processor nodes and switches that you order Strictly speaking there are three types of frames Short frames Tall frames Switch frames The tall and...

Page 165: ...two models Model 500 and Model 550 and two expansion frame features F C 1500 and F C 1550 The new frame replaces the old tall frame which consisted of six models and six frame features See Appendix B...

Page 166: ...w model was born With the new offering IBM simplified the SP frame options by decoupling the imbedded node from the frame offering Therefore when you order a frame all you receive is a frame with the...

Page 167: ...Conductor size AWG low high2 V 10 10 10 10 8 8 10 6 Circuit breaker Amps low high2 V 30 20 7 30 20 7 50 30 7 30 7 40 7 Connector low voltage only4 460C9W 5 430C9W 5 460C9W 5 39336 9C53U06 Receptacle...

Page 168: ...special voltage or synchronization requirements of the two AC sources are required The two AC sources are galvanically isolated within the SP system When both power sources are operating within their...

Page 169: ...gh nodes All node types can be mixed in these frames They also accommodate a switch These frames are designed for concurrent maintenance each processor node can be repaired without interrupting operat...

Page 170: ...power cable All nodes switches and other auxiliary equipment must be ordered separately 4 3 Model 550 frames The model frame is always the first frame in an SP system and it designates the type or mo...

Page 171: ...onfigurations can also utilize non switched expansion frames Nodes in the non switched expansion frames share unused switch ports both in the model frame and in the switched expansion frames 4 3 4 Mod...

Page 172: ...r SP Switch F C 4011 in the 9076 model 555 The configurator then adds an SP Expansion frame F C 1550 which contains an SP Switch The SP Switch ports in these frames connect to the SP System Attachment...

Page 173: ...with eight empty node drawers and a SEPBU power supply All processor nodes and optional switches must be purchased separately for these frames An SP Switch and up to 16 thin nodes eight wide nodes or...

Page 174: ...witch that can be included in each system and vary depending on how your SP model frame is configured There are two standard configurations for F C 1550 expansion frames These are 1 An expansion frame...

Page 175: ...cases the switch which can have ports to attach up to 16 nodes is not fully utilized One example of an under utilized switch would be a tall frame with eight wide nodes and an SP Switch In this examp...

Page 176: ...model frames In some system configurations you can have unused switch ports in either the model frame or the switched expansion frames Those unused switch ports can be used with non switched expansion...

Page 177: ...s the switches in the model and expansion frames Figure 4 5 illustrates the SP Switch frame from the front view Figure 4 5 SP Switch frame front view MainPower Switch Left Skirt 48Volt Power Modules R...

Page 178: ...ame front view All short frames including previous feature codes are 1 25 m in height However the short frame Scalable Electric Power Base Unit SEPBU power subsystem has been redesigned to accommodate...

Page 179: ...SEPBU and AC power cable All nodes switches and other auxiliary equipment must be ordered separately 4 8 Model 500 frames The model frame is always the first frame in an SP system and it designates th...

Page 180: ...All 1 25 m frames have four empty node drawers for separately purchased nodes Up to eight thin nodes four wide nodes or two high nodes can be installed in these frames 4 8 4 Using F C 1500 non switche...

Page 181: ...added to the Model 500 SP frame configured with processor nodes only no switch to take advantage of unused node slots Model 500 systems have a capacity for up to eight nodes If you fill the model fram...

Page 182: ...158 RS 6000 SP and Clustered IBM pSeries Systems Handbook...

Page 183: ...cient network available in SP system and Clustered Enterprise Servers This chapter describe the two available switch series The SP Switch or SPS F C 4011 and F C 4008 The SP Switch2 or SPS2 F C 4012 T...

Page 184: ...ystem allows switch boards only frames that provide switch to switch connections and greatly increase scalability Figure 5 1 shows the front view of the SP Switch board Figure 5 1 Front view of the SP...

Page 185: ...ffered crossbar which allows packets to pass directly from receiving ports to transmitting ports These crossbar paths allow packets to pass through the SP Switch directly from the receivers to the tra...

Page 186: ...mum latency is achieved for packets that use the crossbar Figure 5 3 on page 162 shows the SP Switch chip Figure 5 3 SP Switch chip SPSwitchport Output port Input port Output port Input port Output po...

Page 187: ...ch adapter An SP Switch adapter includes one SP Switch port that is connected to an SP Switch board The SP Switch adapter is installed on an SP node SW3 SW2 SW1 SW0 3 2 1 0 3 2 1 0 3 2 1 0 3 2 1 0 4 5...

Page 188: ...on page 165 shows a SP Switch system with one SP frame there are 16 nodes equipped with SP Switch adapters and one SP Switch board Sixteen SP Switch adapters are connected to 16 of 32 SP Switch ports...

Page 189: ...switch plans Also refer to Chapter 10 Clustering configurations on page 285 for clustering configurations and nodes and adapter placement configuration rules SP switch Adapter SP Node SP switch Adapt...

Page 190: ...ation on the SP Switch 16 port F C 4011 The SP Switch provides low latency high bandwidth communication between nodes supplying a minimum of four paths between any pair of nodes The SP Switch can be u...

Page 191: ...al power for the SP Switch 8 is available using F C 1212 When you order F C 4008 you receive one 8 port SP Switch and all of the cables you need to connect the switch ports to up to eight nodes both w...

Page 192: ...switch adapter is needed for each node in the SP system Table 5 2 shows the SP Switch adapter features Table 5 2 SP Switch adapter features Note The SP attached server Clustered Enterpise Servers and...

Page 193: ...Switch Router The included cable attaches to the SP Switch and uses up one valid node slot on the switch 5 7 Switch cabling The SP CES systems in switched configurations require a number of cables tha...

Page 194: ...ables The rest of the ports can be used by up to twelve additional nodes mounted in non switched expansion frames In this example twelve 10 meter cables are provided to connect the switch to the nodes...

Page 195: ...her switch cables and ac sources 5 Making certain that your raised floor is high enough to contain all cables 6 Placing cables so that cooling air flow is unrestricted through raised floor space 7 Lab...

Page 196: ...red squares represent switch equipped frames The arrows are the cable sets with the quantity of individual cables in each set indicated Switch to node cabling and non switched expansion frames are not...

Page 197: ...es depends on the quantity of switch equipped frames in the system Table 5 3 shows quantities of switch to switch cables required per SP system Table 5 3 Quantities of Switch to Switch cables required...

Page 198: ...iving you optimal switch signal performance Also with less cable occupying the underlying floor area there is an improved cooling air flow and better maintenance access 5 8 SP Switch2 The SP Switch2 i...

Page 199: ...component have been enhanced to support new functions available with the SP Switch2 and SP Switch2 adapter including The Perspectives interface Switch management Software diagnostic Perspectives The P...

Page 200: ...ing have been restructured Node level files daemon log rc switch log css snap log Ecommands log logevnt out and daemon log are in var adm SPlogs css directory In Single Single configuration Adapter le...

Page 201: ...to the switch chips and reading error status information back from the switch chip Adaptive routing To support the double port a number of routing enhancements were added in SP Switch2 namely adaptiv...

Page 202: ...ssemble engine to proceed 64KB IP datagram To improve data flow through the adapter the design include separate paths for microprocessor operations and data transfers and implement four 1000 MB s uni...

Page 203: ...nent The adapter uses the 16 MB RDRam memory to buffer large blocks of data between the switch fabric and the main storage This new function is not available on previous adapters TBIC3 Chip The TBIC3...

Page 204: ...40 microprocessor The 740 microprocessor is responsible for passing control information between the adapter and the software on the POWER3 SMP node for encoding or formatting packet headers for buildi...

Page 205: ...Copyright IBM Corp 181 Chapter 6 SP Switch Routers 9077 This chapter presents the IBM 9077 SP Switch Router within an SP environment only and with the SP Switch only 6...

Page 206: ...9077 04S is based on Ascend GRF 400 IBM 9077 SP Switch Router model 16S 9077 16S is based on Ascend GRF 1600 To connect SP Switch Router to an SP system the following adapter must be installed SP Swi...

Page 207: ...has a fifth optional category of components These components are networking cards that fit into slots in the SP Switch Router In the same way that the SP Switch Router adapter connects the SP Switch...

Page 208: ...up to 150 000 routes Direct access provides much faster lookup times compared to software driven lookups Media cards route IP packets independently at rates of 60 000 to 130 000 IP packets per second...

Page 209: ...witch Router has redundant N 1 hot swappable power supplies Two versions of the RS 6000 SP Switch Router can be used with the SP Switch The Model 04S offers four media card slots The Model 16S offers...

Page 210: ...n requirements There are several requirements for hardware and software that must be met before you can place the RS 6000 SP Switch Router into service with your SP system These requirements are in th...

Page 211: ...n the SP system and the SP Switch Router using the IBM supplied cable in order to maintain both systems at the same electrical potential 6 3 2 SP Switch Router adapter F C 4021 If you are placing an S...

Page 212: ...iber 1103 SONET IP OC3 one port MM fiber 1104 SONET IP OC3 one port SM fiber 1105 ATM OC12 one port SM fiber 1106 FDDI four port MM fiber 1107 Ethernet 10 100Base T eight port 1108 HIPPI one port 1109...

Page 213: ...Ethernet connection between the SP Switch Router and the control workstation An Ethernet connection from the SP Switch Router to an external network which then connects to the control workstation See...

Page 214: ...g sections describe how to connect the SP Switch Router to the control workstation and how to connect the SP Switch Router adapter to a valid SP Switch port 6 4 1 Connecting to the control workstation...

Page 215: ...tation connection in addition to the 10Base T adapter you must also supply a twisted pair Ethernet cable with a crossed connection appropriate for use between two network interface cards 4 The SP Swit...

Page 216: ...les for configuring frames and switches There are two basic sets of rules for choosing a valid switch port 1 Rules for selecting a valid switch port associated with an empty node slot 2 Rules for sele...

Page 217: ...This means the system has two valid switch ports associated with system node numbers 57 and 61 Using node slot positions within a wide or high node The first example is a single frame with an SP Switc...

Page 218: ...194 RS 6000 SP and Clustered IBM pSeries Systems Handbook...

Page 219: ...ers in the SP CES system In addition the control workstation can be set up as an authentication server using Kerberos The control workstation can be the Kerberos primary server with the master databas...

Page 220: ...oth RS 232 and BNC Ethernet only It is the customer s responsibility to supply the cables for twisted pair SP Ethernet network if it exists However the control workstation and SP frames should be no m...

Page 221: ...our SP CES system along with its CWS must be running the latest version of AIX and PSSP In general the CWS offers a service processor as either a standard or optional feature F C 1001 The service proc...

Page 222: ...6000 workstations and servers The pSeries and RS 6000 workstations and servers shown in Table 7 1 are supported as control workstations for the SP CES systems Table 7 1 Supported pSeries and RS 6000 w...

Page 223: ...o the number of frames and not the number of nodes This number includes expansion frames The 7043 and 7044 models can not be used for SP CES environments when the sum of SP frames and clustered server...

Page 224: ...imated so far For two mirrors triple the estimate You might plan to use the control workstation to initially build your own customized mksysb AIX image One reason might be that you want to enable the...

Page 225: ...or the SP frames On SP systems with SP attached servers and CES systems an F50 F80 model configured with 256 MB of memory and 4 of 9 GB disk is the minimum configuration for a two frame system It is r...

Page 226: ...t to serial port cable for drawer to drawer connections 2 4MB sec Yes 3125 Serial port to serial port cable for rack to rack connections 2 4MB sec Yes 8130 1 2 MB sec remote asynchronous node RAN 16 p...

Page 227: ...6 port asynchronous adapter not compatible with SP attached servers and CES No 2996 multiport interface cable No 128 port MCA 8128 128 port asynchronous controller No 8130 remote asynchronous node 16...

Page 228: ...de disk storage The SP system administrator must install AIX and PSSP on the CWS from the distribution medium and perform system customization after the hardware is installed by the service representa...

Page 229: ...ecommend the F80 6H1 and 6F1 as CWS There are different SP Control Workstation offerings as prepackaged solutions for CWS 7044 170 CWS default entry level configuration This configuration is recommend...

Page 230: ...SOFTWARE Product Description Qty 5765 C34 AIX Version 4 1 4061 AIX 4 3 1 5005 Preinstall 1 9001 Asset Registration 1 5692 AIX System Software 1 0598 AIX Welcome Center 1 0838 AIX 4 3 Update CD 1 0857...

Page 231: ...ter PCI 1 3023 18 2 GB 1 Ultra2 SCSI 16 bit 2 Disk 3109 SCSI External Port to SCSI 1 Internal 6 Pack Cable Assembly 3628 P260 Color Monitor Stealth 1 Black 4110 256 MB 2x128MB SDRAM DIMMs 1 5005 Prein...

Page 232: ...shows a 7025 F80 control workstation medium configuration Example 7 3 7025 F80 control workstation medium configuration HARDWARE Product Description Qty 7025 F80 RS 6000 Enterprise Server Model 1 F80...

Page 233: ...8 AIX 4 3 Update CD 1 0857 AIX 4 3 1 0859 Preinstall AIX 4 3 Server 1 Bundle 0860 AIX 4 3 Bonus Pack Non 1 Export 0903 CWS Diagnostic Pre Load 1 1004 CD ROM Process Charge 1 2924 English 1 3410 CD ROM...

Page 234: ...AM DIMMs 2 4223 Ethernet 10Base2 Transceiver 3 5005 Preinstall 1 5202 2 Way RS64 III 450 MHz 1 Processor Card 4MB L2 Cache 6158 20GB 40GB 4mm Tape Drive 1 6205 PCI Dual Channel Ultra2 SCSI 1 Adapter 6...

Page 235: ...rkstation small configuration HARDWARE Product Description Qty 7026 6H1 pSeries 660 1 1 44MB 3 5 in Diskette Drive 1 Integrated SCSI 2 F W Adapter 1 Integrated Ultra2 SCSI Adapter 1 Integrated Etherne...

Page 236: ...ower Distribution Unit 1 Side Mount 1 Phase 9300 Language English US 1 9800 Rack Power Cord US Canada 1 7014 T00 Enterprise Rack 36 EIA 1 0183 Content 9910 A30 5 EIA 1 6088 Front Door for 1 8m Rack Bl...

Page 237: ...ion medium configuration HARDWARE Product Description Qty 7026 6H1 pSeries 660 1 1 44MB 3 5 in Diskette Drive 1 Integrated SCSI 2 F W Adapter 1 Integrated Ultra2 SCSI Adapter 1 Integrated Ethernet Ada...

Page 238: ...1 Side Mount 1 Phase 9300 Language English US 1 9800 Rack Power Cord US Canada 1 7014 T00 Enterprise Rack 36 EIA 1 0183 Content 9910 A30 5 EIA 1 6088 Front Door for 1 8m Rack Black 1 6098 Side Panel f...

Page 239: ...stration 1 7025 6F1 control workstation small configuration This configuration is recommended for SP systems that include no more than 30 nodes Example 7 7 shows a 7025 6F1 control workstation small c...

Page 240: ...anguage English US 1 9800 Power Cord US Canada 125V 1 15A 9910 A13 APC Smart UPS 1400VA 103 132V 1 50 60Hz 950W SOFTWARE Product Description Qty 5765 C34 AIX Version 4 1 4061 AIX 4 3 1 5005 Preinstall...

Page 241: ...r 1 Integrated Ethernet Adapter 1 2624 32x Speed CD ROM 1 2830 POWER GXT130P Graphics Adapter 1 PCI 2943 8 Port Async Adapter 1 EIA 232 422 PCI 2968 10 100 Mbps Ethernet PCI 3 Adapter 3109 SCSI Extern...

Page 242: ...0838 AIX 4 3 Update CD 1 0857 AIX 4 3 1 0859 Preinstall AIX 4 3 Server 1 Bundle 0860 AIX 4 3 Bonus Pack Non 1 Export 0903 CWS Diagnostic Pre Load 1 1004 CD ROM Process Charge 1 2924 English 1 3410 CD...

Page 243: ...y 3153 18 2 GB 10K RPM 1 Ultra3 SCSI 6 16 bit Disk 3628 P260 Color Monitor Stealth 1 Black 3752 Service Package 1 4075 Memory Board 16 position 1 4119 512 MB 2x256MB SDRAM DIMMs 2 5005 Preinstall 1 52...

Page 244: ...3 High Availability Control Workstation The High Availability Control Workstation HACWS is a component of the effort to reduce the possibility of single point of failure opportunities in the SP system...

Page 245: ...ration HACWS utilizes an external disk that is accessed non concurrently between the two control workstations for storage of SP related data There is also a dual RS 232 frame supervisor card with a co...

Page 246: ...s there is a disruptive failover that switches the external disk storage performs IP and hardware address takeover restarts the control workstation applications remounts file systems resumes hardware...

Page 247: ...99 the following are required Two supported pSeries or RS 6000 workstations Each of these systems must have the same set of I O required for control workstations as described in Section 7 2 1 Supporte...

Page 248: ...rder of PSSP 3 2 as an optionally installable component Install a copy on both control workstations 7 3 3 Limits and restrictions The HACWS support has the following limitations and restrictions You c...

Page 249: ...f you are using a CWS which utilizes a service processor F C 1001 the service processor modem must be connected to the S1 serial port Thus you cannot use the S1 serial port for Service Director if you...

Page 250: ...226 RS 6000 SP and Clustered IBM pSeries Systems Handbook Note Refer to Appendix C SP system upgrades on page 407 for more details about the Service Director and the Electronic Service Agent...

Page 251: ...Copyright IBM Corp 227 Chapter 8 PCI communication adapters This chapter provides information for communication adapters and communication adapter extensions supported on the SP 8...

Page 252: ...pters Feature code Adapter ID Description Memory Address Space Card size AIX Level supported PSSP level supported Available 2732 9 W Short Wave HPPI 8M Long 4 2 1 4 3 1 4 3 3 2 4 Yes 2733 9 X Long Wav...

Page 253: ...I 16M Short 4 2 1 2 4 Yes 2969 9 U Gigabit Ethernet SX 16M Short 4 3 2 2 4 Yes 2975 A A IBM 10 100 1000 Base T Ethernet PCI 16M Short No 2985 8 Y 10Base2 and 10BaseT BNC RJ 45 Ethernet LAN 2M Short 4...

Page 254: ...3 3 1 Yes 6205 4 R DUAL CHANNEL ULTRA2 SCSI 32M Long 4 2 1 4 3 3 2 4 Yes 6206 4 K SCSI 2 Ultra Wide 16M Short 4 2 1 2 4 Yes 6207 4 L SCSI 2 Differential Ultra Wide 16M Short 4 2 1 2 4 Yes 6208 4 A SC...

Page 255: ...rformance by off loading the telnet and rlogin daemons TCP IP protocol stack and virtual terminal I O management from the RS 6000 system The adapter buffers the system from frequent CPU intensive pack...

Page 256: ...l SCSI 2 differential devices This adapter provides SCSI bus signal cable quality and a maximum SCSI bus length of up to 19 meters 62 3 feet 8 2 4 IBM Short Wave Serial HIPPI PCI adapter FC 2732 The I...

Page 257: ...nvironments attach to disk array subsystems other SP systems HIPPI switches other vendor computers and tape subsystems It is a 32 bit 33 MHz universal PCI serial HIPPI adapter and supports TCP IP for...

Page 258: ...ed fast 10 MHz and wide two bytes adapter It provides synchronous SCSI bus rates up to 20 Mbps and attaches to SCSI fixed disks CD ROM devices tape drives R W optical devices and storage subsystems Th...

Page 259: ...omponents You must supply the following components for this feature An FDDI concentrator such as the IBM 8240 or equivalent concentrator to connect to your FDDI local area network Vice driver and FDDI...

Page 260: ...onnection provides a fiber optic link that can take advantage of ESCON Directors fiber optic switches permitting multiple channel connections The adapter supports VM ESA MVS ESA and OS 390 Feature cha...

Page 261: ...networks Supports both full and half duplex operations Has a PCI 32 bit Bus Master adapter Feature components This feature order provides the following Adapter card Diskette with adapter device drive...

Page 262: ...e 1200 m dependent on baud rate 230 K maximum baud rate Supports TxD RxD RTS CTS DSR DCD DTR and RI on EIA 232 Supports TxD TxD RxD and RxD on RS 422 Feature components This adapter order features the...

Page 263: ...distance 1200 meter dependent on baud rate Customer supplied components F C 2944 utilizes the following optional RANs and device cables which are available from IBM 1 2 MBps RANs and cables F C 8130...

Page 264: ...ble adapter F C 2947 The ARTIC960Hx 4 Port Selectable PCI adapter F C 2947 is a one slot standard length 32 bit PCI card It provides 4 Ports of either EIA 232 EIA530 RS 449 X 21 or V 35 Only one stand...

Page 265: ...provides the SP with high speed connections between stand alone system units on a wide area network WAN This adapter adheres to the Peripheral Component Interconnect PCI standard and also supports SD...

Page 266: ...er can be configured with different cable types on each port Table 8 2 Cable information for 2 port multi protocol adapter 8 2 18 ATM 155 TURBOWAYS UTP adapter F C 2963 The TURBOWAYS 155 UTP ATM adapt...

Page 267: ...gth If you plan to use multipoint connections you must provide an ATM switch 8 2 19 Ethernet 10 100 MB adapter F C 2968 The IBM 10 100 Ethernet TX PCI adapter F C 2968 is a 10 100 PCI Ethernet adapter...

Page 268: ...that attaches to 1000BaseSX networks via 50 and 62 5 micron multimode cables with SC connectors Feature characteristics This feature has the following characteristics and requirements Compatible with...

Page 269: ...lications to work in an asynchronous transfer mode ATM environment One virtual connection is dedicated to each IP address and a transformation of each IP address to the corresponding virtual connectio...

Page 270: ...thernet LAN without cabling changes 8 2 24 ATM 155 MMF adapter F C 2988 The TURBOWAYS 155 ATM adapter F C 2988 enables TCP IP applications to work in an asynchronous transfer mode ATM environment This...

Page 271: ...ur separate ports Each port has an RJ 45 connector for attachment to standard CAT 3 5 unshielded twisted pair cable The adapter is IEEE 802 3u compatible and has full auto negotiation for detecting sp...

Page 272: ...rdware engines for secure internet transactions such as secure data exchange verifying electronic signatures bulk data encryption and decrypting Cryptographic processes are performed within a tamper p...

Page 273: ...ts both 5 0 and 3 3 volt signaling Supports PCI data streaming Operates in 64 bit slots as a 32 bit device Operational at PCI bus speeds from 16 MHz to 33 MHz Consumes less than 2 watts of power Inclu...

Page 274: ...8 bit or 16 bit SCSI devices on the J2 port using a 68 pin SCSI 3 standard connector Customer components You must supply the following component for this feature Cabling available through IBM 8 2 29...

Page 275: ...f SCSI devices supported over Ultra SCSI NIM Boot Native Boot support on AIX 4 3 3 Feature components This feature order provides the following Adapter card CD ROM with adapter device driver Installat...

Page 276: ...ide interface that can burst data between devices on the SCSI bus at 40 MBps F C 6207 supports Ultra and Fast Wide synchronous data transfers and it supports external devices no internal connections u...

Page 277: ...external devices connected to the same SCSI bus Feature characteristics This feature has the following characteristics 32 bit Bus Master adapter Supports attachment of internal and external single en...

Page 278: ...standard P connector Customer components No customer components required 8 2 34 SSA RAID 5 adapter F C 6215 The PCI SSA RAID 5 adapter F C 6215 supports RAID 5 SSA disk arrays and can be used to acce...

Page 279: ...t Write Cache Option Card F C 6235 that can improve write performance in both RAID 5 and non RAID one initiator applications The Advanced SerialRAID Adapter when operated in a RAID 5 configuration wil...

Page 280: ...ing Adapter card CD ROM with adapter device driver Installation instructions Customer supplied components You must supply the following components for this feature Cables Multimode 50 125 micron fiber...

Page 281: ...ics This feature has the following characteristics Up to 160 MBps data transfer rates per loop Support for the following options 8 way JBOD 2 way RAID 5 2 way RAID 10 1 way RAID 0 2 initiator Fast Wri...

Page 282: ...erves to off load I O tasks from the system microprocessor Feature characteristics This feature has the following characteristics 32 bit PCI 2 1 adapter One 36 pin high density port Support for up to...

Page 283: ...l 80960 RD processor with 4 MB DRAM Universal PCI adapter Replaces Dialogic Antaries ISA adapter 32 bit PCI interface A PLX 9080 local bus provides access to the SC4000s and DSPs from the i960 Two TI...

Page 284: ...260 RS 6000 SP and Clustered IBM pSeries Systems Handbook...

Page 285: ...ftware available for SP systems It covers the following software Parallel System Support Programs PSSP General Parallel File System GPFS LoadLeveler Scientific Subroutine Library ESSL PESSL OSL Parall...

Page 286: ...rkstation Parallel system management tools for allocating SP resources across the enterprise provided Advanced performance monitoring for consolidated analysis and reporting Error detection and recove...

Page 287: ...l user interfaces GUI s which can simplify administrative work Centralized Management Interface Menu based interface for system management commands as well as command line equivalents 9 1 2 RS 6000 cl...

Page 288: ...nce of applications that provide concurrent control for data integrity such as Oracle databases or the GPFS file system IBM Recoverable Virtual Shared Disk RVSD The IBM Recoverable Virtual Shared Disk...

Page 289: ...ntrol of the switch hardware for startup and in case of error execution of any appropriate recovery action 9 1 8 Network Time Protocol NTP Handles synchronizing time of day clocks on your control work...

Page 290: ...ce information PSSP supports a multi threaded standards compliant Message Passing Interface MPI through an IBM Parallel Environment for AIX PE as well as maintaining its single threaded MPI support In...

Page 291: ...ional hardware of the same or even lesser capability GPFS file systems may be multiple Terabytes in capacity and provide throughput of multiple GB sec to and from one file It was designed expressly to...

Page 292: ...ndard file system 9 2 2 Higher performance scalability By delivering file performance across multiple nodes and disks GPFS scales beyond single server node performance limits Unlike NFS and JFS GPFS f...

Page 293: ...It supports concurrent data sharing in a cluster environment Nodes may be added dynamically to a node set when using TCP IP as the communications protocol GPFS 1 4 supports a single node quorum in a...

Page 294: ...across hundreds of SP nodes and IBM workstations It provides automatic recovery of central scheduler and can be configured with HACMP for node and network failover 9 3 1 Administration From a system...

Page 295: ...esources available to those jobs Administrators can change the availability of theses resources to best fit their needs Scalability As nodes are added LoadLeveler automatically scales upward so that t...

Page 296: ...le resources for other tasks More task assignment options More job command file options allow various task geometry for a parallel job Improved performance LoadLeveler daemons are now running multi th...

Page 297: ...al subroutines used by application programmers to solve large optimization problems It includes all of the functions of the AIX OSL 6000 product but solves linear and mixed integer programming problem...

Page 298: ...apabilities include Linear programming Network programming Mixed integer programming Quadratic programming Benchmarks have shown that Parallel OSL achieves significant speed increases on LP and MIP pr...

Page 299: ...e Solve The Linear Least Squares subroutines now include General Matrix QR Factorization 9 4 3 New in Parallel ESSL 2 2 The Parallel ESSL Libraries are tuned for the RS 6000 POWER3 II processors and t...

Page 300: ...xed integer programming problems A new module used to analyze infeasibility in an linear programming problems This new routine enables the user to custom order the LP matrix before symbolic factorizat...

Page 301: ...2 2 4 3 3 10 or higher 3 2 or higher XL FORTRAN for AIX Version 7 1 IBM VisualAge C Professional for AIX Version 5 0 C for AIX Version 5 0 1 ESSL V3 2 Parallel Environment for AIX V3 1 C libraries In...

Page 302: ...for the IBM Message Passing Library for communications between executing tasks in a Fortran C or C parallel program 2 A Parallel Operating Environment POE for managing the development and execution o...

Page 303: ...and for the User Space US library Instrumentation probes that the analysis tool defines and inserts into the target application to collect data An asynchronous communication callback facility that co...

Page 304: ...3 2 or higher XL FORTRAN V7 or higher if FORTRAN programs are to be run If User Space batch or interactive jobs are to be submitted under Parallel Environment then LoadLeveler V2 2 is required At leas...

Page 305: ...e down time by quickly restoring essential services It provides system wide shared resources that cooperate to provide essential services HACMP makes for ease of use with task guides It gives extensiv...

Page 306: ...ers can be configured to meet complicated application availability and recovery needs HACMP configurations can include mutual takeover or standby takeover recovery processes Mutual takeover configurat...

Page 307: ...nounced to the public on June 20 2000 and includes the following enhancements Application Monitoring ES and ESCRM only provides Process Application monitoring and User defined Application monitoring t...

Page 308: ...of up to 8 SP nodes of RS 6000 systems 9 6 4 Software requirements Table 9 6 on page 284shows the software requirements for HACMP 4 4 Table 9 6 Software requirements for HACMP 4 4 AIX version PSSP ve...

Page 309: ...versal clustering capabilities on page 304 shows different SP universal clustering capabilities The sample scenarios provide some possible clustering scenarios from the traditional one frame cluster t...

Page 310: ...e expansion frames i e F C 1550 Tall frame or F C 1500 Short frame and they can be Non switched expansion frames configured with SP nodes only Switched expansion frames configured with SP nodes and an...

Page 311: ...frames F C 1550 and F C 1500 These nodes can also be hosted in the old SP frames with the frame power supply upgraded as the PCI nodes require new power requirements This configuration allows custome...

Page 312: ...le 3 You are allowed to place only a single PCI thin node drawer while with MCA thin nodes you need to fill the drawer with two thin nodes The condition is that it must be installed in the odd slot po...

Page 313: ...y Empty Empty Empty Empty PCI Thin Wide Node PCI Thin Wide Node MCA Thin MCA Thin PCI Thin PCI Thin MCA Thin PCI Thin PCI Thin PCI Thin MCA Thin MCA Thin Nodes must be placed in sequence in short fram...

Page 314: ...mpletely full before the Short expansion frame can mount nodes as shown in Figure 10 2 Figure 10 2 Example on frame configuration Tall frames and Short frames can not be mixed in an SP system A Short...

Page 315: ...a single SP eight port Switch and the nodes can be hosted in a single Short frame or with non switched Short expansion frames after the first Short frame is fully populated Nodes in the non switched S...

Page 316: ...and one frame is supported No expansion frame can be added No imbedded empty drawer is allowed Thin Thin Thin Thin Thin Thin Thin Thin SP Switch 8 Wide Node Wide Node Wide Node Wide Node Wide Node Wi...

Page 317: ...F C 4012 allows a maximum of four switched Tall expansion frames to attach to the Tall model frame without ISB Therefore 1 to 80 processor nodes are supported in this configuration If your SP system...

Page 318: ...configurations SP Switch Frame 1 W ide Node W ide Node W ide Node W ide Node Thin Thin Thin Thin Thin Thin Thin Thin SP Switch Frame 1 Frame 2 W ide Node W ide Node W ide Node W ide Node W ide Node W...

Page 319: ...h node two Wide nodes and four PCI Thin nodes mounted in a non switched expansion frame Note that all PCI Thin nodes on the model frame must be placed on the left side to comply with frame configurati...

Page 320: ...the model frame and in the switched expansion frames Figure 10 7 shows an example of a Single Stage SP Switch with both switched and non switched expansion frame configurations There are four SP Swit...

Page 321: ...nodes are mounted in Tall model frames equipped with an SP Switch 16 ports The SP Switch in these frames forms the first switching layer This configuration can utilize both switched and non switched...

Page 322: ...t of MCA nodes and PCI nodes is supported by SP Switch However as PSSP V3 1 is required for PCI POWER3 nodes the coexistence of PSSP versions should be considered carefully when upgrading the SP syste...

Page 323: ...efine the order of frames in the SP CES system It describes the frame sequence to be examined during the configuration process Each frame is referenced by the tty port to which the frame supervisor is...

Page 324: ...ngle slot in a drawer and its slot number is the corresponding slot A wide node occupies two slots and its slots number is the odd numbered slot A high node occupies four consecutive slots in a frame...

Page 325: ...is determined by using the previous formula Figure 10 9 Node numbering in an SP system with SP attached server Switch port numbering In a switched system the switch boards are attached to each other t...

Page 326: ...ber to that with the highest frame number Each full switch board contains a range of 16 port numbers that can be assigned These ranges are also in sequential order with their switch board number For e...

Page 327: ...3 4 5 6 7 8 9 10 11 12 13 14 15 S P S witch Fram e n 1 1 0 2 4 6 8 10 12 14 1 3 5 7 11 15 SP S w itc h Fram e n Fram e n 1 9 13 2 0 2 4 6 8 10 12 14 1 5 SP Switch Frame n Frame n 1 9 13 3 7 11 15 Fram...

Page 328: ...less of the frame number assigned to the Clustered Enterprise Server Figure 10 11 Switch port number assignment for SP attached servers If an SP CES system does not have an SP Switch the PSSP software...

Page 329: ...system The SP system has 16 thin nodes in an SP tall frame and a 7044 170 RS 6000 system as CWS Each SP node and the CWS are connected to the SP LAN administrative Ethernet The SP frame has a serial...

Page 330: ...1 9432 AIX 4 3 with PSSP V3 2 16 9920 Low Voltage Power 200 240V 1 50 60Hz 9930 PCI Node Enclosure 8 Below is a description of your proposed system This includes the nodes used placement and their de...

Page 331: ...61 LoadLeveler V2 2 1 2005 SP Nodes 16 5000 CD ROM 1 9001 Asset Registration 1 5765 E32 IBM C for AIX V5 1 0016 Base License 1 5809 CD ROM 1 9001 Asset Registration 1 5765 E68 Performance AIDE V3 0 1...

Page 332: ...hernet Adapter 1 3102 18 2 GB 10K RPM Ultra SCSI Hard 2 Disk Drive 3628 P260 Color Monitor Stealth 1 Black 4110 256 MB 2x128MB SDRAM DIMMs 1 4223 Ethernet 10Base2 Transceiver 1 4349 333MHz POWER3 II P...

Page 333: ...igure 10 13 shows an example of a switched SP system using the SP Switch The SP cluster has two SP tall frames with a total of 16 wide nodes and a 7025 F80 RS 6000 system as CWS Each SP node and the C...

Page 334: ...sk Drive 16 Pair 4011 SPS Switch 1 4023 SP Switch MX2 Adapter 16 4098 Memory Expansion Feature 32 4110 256 MB 2x128MB SDRAM DIMMs 16 4444 375 MHz POWER3 II Processor 16 2 way 9201 Logical Frame Design...

Page 335: ...de 1 2057 wide wide 375MHz Wide Node 2057 Quantity placed 16 Product Description Qty 2909 9 1 GB Ultra SCSI Disk Drive 1 Pair 4023 SP Switch MX2 Adapter 1 4098 Memory Expansion Feature 2 4110 256 MB 2...

Page 336: ...Asset Registration 1 5765 E68 Performance AIDE V3 0 1 0001 Installs 1 9001 Asset Registration 1 5765 E74 Performance Toolbox V3 0 1 0001 Server Installs 1 9001 Asset Registration 1 5692 AIX System So...

Page 337: ...6 MB 2x128MB SDRAM DIMMs 1 5005 Preinstall 1 5201 1 Way RS64 III 450 MHz 1 Processor Card 2MB L2 Cache 6159 12GB 24GB 4mm Tape Drive 1 6553 SCSI Hot Swap 6 Pack 1 8700 Quiet Touch Keyboard Stealth 1 B...

Page 338: ...terprise servers M T 7026 are included on the SP environment as SP attached servers The CWS is a 7025 F80 RS 6000 system which uses a 128 port Asynchronous adapter and the necessary Random Asynchronou...

Page 339: ...ption Qty 9076 550 SP Tall Frame Model 1 9123 RS 6000 Server Frame Attachment 5 2057 375MHz Wide Node 8 9122 RS 6000 Server Attached Node 5 2909 9 1 GB Ultra SCSI Disk Drive 8 Pair 4011 SPS Switch 1 4...

Page 340: ...e 9432 AIX 4 3 with PSSP V3 2 8 9920 Low Voltage Power 200 240V 1 50 60Hz 9930 PCI Node Enclosure 8 Below is a description of your proposed system This includes the nodes used placement and their devi...

Page 341: ...figurations 317 3 2 9122 1 Node RS 6000 Server Attac Frame 3 Feature 9123 Drawer Left Right 8 7 6 5 4 3 2 9122 1 Node RS 6000 Server Attac Frame 4 Feature 9123 Drawer Left Right 8 7 6 5 4 3 2 9122 1 N...

Page 342: ...4 3 2 9122 1 Node RS 6000 Server Attac Frame 6 Feature 9123 Drawer Left Right 8 7 6 5 4 3 2 9122 1 Node RS 6000 Server Attac RS 6000 Server Attached Node RS 6000 Server Attached Node Quantity placed 5...

Page 343: ...5812 RS 6000 SP Resource Center 1 CD ROM 5813 CD ROM 1 9001 Asset Registration 1 5765 D61 LoadLeveler V2 2 1 2005 SP Nodes 8 5000 CD ROM 1 9001 Asset Registration 1 5765 E32 IBM C for AIX V5 1 0016 Ba...

Page 344: ...reinstall 1 5320 6 way 600 MHz RS64 IV Processor 1 Card 16MB L2 Cache 6000 System Control and 1 Initialization Cable 6008 Processor Complex to Rack Power 2 Control Cable 6088 Front Door for 1 8m Rack...

Page 345: ...AIX System Software 1 0598 AIX Welcome Center 1 0838 AIX 4 3 Update CD 1 0857 AIX 4 3 1 0859 Preinstall AIX 4 3 Server 1 Bundle 0860 AIX 4 3 Bonus Pack Non 1 Export 0917 Performance AIDE V3 0 1 1004...

Page 346: ...rawer 5 EIA 1 6540 IPL Disk Mounting Hardware 1 Cables Terminator 8396 SP System Attachment Adapter 1 9172 AC Power Specify 1 9300 Language English US 1 7014 T00 Enterprise Rack 36 EIA 1 0176 Content...

Page 347: ...on Qty 7025 F80 RS 6000 Enterprise Server Model 1 F80 1 44MB 3 5 in Diskette Drive 1 Integrated Ultra2 SCSI Adapter 1 Integrated Ethernet Adapter 1 2624 32x Speed CD ROM 1 2830 POWER GXT130P Graphics...

Page 348: ...Preinstall 1 9001 Asset Registration 1 5692 AIX System Software 1 0598 AIX Welcome Center 1 0838 AIX 4 3 Update CD 1 0857 AIX 4 3 1 0859 Preinstall AIX 4 3 Server 1 Bundle 0860 AIX 4 3 Bonus Pack Non...

Page 349: ...has one serial connection to the CWS Each server is connected by the SP administrative Ethernet LAN to the CWS Figure 10 15 Pure CES system environment Example 10 4 shows a sample feature codes confi...

Page 350: ...d Server Control 1 Panel to Control Workstation 4190 1024 MB Memory 4x256MB Cards 2 5005 Preinstall 1 5318 6 way 450MHz RS64 III Processor 1 Card 8MB L2 Cache 6000 System Control and 1 Initialization...

Page 351: ...ocess Charge 1 2924 English 1 3410 CD ROM 1 5005 Preinstall 1 5924 AIX 4 3 PII English 1 9001 Asset Registration 1 M T 7026 Quantity 12 M T 7026 HARDWARE Product Description Qty 7026 M80 RS 6000 Enter...

Page 352: ...O Drawer 5 EIA 1 6540 IPL Disk Mounting Hardware 1 Cables Terminator 9172 AC Power Specify 1 9300 Language English US 1 7014 T00 Enterprise Rack 36 EIA 1 0129 Content 7026 M80 8 EIA 1 0176 Content FC...

Page 353: ...erver Model 1 F80 1 44MB 3 5 in Diskette Drive 1 Integrated Ultra2 SCSI Adapter 1 Integrated Ethernet Adapter 1 2432 Point to Point Cable 1 1m 1 2624 32x Speed CD ROM 1 2830 POWER GXT130P Graphics Ada...

Page 354: ...4061 AIX 4 3 1 5005 Preinstall 1 9001 Asset Registration 1 5765 E32 IBM C for AIX V5 1 0016 Base License 1 3483 Single Pallet Delivery 1 5809 CD ROM 1 9001 Asset Registration 1 5765 E68 Performance A...

Page 355: ...onous adapter and the necessary Random Asynchronous Node RAN as the serial connection interface Each 7017 server has two serial line connection and each 7026 server has one serial connection to the CW...

Page 356: ...1 Hot Swap Disk Drive 3143 Remote I O Cable 6m 2 4191 2048 MB Memory 4x512MB Cards 1 5005 Preinstall 1 5320 6 way 600 MHz RS64 IV Processor 1 Card 16MB L2 Cache 6000 System Control and 1 Initializatio...

Page 357: ...4 3 Update CD 1 0857 AIX 4 3 1 0859 Preinstall AIX 4 3 Server 1 Bundle 0860 AIX 4 3 Bonus Pack Non 1 Export 0917 Performance AIDE V3 0 1 1004 CD ROM Process Charge 1 2924 English 1 3410 CD ROM 1 5005...

Page 358: ...1 Cables Terminator 8396 SP System Attachment Adapter 1 9172 AC Power Specify 1 9300 Language English US 1 7014 T00 Enterprise Rack 36 EIA 1 0176 Content FC 6324 5 EIA 1 0188 Content 7026 6H1 5 EIA 1...

Page 359: ...HARDWARE Product Description Qty 9076 555 Standalone Switch for Clustered 1 Nodes 4011 SPS Switch 1 9122 RS 6000 Server Attached Node 5 9123 RS 6000 Server Frame Attachment 5 9310 10 meter SP Switch S...

Page 360: ...mm Tape Drive 1 6553 SCSI Hot Swap 6 Pack 1 8131 4 5m Controller Cable 1 8137 Enhanced Async Node 16 Port 1 EIA 232 8700 Quiet Touch Keyboard Stealth 1 Black English US 8741 3 Button Mouse Stealth Bla...

Page 361: ...a new system wide boolean attribute is created in the SP class of the System Data Repository SDR called IsPartitionable This attribute is set to the value of false for SP Switch2 systems and CES syste...

Page 362: ...Manufacturing Interface SAMI for M T 7017 models Converge Service Processor CSP for M T 7026 models Table 10 2 is a summary of the spframe command for a CES system Syntax spframe p SAMI CSP n startin...

Page 363: ...operation Specify a value between 1 and 128 inclusive frame_count Specifies the number of Enterprise Servers being added with this operation The tty and s1tty port values are assigned sequentially beg...

Page 364: ...Perspective The Event Perspective The VSD Perspective The System Partitioning Aid Perspective The Performance Monitor Perspective SP Perspectives are enabled to perform system management tasks for yo...

Page 365: ...both the Nodes pane Nodes 1 and Frames and Switches pane Frames and Switches 1 The Nodes pane is displayed in the icon view and the Frames and Switches pane is displayed in the tree view To check for...

Page 366: ...ts Using the Event Perspective you can create event definitions that let you know automatically when resource changes that are important to you have occurred in your CES system An event is the result...

Page 367: ...n nodePowerDown The power to the node is off nodePowerLED Node power is off power LED 1 nodeSerialLinkOpen The serial link to the node TTY is open pageSpaceLow The paging space utilized on the node ex...

Page 368: ...onitor Perspective may set up performance and monitoring hierarchies and archiving on your CES 10 4 Building SP CES systems scenarios We may consider different scenarios of building your SP CES system...

Page 369: ...he SP attached server begins in slot number 1 and occupies the full 16 slots in the frame using slot number 1 to calculate its node number Therefore 16 is added to that node number to derive the next...

Page 370: ...new Enterprise Servers you install your SP attached servers from scratch Your Enterprise Servers are either newly obtained or you do not care about the software previously installed on them Use the st...

Page 371: ...servers So you have to preserve the current content of these servers that are currently used for your business Performing the steps described in Chapter 6 Reconfiguring the RS 6000 SP system in IBM Pa...

Page 372: ...will be read from the SDR In order to get to the SDR you must FTP the etc SDR_dest_info file from the CWS to the etc SDR_dest_info file on the Enterprise Server and check the mode and ownership of the...

Page 373: ...dev tty0 and S1 port dev tty1 on frame 1 respectively SAMI port dev tty2 and S1 port dev tty3 on frame 2 In order to initate Step 29 Enter Frame Information and Reinitialize the SDR described in Chap...

Page 374: ...ttached servers and you want to use all of your SP frames for other SP systems Therefore you remove all of your SP frames from your SP system and manage the remaining SP attached servers as a CES syst...

Page 375: ...ch port numbers as if you are planning for SP attached servers with SP frames so that you can migrate to an upscaled SP system in the future without having to totally reconfigure your existing CES sys...

Page 376: ...onnect to the SP Switch board in frame C It does not matter where you have placed the SP frames When adding SP Switch adapters using the spadaptrs command with the n yes flag this is the default the s...

Page 377: ...ure 10 17 on page 353 you have an CES system with frame 1 and frame 2 assigned with switch port numbers 0 and 1 respectively If you add a switchless SP frame in the future you have to assign the frame...

Page 378: ...CES numbering there are also some recommendations provided here to provide greater flexibility 1 For a CES system with 16 or less enterprise servers start the frame number larger than 1 For a CES syst...

Page 379: ...ow a thin node a wide node or a high node to be added to the SP system One of these nodes is possible to be hosted in node slot number 13 as shown in Figure 10 19 Figure 10 19 Changing a 15 node CES s...

Page 380: ...cale from a CES system to a switchless SP system Another expansion plan could be considered when you plan to upscale from a CES system to a switched SP system Both expansion plans take in consideratio...

Page 381: ...ers are mounted in the first I O rack of the pSeries 680 at the Customer Solutions Center in Rochester MN World wide orders for the entry and advanced Cluster Server Solutions will be fulfilled from R...

Page 382: ...wo Rack Content Specify FC 6324 5EIA F C 0176 One Customer Service Specify Rochester F C 5001 Note Additional optional pSeries 680 features may be added as desired Two Complete pSeries 660 Model 6H1 7...

Page 383: ...tion Indicator F C 0702 Two SCSI Boot Disks One ASYNCH adapter for Control Workstation Attachment One Clustered Server Serial Port to CWS cable F C 3150 One Clustered Server Control Panel to CWS cable...

Page 384: ...10 100 Mbps Ethernet PCI Adapter F C 2968 One PSSP Version 3 2 or later license One AIX 4 3 3 or later license One Customer Service Specify Rochester F C 5001 One Software Preinstall F C 5005 A pSerie...

Page 385: ...Corp 361 Appendix A Naming convention The naming convention appendix provides naming conventions used in the contents of the redbook This appendix is formatted in the following manner Overview Naming...

Page 386: ...n Table A 2 Table A 2 Machine names M T and Nicknames Solutions SP SP aAttached server Clustered Entreprise Servers or CES Component CWS CWS CWS CWS Frame Frame Server frame Server Frame Node Internal...

Page 387: ...Appendix A Naming convention 363 IBM RS 6000 7017 Model S70 7017 S70 S70 Node name Machine type M T Nickname used here...

Page 388: ...364 RS 6000 SP and Clustered IBM pSeries Systems Handbook...

Page 389: ...rding 1 SP Communication adapter requirements 2 Evaluating SP System power requirement 3 Legacy SP Node 4 Legacy Models by Frame and Switch Types 5 Legacy Model by Frame and Nodes Types 6 SP LAN Topol...

Page 390: ...ed if you install fewer than the maximum quantity of adapters For guidelines to help you achieve this improved performance see Suggested PCI adapter quantities for optimum operation on page 376 To eff...

Page 391: ...33 MHz 33 MHz 33 Mhz SP Expansion I O 0 3 Primary I1 to I8 64 bit 33 MHz 375 MHz POWER3 and POWER3 Wide 1 2 3 Primary Primary Primary I2 and I3 CPU side I1 to I4 I O side I5 to I8 I O side 32 bit 64 b...

Page 392: ...de Thin Notes 2732 Serial HIPPI Channel 1 2 1 2733 Serial HIPPI Channel 1 2 1 2741 FDDI SK NET LP SAS 1 4 2 1 2742 FDDI SK NET LP DAS 1 4 2 1 2743 FDDI SK NET UP SAS 1 4 2 1 2751 S 390 ESCON 1 2 1 292...

Page 393: ...8 2 6215 SSA RAID5 1 6 2 6222 F W Cache Option 0 mounts on 6215 6225 SSA RAID EL 1 6 2 6227 FC AL 1 3 1 2 6228 FC AL 64 bit 1 3 1 2 6230 SSA RAID EL 1 6 2 6231 128 MB DIMM Option 0 mounts on 6225 and...

Page 394: ...I Adapter Name Max Quantity per High node Max Quantity per SP Expansi on I O Unit Combi n ation Note 1 Combi n ation Note 2 2732 Serial HIPPI SW 1 3 8 8 2733 Serial HIPPI LW 1 3 8 8 2741 FDDI SK NET L...

Page 395: ...4 24 6215 SSA RAID5 2 4 24 24 6222 F W Cache Option mounts on 6215 mounts on 6215 6225 SSA RAID EL 2 2 12 16 6227 FC AL 2 3 10 14 6228 FC AL 64 bit 2 3 10 14 6230 SSA RAID EL 2 2 12 16 6231 128 MB DIM...

Page 396: ...ed place one in slot I1 through I4 I O side and the other in slot I5 through I8 F C 2751 must be placed in either slot I3 CPU side or in slot I4 F C 2963 and 2988 cannot be placed in slot I5 F C 2732...

Page 397: ...y one of any other adapter is installed placing the other adapter in slot I2 initially avoids moving it if you install F C 2751 later F C 2732 2733 2969 6205 6225 6227 6228 6230 cannot occupy the same...

Page 398: ...e installed F C 2751 must be placed in either slot I3 CPU side or in slot I4 If one F C 2969 is installed place it in slot I1 through I8 I O side If two F C 2969 are installed place one in slot I1 thr...

Page 399: ...annot be placed in slot I5 through I8 Maximum of one F C 2732 2733 2969 6205 6225 6230 per PCI bus If two F C 6225 or 6230 are installed each must be placed in a separate PCI bus in slot I2 or I3 CPU...

Page 400: ...essor and memory utilization for larger I O read and write operations Larger and smaller I O reads and writes refers to the basic I O payload Nodes are assumed to have the maximum quantity of CPUs alo...

Page 401: ...2 2969 Gigabit Ethernet SX Comm High 2985 Ethernet 10 Mb BNC Comm Low 2987 Ethernet 10 Mb AUI Comm Low 2988 ATM 155 MMF Comm Medium 4951 Four port 10 100 LAN Comm Low no 100 Med 1 2 100 High 3 4 100...

Page 402: ...Comm Low Notes 1 Asterisk indicates the default weighting factor used by the configurator 2 Low for 10 Mbps operation Medium for 100 3 Low for Fast SCSI operation Medium for Fast Wide High for Ultra 4...

Page 403: ...ting factors 1 Distribute adapters across the PCI buses to equalize the weighting factor on each bus application usage might require a different distribution 2 Place adapters with high and medium weig...

Page 404: ...and 3 Low 4 Low 332 MHz Thin and Wide Node Select one of the following options for PCI Bus 1 1 High 2 Medium 1 Medium and 1 Low 2 Low 332 Mhz Wide Node Select one of the following options for PCI Bus...

Page 405: ...e Channel 266 1 2 2 NA 1 9 240 2 IBM Network Terminal Accelerator 256 1 7 4 4 9 240 3 IBM Network Terminal Accelerator 2048 1 7 4 4 9 241 0 SCSI 2 External I O Controller 1 7 4 NA 241 2 Enhanced SCSI...

Page 406: ...Token Ring 1 7 4 12 297 2 Auto Token Ring LANstreamer MC 32 1 7 3 12 298 0 Ethernet 1 7 3 12 2 298 4 ATM TURBOWAYS 100 1 2 2 2 9 298 9 ATM TURBOWAYS 155 1 4 2 4 9 299 2 Ethernet FDX 10 Mbps TP AUI MC...

Page 407: ...ro Channel SSA Multi Initiator RAID EL Adapter 1 4 2 8 8 622 2 SSA Fast Write Cache Option 0 Mounts on 6219 630 5 Digital Trunk Dual 1 6 3 2 700 6 Realtime Interface Co Processor Portmaster 1 7 4 8 81...

Page 408: ...our system Notes 1 Not supported in 120 MHz thin nodes or 135 MHz wide nodes 2 High nodes and wide nodes have a minimum of one if used 3 FDDI dual ring adapters F C 2723 have a mandatory prerequisite...

Page 409: ...55 1500 1550 1 x 41 41 Nodes 375 MHz POWER3 SMP High Node F C 2058 ___ x 650 375 MHz POWER3 SMP Wide Node F C 2057 ___ x 104 375 MHz POWER3 SMP Thin Node F C 2056 ___ x 59 POWER3 SMP High Node F C 205...

Page 410: ...4022 4023 ___ x 26 SP Switch2 F C 4012 ___ x 618 SP Switch2 adapter F C 4025 ___ x 78 Hard disk drives 4 5 GB Ultra SCSI F C 2900 ___ x 8 9 4 5 GB Ultra SCSI disk pair F C 2904 ___ x 17 8 9 1 GB Ultr...

Page 411: ...9 2 Port Multiprotocol X 25 F C 2962 ___ x 10 8 TURBOWAYS 155 UTP ATM F C 2963 ___ x 10 5 10 100 Ethernet 10BASE TX F C 2968 ___ x 9 1 Gigabit Ethernet SX F C 2969 ___ x 27 4 10BASE2 10BASE T Etherne...

Page 412: ...pters MCA slots occupied in uniprocessor thin nodes ___ x 46 MCA slots occupied in uniprocessor high and wide nodes ___ x 35 6 Notes 1 1 Watt 3 412 BTU Hour 2 The SEPBU has a power factor of 1 thus W...

Page 413: ...03 WIDE 66Mhz Power2 2004 THIN 66Mhz Power2 2005 WIDE 77Mhz Power2 2006 HIGH 112Mhz PowerPC604 2007 WIDE 135Mhz P2SC 2008 THIN 120Mhz P2SC 2009 HIGH 200Mhz PowerPC604 2022 THIN 160Mhz P2SC 2050 332 SM...

Page 414: ...switch types table 1 of 2 Model Frame Switch Switch Frame Nodes Electrical Power 2Ax Short None N A 1 to 8 1 phase 3Ax Short SPS 8 No 1 to 8 1 phase 3Bx Tall SPS 8 No 1 to 8 3 phase 20x Tall None N A...

Page 415: ...ypes Table B 9 Legacy models by frames and node types table 2 of 2 Model MHz Form Processor Type I O Bus Available xx1 62 Thin Uni MCA No xx2 66 Thin Uni MCA No xx3 66 Wide Uni MCA No xx4 66 Thin 2 Un...

Page 416: ...lustered Enterprise Servers is 10 100 Ethernet 10BASE TX adapter F C 2968 Twisted pair cable connection Shared or switched 100BASE TX network SP LANs used in systems populated exclusively with POWER3...

Page 417: ...d nodes can continue to run with 10 Mbps SP LAN connections In this case you can use an Ethernet switch to provide a single LAN which connects to the CWS at 100 Mbps FDX As illustrated in Figure B 2 o...

Page 418: ...ix of older nodes with 10 Mbps BNC and newer nodes with 100 Mbps UTP connections Shared 10BASE2 network In small SP systems such as a single frame the control workstation and the nodes typically share...

Page 419: ...f this performance limitation is acceptable this setup is limited by a maximum quantity of 30 stations on a 10BASE2 segment In practice no more than 16 to 24 stations should be connected to a single 1...

Page 420: ...subnets simultaneously Switched 10BASE2 network A network that overcomes performance limitations in shared or segmented Ethernet networks is Ethernet switching Even with an added router this setup is...

Page 421: ...switch The uplink to the CWS can be run at 100 Mbps in full duplex mode This setup eliminates the routing overhead for communications between nodes or a node and the CWS With a 100Mbps full duplex up...

Page 422: ...ot install server s en0 Ethernet adapter must be directly connected to each of the control workstations Ethernet adapters The Ethernet adapter configured as en0 must always be in the SP node s lowest...

Page 423: ...ation if you have an available I O slot and use two Ethernet segments to the SP nodes Each network should be connected to half of the SP nodes During network install you can install all 16 nodes at th...

Page 424: ...nodes There are three ways to accomplish this 1 The first method uses a control workstation with one Ethernet adapter for each frame of the system and one associated SP Ethernet per frame So if you h...

Page 425: ...an Ethernet card in the rest of the nodes in the frame Figure B 8 shows an Ethernet topology for this multi frame system Figure B 8 Method 2 Ethernet topology for multi frame SP system When using thi...

Page 426: ...n will grow over time to a large configuration you might want to dedicate your network install nodes in a different manner For very large configurations you might want to dedicate a frame of nodes as...

Page 427: ...egment The network install servers then install eight other nodes until all nodes are installed The network address usually used for the SP Ethernet is a class C internet address This address has a li...

Page 428: ...eset Name Image Size File Size PSSP minimal AIX image spimg spimg 433 91MB PSSP image rsct basic 16MB rsct basic hacmp 280KB rsct basic rte 20MB rsct basic sp 1 6MB PSSP image rsct clients 500KB rsct...

Page 429: ...MB ssp ucode 907KB PSSP image ssp hacws 160KB ssp hacws 141KB PSSP image ptpe 7MB ptpe docs 3 1MB ptpe program 6 2MB PSSP image vsd 21MB vsd cmi 173KB vsd hsd 180KB vsd rvsd hc 374KB vsd rvsd rvsdd 33...

Page 430: ...0 SP and Clustered IBM pSeries Systems Handbook PSSP image ssp resctr for the Resource Center ssp resctr rte 4MB Note The total storage can cross multiple file systems Image or Fileset Name Image Size...

Page 431: ...Examples of typical upgrades include adding frames to your SP system installing new higher performance nodes or switches and converting MCA type nodes to PCI nodes If you are planning an upgrade for...

Page 432: ...deep expansion frame F C 1550 since the POWER3 High Node does not physically fit into the old style frame According to configurator rules if there are no existing POWER3 High Nodes in your system the...

Page 433: ...550 since they do not physically fit into the old style frame According to configurator rules if there are no existing POWER3 High Nodes in your system the MES will include a tall deep expansion frame...

Page 434: ...POWER3 Thin F C 2056 375 MHz POWER3 Wide F C 2057 375 MHz POWER3 High F C 2058 POWER3 Wide F C 2053 375 MHz POWER3 Wide F C 2057 375 MHz POWER3 High F C 2058 POWER3 High F C 2054 375 MHz POWER3 High F...

Page 435: ...e 2 F C 9304 BNC Ethernet cable Upgrading SP frames The following SP frame upgrades can be performed Upgrading Model 500 and F C 1500 to Model 550 and F C 1550 This conversion is available if you want...

Page 436: ...412 RS 6000 SP and Clustered IBM pSeries Systems Handbook...

Page 437: ...this appendix the following software packages are described 1 PSSP and AIX 2 High Availability Cluster Multi Processing HACMP 3 Virtual shared disk and Recoverable virtual shared disk VSD and RVSD 4 G...

Page 438: ...AIX IBM LPPs PSSP3 2 AIX 4 3 3 LoadLeveler 2 2 2 1 PE 3 1 ESSL 3 1 PESSL 2 1 GPFS 1 3 1 2 1 1 HACMP ES and HACMP 4 3 HACMP with HAGEO or GeoRM 2 1 PSSP 3 1 1 AIX 4 3 3 LoadLeveler 2 2 2 1 PE 2 4 ESSL...

Page 439: ...PSSP 2 4 S S S S S N N N AIX 4 3 1 PSSP 2 4 S S S S S N N N AIX 4 3 2 PSSP 3 1 A A A A A A A N AIX 4 3 3 PSSP 3 1 1 A A A A A A A A AIX 4 3 3 PSSP 3 2 A A A A A A A A Note AIX V4 2 1 with PSSP V2 4 o...

Page 440: ...es running any combination of AIX and PSSP as shown in Table D 4 Table D 4 Levels of PSSP and AIX supported in a mixed system partition S Supported N Not supported PSSP 2 4 and AIX 4 2 1 or 4 3 3 PSSP...

Page 441: ...3 can be run on the SP nodes and SP attached servers HACMP ES 4 3 can run on the control workstation but prior levels can only run on nodes not on SP attached servers and not on the control workstatio...

Page 442: ...luster however the version compatibility function allows you to upgrade the cluster one node at a time without taking the entire cluster offline Due to HACMP dependencies on levels of AIX migrating on...

Page 443: ...dow of less than four hours approximately ten minutes The rvsdrestrict command allows the administrator to select the level at which the RVSD subsystem is to run in a mixed system partition If any nod...

Page 444: ...ew functions available in the Recoverable Virtual Shared Disk option of PSSP 3 2 all nodes in a system partition must be running PSSP 3 2 with the Recoverable Virtual Shared Disk component Recoverable...

Page 445: ...d Coexistence GPFS 1 3 does not coexist in a system partition with nodes using earlier levels of GPFS It cannot coexist in a mixed system partition it works only with PSSP 3 2 and AIX 4 3 3 However al...

Page 446: ...ome migration limitations as follows 1 All nodes in the system partition need to be migrated to a new level of PE within the same service window 2 You can run a particular level of PE with plus or min...

Page 447: ...261 LoadLeveler LoadLeveler is the PSSP related LPP that supports scheduling and load balancing of parallel jobs on the SP system The supported levels are shown in Table D 10 Supported Levels Table D...

Page 448: ...SSP 2 4 or 3 1 and AIX 4 3 2 to PSSP 3 2 Coexistence LoadLeveler 2 2 can coexist with LoadLeveler 2 1 within a cluster PTF on 2 1 is required for this LoadLeveler 2 2 does coexist with PSSP 3 1 1 and...

Page 449: ...that are used in SP CES systems management The tools are Network Installation Manager for installation and migration Service Director Electronic Service Agent to alert user and IBM about a problem Inv...

Page 450: ...g a cluster from several servers still uses the SP NIM documentation and specification As soon as a Enterprise Server is part of an SP or Clustered Enterprise Server CES it is seen as a SP node from t...

Page 451: ...e allowable flag with which it can be called h However all this does is display the help text setup_server runs on every boot of a node boot install server or the CWS called from etc rc sp However set...

Page 452: ...ng Volume 2 Control Workstation and Software Environment GA22 7281 PSSP Installation and Migration Guide GA22 7347 The first part of the installation procedure deals with setting up the CWS and making...

Page 453: ...selected to improve the installation performance Netbooting To netboot an RS 6000 we would turn the keyswitch and go into SMS or use a ROM IPL disk depending on the model On the SP this is all handled...

Page 454: ...ing the etc hosts file and starting or stopping volume group mirroring The final part of node customization is performed after the node is rebooted As part of an installation or migration operation ps...

Page 455: ...liable_hostname install_info file for every node in the SDR whose bootp_response is not set to disk This file is used during the network installation of the nodes mknimres This wrapper creates all the...

Page 456: ...Service Director supports all classic RS 6000 machine types and the 9076 Classic RS 6000 refers to machines that have concurrent diagnostics installed Some of the PCI based PowerPC machines had diagn...

Page 457: ...red to run constantly or on a specific time schedule When the analysis routine runs it monitors errors or events identified by a PSA Errors or events are logged and depending on customer configured op...

Page 458: ...taining higher availability and performance It allows IBM Service to respond faster and with the correct repair parts In some cases IBM may notify a customer of an error and provide a resolution prior...

Page 459: ...th the IBM Service Agent Server SAS During the registration process an electronic key is created that becomes part of your resident Service Agent program This key is used each time Service Agent place...

Page 460: ...e United States is required Please refer to local procedures in your country to see what the modem requirements are for Service Agent IBM ships the following modem types for use with Service Agent on...

Page 461: ...the latest microcode but will be directed to Contact CE to obtain the new level of microcode In the html report for all RS 6000 systems a link will be provided to the README of the latest level of mi...

Page 462: ...438 RS 6000 SP and Clustered IBM pSeries Systems Handbook http techsupport services ibm com rs6k mds html VPD Capture Service Http techsupport services ibm com rs6k vcs html...

Page 463: ...ok including RS 6000 Model S80 SG24 6023 Other resources These publications are also relevant as further information sources IBM RS 6000 SP Planning Volume 2 Control Workstation and Software Environme...

Page 464: ...dditional Redbooks or redpieces view download or order hardcopy from the Redbooks Web site ibm com redbooks Also download additional materials code samples or diskette CD ROM images from this Redbooks...

Page 465: ...his program who wish to have information about it for the purpose of enabling i the exchange of information between independently created programs and other programs including this one and ii the mutu...

Page 466: ...r registered trademarks of Sun Microsystems Inc in the United States and or other countries Microsoft Windows Windows NT and the Windows logo are trademarks of Microsoft Corporation in the United Stat...

Page 467: ...l Business Machines Corporation IP Internet Protocol ITSO International Technical Support Organization Abbreviations and acronyms JFS Journaled File System LANE LAN Emulation LAPI Low level Applicatio...

Page 468: ...444 RS 6000 SP and Clustered IBM pSeries Systems Handbook Tcl Tool command Language US User Space UTP Unshielded Twisted Pair VSD Virtual Shared Disk WAN Wide Area Network...

Page 469: ...SMP thin node bus 72 configuration rule 72 disk option 74 disk requirement 74 memory option 74 memory requirement 74 option 73 processor option 74 processor requirement 74 requirement 73 switch adapte...

Page 470: ...s lscfg 435 mksysb 200 nodecond 429 rvsdrestrict 419 setup_server 431 spadaptrs 352 spdelfram 337 spframe 337 338 347 349 spmon 429 Communication Subsystems Support 265 conductor size for SP computer...

Page 471: ...uad DTA E1 75 ohm un balanced ungrounded 1 8 m 4 port cable 259 2877 ARTIC960RxD Quad DTA H 100 4 drop cable 259 2900 4 5 GB Ultra SCSI disk drive 70 75 2904 4 5 GB Ultra SCSI disk drive pair 70 75 29...

Page 472: ...r 40 46 51 feature code 3805 9 1 GB Ultra SCSI 10K RPM disk pair 42 feature code 3810 18 2 GB Ultra SCSI 10K RPM disk pair 46 51 feature code 3811 18 2 GB Ultra SCSI 10K RPM disk pair 42 feature code...

Page 473: ...e System 268 L LAPI 266 Load Balancing Cluster 18 logical dependent node 16 login control 263 Logs var adm SPlogs sdr sdrlog syspar_ip_addr pid 427 adapter log 176 cable miswire 176 css snap log 176 d...

Page 474: ...power supply phases for SP frames 143 POWER3 2 POWER3 SMP architecture 25 POWER3 SMP High Node 37 55 POWER3 SMP node 52 6xx bus 54 POWER3 microprocessor 53 service processor 31 system architecture 53...

Page 475: ...tch MX2 Adapter 168 SP Switch MX2 Adapter F C 4023 41 SP Switch port numbering rule 299 SP Switch Router 3 16 182 connection to the control workstation 190 connection to the SP Switch 192 network inte...

Page 476: ...switch system 147 U utility loading for SP frames 143 V V 35 cable 242 V 36 EIA 449 cable 242 Vertical scaling 23 VMM Virtual Memory Manager 5 VPD Vital Product Data 6 VSD Virtual Shared Disk 265 VSD...

Page 477: ...0 1 spine 0 1 0 169 53 89 pages RS 6000 SP and Clustered IBM pSeries Systems Handbook...

Page 478: ......

Page 479: ......

Page 480: ...te of the RS 6000 SP Systems Handbook published in 2000 This publication includes Blue Hammer and Blue Hammer Jr clustering solutions configurations This publication includes the following Information...

Reviews:

No comments

Related manuals for RS/6000 SP

D-Link DP-300+ User Manual preview
DP-300+
Brand: D-Link Pages: 38
D-Link Epress EtherNetwork DP-301P+ Datasheet preview
Epress EtherNetwork DP-301P+
Brand: D-Link Pages: 2
Quatech AirborneDirect ABDG-SE-IN5410 Quick Start Manual preview
AirborneDirect ABDG-SE-IN5410
Brand: Quatech Pages: 8
aizo digitalSTROM-Server Installation Notes preview
digitalSTROM-Server
Brand: aizo Pages: 2
Supermicro SUPERSERVER 5018D-FN8T User Manual preview
SUPERSERVER 5018D-FN8T
Brand: Supermicro Pages: 124
BRONKHORST FlowDDE Instruction Manual preview
FlowDDE
Brand: BRONKHORST Pages: 19
HP Proliant BL480c Maintenance And Service Manual preview
Proliant BL480c
Brand: HP Pages: 65
HP ProLiant BL420c User Manual preview
ProLiant BL420c
Brand: HP Pages: 88
HP ProLiant BL20p Specification preview
ProLiant BL20p
Brand: HP Pages: 34
HP ProLiant BL685c G5 Performance Manual preview
ProLiant BL685c G5
Brand: HP Pages: 23
HP ProLiant BL660c Gen 9 Disassembly Instructions preview
ProLiant BL660c Gen 9
Brand: HP Pages: 3
HP ProLiant BL460c G7 Maintenance And Service Manual preview
ProLiant BL460c G7
Brand: HP Pages: 74
HP ProLiant BL495c G6 User Manual preview
ProLiant BL495c G6
Brand: HP Pages: 90
HP ProLiant BL685c G7 Maintenance And Service Manual preview
ProLiant BL685c G7
Brand: HP Pages: 67
HP ProLiant BL280c Generation 6 (G6) Quickspecs preview
ProLiant BL280c Generation 6 (G6)
Brand: HP Pages: 36
HP ProLiant BL620c Generation 7 Quickspecs preview
ProLiant BL620c Generation 7
Brand: HP Pages: 42
HP ProLiant BL685c Generation 6 Specification preview
ProLiant BL685c Generation 6
Brand: HP Pages: 33
HP ProLiant BL660c Gen9 Quickspecs preview
ProLiant BL660c Gen9
Brand: HP Pages: 37

Brands by name

Popular brands

Load more brands