IBM BladeCenter PS703, Technical Overview And Introduction

Page 1: ...erview and Introduction David Watts Kerry Anders David Harlow Joe Shipman II Features the POWER7 processor providing advanced multi core technology Details the follow on to the BladeCenter PS700 PS701...

Page 2: ......

Page 3: ...International Technical Support Organization IBM BladeCenter PS703 and PS704 Technical Overview and Introduction May 2011 REDP 4744 00...

Page 4: ...ricted Rights Use duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp First Edition May 2011 This edition applies to IBM BladeCenter PS703 7891 73X IBM BladeCenter PS704 78...

Page 5: ...ocessor 20 1 6 6 Memory features 20 1 6 7 I O features 21 1 6 8 Disk features 26 1 6 9 Standard onboard features 26 1 7 Supported BladeCenter I O modules 28 1 7 1 Ethernet switch and intelligent pass...

Page 6: ...m support 83 2 13 IBM EnergyScale 85 2 13 1 IBM EnergyScale technology 86 2 13 2 EnergyScale device 88 Chapter 3 Virtualization 89 3 1 PowerVM Version 2 2 enhancements 90 3 2 POWER Hypervisor 92 3 3 P...

Page 7: ...ab 156 5 2 2 Settings tab 157 5 3 POWER based blades management 157 5 3 1 IVM characteristics 157 5 3 2 SDMC added capability for POWER based blades 158 5 4 IVM to SDMC transition 158 5 4 1 IVM to SDM...

Page 8: ...vi IBM BladeCenter PS703 and PS704 Technical Overview and Introduction...

Page 9: ...ditions of the publication IBM may make improvements and or changes in the product s and or the program s described in this publication at any time without notice Any references in this information to...

Page 10: ...y Manager IBM iSeries Micro Partitioning POWER Hypervisor Power Systems Power Systems Software POWER4 POWER5 POWER6 POWER6 POWER7 PowerVM POWER pSeries Redbooks Redpaper Redbooks logo ServerProven Sol...

Page 11: ...PowerVM in Lab Services for the IBM Systems and Technology Group based in Austin Texas He supports clients in implementing IBM Power Systems blades using Virtual I O Server Integrated Virtualization M...

Page 12: ...roject From IBM Power Systems development Chris Austen Larry Cook John DeHart Kaena Freitas Bob Galbraith Jim Gallagher Seth Lewis Hoa Nguyen Amartey Pearson From IBM Power Systems marketing John Bieb...

Page 13: ...lcome Your comments are important to us We want our papers to be as helpful as possible Send us your comments about this paper or other IBM Redbooks publications in one of the following ways Use the o...

Page 14: ...xii IBM BladeCenter PS703 and PS704 Technical Overview and Introduction...

Page 15: ...automate processes reduce energy consumption and scale easily The POWER7 processor based PS703 and PS704 blades support AIX IBM i and Linux operating systems Their ability to coexist in the same chas...

Page 16: ...supports optional Active Memory Expansion which is a POWER7 technology that allows the effective maximum memory capacity to be much larger than the true physical memory Innovative compression decompre...

Page 17: ...ated Ethernet ports that are connected to the BladeCenter chassis fabric midplane The PS704 also has an integrated SAS controller that supports local on board storage integrated USB controller and Ser...

Page 18: ...ernet SAS Fibre Channel and FCoE I O fabrics can also be shared within the same chassis All chassis can offer full redundancy for all shared infrastructure network and I O fabrics Having multiple powe...

Page 19: ...te flexibility to even the most demanding IT environments In 9 U of rack space the BladeCenter H chassis can contain up to 14 blade servers 10 switch modules and four power supplies to provide the nec...

Page 20: ...S703 and PS704 Technical Overview and Introduction Figure 1 2 displays the front view of an IBM BladeCenter H and Figure 1 3 displays the rear view Figure 1 2 BladeCenter H front view Figure 1 3 Blade...

Page 21: ...ease data center space constraints Help in protecting your IT investment through IBM BladeCenter family longevity compatibility and innovation leadership in blades Support for the latest generation of...

Page 22: ...enter HT provides a solid foundation for next generation networks NGN enabling service providers to become on demand providers IBM s technological expertise in the enterprise data center coupled with...

Page 23: ...lies and cooling and built in system management resources The result is a Network Equipment Building Systems NEBS 3 and ETSI compliant server platform optimized for next generation networks The follow...

Page 24: ...w serial port for direct serial connection to installed blades Compliance with the NEBS 3 and ETSI core network specifications BladeCenter S The BladeCenter S chassis can hold up to six blade servers...

Page 25: ...ides chassis level solutions simplifying deployment and management of your installation Support for up to four network or storage switches or pass through modules A light path diagnostic panel and two...

Page 26: ...r Power Configurator tool helps determine whether the combination desired is valid It is expected that this tool will be updated to include the PS703 and PS704 blade configurations For more informatio...

Page 27: ...and S This section describes the physical dimensions of the POWER7 blade servers and the supported BladeCenter chassis only Table 1 4 shows the physical dimensions of the PS703 and PS704 blade servers...

Page 28: ...um features for the POWER7 processor based blade servers on page 18 1 6 4 Power supply features on page 19 1 6 5 Processor on page 20 1 6 6 Memory features on page 20 1 6 7 I O features on page 21 1 6...

Page 29: ...ing 16 GB DIMMs Industry standard VLP DDR3 DIMMs Optional Active Memory Expansion Disk 3 Gb SAS disk storage controller One disk drive bay which supports one 2 5 inch SAS HDD hard disk drive or two 1...

Page 30: ...server The two halves of the BladeCenter PS704 are shown in Figure 1 9 on this page and Figure 1 10 on page 17 Figure 1 9 Top view of PS704 blade server base unit Two 8 core processors Drive bay CIOv...

Page 31: ...of 32 cores in the blade server Based on CMOS 12S 45 nm SOI silicon on insulator technology Power consumption is 110W per socket Memory 32 DIMM slots Minimum 32 GB maximum capacity 512 GB using 16 GB...

Page 32: ...Console through FSP Expansion Card I O Options Two CIOv expansion card slots PCIe Two CFFh expansion card slots PCIe 1 6 3 Minimum features for the POWER7 processor based blade servers At the minimum...

Page 33: ...pported see 1 3 2 Number of PS703 and PS704 blades in a chassis on page 12 Category Minimum features required BladeCenter chassis Supported BladeCenter chassis Refer to 1 3 1 Supported BladeCenter cha...

Page 34: ...come with a standard processor configuration There are no optional processor configurations for the PS703 and PS704 The PS703 and PS704 processor configurations are as follows The PS703 blade server...

Page 35: ...Fibre Channel Expansion Card CIOv for IBM BladeCenter feature 8242 enables high speed access for IBM blade servers to connect to a Fibre Channel storage area network SAN When compared to the previous...

Page 36: ...Expansion Card CIOv is supported per single wide 30 mm blade server The card has the following features CIOv form factor PCI Express 2 0 host interface Support for two full duplex Fibre Channel ports...

Page 37: ...located in bays 3 and 4 of a supported BladeCenter chassis The card has the following features CIOv form factor Provides external connections for the two SAS ports of the blade server s onboard SAS c...

Page 38: ...r remote startup boot operations Support for BladeCenter Open Fabric Manager Support for Fibre Device Management Interface FDMI standard VESA standard Fibre Channel 8 Gbps 4 Gbps or 2 Gbps auto negoti...

Page 39: ...d CFFh for IBM BladeCenter is a dual port InfiniBand Host Channel Adapter HCA based on proven Mellanox ConnectX IB technology This HCA when combined with the QDR switch delivers end to end 40 Gb bandw...

Page 40: ...can have up to two 1 8 inch SATA SSDs On the expansion unit it can have one 2 5 inch SAS HDD On the expansion unit it can have up to two 1 8 inch SATA SSDs Table 1 6 lists the supported disk features...

Page 41: ...ntroller supports hardware RAID 0 RAID 5 RAID 6 or RAID 10 depending on the number of drives installed The 3 Gb SAS Passthrough Expansion Card can be used to connect to the BladeCenter SAS Connectivit...

Page 42: ...teroperability see the IBM BladeCenter Interoperability Guide at the following web page http www ibm com support docview wss uid psg1MIGR 5073016 1 7 1 Ethernet switch and intelligent pass through mod...

Page 43: ...storage In the PS703 and PS704 blades the 3 Gb SAS Passthrough Expansion Card CIOv is required for external SAS connectivity The SAS expansion card requires SAS I O modules in switch bays 3 and 4 of...

Page 44: ...rds require the use of the MSIM in a BladeCenter H or the MSIM HT in a BladeCenter HT plus Fibre Channel I O modules The CFFh Fibre Channel cards are as follows QLogic Ethernet and 4 Gb Fibre Channel...

Page 45: ...le 1 13 on page 32 shows the currently available I O modules that are available to provide an FCoE solution Part number Feature codea a These feature codes are for the Power Systems ordering system eC...

Page 46: ...offers latency of less than 200 nanoseconds allowing applications to operate at maximum efficiency The PS703 and PS704 blades connect to the Voltaire switch through the 2 port 40 Gb InfiniBand Expans...

Page 47: ...703 and PS704 blades the following expansion cards require an MSIM in a BladeCenter H chassis QLogic Ethernet and 4 Gb Fibre Channel Expansion Card CFFh QLogic 8 Gb Fibre Channel Expansion Card CFFh T...

Page 48: ...ide http www ibm com support docview wss uid psg1MIGR 5073016 With PS703 and PS704 blades the QLogic Ethernet and 4 Gb Fibre Channel Expansion Card CFFh requires an MSIM HT in a BladeCenter HT chassis...

Page 49: ...equired features 1 9 Model upgrades The PS703 and PS704 are new serial number blade servers There are no upgrades from POWER5 POWER6 POWER7 and the POWER7 PS700 PS701 and PS702 blade servers to the PO...

Page 50: ...36 IBM BladeCenter PS703 and PS704 Technical Overview and Introduction...

Page 51: ...WER7 processor on page 39 2 3 POWER7 processor based blades on page 47 2 4 Memory subsystem on page 47 2 5 Active Memory Expansion on page 52 2 6 Technical comparison on page 54 2 7 Internal I O subsy...

Page 52: ...on of the USB controller This means that the components are doubled for the PS704 double wide blade as compared to the PS703 single wide blade except for the SAS controller and USB controller See 2 7...

Page 53: ...ased on POWER processors the design philosophy for POWER7 PS704 base planar BCM5709 Gigabit Ethernet To chassis I O bays 1 2 BCM5387 Ethernet switch To media tray Flash NVRAM DDR TPMD POWER7 Processor...

Page 54: ...ght POWER7 processor cores L2 cache L3 cache and chip power bus Interconnect simultaneous multiprocessing SMP links GX interface and two memory controllers Figure 2 3 POWER7 processor architecture 2 2...

Page 55: ...double precision floating point units 1 vector unit 1 branch unit 1 condition register unit 1 decimal floating point unit The caches that are tightly coupled to each POWER7 processor core are as foll...

Page 56: ...ling users to select the threading technology that meets a combination of objectives such as performance throughput energy use and workload enablement Intelligent threads The POWER7 processor features...

Page 57: ...ility to provide leadership performance in either case POWER7 processor cores The base design for the POWER7 processor is an 8 core processor with 32 MB of on chip L3 cache 4 MB per core However the a...

Page 58: ...rough in material engineering and microprocessor fabrication has enabled IBM to implement the L3 cache in eDRAM and place it on the POWER7 processor die L3 cache is critical to a balanced design as is...

Page 59: ...2x bandwidth improvement occurs with on chip interconnect Frequency and bus sizes are increased to and from each core No off chip driver or receivers Removing drivers and receivers from the L3 access...

Page 60: ...e 8 MB per core and at a faster processor core frequency which delivers higher performance per core and might save on software costs for those applications that are licensed per core 2 2 8 Comparison...

Page 61: ...support POWER7 processors with various processor core counts Table 2 3 summarizes the POWER7 processors for the PS700 PS701 PS702 PS703 and PS704 Table 2 3 Summary of POWER7 processor options for the...

Page 62: ...hnology is used to increase reliability speed and density of memory subsystems 2 4 1 Memory placement rules The supported memory minimum and maximum for each server is listed in Table 2 4 Table 2 4 Me...

Page 63: ...type and technology You can mix compatible DIMMs from different manufacturers Each DIMM within a processor support group 1 4 5 8 9 12 13 16 must be the same size and speed Install only supported DIMM...

Page 64: ...n code PS703 Number of DIMMs to install 2 4 6 8 10 12 14 16 1 P1 C1 x x x x x x x x 2 P1 C2 x x x x 3 P1 C3 x x x x 4 P1 C4 x x x x x x x x 5 P1 C5 x x x x x x 6 P1 C6 x x 7 P1 C7 x x 8 P1 C8 x x x x...

Page 65: ...C1 x x x x x x x x 2 P1 C2 x x x x 3 P1 C3 x x x x 4 P1 C4 x x x x x x x x 5 P1 C5 x x x x x x 6 P1 C6 x x 7 P1 C7 x x 8 P1 C8 x x x x x x 9 P1 C9 x x x x x x x 10 P1 C10 x x x 11 P1 C11 x x x 12 P1 C...

Page 66: ...ndividual AIX partition can turn on or turn off Active Memory Expansion Control parameters set the amount of expansion desired in each partition to help control the amount of CPU used by the Active Me...

Page 67: ...s topic see the white paper Active Memory Expansion Overview and Usage Guide available from http www ibm com systems power hardware whitepapers am_exp html Active Memory Expansion Modeled Statistics M...

Page 68: ...r core 4 MB On chip eDRAM per core Memory buffers 2 4 8 8 16 DIMM slots 8 16 32 16 32 DIMM speed 1066 MHz 1066 MHz 1066 MHz 1066 MHz 1066 MHz Max Mem core 16 GB 16 GB 16 GB 8 GB 8 GB Anchor SVPD card...

Page 69: ...chips one on each planar The I O system of the two hubs is duplicated on both planars except for the embedded SAS controller and the USB controller The PS704 has only one embedded 3Gb SAS controller l...

Page 70: ...installed in these switch bays must match the type of expansion card installed Ethernet Fibre Channel and so forth 2 7 2 PCIe slots The two PCIe slots are connected to the three x8 Gen2 PCIe links on...

Page 71: ...SIM HT BladeCenter HT chassis is installed in bays 7 and 8 bays 9 and 10 or both A high speed switch module be installed in bay 7 and bay 9 In the BladeCenter S a compatible switch module is installed...

Page 72: ...location codes for PCIe expansion cards Figure 2 15 shows the locations of the PCIe CIOv and CFFh connectors for the PS704 base planar and the physical location codes The expansion unit for the PS704...

Page 73: ...e no externally accessible ports on the PS703 and PS704 blades all I O is routed through a BladeCenter midplane to the I O modules bays The I O ports on all expansion cards are typically set up to pro...

Page 74: ...I O Bay 4 I O Bay 2 I O Bay 1 Standard I O bays connections High speed I O bays connections Bridge modules I O bays connections Legend Mid Plane CIOv Blade Server 12 Blade Server 1 On Board 1GbE CFFh...

Page 75: ...e installed in bays 3 and 4 of the BladeCenter chassis CFFh expansion cards are supported in BladeCenter H and HT The Broadcom 2 4 Port Ethernet Expansion Card CFFh is also supported in the BladeCente...

Page 76: ...kbone 5 FC BB 5 project It is not meant to displace or replace FC FCoE is an enhancement that expands FC into the Ethernet by combining two leading edge technologies FC and Ethernet This evolution of...

Page 77: ...eds of 2 5 120 Gbps The architecture defines a layered hardware protocol as well as a software layer to manage initialization and the communication between devices Each link can support multiple trans...

Page 78: ...deCenter chassis midplane However only two are used Two USB ports are connected to the BladeCenter Media Tray providing access to the optical drive if installed and external USB ports to the blade ser...

Page 79: ...mmand line interface CLI over a Telnet or secure shell SSH connection SOL is required to manage servers that do not have KVM support or that are attached to an SDMC SOL provides console redirection fo...

Page 80: ...les you to have 14 simultaneous SOL sessions active one for each of up to 14 blade servers with six additional CLI sessions available for BladeCenter unit management With a BladeCenter S unit you have...

Page 81: ...lty system planar to the replacement planar Before the service processor knows what system it resides on it reads the SmartChip VPD to obtain system information There is only one anchor card for the P...

Page 82: ...olid state drives SSD via the SAS to SATA interposer card at each DASD bay location as shown in Figure 2 23 Figure 2 23 PS703 SAS configuration Note The anchor card used in the PS700 PS704 unlike the...

Page 83: ...ntroller is located on the SMP planar A total of eight SAS ports are used in the PS704 blade four of which are used on the SMP planar and the other four are routed from the SMP planar to the base plan...

Page 84: ...base planar Figure 2 26 HDD location and physical location code PS704 base planar x8 Gen1 P7IOC I O hub HDD SSD connector SAS Controller Modules in bays 3 and 4 of the chassis SAS Passthru card CIOv...

Page 85: ...ation code PS704 SMP planar Figure 2 28 shows the SATA SSD interposer card used to connect the 1 8 inch SATA SSD drives to the drive bay Figure 2 28 SATA SSD Interposer card P2 D1 for SAS HDD P2 C18 f...

Page 86: ...10 To achieve RAID1 mirror functionality use the RAID 10 option with two internal disk drives You can configure a hot spare disk if there are enough disks available A hot spare is a disk that can be u...

Page 87: ...isk subsystems that are supported IBM System Storage family of products For up to date compatibility information for Power blades and IBM Storage go to the Storage System Interoperability Center at th...

Page 88: ...installed Component description Part number Min max quantity Disk Storage Module DSM 43W3581 1 2 SAS Connectivity Module 39Y9195 1 2 3 Gb SAS Passthrough Card CIOv a a Also known as the SAS Connectiv...

Page 89: ...installed Mid Plane Blade Server 6 Blade Server 1 SAS Connectivity Card Expansion card connections DSM connections HDDs connections inside DSM Legend Disk Storage Module 1 Disk Storage Module 2 SAS Co...

Page 90: ...efined templates or creates custom configurations The RAID functionality is supplied by the onboard SAS controller when SAS Connectivity Cards are used in the blade servers The maximum number of drive...

Page 91: ...by SAS RAID Controller Modules Table 2 12 Hard disk drives supported in DSMs by SAS RAID Controller Modules Component description Part number Min max quantity Disk Storage Module DSM 43W3581 1 2 SAS...

Page 92: ...Volumes can be assigned to a specific blade or can be shared by several blade servers Zoning is supported by the SAS RAID controller module However zoning should not be used for regular operations in...

Page 93: ...uid psg1MIGR 5078040 SAS RAID Controller Module Interoperability Guide http www ibm com support docview wss uid psg1MIGR 5078491 SAS RAID Controller Module Detailed Host Attachment Guide Remote Boot...

Page 94: ...tem Storage DS5000 New DS5000 enhancements help reduce costs by reducing power per performance by introducing SSD drives Also with the new EXP5060 expansion unit supporting 60 1 TB SATA drives in a 4...

Page 95: ...o enable non disruptive migration of data from existing storage simplifying implementation and minimizing disruption to users IBM Storwize V7000 also enables you to virtualize and reuse existing disk...

Page 96: ...48 systems 1024 LPARS One SDMC can manage multiple servers 48 systems 1024 virtual servers High end servers Not supported Supported Supported hardware appliance only Low end midrange servers Supported...

Page 97: ...f firmware and management partition detected errors Service Focal Point support for consolidated management of operating system and firmware detected errors Service and Support Manager for consolidate...

Page 98: ...wnloading operating system downloads and is part of the base operating system For more information about the suma command functionality go to the following web page http www14 software ibm com webapp...

Page 99: ...lowing web page http www redhat com rhel features Supported virtualization features are listed in 3 4 10 Supported PowerVM features by operating system on page 117 2 13 IBM EnergyScale IBM EnergyScale...

Page 100: ...e by a fixed amount reducing the energy consumption of the system and still delivering predictable performance This percentage is predetermined to be within a safe operating limit and is not user conf...

Page 101: ...detects that a processor thread is idle it yields control of a hardware thread to the POWER Hypervisor The POWER Hypervisor immediately puts the thread into Nap mode Nap mode allows the hardware to cl...

Page 102: ...a significant improvement in power and performance over the IBM POWER6 chip POWER7 has more internal hardware and power and thermal management functions to interact with More hardware Eight cores vers...

Page 103: ...lications Share CPU memory and I O resources to reduce total cost of ownership Improve business responsiveness and operational speed by dynamically re allocating resources to applications as needed to...

Page 104: ...management and auditing of system functions Suspend Resume Using Suspend Resume clients can provide long term suspension greater than 5 10 seconds of partitions saving partition state memory NVRAM an...

Page 105: ...ederated management of WPARs across multiple systems by command line Support for workload partition definitions The WPAR definitions can be preserved after WPARs are deleted These definitions can be d...

Page 106: ...processors to physical processors and saves and restores all processor state information during a logical processor context switch Controls hardware I O interrupt management facilities for logical par...

Page 107: ...ection Virtual Ethernet support starts with AIX Version 5 3 or the appropriate level of Linux supporting virtual Ethernet devices see 3 4 10 Supported PowerVM features by operating system on page 117...

Page 108: ...apter Each logical partition is identified by a unique WWPN which means that you can connect each logical partition to independent physical storage on a SAN You can only configure virtual Fibre Channe...

Page 109: ...des the virtual console using a virtual TTY or serial adapter and a set of Hypervisor calls to operate on it Virtual TTY does not require the purchase of any additional features or software such as th...

Page 110: ...mpatible with v2 05 of the Power Instruction Set Architecture ISA For more information see http www power org resources reading PowerISA_V2 05 pdf POWER6 compatibility mode This mode is similar to POW...

Page 111: ...re utilization VMX Vector Multimedia Extension or AltiVec VSX Vector Scalar Extension High performance computing for graphic and scientific workload Affinity OFF by default 3 tier memory micro partiti...

Page 112: ...atform for consolidation of AIX Linux and IBM i operating system applications helping clients reduce infrastructure complexity and cost PowerVM Enterprise Edition The Enterprise edition is suitable fo...

Page 113: ...processors memory and I O components to be added and deleted from logical partitions as they are executing IBM AIX Version 5 2 with necessary enhancements to enable dynamic LPAR was introduced in 2002...

Page 114: ...ase of an uncapped partition Virtual processors The minimum desired and maximum number of virtual processors A virtual processor is a depiction or a representation of a physical processor that is pres...

Page 115: ...r four independent software threads simultaneously To support this feature we use the concept of logical processors The operating system AIX IBM i or Linux sees one physical processor as two or four l...

Page 116: ...One processing unit represents one physical processor s processing capacity At the end of the POWER Hypervisor s dispatch cycle 10 ms all partitions receive total CPU time equal to their processing u...

Page 117: ...red Processor Pool All Power Systems servers that support the Multiple Shared Processor Pools capability will have a minimum of one the default Shared Processor Pool and up to a maximum of 64 Shared P...

Page 118: ...d Processor Pool to a value greater than zero it becomes active and can accept micro partitions either transferred from SPP0 or newly created Figure 3 7 shows the creation of a processor pool named IT...

Page 119: ...red Processor Pool Unused processor cycles from within a Shared Processor Pool are harvested and then redistributed to any eligible micro partition within the same Shared Processor Pool Level1 When al...

Page 120: ...tes some of the extra capacity to the uncapped micro partitions This level of processor capacity management is sometimes referred to as Level1 capacity resolution POWER Hypervisor SPPn SPP2 SPP1 SPP0...

Page 121: ...C using either the GUI or CLI Dynamic movement between Shared Processor Pools A micro partition can be moved dynamically from one Shared Processor Pool to another using the HMC and either the GUI or C...

Page 122: ...liance server redundancy for physical devices attached to the VIOS can be provided by using capabilities such as Multipath I O and IEEE 802 3ad Link Aggregation Installation of the VIOS partition is p...

Page 123: ...n SEA can include up to 16 virtual Ethernet adapters on the VIOS that share the same physical access Figure 3 11 Architectural view of a SEA A single SEA setup can have up to 16 Virtual Ethernet trunk...

Page 124: ...on The virtual SCSI client adapter allows a client partition to access physical SCSI and SAN attached devices and LUNs that are assigned to the client partition The provisioning of virtual disk resour...

Page 125: ...ty on page 112 Support for virtual SCSI devices backed by a file These are then accessed as standard SCSI compliant LUNs Support for virtual Fibre Channel devices used with the NPIV feature VIOS Expan...

Page 126: ...M Express Edition PowerVM Standard Edition and in the PowerVM Enterprise Edition More information about PowerVM Lx86 can be found at the following web page http www ibm com systems power software virt...

Page 127: ...Set the preferred processor compatibility mode to the default mode When you activate the logical partition on the POWER6 processor based server it runs in the POWER6 mode 2 Move the logical partition...

Page 128: ...edicated memory model the system administrator s task is to optimize available memory distribution among partitions When a partition has performance degradation due to memory constraints and other par...

Page 129: ...er and resumed Key requirements for Suspend Resume are VIOS 2 2 or later AIX6 1 TL6 SP1 or AIX7 1 SP1 No Physical devices assigned to partition or virtual server No BSR or Huge Pages POWER6 6 or POWER...

Page 130: ...le 3 7 on page 117 shows the NPIV compatibility matrix for IBM i clients with feature codes Expansion Card on the blade servers I O modules in the BladeCenter chassis QLogic 8Gb FC CIOv 8242 a QLogic...

Page 131: ...Gb Switch Module 3243 3244 b b Requires Firmware level 6 5 0 22 or later No No No QLogic 8 Gb Switch Module 3284 c c Requires Firmware level 7 10 1 4 or later Yesd d DS8000 support requires QLogic 8Gb...

Page 132: ...Yes Virtual Ethernet Yes Yes Yes Yes Yes Yes Yes Yes Yes NPIV Yes Yes Yes Yes Yes Yes Yes Yes Yes Live Partition Mobility Yes Yes Yes No No Yes Yes Yes Yes Workload Partitions No Yes Yes No No No No...

Page 133: ...ibed as follows Reliability Reliability indicates how infrequently a defect or fault in a server manifests itself Availability Availability indicates how infrequently the functionality of a system or...

Page 134: ...eCenter chassis and the various components that make up the BladeCenter infrastructure In general the BladeCenter infrastructure RAS is outside the scope of this chapter However when appropriate the B...

Page 135: ...that most affect system availability are protected with redundancy and the ability to be repaired concurrently with operation Redundant parts allow the system to remain operational In POWER processor...

Page 136: ...valued at 255 The default value is set at 127 for standard partitions and 192 for Virtual I O Server VIOS partitions You can vary the priority of individual partitions Partition availability prioritie...

Page 137: ...sources of radiation are generally not repeatable With this function when an error is encountered in the core in caches and certain logic functions the POWER7 processor automatically retries the inst...

Page 138: ...e a variety of protection methods are used in POWER processor based systems to avoid uncorrectable errors in memory Memory protection plans must take into account many factors including Size Desired p...

Page 139: ...il the failed DIMM can be replaced assuming no additional single bit errors POWER7 memory subsystem The POWER7 chip contains two memory controllers with four channels per memory controller The impleme...

Page 140: ...marked for deallocation Pages used by the POWER Hypervisor are deallocated as soon as the page is released In other cases the POWER Hypervisor notifies the owning partition that the page should be de...

Page 141: ...line delete in both L2 and L3 arrays Processor Instruction Retry and Alternate Processor Recovery protection on L1 I and L1 D and redundant Repair bits in L1 I L1 D and L2 caches as well as L2 and L3...

Page 142: ...ta is used termination can be limited to the program or kernel or hypervisor owning the data Also possible is the freezing of the I O adapters that are controlled by an I O hub controller if data is t...

Page 143: ...the affected PCI slot hardware by calling system firmware that examines the affected bus allowing the device driver to reset it and continue without a system reboot For Linux EEH support extends to th...

Page 144: ...nt notification includes a clear indication of when servicer intervention is required to rectify the problem The intervention might be a service action that the client can perform or it might require...

Page 145: ...hose that go undetected can cause problems because the system does not have the opportunity to evaluate and act if necessary POWER processor based systems employ IBM System z server inspired error det...

Page 146: ...ory NVRAM When the operating system completes booting the information is passed from the NVRAM into the system error log where it is analyzed by error log analysis ELA routines Appropriate actions are...

Page 147: ...Figure 4 2 Schematic of a FIR implementation Fault isolation The service processor interprets error data captured by the FFDC checkers saved in the FIRs or other firmware related data capture methods...

Page 148: ...o minimize boot time the system determines which of the diagnostics are required to be started to ensure correct operation based on the way the system was powered off or through the boot time selectio...

Page 149: ...ords unrecoverable checkstop conditions forwards them to the SFP application or SSM and the BladeCenter AMM and notifies the system administrator After the information is logged in the SFP application...

Page 150: ...sentative or for additional analysis System dump handling In certain circumstances an error might require a dump to be automatically or manually created A manual dump creation can be done through the...

Page 151: ...lso collects VPD on the individual blades and the components of the BladeCenter chassis This information is used by support representatives to understand the complete BladeCenter blade environment IBM...

Page 152: ...such as latches levers thumb screws pop Nylatches U clips and cables are included to help prevent loose connections and aid in installing seating parts correctly These positive retention items do not...

Page 153: ...repair the LEDs shut off if the problem is fixed Service labels Service providers use these labels to assist them in performing maintenance actions Service labels are found in various formats and pos...

Page 154: ...l connectors from repeated plugging and unplugging for example or other unexpected failure For this reason these devices are designed to be concurrently maintainable when properly configured Live Part...

Page 155: ...to efficiently and effectively manage your system 4 5 1 Service user interfaces The Service Interface allows support personnel or the client to communicate with the service support applications in a s...

Page 156: ...of the AIX or VIOS operating system on the disk or server They can be booted in single user mode service mode run in maintenance mode or run concurrently concurrent mode with other applications They h...

Page 157: ...n conjunction with the SDMC provides a method to list problems and to drill down event status and additional details Starting at the highest level of System Status and Health Problems General overall...

Page 158: ...d install microcode updates on Power Systems and associated I O adapters The system firmware consists of service processor microcode Open Firmware microcode SPCN microcode and the POWER Hypervisor The...

Page 159: ...4 4 Support for IBM Systems web page After selecting the BladeCenter link you will be directed the BladeCenter section of the IBM Support Portal Figure 4 5 on page 146 From this page the specific Blad...

Page 160: ...e or power subsystem firmware that has been installed and is installed into memory after the managed system is powered off and powered on It is installed on the temporary side of system firmware Activ...

Page 161: ...event monitoring and call home function for SDMC and IBM Systems Director ESA is available on VIOS AIX IBM i and Linux operating systems This tool tracks and captures service information hardware erro...

Page 162: ...ble event designated as a call home event is detected a message is written in the event log and any configured alerts sent The information gathered by the service advisor is the same information that...

Page 163: ...isplay Call Home Flag checkbox If you select the checkbox events are marked with a C for call home events and an N for events that are not called home In addition you can filter the event log view bas...

Page 164: ...150 IBM BladeCenter PS703 and PS704 Technical Overview and Introduction...

Page 165: ...and how they relate to POWER6 and POWER7 based blades Installation and setup of the SDMC is outside the scope of this paper and will not be covered in this chapter For a comprehensive view of the SDMC...

Page 166: ...sor is not permitted All communication is accomplished through a special channel from the guest to the host 5 1 2 Software appliance The SDMC software appliance can be installed in an existing x86 vir...

Page 167: ...nce 520 9407 M15 HMC or IVM Hardware or software appliance Blade systems JS22 7998 61X IVM Hardware or software appliance JS12 7998 60X IVM Hardware or software appliance JS23 43 7778 23X IVM Hardware...

Page 168: ...owser to the following URL where system_name is the host name or IP address of the SDMC system https system_name A login page opens as shown in Figure 5 1 on page 155 HMC IVM terminology SDMC terminol...

Page 169: ...ole 155 Figure 5 1 SDMC login Enter the user ID and password that corresponds to an authorized SDMC user and click Log in The Welcome page shown in Figure 5 2 will display after logging in successfull...

Page 170: ...in Figure 5 2 on page 155 The Resource tab provides a dashboard of all the servers virtual servers power units and operating systems that your SDMC is currently managing The properties for a selected...

Page 171: ...onal way to manage POWER based blade servers is through the use of Integrated Virtualization Manager IVM The introduction of the SDMC provides new capability to these blades This section highlights so...

Page 172: ...SDMC added capability for POWER based blades The SDMC can consolidate most of the AMM and IVM functions and adds new capability when used with POWER based blades The SDMC interfaces directly with the...

Page 173: ...stem The virtual servers hosted by the system are retrieved and listed on the Welcome page Information on the actual steps required to perform the transition can be found in 5 4 2 Steps to SDMC manage...

Page 174: ...Service Processor FSP on the blade to communicate on the network The basic steps are 1 Expose the POWER based blade FSP to the network 2 Discovery of the server to be managed 3 Request access to the s...

Page 175: ...rver discovery process used by SDMC is the same as Systems Director and is initiated from the navigation section by selecting Inventory System Discovery Figure 5 5 shows the user interface page used t...

Page 176: ...by clicking the No access link shown in Figure 5 6 This link will take you to the page that allows you to enter an HMC password as shown in Figure 5 7 If you have not set a password previously you ca...

Page 177: ...SDMC main view and review the newly added server as show in Figure 5 9 The name is the same as the discovery method IP address in this case Notice the Detailed State is Password Update Required Figur...

Page 178: ...steps are now complete 5 4 7 Systems Director inventory collection One of the most important tasks to be completed on a newly discovered and accessed object is the core Systems Director function of co...

Page 179: ...s can now be started 5 5 SDMC basic management of POWER based blades This section is only a brief introduction to the functionality of the SDMC in a POWER based blade environment No attempt has been m...

Page 180: ...stallation of the VIOS allows more flexibility and capability for this POWER platform Starting from the SDMC Resources view you can select a server to create a virtual server on Right click the server...

Page 181: ...i or AIX Linux can be assigned dedicated or shared memory if an Active Memory Sharing AMS pool has been previously created Figure 5 15 Virtual server creation wizard Step 2 Memory assignment Processo...

Page 182: ...xt step Figure 5 17 shows the default number of virtual adapters is two Figure 5 17 Virtual server creation wizard Step 4 Virtual Ethernet assignment The Add or Edit button on the virtual Ethernet ada...

Page 183: ...pters can be added next as shown in Figure 5 19 Figure 5 19 Virtual server creation wizard Step 5 Virtual storage adapter creation The types of virtual storage adapters available are SCSI and Fibre Ch...

Page 184: ...All the physical adapters in the system can be displayed or toggled to only show the available hardware Figure 5 21 shows the check box marked to display only adapters that are currently available Fi...

Page 185: ...he virtual server This profile can be edited and additional profiles can be generated for the same virtual server 5 5 2 Multiple profiles for POWER based blades IVM managed systems had the limitation...

Page 186: ...r is shown Figure 5 25 shows a single profile that has a status of being the default profile and the last activated Figure 5 25 Managed profiles page The existing profile can be edited used as a start...

Page 187: ...t method With SDMC the creation of virtual servers and the type of operating system environment that they support can occur prior to any operating system installation The only limitation from a dual V...

Page 188: ...d to the first VIOS The Fibre Channel ports on the CIOv expansion card and the Ethernet ports on the CFFh combo card would be assigned to the second VIOS Both VIO Servers in this example would boot fr...

Page 189: ...n suspend the operating system and applications When the virtual server is resumed the prior running processes are also resumed The processor and memory resources of a suspended virtual server can be...

Page 190: ...ssigned physical memory AME compresses memory pages using processor capacity to provide additional memory capacity for a virtual server Figure 5 31 show how to select this option during the creation o...

Page 191: ...ole through the IVM function SDMC provides for a virtual console to any virtual server operating system In order for the SDMC console to function to the same virtual server that owns the first Etherne...

Page 192: ...ew and Introduction Figure 5 33 Opening a console to a virtual server When the operation completes a separate window will be opened for the console that will require the same password as the current I...

Page 193: ...sis ESA Electronic Service Agent ETSI European Telecommunications Standard Industry FC Fibre Channel FC AL Fibre Channel arbitrated loop Abbreviations and acronyms FC IP Fibre Channel Internet Protoco...

Page 194: ...x RSA Remote Supervisor Adapter SAN storage area network SAS Serial Attached SCSI SATA Serial ATA SCM Supply Chain Management SCSI Small Computer System Interface SEA Shared Ethernet Adapter SER soft...

Page 195: ...uide SG24 7655 IBM BladeCenter JS23 and JS43 Implementation Guide SG24 7740 IBM BladeCenter Products and Technology SG24 7523 IBM PowerVM Live Partition Mobility SG24 7460 IBM PowerVM Virtualization M...

Page 196: ...02 Express home page http ibm com systems bladecenter hardware servers ps700series How to get Redbooks You can search for view or download Redbooks Redpapers Technotes draft publications and Additiona...

Page 197: ......

Page 198: ...the follow on to the BladeCenter PS700 PS701 and PS702 Describes management using the new Systems Director Management Console The IBM BladeCenter PS703 and PS704 are premier blades for 64 bit applica...