manualshive.com logo in svg

IBM Power 750 Express, Technical Overview And Introduction

The IBM Power 750 Express is a cutting-edge server designed to meet your business needs. Our Technical Overview and Introduction manual offers in-depth insights into its features and functionalities. Download this comprehensive manual for free at 88.208.23.73:8080, and unlock the full potential of your Power 750 Express.

Share
Download
background image

iv

 

IBM Power 750 and 760 Technical Overview and Introduction

2.1.4  Memory access . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  48
2.1.5  On-chip L3 cache innovation and Intelligent Cache . . . . . . . . . . . . . . . . . . . . . . .  49
2.1.6   processor and Intelligent Energy . . . . . . . . . . . . . . . . . . . . . . . . . . . .  51
2.1.7  Comparison of the , POWER7, and POWER6 processors . . . . . . . . .  51

2.2   processor card . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  51

2.2.1  Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  52
2.2.2  Processor interconnects . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  52

2.3  Memory subsystem . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  54

2.3.1  Registered DIMM  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  54
2.3.2  Memory placement rules. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  54
2.3.3  Memory bandwidth . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  60

2.4  Capacity on Demand. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  61

2.4.1  Capacity Upgrade on Demand . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  61
2.4.2  Capacity Backup offering (applies only to IBM i). . . . . . . . . . . . . . . . . . . . . . . . . .  61
2.4.3  Software licensing and CoD . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  62

2.5  System bus . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  62

2.5.1  I/O buses and GX++ card . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  62

2.6  Internal I/O subsystem  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  63

2.6.1  Blind swap cassettes  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  64
2.6.2  Integrated multifunction card. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  64

2.7  PCI adapters . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  65

2.7.1  PCI Express  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  65
2.7.2  PCI-X adapters . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  66
2.7.3  IBM i IOP adapters . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  66
2.7.4  PCIe adapter form factors . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  66
2.7.5  LAN adapters  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  68
2.7.6  Graphics accelerator adapters  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  70
2.7.7  SCSI and SAS adapters . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  70
2.7.8  iSCSI adapters  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  70
2.7.9  Fibre Channel adapters  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  71
2.7.10  Fibre Channel over Ethernet . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  71
2.7.11  InfiniBand host channel adapter . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  72
2.7.12  Asynchronous and USB adapters . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  73
2.7.13  Cryptographic coprocessor . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  73

2.8  Internal Storage. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  74

2.8.1  Dual split backplane mode  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  77
2.8.2  Triple split backplane mode  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  77
2.8.3  Dual storage I/O Adapter (IOA) configurations . . . . . . . . . . . . . . . . . . . . . . . . . . .  78
2.8.4  DVD  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 79

2.9  External I/O subsystems . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  80

2.9.1  PCI-DDR 12X expansion drawer  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  80
2.9.2  12X I/O Drawer PCIe  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  80
2.9.3  12X I/O Drawer PCIe configuration and cabling rules. . . . . . . . . . . . . . . . . . . . . .  82

2.10  External disk subsystems . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  86

2.10.1  EXP30 Ultra SSD I/O drawer  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  86
2.10.2  EXP24S SFF Gen2-bay drawer  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  91
2.10.3  EXP12S SAS expansion drawer . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  93
2.10.4  TotalStorage EXP24 disk drawer and tower . . . . . . . . . . . . . . . . . . . . . . . . . . . .  93
2.10.5  IBM 7031 TotalStorage EXP24 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  93
2.10.6  IBM System Storage . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  94

2.11  Hardware Management Console  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  95

2.11.1  HMC connectivity to the  processor-based systems . . . . . . . . . . . . .  97
2.11.2  High availability HMC configuration  . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .  99

Summary of Contents for Power 750 Express

Page 1: ...erview and Introduction James Cruickshank Sorin Hanganu Volker Haug Stephen Lutz John T Schmidt Marco Vallone Features the 8408 E8D and 9109 RMD based on the latest POWER7 processor technology Discusses the dual chip module architecture Describes the enhanced I O subsystem ...

Page 2: ......

Page 3: ...International Technical Support Organization IBM Power 750 and 760 Technical Overview and Introduction May 2013 REDP 4985 00 ...

Page 4: ...ed Rights Use duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp First Edition May 2013 This edition applies to the IBM Power 750 8408 E8D and Power 760 9109 RMD Power Systems servers Note Before using this information and the product it supports read the information in Notices on page vii ...

Page 5: ...tures 16 1 6 Disk and media features 18 1 7 I O drawers 21 1 7 1 12X I O Drawer PCIe 21 1 7 2 EXP30 Ultra SSD I O drawer 22 1 7 3 EXP24S SFF Gen2 bay drawer 22 1 7 4 EXP12S SAS drawer 23 1 7 5 I O drawers and usable PCI slots 23 1 8 Comparison between models 24 1 9 Build to order 26 1 10 IBM editions 26 1 11 Model upgrades 26 1 12 Server and virtualization management 27 1 13 System racks 28 1 13 1...

Page 6: ...ter form factors 66 2 7 5 LAN adapters 68 2 7 6 Graphics accelerator adapters 70 2 7 7 SCSI and SAS adapters 70 2 7 8 iSCSI adapters 70 2 7 9 Fibre Channel adapters 71 2 7 10 Fibre Channel over Ethernet 71 2 7 11 InfiniBand host channel adapter 72 2 7 12 Asynchronous and USB adapters 73 2 7 13 Cryptographic coprocessor 73 2 8 Internal Storage 74 2 8 1 Dual split backplane mode 77 2 8 2 Triple spli...

Page 7: ...uplication 139 3 4 8 Dynamic Platform Optimizer 142 3 4 9 Dynamic System Optimizer 143 3 4 10 Operating system support for PowerVM 143 3 4 11 Linux support 144 3 5 System Planning Tool 146 3 6 New PowerVM Version 2 2 2 features 147 Chapter 4 Continuous availability and manageability 149 4 1 Reliability 150 4 1 1 Designed for reliability 150 4 1 2 Placement of components 151 4 1 3 Redundant compone...

Page 8: ...4 Electronic Services and Electronic Service Agent 179 4 5 POWER7 RAS features 180 4 6 Power On Reset Engine 181 4 7 Operating system support for RAS features 181 Related publications 185 IBM Redbooks 185 Other publications 186 Online resources 187 Help from IBM 187 ...

Page 9: ...do not in any manner serve as an endorsement of those websites The materials at those websites are not part of the materials for this IBM product and use of those websites is at your own risk IBM may use or distribute any of the information you supply in any way it believes appropriate without incurring any obligation to you Any performance data contained herein was determined in a controlled envi...

Page 10: ...POWER6 POWER7 POWER7 PowerHA PowerPC PowerVM pSeries PureFlex Rational Rational Team Concert Real time Compression Redbooks Redpaper Redpapers Redbooks logo RS 6000 Storwize System p System Storage System x System z Tivoli XIV The following terms are trademarks of other companies Intel Intel Xeon Intel logo Intel Inside logo and Intel Centrino logo are trademarks or registered trademarks of Intel ...

Page 11: ...tive Memory Expansion technology that provides more usable memory than is physically installed in the system IBM EnergyScale technology that provides features such as power trending power saving capping of power and thermal measurement Improved reliability serviceability and availability Dynamic Platform Optimizer High performance SSD drawer This publication is for professionals who want to acquir...

Page 12: ...cademy of Technology Stephen Lutz is a Certified Senior Technical Sales Professional for Power Systems working for IBM Germany He holds a degree in Commercial Information Technology from the University of Applied Science Karlsruhe Germany He is POWER7 champion and has 14 years experience in AIX Linux virtualization and Power Systems and its predecessors providing pre sales technical support to cli...

Page 13: ...ITSO residency project and help write a book in your area of expertise while honing your experience using leading edge technologies Your efforts will help to increase product acceptance and customer satisfaction as you expand your network of technical contacts and relationships Residencies run from two to six weeks in length and you can participate either in person or as a remote resident working ...

Page 14: ... Twitter http twitter com ibmredbooks Look for us on LinkedIn http www linkedin com groups home gid 2130806 Explore new Redbooks publications residencies and workshops with the IBM Redbooks weekly newsletter https www redbooks ibm com Redbooks nsf subscribe OpenForm Stay current on recent Redbooks publications with RSS Feeds http www redbooks ibm com rss html ...

Page 15: ...ffective maximum memory capacity to be much larger than the true physical memory The POWER7 processor includes built in accelerators that increase the efficiency of the compression and decompression process allowing greater levels of expansion up to 125 This can enable a partition to do significantly more work or enable a server to run more partitions with the same physical amount of memory The Po...

Page 16: ...ted with one two three or four DCMs providing 8 16 24 or 32 cores All the cores are active The Power 750 Express server supports a maximum of 64 DDR3 DIMM slots 16 per 8 core DCM Memory features two DIMMs per memory feature supported are 8 16 and 32 GB and run at a speed of 1066 MHz A system with four DCMs installed has a maximum memory of 1024 GB The optional Active Memory Expansion feature enabl...

Page 17: ...tegrated POWER7 I O controllers One hot plug slim line SATA media bay optional Choice of Integrated Multifunction Card options maximum one per system Dual 10 Gb Copper Dual 1 Gb Ethernet FC 1768 Dual 10 Gb Optical Dual 1 Gb Ethernet FC 1769 Dual 10 Gb Copper Dual 1 10 Gb RJ45 Ethernet FC EN10 Dual 10 Gb Optical Dual 1 10 Gb RJ45 Ethernet FC EN11 One serial port on the Integrated Multifunction Card...

Page 18: ...nch SFF and hot swappable The six SAS or SSD bays can be split into two sets of three bays for additional configuration flexibility using just the integrated SAS adapters Two new SSD packages offer ordering convenience and price savings for a new server order Each 6 pack SSD feature FC ESR2 or FC ESR4 for the EXP30 Ultra SSD I O Drawer can provide up to 140 000 I O operations per second IOPS in ju...

Page 19: ...tem unit with 32 cores installed Power 760 2400 watts maximum system unit with 48 cores active Not applicable Power source loading Power 750 2 45 kVA maximum system unit with 32 cores installed Power 760 2 45 kVA maximum system unit with 48 cores active Not applicable Thermal output Power 750 8 189 BTU hr maximum system unit with 32 cores installed Power 760 8 189 BTU hr maximum system unit with 4...

Page 20: ...ilable only in a rack mounted form factor and each can take five EIA units 5U of rack space Table 1 2 Physical dimensions of a Power 750 Express and Power 760 server Figure 1 2 shows the rear view of the Power 750 Express and Power 760 Figure 1 2 Rear view of the Power 750 Express and Power 760 Dimension Power 750 Model 8408 E8D Power 760 Model 9109 RMD Width 447 mm 17 6 in 447 mm 17 6 in Depth 85...

Page 21: ...et FC 1768 Dual 10 Gb Optical and Dual 1 Gb Ethernet FC 1769 Dual 10 Gb Copper and Dual 1 10 Gb RJ45 Ethernet FC EN10 Dual 10 Gb Optical and Dual 1 10 Gb RJ45 Ethernet FC EN11 One serial port on the Integrated Multifunction Card Two USB ports on the Integrated Multifunction Card plus another USB port on the base system unit DASD and Media backplane with 6 x 2 5 inch HDD or SSD FC EPTS One to six S...

Page 22: ... orderable 1 5 2 Power 760 system features The following features are available on the Power 760 A 5U 19 inch rack mount system enclosure One to four 0 12 core CUoD processor DCMs 0 12 core 2 x 6 core 3 1 GHz processor DCM FC EPT5 0 12 core 2 x 6 core 3 4 GHz processor DCM FC EPT6 POWER7 DDR3 Memory DIMMs two per feature 8 GB 2 x 4 GB 1066 MHz FC EM08 16 GB 2 x 8 GB 1066 MHz FC EM4B 32 GB 2 x 16 G...

Page 23: ...e SAS bays One slim bay for a DVD RAM required One integrated SATA controller to run the DVD RAM Eight I O expansion slots per system Six Gen2 PCIe 8x slots plus two GX slots Two HMC ports Permanent Processor CUoD PowerVM optional Micro Partitioning Virtual I O Server VIOS Automated CPU and memory reconfiguration support for dedicated and shared processor logical partition LPAR groups PowerVM Live...

Page 24: ...IX FC 2146 IBM i FC 2145 Linux FC 2147 One processor card 8 core 3 5 GHz processor card DCM FC EPT8 8 core 4 0 GHz processor card DCM FC EPT7 Eight processor activations For processor card FC EPT7 one of the following items 8 X FC EPTE 4 X FC EPTC plus 4 x FC EPTE For processor card FC EPT8 one of the following items 8 X FC EPTF 4 X FC EPTD plus 4 x FC EPTF 32 GB minimum DDR3 memory A minimum of t...

Page 25: ... either FC EPTC or FC EPTD are ordered 50 of the DCM processor core activations can be no charge FC EPTC or FC EPTD and at 50 must be priced FC EPTE or FC EPTF The Ethernet ports and serial port of the Integrated Multifunction Card is not natively supported by IBM i and thus cannot be used for IBM i LAN console support The FC 5899 4 port Ethernet adapter is usually used with this function or an op...

Page 26: ...7 If SAN boot FC 0837 is selected then no disk drive is required For IBM i Two disk drives 856 GB 10K RPM SAS SFF Disk Drive FC 1737 856 GB 10K RPM SAS SFF 2 Disk Drive FC 1738 571 GB 10K RPM SAS SFF Disk Drive FC 1916 571 GB 10K RPM SAS SFF 2 Disk Drive FC 1962 283 GB 15K RPM SAS SFF Disk Drive FC 1879 283 GB 15K RPM SAS SFF 2 Disk Drive FC 1948 283 GB 10K RPM SFF SAS Disk Drive FC 1911 283 GB 10...

Page 27: ...ssor card features The Power 750 and Power 760 systems contain a processor planar board FC EPT1 that has the following sockets Four processor sockets Eight memory riser sockets two per processor module with eight DIMM sockets per riser Five power regulator sockets one regulator socket is preinstalled on the planar The processor planar is populated with one two three or four processor modules The p...

Page 28: ... Demand for processors only A minimum of eight processor activations are required per system Additional processor activations may be purchased with the initial configuration or at a later time More information about Capacity Upgrade on Demand is in 2 4 1 Capacity Upgrade on Demand on page 61 PCIe slot 1 PCIe slot 3 PCIe slot 2 PCIe slot 4 PCIe slot 5 PCIe slot 6 Memory Riser 1 Memory Riser 2 Memor...

Page 29: ...x EPT8 54A1 3 5 GHz 8 core POWER7 Processor DCM 2x4 core AIX IBM i Linux EPT7 4 0 GHz 8 core POWER7 Processor DCM 2x4 core AIX IBM i Linux EPTC N A 1 core activation of FC EPT7 No charge AIX IBM i Linux EPTD N A 1 core activation of FC EPT8 No charge AIX IBM i Linux EPTE N A 1 core activation of FC EPT7 AIX IBM i Linux EPTF N A 1 core activation of FC EPT8 AIX IBM i Linux EPTR 2B67 Service process...

Page 30: ...emory riser cards The DIMMs are plugged into memory riser cards FC EM01 located on the processor and memory backplane FC EPT1 Each riser card has eight DIMM slots Figure 1 4 outlines the general connectivity of a POWER7 DCM and DDR3 memory DIMMs The figure shows the eight memory channels four per DCM Figure 1 4 Outline of POWER7 processor connectivity to DDR3 DIMMs in Power 750 and Power 760 DCM M...

Page 31: ...erent memory features Invalid configurations using more than one memory size feature are as follows More than two sizes of memory features For example 8 GB plus 16 GB plus 32 GB on one riser Three of one memory features plus one of another memory feature Use two sets of two features instead if installing eight DIMMs DCMs in system DIMM slots Power 750 memory Power 760 memory Minimum Maximum Minimu...

Page 32: ...card The four DIMMs if present in C5 C6 C7 and C8 must be identical in a riser card Plans for future memory upgrades should be taken into account when deciding which memory feature size to use at the time of initial system order 1 6 Disk and media features The Power 750 and the Power 760 system unit includes six SFF SAS bays This offers up to 5 4 TB HDD capacity or up to 3 6 TB SSD capacity All SA...

Page 33: ...48 19B1 283 GB 15K RPM SAS SFF 2 Disk Drive IBM i ES0B 387 GB SFF SSD eMLC IBM i ES0D 387 GB SFF 2 SSD eMLC IBM i 1916 19A3 571 GB 10K RPM SAS SFF Disk Drive IBM i 1962 19B3 571 GB 10K RPM SAS SFF 2 Disk Drive IBM i 1737 19A4 856 GB 10K RPM SAS SFF Disk Drive IBM i 1738 19B4 856 GB 10K RPM SAS SFF 2 Disk Drive IBM i Feature code Description OS support 1818 Quantity 150 of FC 1964 600 GB 10K RPM SA...

Page 34: ...387 GB SAS SFF SSD AIX Linux EQ0C Quantity 150 of FC ES0C 387 GB SAS SFF SSD AIX Linux EQ51 Quantity 150 of FC 1751 900 GB SFF disk AIX Linux EQ52 Quantity 150 of FC 1752 900 GB SFF 2 disk AIX Linux 7578 Quantity 150 of FC 1775 177 GB SAS SFF SSD AIX Linux 1958 Quantity 150 of FC 1794 177 GB SAS SSD IBM i 7582 Quantity 150 of FC 1787 177 GB SAS SFF SSD IBM i EQ0B Quantity 150 of FC ES0B 387GB SAS ...

Page 35: ...le partition support EXP30 Ultra SSD I O drawer FC EDR1 EXP24S SFF Gen2 bay drawer FC 5887 for high density storage holds SAS Hard Disk drives EXP12S FC 5886 drawer holds a 3 5 inch SAS disk or SSD A suggestion is that any attached I O drawers be located in the same rack as the Power 750 Express or the Power 760 server for ease of service but they can be installed in separate racks if the applicat...

Page 36: ... clients This ultra dense SSD option is similar to the Ultra Drawer FC 5888 which remains available to the Power 710 720 730 and 740 The EXP30 attaches to the Power 750 or Power 760 server with a GX adapter FC 1914 Figure 1 6 shows the EXP30 I O drawer Figure 1 6 EXP30 Ultra SSD I O Drawer 1 7 3 EXP24S SFF Gen2 bay drawer The EXP24S SFF Gen2 bay Drawer FC 5887 is an expansion drawer that supports ...

Page 37: ...8 EXP12S SAS Drawers rear view 1 7 5 I O drawers and usable PCI slots The I O drawer model types can be intermixed on a single server within the appropriate I O loop Depending on the system configuration the maximum number of I O drawers that is supported differs The Power 750 and Power 760 servers deliver great I O expandability In addition to the six PCIe Gen2 slots in the system unit up to four...

Page 38: ...es and matches them to the L3 cache sizes for the Power 750 and Power 760 Table 1 12 Summary of processor core counts core frequencies and L3 cache sizes Table 1 13 compares the Power 750 and Power 760 systems Table 1 13 Comparison between models Server Maximum FC EDR1 drawers Maximum FC 5887 drawers Maximum FC 5886 drawers Power 750 2 51 27 Power 760 2 51 27 System Cores per POWER7 DCM Frequency ...

Page 39: ...er populated DCM DIMMs memory feature code With 1 DCM 32 GB 2 x FC EM4B or 4 x FC EM08 With 2 DCMs 32 GB 4 x FC EM08 With 3 DCMs 48 GB 6 x FC EM08 With 4 DCMs 64 GB 8 x FC EM08 64 16 per DCM from the list of FC EM08 FC EM4B FC EM4C With 1 DCM 32 GB 2 x FC EM4B or 4 x FC EM08 With 2 DCMs 32 GB 4 x FC EM08 With 3 DCMs 48 GB 6 x FC EM08 With 4 DCMs 64 GB 8 x FC EM08 64 16 per DCM from the list of FC ...

Page 40: ... no charge activations cannot be ordered and all activations must be the full price If the server previously had not qualified for the no charge activations and a MES order is placed with enough memory to meet the 8 GB per core minimum on the entire server original plus MES then a maximum of 50 of the cores activation features on that MES order can be no charge If the server previously had a great...

Page 41: ...irtual operating system session terminal for each partition Displaying a virtual operator panel of contents for each partition Detecting reporting and storing changes in hardware conditions Powering managed systems on and off Acting as a service focal point for service representatives to determine an appropriate service strategy The IBM Power 750 is supported by the Integrated Virtualization Manag...

Page 42: ...be a rack mount CR3 model or later or deskside C06 model or later 1 13 System racks The Power 750 8408 E8D Power 760 9109 RMD and their I O drawers are designed to mount in the 7014 T00 7014 T42 7014 B42 feature 0551 and feature 0553 racks These are built to the 19 inch EIA standard When ordering a new Power 750 or Power 760 system you can order the appropriate 7014 rack model with the system hard...

Page 43: ...ls identified in the physical specifications section You can order the acoustic door feature on new 7014 T00 FC 0551 7014 T42 FC 0553 racks or for the 7014 T00 FC 0551 or 7014 T42 FC 0553 racks that you already own A Power 750 Express or Power 760 door FC ERG7 is available on the 7014 T42 rack If a system is to be installed in a rack or cabinet that is not from IBM it must meet requirements 1 13 1...

Page 44: ...essary The Ruggedized Rack Feature also includes hardware for bolting the rack to a concrete floor or a similar surface and bolt in steel filler panels for any unoccupied spaces in the rack Weights are as follows T00 base empty rack 244 kg 535 lb T00 full rack 816 kg 1795 lb Maximum weight of drawers is 572 kg 1260 lb Maximum weight of drawers in a zone 4 earthquake environment is 490 kg 1080 lb w...

Page 45: ...rance Front Door FC 6250 provides a front rack door with a field installed Power 780 logo designed to be used when the rack will contain a Power 780 system The door is not acoustic and has a depth of about 90 mm 3 5 in The FC ERG7 provides an attractive black full height rack door The door is steel with a perforated flat front surface The perforation pattern extends from the bottom to the top of t...

Page 46: ...hen you order the 7014 T00 rack The included features might differ Several features that are delivered as part of the 7014 T00 must be ordered separately with the FC 0551 1 13 4 Feature code 0553 rack The 2 0 meter rack FC 0553 is a 42U EIA units rack The rack that is delivered as FC 0553 is the same rack delivered when you order the 7014 T42 or B42 rack The included features might differ Several ...

Page 47: ...illers in the EIA units that are occupied by these PDUs to facilitate proper air flow and ventilation in the rack Figure 1 10 PDU placement and PDU view The PDU receives power through a UTG0247 power line connector Each PDU requires one PDU to wall power cord Various power cord features are available for various countries and applications by varying the PDU to wall power cord which must be ordered...

Page 48: ... systems IBM System Storage 7214 Tape and DVD Enclosure The IBM System Storage 7214 Tape and DVD Enclosure Model 1U2 is designed to mount in one EIA unit of a standard IBM Power Systems 19 inch rack and can be configured with one or two tape drives or either one or two Slim DVD RAM or DVD ROM drives in the bay on the right side Feature code Wall plug Rated voltage Vac Phase Rated amperage Geograph...

Page 49: ...ve Available 1402 DAT320 160 GB SAS Tape Drive Withdrawn 1420 DVD RAM SAS Optical Drive Available 1421 DVD ROM Optical Drive Withdrawn 1423 DVD ROM Optical Drive Available 1404 LTO Ultrium 4 Half High 800 GB Tape Drive Available Support The IBM System Storage 7214 1U2 Tape and DVD Enclosure is no longer orderable Although the drawer is supported to be attached to a Power 750 or Power 760 server Fe...

Page 50: ...support the USB cable that is provided as part of the feature code Additional USB hubs add on USB cables or USB cable extenders are not supported For each RDX Docking Station feature installed in the 7216 the appropriate external USB cable will be included The 7216 RDX Docking Station feature can be connected to the external integrated USB ports on the Power 750 and Power 760 or to the USB ports o...

Page 51: ...ive to tape backup and restore devices IBM System Storage 7226 Model 1U3 Multi Media Enclosure IBM System Storage 7226 Model 1U3 Multi Media Enclosure can accommodate up to two tape drives two RDX removable disk drive docking stations or up to four DVD RAM drives The 7226 offers SAS USB and FC electronic interface drive options The 7226 Storage Enclosure delivers external tape removable disk drive...

Page 52: ...interface option is compatible with most standard DVD disks RDX removable disk drives The RDX USB docking station is compatible with most RDX removable disk drive cartridges when used in the same operating system The 7226 offers the following RDX removable drive capacity options 320 GB FC EU08 500 GB FC 1107 1 0 TB FC EU01 1 5 TB FC EU15 Removable RDX drives are in a rugged cartridge that inserts ...

Page 53: ...IBM i operating system does not support 7226 USB devices For a complete list of host software versions and release levels that support the 7226 see the following System Storage Interoperation Center SSIC website http www ibm com systems support storage config ssic index jsp Flat panel display options The IBM 7316 Model TF3 is a rack mountable flat panel console kit consisting of a 17 inch 337 9 mm...

Page 54: ...p The key points mentioned are as follows The front rack opening must be 451 mm wide 0 75 mm 17 75 in 0 03 in and the rail mounting holes must be 465 mm 0 8 mm 18 3 in 0 03 in apart on center horizontal width between the vertical columns of holes on the two front mounting flanges and on the two rear mounting flanges Figure 1 13 shows a top view showing the specification dimensions Figure 1 13 Top ...

Page 55: ... 1 75 in apart on center Rail mounting holes must be 7 1 mm 0 1 mm 0 28 in 0 004 in in diameter Figure 1 14 shows the top front specification dimensions Figure 1 14 Rack specification dimensions top front view Hole Diameter 7 1 0 1mm Rack Mounting Holes Center to Center Rack Front Opening 450 0 75mm 465 0 8mm EIA Hole Spacing 6 75mm min 15 9mm 15 9mm 12 7mm 15 9mm 15 9mm 12 7mm 6 75mm min 15 9mm 1...

Page 56: ...42 IBM Power 750 and 760 Technical Overview and Introduction ...

Page 57: ...wo 6 core POWER7 processors This chapter provides an overview of the system architecture and its major components The bandwidths numbers that are provided are theoretical maximums used for reference The speeds shown are at an individual component level Multiple components and application implementation are key to achieving the best performance Always do the performance sizing at the application wo...

Page 58: ...et Ethernet Ethernet Ethernet Controller Serial USB USB USB Cont Hard Disk 1 Hard Disk 2 Hard Disk 3 Hard Disk 4 Hard Disk 5 Hard Disk 6 Optical Optical Int SAS Cnt DIMM DIMM DIMM DIMM DIMM DIMM DIMM DIMM Buffer Buffer DIMM DIMM DIMM DIMM DIMM DIMM DIMM DIMM Buffer Buffer DIMM DIMM DIMM DIMM DIMM DIMM DIMM DIMM Buffer Buffer DIMM DIMM DIMM DIMM DIMM DIMM DIMM DIMM Buffer Buffer DIMM DIMM DIMM DIMM...

Page 59: ...R7 processor and POWER7 processor based systems include but are not limited to the following items On chip L3 cache implemented in embedded dynamic random access memory eDRAM Cache hierarchy and component innovation Advances in memory subsystem Advances in off chip signaling Advances in I O card throughput and latency Advances in RAS features such as power on reset and L3 cache dynamic column repa...

Page 60: ...mponents transistors Up to eight processor cores are on the chip each with 12 execution units 256 KB of L2 cache per core and up to 80 MB of shared on chip L3 cache per chip For memory access the POWER7 processor includes a double data rate 3 DDR3 memory controller with four memory channels Table 2 1 summarizes the technology characteristics of the POWER7 processor Table 2 1 Summary of POWER7 proc...

Page 61: ...a cache 32 KB L2 cache 256 KB implemented in fast SRAM 2 1 3 Simultaneous multithreading POWER7 processors support SMT1 SMT2 and SMT4 modes to enable up to four instruction threads to execute simultaneously in each POWER7 processor core The processor supports the following instruction thread execution modes SMT1 Single instruction execution thread per core SMT2 Two instruction execution threads pe...

Page 62: ... work With more threads the POWER7 processor can deliver more total capacity as more tasks are accomplished in parallel With fewer threads those workloads that need fast individual tasks can get the performance that they need for maximum benefit 2 1 4 Memory access Each POWER7 processor chip has one memory controller that uses two memory channels Each memory channel operates at 1066 MHz connects t...

Page 63: ...other L3 cache regions as shared L3 cache Additionally each core can negotiate to use the FLR L3 cache associated with another core depending on reference patterns Data can also be cloned to be stored in more than one core s FLR L3 cache again depending on reference patterns This Intelligent Cache management enables the POWER7 processor to optimize the access to L3 cache lines and minimize overall...

Page 64: ...rements conserves energy and lowers latency Small physical footprint The performance of eDRAM when implemented on chip is similar to conventional SRAM but requires far less physical space IBM on chip eDRAM uses only a third of the components used in conventional SRAM which has a minimum of six transistors to implement a 1 bit memory cell Low energy consumption The on chip eDRAM uses only 20 of the...

Page 65: ...CM consists of two POWER7 processors DCMs installed in a Power 750 server consist of two 4 core chips DCMs installed in the Power 760 server consist of two 6 core chips The Power 750 and Power 760 can host one two three or four DCMs Each DCM can address 16 DDR3 memory DIMM slots Characteristic POWER7 POWER7 POWER6 Technology 32 nm 45 nm 65 nm Die size 567 mm2 567 mm2 341 mm2 Maximum cores 8 8 2 Ma...

Page 66: ...partitions that need processor and memory resources that span multiple processor sockets Similar to its previous POWER7 version the POWER7 technology based Power 750 design still provides 32 cores across four processor sockets but the system design delivers a new architecture The Power 750 8404 E8D and Power 760 systems introduce a two tier interconnect architecture for a 4 socket system design Wi...

Page 67: ...illustrated in Figure 2 8 Figure 2 8 Inter node buses From a topology standpoint the new Power 750 8408 E8D and Power 760 9109 RMD systems are similar to the 4 CEC enclosure Power 770 and Power 780 systems In this case the interconnects between chips in a DCM of a Power 750 8408 E8D and Power 760 9109 RMD server are similar to the interconnects that are used between sockets in a single Power 770 o...

Page 68: ...e Power 760 2 3 1 Registered DIMM Industry standard DDR3 Registered DIMM RDIMM technology is used to increase reliability speed and density of memory subsystems by putting a register between the DIMM modules and the memory controller This register is also referred to as a buffer 2 3 2 Memory placement rules The following memory options are orderable for the Power 750 system 8 GB 2 x 4 GB Memory DI...

Page 69: ...0 and Power 760 systems do not support capacity on demand CoD for memory Number of DCMs Power 750 Power 760 DCM MC Memory Controller BC Memory Buffer Memory Riser Card 2 DDR3 RDIMM Slot 2 DDR3 RDIMM Slot 1 DDR3 RDIMM Slot 8 DDR3 RDIMM Slot 7 DDR3 RDIMM Slot 4 DDR3 RDIMM Slot 3 DDR3 RDIMM Slot 6 DDR3 RDIMM Slot 5 BC B BC A POWER 7 Chip 1 MC1 Channel D MC1 Channel C POWER 7 Chip 0 MC0 Channel B MC0 ...

Page 70: ...es The memory placement rules are as follows Each DCM requires two memory riser cards Each riser card must be populated at least with one pair of DIMMs The DIMMs of a DIMM pair as listed in the tables Table 2 4 on page 57 through Table 2 7 on page 59 must have the same size Each DIMM within a DIMM quad area C1 C2 C3 and C4 or C5 C6 C7 and C8 must be identical although memory DIMMs in C1 C2 C3 and ...

Page 71: ...r and so on DIMMs in each colored area must be identical DCM 0 P3 C12 MC1 Riser card 1 P3 C1 MC0 Riser card 2 P3 C2 Pair of DIMM slots Pair of DIMM slots C1 C3 C2 C4 C5 C7 C6 C8 C1 C3 C2 C4 C5 C7 C6 C8 1 5 7 3 2 6 8 4 DCM 0 P3 C12 MC1 Riser card 1 P3 C1 MC0 Riser card 2 P3 C2 Pair of DIMM slots Pair of DIMM slots C1 C3 C2 C4 C5 C7 C6 C8 C1 C3 C2 C4 C5 C7 C6 C8 1 9 13 5 2 10 14 6 DCM 1 P3 C17 MC1 R...

Page 72: ...M slots C1 C3 C2 C4 C5 C7 C6 C8 C1 C3 C2 C4 C5 C7 C6 C8 1 13 19 7 2 14 20 8 DCM 1 P3 C17 MC1 Riser card 1 P3 C8 MC0 Riser card 1 P3 C9 Pair of DIMM slots Pair of DIMM slots C1 C3 C2 C4 C5 C7 C6 C8 C1 C3 C2 C4 C5 C7 C6 C8 3 15 21 9 4 16 22 10 DCM 2 P3 C16 MC1 Riser card 1 P3 C6 MC0 Riser card 1 P3 C7 Pair of DIMM slots Pair of DIMM slots C1 C3 C2 C4 C5 C7 C6 C8 C1 C3 C2 C4 C5 C7 C6 C8 5 17 23 11 6 ...

Page 73: ...C1 Riser card 1 P3 C8 MC0 Riser card 1 P3 C9 Pair of DIMM slots Pair of DIMM slots C1 C3 C2 C4 C5 C7 C6 C8 C1 C3 C2 C4 C5 C7 C6 C8 3 19 27 11 4 20 28 12 DCM 2 P3 C16 MC1 Riser card 1 P3 C6 MC0 Riser card 1 P3 C7 Pair of DIMM slots Pair of DIMM slots C1 C3 C2 C4 C5 C7 C6 C8 C1 C3 C2 C4 C5 C7 C6 C8 5 21 29 13 6 22 30 14 DCM 3 P3 C13 MC1 Riser card 1 P3 C3 MC0 Riser card 1 P3 C4 Pair of DIMM slots Pa...

Page 74: ...Bps L2 cache In one clock cycle one 32 byte load operation and one 16 byte store operation can be accomplished Using an 4 060 GHz processor card the formula is as follows 1 32 B 1 16 B 4 060 GHz 194 88 GBps L3 cache One 32 byte load operation and one 32 byte store operation can be accomplished at half clock speed Using an 4 060 GHz processor card the formula is as follows 1 32 B 1 32 B 4 060 GHz 2...

Page 75: ...rver or interrupt your business The Power 760 systems requires a minimum of eight cores being activated For further activations the following feature codes can be used to activate additional cores FC EPT5 one additional core for 3 1 GHz processors FC EPT6 one additional core for 3 4 GHz processors 2 4 2 Capacity Backup offering applies only to IBM i The Power 750 and Power 760 systems Capacity Bac...

Page 76: ... core and 256 KB of L2 cache per core A Power 750 Express server can be populated with one two three or four DCMs providing 8 16 24 or 32 cores All the cores are active In the Power 760 each POWER7 processor DCM is a 64 bit 0 12 core CUoD processor packaged on a dedicated card with a maximum of 64 DDR3 DIMMs 10 MB of L3 cache per core and 256 KB of L2 cache per core A Power 760 server can be popul...

Page 77: ...s the slot configuration of the Power 750 and Power 760 Table 2 11 Slot configuration of the Power 750 and Power 760 Processor card Slot description Frequency GX Bandwidth maximum theoretical Power 760 3 416 GHz 3 136 GHz Power 750 4 060 GHz 3 500 GHz CPU Socket 1 DCM1 GX bus 1 2 5 GHz 20 GBps CPU Socket 1 DCM1 GX bus 0 2 5 GHz 20 GBps Total External I O 40 GBps Bandwidth Technically all the other...

Page 78: ...onsole will be on the HMC When ordering a Power 750 or Power 760 you may select a integrated multifunction card from the following options 1 Gb Ethernet RJ45 and 10 Gb copper SFP This card FC 1768 CCIN 2BF3 provides four Ethernet connections Two 1 Gb RJ45 and two 10 Gb Small Form factor Pluggable SFP active copper twinax The RJ45 ports support up to 100 m cabling distance using Cat 5e cable The 10...

Page 79: ...otiate the highest speed either 10 Gb 10 GBaseT 1 Gb 1000 BaseT or 100 Mb 100 BaseT Each RJ45 port s configuration is independent of the other The RJ45 ports use 4 pair Cat 6A cabling for distances of up to 100 meters CAT5 cabling is not supported 2 7 PCI adapters This section covers the types and functions of the PCI adapters supported by IBM Power 750 and Power 760 systems 2 7 1 PCI Express Peri...

Page 80: ...ed such as certain tape libraries or optical drive libraries or any HVD SCSI device Twinaxial displays or printers cannot be attached except through an OEM protocol converter SDLC attached devices using a LAN or WAN adapter are not supported SNA applications still can run when encapsulated inside TCP IP but the physical device attachment cannot be SNA Earlier Fibre Channel and SCSI controllers tha...

Page 81: ... RAID and SSD SAS Adapter 3 Gb is available as a low profile adapter or as a full height adapter each one having a different feature code As expected they have equivalent functional characteristics Table 2 12 is a list of low profile adapter cards and their equivalents in full height Table 2 12 Equivalent adapter cards Low profile Adapter description Full height Feature code CCIN Feature code CCIN...

Page 82: ... Other LAN adapters are supported in the PCIe slots of the system unit or in an I O drawer that are attached to the system by using a PCIe slot Table 2 13 on page 69 lists the additional LAN adapters that are available for the Power 750 and Power 760 servers 5272 5272 10 Gigabit Ethernet CX4 PCI Express adapter 5732 5732 5273 577D 8 Gigabit PCI Express Dual Port Fibre Channel adapter 5735 577D 527...

Page 83: ...ull height Linux 5745 2B43 PCIe2 4 Port 10 Gb Ethernet 1 Gb Ethernet SFP Copper RJ45 adapter PCIe Full height Linux 5767 5767 2 Port 10 100 1000 Base TX Ethernet PCI Express adapter PCIe Full height AIX IBM i Linux 5768 5768 2 Port Gigabit Ethernet SX PCI Express adapter PCIe Full height AIX IBM i Linux 5769 5769 10 Gigabit Ethernet SR PCI Express adapter PCIe Full height AIX Linux 5772 576E 10 Gi...

Page 84: ...ystem iSCSI support Table 2 16 Available iSCSI adapters Feature code CCIN Adapter description Slot Size OS support 5748 5748 POWER GXT145 PCI Express Graphics Accelerator PCIe Full height AIX Linux Feature code CCIN Adapter description Slot Size OS support 2055 57CD PCIe RAID and SSD SAS adapter 3 Gb with Blind Swap Cassette PCIe Full height AIX IBM i Linux 5805 574E PCIe 380 MB Cache Dual x4 3 Gb...

Page 85: ... connection and a FCoE connection EN10 2C4C Integrated Multifunction Card with 10 Gb Ethernet RJ45 Copper Twinax n a Feature code CCIN Adapter description Slot Size OS support Feature code CCIN Adapter description Slot Size OS support 5729a a A Gen2 PCIe slot is required to provide the bandwidth for all four ports to operate at full speed 2B53 PCIe2 8 Gb 4 Port Fibre Channel adapter PCIe Full heig...

Page 86: ...nect standards and specifications The main IB specification is published by the InfiniBand Trade Association and is available at the following location http www infinibandta org InfiniBand is based on a switched fabric architecture of serial point to point links where these IB links can be connected to either host channel adapters HCAs used primarily in servers or to target channel adapters TCAs u...

Page 87: ...PCIe adapters provide connection of asynchronous EIA 232 or RS 422 devices Table 2 20 lists the available asynchronous and USB adapters Table 2 20 Available asynchronous adapters 2 7 13 Cryptographic coprocessor The cryptographic coprocessor cards provide both cryptographic coprocessor and cryptographic accelerator functions in a single card The IBM PCIe Cryptographic Coprocessor adapter has the f...

Page 88: ...hese two controllers provide redundancy and additional flexibility The optional 175 MB Cache RAID Dual IOA Enablement Card enables dual 175 MB write cache and provides dual batteries for protection of that write cache There are two PCIe integrated SAS controllers under the POWER7 I O chip and also the SAS controller that is directly connected to the DVD media bay Figure 2 13 on page 76 Power 750 a...

Page 89: ...ry The write cache can provide additional I O performance for attached disk or solid state drives particularly for RAID 5 and RAID 6 The write cache contents are mirrored for redundancy between the two RAID adapters resulting in an effective write cache size of 175 MB The batteries provide power to maintain both copies of write cache information in the event that power is lost Without the Dual IOA...

Page 90: ...mmarizes the internal storage combination and the feature codes that are required for any combination Table 2 22 SAS configurations summary I O Planar DASD Backplane Hard Disk 2 Hard Disk 3 SAS Port Expander Hard Disk 4 Hard Disk 5 Hard Disk 6 SAS Port Expander Optical Optical Int SAS Cnt Hard Disk 1 Integrated SAS Controller Integrated SAS Controller External SAS Port P7IOC P7IOC SAS subsystem co...

Page 91: ... This mode requires an internal SAS Cable FC 1815 a SAS cable FC 3679 and a SAS controller such as SAS adapter FC 5901 Figure 2 15 on page 78 shows how the six disk bays are shared with the Dual storage IOA with internal disk and external disk enclosure Yes Requires an external disk drawer FC 5887 or FC 5886 Internal SAS port FC 1819 SAS cable assembly for connecting to an external SAS drive enclo...

Page 92: ...nal enclosure disks This configuration increases availability by using dual storage IOA or high availability HA to connect multiple adapters to a common set of internal disk drives It also increases the performance of RAID arrays The following rules apply to this configuration This configuration uses the 175 MB Cache RAID Dual IOA Enablement Card FC 5662 Using the dual IOA enablement card the two ...

Page 93: ...s a specific chip VSES for controlling the DVD LED and power The VSES appears as a separate device to the device driver and operating systems Figure 2 13 on page 76 Because the integrated SAS controller is independent from the two SAS disk or SSD controllers it allows the DVD to be switched between multiple partitions without affecting the assignment of disks or SSDs in the system enclosure I O Pl...

Page 94: ... swap small form factor SFF disk bays which can be used for either disk drives or SSD drives Using 900 GB disk drives each I O drawer provides up to 16 2 TB of storage The adapter slots within the I O drawer use Gen3 blind swap cassettes and support hot plugging of adapter cards The 12X I O Drawer PCIe No Disk FC 5877 is the same as FC 5802 except that it does not support any disk bays A maximum o...

Page 95: ...in a 19 inch rack Figure 2 17 shows the front view of the 12X I O Drawer PCIe FC 5802 Figure 2 17 Front view of the 12X I O Drawer PCIe Figure 2 18 shows the rear view of the 12X I O Drawer PCIe FC 5802 Figure 2 18 Rear view of the 12X I O Drawer PCIe Disk drives Service card Port cards Power cables 10 PCIe cards X2 SAS connectors 12X connectors Mode switch SPCN connectors ...

Page 96: ...ed as one two or four sets This way allows for partitioning of disk bays Disk bay partitioning configuration can be done with the physical mode switch on the I O drawer Figure 2 19 indicates the mode switch in the rear view of the FC 5802 I O drawer and shows the configuration rules of disk bay partitioning in the PCIe 12X I O drawer There is no specific feature code for mode switch setting Figure...

Page 97: ...802 I O drawer from view location codes Figure 2 21 FC 5802 I O drawer rear view location codes P3 D1 P3 D2 P3 D3 P3 D4 P3 D5 P3 D6 P3 D7 P3 C1 P3 C2 P3 D8 P3 D9 P3 D10 P3 D11 P3 C3 P3 C4 P3 D12 P3 D13 P3 D14 P3 D15 P3 D16 P3 D17 P3 D18 E1 E2 ARECW500 0 P1 C1 P1 C2 P1 C3 P1 C4 P1 T2 P1 C5 P1 C6 P1 C7 P1 C8 P1 C9 P1 C10 P4 T5 P2 T1 P2 T2 P2 T3 ARECW501 0 P4 T1 P4 T2 P4 T3 P4 T4 P1 T1 ...

Page 98: ...nd Power 760 system unit with data transfer cables such as the 12X DDR cables for the FC 5802 and FC 5877 I O drawers The first 12X I O drawer that is attached in any I O drawer loop requires two data transfer cables Each additional drawer up to the maximum allowed in the loop requires one additional data transfer cable Consider the following information A 12X I O loop starts at a system unit adap...

Page 99: ...e 86 shows an example for a Power 750 or Power 760 connecting to four I O drawers Other connections options are available 1 Start at SPCN 0 T4 of the system unit to J15 T1 of the first expansion unit 2 Cable all units from J16 T2 of the previous unit to J15 T1 of the next unit 3 To complete the cabling loop connect J16 T2 from the final expansion unit to the SPCN 1 T5 in the system unit 4 Ensure t...

Page 100: ...e 2 10 1 EXP30 Ultra SSD I O drawer The EXP30 Ultra SSD I O drawer FC EDR1 CCIN 57C3 is a 1U high I O drawer providing 30 hot swap SSD bays and a pair of integrated large write caches high performance SAS controllers without using any PCIe slots on the POWER7 server The two high performance Feature code Description 6001a Power Control Cable SPCN 2 meter 6006 Power Control Cable SPCN 3 meter 6008a ...

Page 101: ...logical partition Table 2 27 lists the RAID levels for the AIX IBM i Linux operating system that are supported by the controller Table 2 27 Supported RAID levels The EXP30 Ultra SSD I O drawer FC EDR1 delivers up to 480 000 IOPS read only up to 410 000 IOPS 60 read and 40 write or up to 325 000 IOPS 100 write and has up to 30 performance improvement over the previous version of the EXP30 FC 5888 A...

Page 102: ...e of the logical sets With proper software if one of the controller fails the other controller can run both sets of bays FC ES02 and FC ES04 are identical SSD drives but have separate feature codes for use with the AIX IBM i and Linux operating systems FC ES02 is used for AIX and Linux FC ES04 is used for IBM i EXP30 connection to a Power Systems server The GX 2 port PCIe adapter FC 1914 CCIN 2B94...

Page 103: ...Figure 2 26 Figure 2 26 Connection between one or two FC 1914 cards and a single FC EDR1 drawer Power 750 or Power 760 ERM C1 T1 T3 ERM C2 PSU P2 PCIe Gen2 8X cable PCIe Gen2 8X cable FC EDR1 FC 1914 T2 8X 8X T3 PSU P1 T2 T1 T2 ERM C1 T1 ERM C2 PSU P2 FC EDR1 PSU P1 T2 T1 T2 T3 T3 FC 1914 T2 8X 8X T1 FC 1914 T2 8X 8X T1 PCIe Gen2 8X cable Power 750 or Power 760 PCIe Gen2 8X cable T1 ...

Page 104: ...both T1 connector locations of the EXP30 drawer to connect an EX SAS cable to the two T1 connector locations of the first EXP24S drawer If you want to attach a second EXP24S drawer connect both T2 connector locations of the EXP30 drawer with the two T1 connector location of the second EXP24S drawer Power 750 or Power 760 ERM C1 T1 ERM C2 PSU P2 FC EDR1 PSU P1 T2 T1 T2 ERM C1 T1 T3 ERM C2 PSU P2 PC...

Page 105: ...rt or to the integrated SAS controllers in the EXP30 Ultra SSD I O Drawer The SAS controller and the EXP24S SAS ports are attached using the appropriate SAS Y or X or EX cables The following internal SAS adapters support the EXP24S PCIe 380 MB Cache Dual x4 3 Gb SAS RAID Adapter FC 5805 CCIN 574E PCIe Dual port x4 SAS adapter FC 5901 CCIN 57B3 PCIe 380 MB Cache Dual x4 3 Gb SAS RAID adapter FC 590...

Page 106: ... with four sets of six bays mode 4 two sets of 12 bays mode 2 or one set of 24 bays mode 1 With IBM i the EXP24S can be ordered as one set of 24 bays mode 1 There are six SAS connectors on the rear of the EXP24S drawer to which to SAS adapters or controllers are attached They are labeled T1 T2 and T3 there are two T1 two T2 and two T3 connectors Figure 2 29 shows the rear connectors of the EXP24S ...

Page 107: ... and two service managers for redundancy The EXP12S takes up a 2U space in a 19 inch rack and the SAS controller can be a SAS PCIe adapter or pair of adapters A maximum number of 27 EXP12S drawers can be attached to a Power 750 and Power 760 server 2 10 4 TotalStorage EXP24 disk drawer and tower The TotalStorage EXP24 is not supported with the Power 750 and Power 760 server 2 10 5 IBM 7031 TotalSt...

Page 108: ...ter and IBM Power Systems By offering substantial improvements at a price that fits most budgets the DS3500 delivers superior price for performance ratios functionality scalability and ease of use for the entry level storage user For more information see the following website http www ibm com systems storage disk ds3500 index html IBM Storwize V7000 and Storwize V7000 Unified Disk Systems IBM Stor...

Page 109: ... as standard on all systems Optimized Flash technology for dynamic performance and operational analytics Additionally the DS8000 includes a range of features that automate performance optimization and application quality of service and also provide the highest levels of reliability and system uptime For more information see the following website http www ibm com systems storage disk ds8000 index h...

Page 110: ... than 254 partitions the HMC should have 3 GB of RAM minimum and be a CR3 model or later rack mounted or a C06 or later deskside HMC code level HMC V7R7 7 0 SP1 contains the following new benefits Support for managing IBM Power 750 and Power 760 systems Support for PowerVM functions such as new HMC GUI interface for VIOS install Improved transition from IVM to HMC management Ability to update a us...

Page 111: ...or 7042 CR6 and 7042 CR7 2 11 1 HMC connectivity to the POWER7 processor based systems POWER7 processor technology based servers and also their predecessor systems that are managed by an HMC require Ethernet connectivity between the HMC and the server s service processor In addition if dynamic LPAR Live Partition Mobility or PowerVM Active Memory Sharing operations are required on the managed part...

Page 112: ...rocessor and LPARs network connection The default mechanism for allocation of the IP addresses for the service processor HMC ports is dynamic The HMC can be configured as a DHCP server providing the IP address at the time that the managed server is powered on In this case the FSPs are allocated an IP address from a set of address ranges that are predefined in the HMC software These predefined rang...

Page 113: ...ervers or an environment with a mixture of POWER5 POWER5 POWER6 POWER6 POWER7 and POWER7 processor based servers The HMCs provide a locking mechanism so that only one HMC at a time has write access to the service processor Both HMCs should be available on a public subnet to allow full synchronization of functionality Depending on your environment you have multiple options to configure the network ...

Page 114: ...g PowerVM Live Partition Mobility consider how the source server is managed If the source server is managed by one HMC and the destination server is managed by another HMC ensure that the HMC that is managing the POWER6 processor based server is at a minimum level of V7 R7 3 5 or later and that the HMC that is managing the POWER7 processor based server is at minimum level of V7 R7 6 0 or later 2 1...

Page 115: ...Version 5 3 is not supported with the Power 750 and Power 760 IBM AIX Version 6 1 The following minimum levels of AIX Version 6 1 support the Power 750 and Power 760 AIX V6 1 with the 6100 08 Technology Level and Service Pack 2 or later AIX V6 1 with the 6100 07 Technology Level and Service pack 7 or later planned availability March 29 2013 AIX V6 1 with the 6100 06 Technology Level and Service pa...

Page 116: ...ides an implementation like UNIX across many computer architectures The supported versions of Linux on the Power 750 and Power 760 servers are as follows SUSE Linux Enterprise Server 11 Service Pack 2 or later with current maintenance updates available from Novell to enable all planned functionality For Red Hat Enterprise Linux consult the following Statements of Direction RHEL 6 4 support for Pow...

Page 117: ...applications to Java 7 Java 6 or Java 5 when possible See the AIX download and service information page http www ibm com developerworks java jdk aix service html 2 12 6 Boosting performance and productivity with IBM compilers IBM XL C XL C C and XL Fortran compilers for AIX and for Linux use the latest POWER7 processor architecture With each release these compilers continue to help improve applica...

Page 118: ...cluding POWER7 of AIX IBM Rational Development Studio for IBM i 7 1 provides programming languages for creating modern business applications ILE RPG ILE COBOL C and C compilers Heritage RPG and COBOL compilers The latest release includes performance improvements and XML processing enhancements for ILE RPG and ILE COBOL improved COBOL portability with a COMP 5 data type and easier Unicode migration...

Page 119: ...g the data from all system components changing operational parameters in components and interacting with the IBM Systems Director Active Energy Manager an IBM Systems Director plug in for energy management and control IBM EnergyScale makes use of power and thermal information collected from the system to implement policies that can lead to better performance or better energy utilization IBM Energy...

Page 120: ...ncy varies depending on whether the user favors power savings or system performance If an administrator prefers energy savings and a system is fully utilized the system is designed to reduce the maximum frequency to about 95 of nominal values If performance is favored over energy consumption the maximum frequency can be increased to up to 112 8 of nominal frequency for extra performance The maximu...

Page 121: ...cap can be set power capping as described previously and soft power capping Soft power capping extends the allowed energy capping range further beyond a region that can be guaranteed in all configurations and conditions If the energy management goal is to meet a particular consumption limit then soft power capping is the mechanism to use Processor core nap mode The IBM POWER7 and POWER7 processor ...

Page 122: ... meters above sea level The Power 750 and the Power 760 comply to the ASHRAE Class A3 standard and can support up to 35 degrees Celsius and 1825 meter at the rated performance However they can operate in a degraded performance above 35 degrees Celsius up to 40 degrees Celsius or higher altitudes Processor folding Processor folding is a consolidation technique that dynamically adjusts over the shor...

Page 123: ... reacting within milliseconds to adjust workload performance and also deliver power savings when the partition is underused In addition to the two dynamic power saver options you can select to have no power savings on a given partition This option keeps the processor cores assigned to the partition running at their nominal frequencies and voltages A power savings mode referred to as inherit host s...

Page 124: ...ies to be set The TPMD is part of the EnergyScale infrastructure 2 13 3 Energy consumption estimation Often for Power Systems various energy related values are important Maximum power consumption and power source loading values These values are important for site planning and are in the hardware information center http pic dhe ibm com infocenter powersys v3r1m5 index jsp Search for type and model ...

Page 125: ...ke better use of IT assets Improve business responsiveness and operational speed by dynamically re allocating resources to applications as needed to better match changing business needs or handle unexpected changes in demand Simplify IT infrastructure management by making workloads independent of hardware resources so you can make business driven policies to deliver resources based on time cost an...

Page 126: ...it detects the loss of the service processor notifying the operating system if the problem is not corrected The POWER Hypervisor is always active regardless of the system configuration and also when not connected to the managed console It requires memory to support the resource assignment to the logical partitions on the server The amount of memory that is required by the POWER Hypervisor firmware...

Page 127: ...configuration For more information see 3 4 10 Operating system support for PowerVM on page 143 Virtual Ethernet has the following major features The virtual Ethernet adapters can be used for both IPv4 and IPv6 communication and can transmit packets with a size up to 65 408 bytes Therefore the MTU for the corresponding interface can be up to 65 394 or 65 390 if VLAN tagging is used The POWER Hyperv...

Page 128: ...operating system installation network setup and various problem analysis activities require a dedicated system console The POWER Hypervisor provides the virtual console by using a virtual TTY or serial adapter and a set of Hypervisor calls to operate on them Virtual TTY does not require the purchase of any additional features or software such as the PowerVM Edition features Depending on the system...

Page 129: ...ode is compatible with Version 2 05 of the Power Instruction Set Architecture ISA For more information visit the following address http power org wp content uploads 2012 07 PowerISA_V2 05 pdf POWER6 compatibility mode This mode is similar to POWER6 with eight additional storage protection keys POWER7 mode This is the native mode for POWER7 and POWER7 processors implementing the v2 06 of the Power ...

Page 130: ...Overview and Introduction The selection of the mode is made on a per partition basis from the managed console by editing the partition profile Figure 3 2 Figure 3 2 Configuring partition profile compatibility mode from the managed console ...

Page 131: ...ailable for partitions running AIX 6 1 Technology Level 4 with SP2 or later Active Memory Expansion uses the CPU resource of a partition to compress and decompress the memory contents of this same partition The trade off of memory capacity for processor cycles can be an excellent choice but the degree of expansion varies based on how POWER6 and POWER6 mode POWER7 mode Customer value 2 thread SMT 4...

Page 132: ...in each partition to help control the amount of CPU that is used by the Active Memory Expansion function An initial program load IPL is required for the specific partition that is turning memory expansion on or off After turned on monitoring capabilities are available in standard AIX performance tools such as lparstat vmstat topas and svmon For specific POWER7 hardware compression the amepat tool ...

Page 133: ...processing power 2 13 physical processors in this setup to benefit from 119 extra memory capacity Figure 3 4 Output from Active Memory Expansion planning tool Active Memory Expansion Modeled Statistics Modeled Expanded Memory Size 52 00 GB Achievable Compression ratio 4 51 Expansion Modeled True Modeled CPU Usage Factor Memory Size Memory Gain Estimate 1 40 37 25 GB 14 75 GB 40 0 00 0 1 80 29 00 G...

Page 134: ...is provided when the enablement feature is ordered that is applied to the server Rebooting is not required to enable the physical server The key is specific to an individual server and is permanent It cannot be moved to a separate server This feature is ordered per server independent of the number of partitions using memory expansion Active Memory Expansion Modeled Statistics Modeled Expanded Memo...

Page 135: ... com common ssi ecm en pow03037usen POW03037USEN PDF Moving an LPAR If you want to move an LPAR that uses Active Memory Expansion to a different system using Live Partition Mobility the target system must support Active Memory Expansion the target system must have Active Memory Expansion activated with the software key If the target system does not have Active Memory Expansion activated the mobili...

Page 136: ...olidation PowerVM Enterprise Edition This edition is suitable for large server deployments such as multi server deployments and cloud infrastructures It includes unique features like Active Memory Sharing and Live Partition Mobility Table 3 3 lists the editions of PowerVM that are available on Power 750 and Power 760 Table 3 3 Availability of PowerVM per POWER7 processor technology based server mo...

Page 137: ...shared processor partition several options must be defined The minimum desired and maximum processing units Processing units are defined as processing power or the fraction of time that the partition is dispatched on physical processors Processing units define the capacity entitlement of the partition The shared processor pool Select one from the list with the names of each configured shared proce...

Page 138: ...point is that the maximums stated are supported by the hardware but the practical limits depend on application workload demands Consider the following additional information about virtual processors A virtual processor can be running dispatched either on a physical processor or as standby waiting for a physical processor to became available Virtual processors do not introduce any additional abstra...

Page 139: ...g system is executing for AIX use the smtctl command for Linux use the ppc64_cpu smt command If simultaneous multithreading is off each physical processor is presented as one logical processor and thus only one thread Shared dedicated mode On POWER7 processor technology based servers you can configure dedicated partitions to become processor donors for idle processors that they own allowing for th...

Page 140: ...ading is turned on or off 3 4 3 Multiple shared processor pools Multiple shared processor pools MSPPs is a capability that is supported on POWER6 POWER6 POWER7 and POWER7 processor based servers This capability allows a system administrator to create a set of micropartitions with the purpose of controlling the processor capacity that can be consumed from the physical shared processor pool Implemen...

Page 141: ...ult shared processor pool and up to a maximum of 64 shared processor pools Default shared processor pool SPP0 On any Power Systems server supporting multiple shared processor pools a default shared processor pool is always automatically defined The default shared processor pool has a pool identifier of zero SPP ID 0 and can also be referred to as SPP0 The default shared processor pool has the same...

Page 142: ...utes them to eligible micropartitions regardless of the Multiple shared processor pools structure Figure 3 9 shows the levels of unused capacity redistribution implemented by the POWER Hypervisor Figure 3 9 The levels of unused capacity redistribution POWER Hypervisor SPPn SPP2 SPP1 SPP0 Micro partition n SPP2 capacity resolution SPPn capacity resolution SPP1 capacity resolution SPP0 capacity reso...

Page 143: ...he POWER Hypervisor In busy shared processor pools where the micropartitions have used all of the entitled pool capacity the POWER Hypervisor allocates additional cycles to micropartitions in which all of the following statements are true The maximum pool capacity of the shared processor pool hosting the micropartition is not met The micropartition is uncapped The micropartition has enough virtual...

Page 144: ...d unless all micropartitions hosted by the shared processor pool have been removed Live Partition Mobility and multiple shared processor pools A micropartition can leave a shared processor pool because of PowerVM Live Partition Mobility Similarly a micropartition can join a shared processor pool in the same way When performing PowerVM Live Partition Mobility you are given the opportunity to design...

Page 145: ...l Ethernet network The Shared Ethernet Adapter provides this access by connecting the internal hypervisor VLANs with the VLANs on the external switches Because the Shared Ethernet Adapter processes packets at layer 2 the original MAC address and VLAN tags of the packet are visible to other systems on the physical network IEEE 802 1 VLAN tagging is supported The Shared Ethernet Adapter also provide...

Page 146: ...al VLAN networks The number of shared Ethernet adapters that can be set up in a Virtual I O Server partition is limited only by the resource availability because there are no configuration limits Unicast broadcast and multicast are supported so protocols that rely on broadcast or multicast such as Address Resolution Protocol ARP Dynamic Host Configuration Protocol DHCP Boot Protocol BOOTP and Neig...

Page 147: ...e Virtual I O Server Physical disks presented to the Virtual O Server can be exported and assigned to a client partition in several ways The entire disk is presented to the client partition The disk is divided into several logical volumes which can be presented to a single client or multiple clients As of Virtual I O Server 1 5 files can be created on these disks and file backed storage devices ca...

Page 148: ... N_Port ID Virtualization N_Port ID Virtualization NPIV is a technology that allows multiple logical partitions to access independent physical storage through the same physical Fibre Channel adapter This adapter is attached to a Virtual I O Server partition that acts only as a pass through managing the data transfer through the POWER Hypervisor Each partition that uses NPIV is identified by a pair...

Page 149: ...designed to ease the deployment of a virtualized infrastructure For more information about the System Planning Tool see 3 5 System Planning Tool on page 146 IBM Systems Director agent and several preinstalled IBM Tivoli agents such as the following examples Tivoli Identity Manager to allow easy integration into an existing Tivoli Systems Management infrastructure Tivoli Application Dependency Disc...

Page 150: ...o a single large server Deconsolidation You can move workloads from server to server to optimize resource use and workload performance within your computing environment With active partition mobility you can manage workloads with minimal downtime Hardware and operating system requirements for Live Partition Mobility PowerVM Live Partition Mobility requires systems with POWER6 or newer processors r...

Page 151: ...he POWER7 mode Now the current processor compatibility mode of the logical partition is the POWER7 mode and the logical partition run on the POWER7 processor based server The Virtual I O Server on the source system provides the access to the client resources and must be identified as a mover service partition MSP The Virtual Asynchronous Services Interface VASI device allows the mover service part...

Page 152: ...le only with the Enterprise version of PowerVM The physical memory of an IBM Power System can be assigned to multiple partitions in either dedicated or shared mode The system administrator has the capability to assign some physical memory to a partition and some physical memory to a pool that is shared by other partitions A single partition can have either dedicated or shared memory With a pure de...

Page 153: ...pool Identical pages within the same or different LPARs each require their own unique physical memory page consuming space with repeated information Figure 3 13 Active Memory Sharing shared memory pool without Active Memory Deduplication enabled Active Memory Deduplication allows the hypervisor to dynamically map identical partition memory pages to a single physical memory page within a shared mem...

Page 154: ...at some pages such as frequently referenced read only code pages are particularly good for deduplication To perform deduplication the hypervisor cannot compare every memory page in the Active Memory Sharing pool with every other page Instead it computes a small signature for each page that it visits and stores the signatures in an internal table Each time that a page is inspected a look up of its ...

Page 155: ...size of the deduplication table ranging from 1 8192 to 1 256 of the configured maximum Active Memory Sharing memory pool size Having this table be too small might lead to missed deduplication opportunities Conversely having a table that is too large might waste a small amount of overhead space The management of the Active Memory Deduplication feature is done through a managed console allowing admi...

Page 156: ...orm Optimizer DPO is an IBM PowerVM feature that helps the user to configure the logical partition memory and CPU affinity on the POWER7 processor based servers thus improve performance under some workload scenarios On a nonuniform memory access NUMA context the main goal of the DPO is to assign a local memory to the CPUs thus reducing the memory access time because a local memory access is much f...

Page 157: ...size for the machine workload 3 4 10 Operating system support for PowerVM Table 3 5 summarizes the PowerVM features that are supported by the operating systems compatible with the POWER7 processor based servers Table 3 5 Virtualization features supported by AIX IBM i and Linux TIP While the DPO process is running the affected LPARs can have up to 20 performance degradation To explicitly protect pa...

Page 158: ...duplication No Yesf Yesg No Yesh No Yes No Yes Live Partition Mobility Yes Yes Yes No Yesi Yes Yes Yes Yes Simultaneous multithreading SMT Yesj Yesk Yes Yesl Yes Yesj Yes Yesj Yes Active Memory Expansion No Yesm Yes No No No No No No Capacity on Demandn Yes Yes Yes Yes Yes Yes Yes Yes Yes AIX Workload Partitions No Yes Yes No No No No No No a This version can only support 10 virtual machines per c...

Page 159: ... mode No Yes No Yes Take advantage of the POWER7 and POWER7 features Strong Access Ordering No Yes No Yes Can improve Lx86 performance Scale to 256 cores and 1024 threads No Yes No Yes Base OS support is available Four way SMT No Yes No Yes Better hardware usage VSX support No Yes No Yes Full exploitation requires Advance Toolchain Distro toolchain mcpu mtune p7 No Yes No Yes SLES11 GA toolchain h...

Page 160: ...stem Planning Tool and both the Workload Estimator and IBM Performance Management allows you to create a system that is based on performance and capacity data from an existing system or that is based on new workloads that you specify You can use the SPT before you order a system to determine what you must order to support your workload You can also use the SPT to determine how you can partition a ...

Page 161: ...f storage for virtualized workloads and can improve storage utilization simplify administration and reduce SAN infrastructure costs The enhancements capabilities enable 16 nodes to participate in a Shared Pool configuration which can improve efficiency agility scalability flexibility and availability Shared Storage Pools flexibility and availability improvements include the following items IPv6 an...

Page 162: ...148 IBM Power 750 and 760 Technical Overview and Introduction ...

Page 163: ...ccessive generation of IBM servers is designed to be more reliable than the previous server family POWER7 processor based servers have new features to support new levels of virtualization help ease administrative burden and increase system utilization Reliability starts with components devices and subsystems designed to be fault tolerant POWER7 uses lower voltage technology improving reliability w...

Page 164: ... core processor design Not only does this case reduce the total number of system components it reduces the total amount of heat generated in the design resulting in an additional reduction in required power and cooling components POWER7 processor based servers also integrate L3 cache into the processor chip for a higher integration of parts Parts selection also plays a critical role in overall sys...

Page 165: ...Power 750 and Power 760 main memory DIMMs which use an innovative ECC algorithm from IBM research that improves bit error correction and memory failures Redundant and hot swap cooling Redundant and hot swap power supplies For maximum availability be sure to connect power cords from the same system to two separate power distribution units PDUs in the rack and to connect each PDU to independent powe...

Page 166: ... highest priority partition is rated at 255 The default value is set at 127 for standard partitions and 192 for Virtual I O Server VIOS partitions You can vary the priority of individual partitions using the hardware management console 4 2 2 General detection and deallocation of failing components Runtime correctable or recoverable errors are monitored to determine whether there is a pattern of er...

Page 167: ...r deallocation enables automatic deconfiguration of processor cores when patterns of recoverable core related faults are detected Dynamic processor deallocation prevents a recoverable error from escalating to an unrecoverable system error which might otherwise result in an unscheduled server outage Dynamic processor deallocation relies on the service processor s ability to use FFDC generated recov...

Page 168: ...f nine DRAM chips With this ECC code the system can dynamically recover from an entire DRAM failure by Chipkill but can also correct an error even if another symbol a byte accessed by a 2 bit line pair experiences a fault an improvement from the double error detection or single error correction ECC implementation found on the POWER6 processor based systems Hardware scrubbing Hardware scrubbing is ...

Page 169: ...ynamically added to a partition through a dynamic LPAR operation the POWER Hypervisor warns the operating system when memory pages are included that need to be deallocated Finally If an uncorrectable error in memory is discovered the logical memory block associated with the address with the uncorrectable error is marked for deallocation by the POWER Hypervisor This deallocation will take effect on...

Page 170: ... errors detected on a cache line can result in the data in the cache line being purged and the cache line removed from further operation without requiring a reboot An ECC uncorrectable error detected in the cache can also trigger a purge and delete of the cache line This results in no loss of operation because an unmodified copy of the data can be held on system memory to reload the cache line fro...

Page 171: ...ing normal operations Depending on the model and type of I O being used the freeze might include the entire PHB chip or simply a single bridge resulting in the loss of all I O operations that use the frozen hardware until a power on reset of the PHB is done The impact to partitions depends on how the I O is configured for redundancy In a server configured for failover availability redundant adapte...

Page 172: ...o implement a strategy that incorporates best of its kind service characteristics from diverse IBM Systems offerings The purpose of serviceability is to repair the system while attempting to minimize or eliminate service cost within budget objectives and while maintaining high customer satisfaction Serviceability includes system installation MES system upgrades downgrades and system maintenance re...

Page 173: ...ty to evaluate and act if necessary Power processor based systems employ IBM System z server inspired error detection mechanisms that extend from processor cores and memory to power supplies and hard drives Service processor The service processor is a microprocessor that is powered separately from the main instruction processing complex The service processor provides capabilities for the following...

Page 174: ... the ability to do processor instruction retry and alternate processor recovery for several core related faults This significantly reduces exposure to both hard logic and soft transient errors in the processor core Soft failures in the processor core are transient intermittent errors often because of cosmic rays or other sources of radiation and generally are not repeatable When an error is encoun...

Page 175: ...ther operation without requiring a reboot An ECC uncorrectable error detected in the cache can also trigger a purge and delete of the cache line This results in no loss of operation if the cache line contained data that was unmodified from what was stored in system memory Modified data is handled through Special Uncorrectable Error handling L1 data and instruction caches also have a retry capabili...

Page 176: ...f each unique failure Ability to initiate a wide variety of recovery mechanisms designed to correct the problem The POWER processor based systems include extensive hardware and firmware recovery logic Fault isolation registers Error checker signals are captured and stored in hardware fault isolation registers FIRs The associated logic circuitry is used to limit the domain of an error to the first ...

Page 177: ...exceeded a predetermined threshold or was unrecoverable Based on the isolation analysis recoverable error threshold counts can be incremented No specific service action is necessary when the event is recoverable When the event requires a service action additional required information is collected to service the fault For unrecoverable errors or for recoverable events that meet or exceed their serv...

Page 178: ...n of I O hardware followed by OS initiated software test routines Boot time diagnostic routines include the following items Built in self tests BISTs for both logic components and arrays ensure the internal integrity of components Because the service processor assists in performing these tests the system is enabled to perform fault determination and isolation whether or not the system processors a...

Page 179: ...rated service processor the system has the ability to automatically send out an alert through a phone line to a pager or call for service in the event of a critical system failure A hardware fault also illuminates the amber system fault LED located on the system unit to alert the user of an internal hardware problem On POWER7 processor based servers hardware and software failures are recorded in t...

Page 180: ...mple the service processor will also forward error notification of these events to the Hardware Management Console providing a redundant error reporting path in case of errors in the Remote Management and Control subsystem network The first occurrence of each failure type is recorded in the Manage Serviceable Events task on the management console This task then filters and maintains a history of d...

Page 181: ... home Call home refers to an automatic or manual call from a customer location to IBM support structure with error log data server status or other service related information Call home invokes the service organization so that the appropriate service action can begin Call home can be done through HMC or most non HMC managed systems Although configuring call home is optional clients are encouraged t...

Page 182: ...revent loose connections and aid in installing seating parts correctly These positive retention items do not require tools Light Path The Light Path LED feature is for low end systems including Power Systems up to models 750 and 760 that can be repaired by clients In the Light Path LED implementation when a fault condition is detected on the POWER7 or POWER7 processor based system an amber FRU fau...

Page 183: ...chanical mechanisms can engage or disengage Arrows generally improve the ease of serviceability The operator panel The operator panel on a POWER processor based system is an LCD display four rows by sixteen elements that is used to present boot progress codes indicating advancement through the system power on and initialization processes The operator panel is also used to display error and locatio...

Page 184: ... the management console for firmware updates Using the management console allows you to take advantage of the Concurrent Firmware Maintenance CFM option when concurrent service packs are available CFM is the IBM term used to describe the IBM Power Systems firmware updates that can be partially or wholly concurrent or nondisruptive With the introduction of CFM IBM is significantly increasing a clie...

Page 185: ...le If the FRU to be replaced is a PCI adapter or an internal storage device the service action is always performed from the operating system of the partition owning that resource Clients can subscribe through the subscription services to obtain the notifications about the latest updates available for service related documentation The latest version of the documentation is accessible through the In...

Page 186: ...e following information Both Ethernet ports are visible only to the service processor and can be used to attach the server to an HMC or to access the ASMI The ASMI options can be accessed through an HTTP server that is integrated into the service processor operating environment Both Ethernet ports support only auto negotiation Customer selectable media speed and duplex settings are not available B...

Page 187: ...ersion 10 0 9200 16439 Mozilla Firefox Version 17 0 2 and Opera Version 9 24 Later versions of these browsers might work but are not officially supported The JavaScript language and cookies must be enabled The web interface is available during all phases of system operation including the initial program load IPL and run time However several of the menu options in the web interface are unavailable ...

Page 188: ...or panel Error information Generate dump View machine type model and serial number Limited set of repair functions Operating system service menu The system diagnostics consist of IBM i service tools stand alone diagnostics that are loaded from the DVD drive and online diagnostics available in AIX Online diagnostics when installed are a part of the AIX or IBM i operating system on the disk or serve...

Page 189: ... accessed on the ASMI menus You can also access the system diagnostics from a Network Installation Management NIM server The IBM i operating system and associated machine code provide dedicated service tools DST as part of the IBM i licensed machine code Licensed Internal Code and System Service Tools SST as part of the IBM i operating system DST can be run in dedicated mode no operating system lo...

Page 190: ...epetitive call home information by recognizing that these are repeated errors and consolidating them into one error In addition you can use the Manage Serviceable Events task to initiate service functions on systems and logical partitions including the exchanging of parts configuring connectivity and managing dumps 4 4 2 IBM Power Systems firmware maintenance The IBM Power Systems Client Managed M...

Page 191: ...le to download and install Each IBM Power Systems server has the following levels of server firmware and power subsystem firmware Installed level This level of server firmware or power subsystem firmware is installed and will be installed into memory after the managed system is powered off and then on It is installed on the temporary side of system firmware Activated level This level of server fir...

Page 192: ...idrange Systems Firmware for 8208 E8D and 9109 RMD An installation is disruptive if the following statements are true The release levels SSS of currently installed and new firmware differ The service pack level FFF and the last disruptive service pack level DDD are equal in new firmware Otherwise an installation is concurrent if the service pack level FFF of the new firmware is higher than the ser...

Page 193: ... assistance in resolving technical problems Electronic Service Agent The Electronic Service Agent is software that resides on your server It monitors events and transmits system inventory information to IBM on a periodic client defined timetable The Electronic Service Agent automatically reports hardware problems to IBM Early knowledge about potential problems enables IBM to deliver proactive serv...

Page 194: ...orts are available for any system associated with the customers IBM ID Premium Search combines the function of search and the value of Electronic Service Agent information providing advanced search of the technical support knowledgebase Using Premium Search and the Electronic Service Agent information that has been collected from your system your client are able to see search results that apply sp...

Page 195: ...o a processor core chiplet by loading new initialization values into memory and then forcing it to go in and out of winkle mode This step happens all without causing disruption to the workloads or operating system all occurring in a few milliseconds In the same fashion PORE can initiate an L3 cache dynamic bit line repair operation if the POWER Hypervisor detects too many recoverable errors in the...

Page 196: ...l repair X X X X X X X Processor memory controller memory scrubbing X X X X X X X Memory page deallocation X X X X X X X Chipkill memory X X X X X X X L1 instruction and data array protection X X X X X X X L2 L3 ECC and cache line delete X X X X X X X Special uncorrectable error handling X X X X X X X Active Memory Mirroring for Hypervisorb X X X X X X X Fault detection and isolation Platform FFDC...

Page 197: ...rmware update with management console X X X X X X X PORE Core Initialization without reboot X X X X X X X Service processor support for BIST X X X X X X X Electronic Service Agent Call Home Application X X X X Guiding light LEDs X X X X X X X System dump for memory POWER Hypervisor SP X X X X X X X Information center Systems Support Site service publications X X X X X X X System Support Site educa...

Page 198: ...ns and blower for system enclosure X X X X X X X Redundant hot swap power for system enclosure X X X X X X X TPMD for system power and thermal management X X X X X X X system enclosure power thermal sensor CPU and memory X X X X X X X Redundant power for I O drawersa X X X X X X X a Not available on Power 710 and Power 730 b Need mid tier and large tier POWER7 systems or later including Power 770 ...

Page 199: ...ical Overview and Introduction REDP 4984 IBM Power 750 and 755 8233 E8B 8236 E8C Technical Overview and Introduction REDP 4638 IBM Power 770 and 780 9117 MMD 9179 MHD Technical Overview and Introduction REDP 4798 IBM Power 795 9119 FHB Technical Overview and Introduction REDP 4640 IBM Power Systems HMC Implementation and Usage Guide SG24 7491 IBM Power Systems SDMC to HMC Migration Guide RAID1 RED...

Page 200: ...ttp public dhe ibm com common ssi ecm en pod03051usen POD03051USEN PDF IBM Power 750 server data sheet http public dhe ibm com common ssi ecm en pod03034usen POD03034USEN PDF IBM Power 755 server data sheet http public dhe ibm com common ssi ecm en pod03035usen POD03035USEN PDF IBM Power 760 server data sheet http public dhe ibm com common ssi ecm en pod03080usen POD03080USEN PDF IBM Power 770 ser...

Page 201: ...stems power hardware cod Support for IBM Systems website http www ibm com support entry portal Overview brandind Hardware Systems Power IBM Power Systems website http www ibm com systems power IBM Storage website http www ibm com systems storage IBM Systems Energy Estimator http www 912 ibm com see EnergyEstimator Migration combinations of processor compatibility modes for active Partition Mobilit...

Page 202: ...188 IBM Power 750 and 760 Technical Overview and Introduction ...

Page 203: ......

Page 204: ...nd their prominent functions The IBM POWER7 processor is available at frequencies of 3 1 GHz 3 4 GHz 3 5 GHz and 4 0 GHz The larger IBM POWER7 Level 3 cache provides greater bandwidth capacity and reliability The newly introduced POWER7 dual chip module DCM New 10GBase T options for the Integrated Multifunction Card that provides two USB ports one serial port and four Ethernet connectors for a pro...

Reviews:

No comments

Related manuals for Power 750 Express

IBM ThinkPad 560Z Quick Reference Manual preview
ThinkPad 560Z
Brand: IBM Pages: 2
J-PRO JL7100 User Manual preview
JL7100
Brand: J-PRO Pages: 50
IBM ThinkPad A22e Hardware Maintenance Manual preview
ThinkPad A22e
Brand: IBM Pages: 142
Acer Aspire 5670 Service Manual preview
Aspire 5670
Brand: Acer Pages: 135
Fujitsu FPCR22451 Getting Started Manual preview
FPCR22451
Brand: Fujitsu Pages: 8
Fujitsu FPCR33561 Datasheet preview
FPCR33561
Brand: Fujitsu Pages: 6
Fujitsu FPCR34121 Datasheet preview
FPCR34121
Brand: Fujitsu Pages: 6
Fujitsu FPCR34711 Operating Manual preview
FPCR34711
Brand: Fujitsu Pages: 85
Fujitsu FPCR34121 Operating Manual preview
FPCR34121
Brand: Fujitsu Pages: 86
Fujitsu FPCR33681 Brochure preview
FPCR33681
Brand: Fujitsu Pages: 2
Fujitsu FPCM45161 Datasheet preview
FPCM45161
Brand: Fujitsu Pages: 2
Fujitsu FPCM23451 User Manual preview
FPCM23451
Brand: Fujitsu Pages: 132
Fujitsu FPCR32972 User Manual preview
FPCR32972
Brand: Fujitsu Pages: 166
Fujitsu FPCR34181 User Manual preview
FPCR34181
Brand: Fujitsu Pages: 327
Fujitsu FPCR34711 Datasheet preview
FPCR34711
Brand: Fujitsu Pages: 2
Lenovo 05962R5 Brochure & Specs preview
05962R5
Brand: Lenovo Pages: 5
Lenovo 06793JU Hardware Maintenance Manual preview
06793JU
Brand: Lenovo Pages: 97
Lenovo 06222FU Brochure & Specs preview
06222FU
Brand: Lenovo Pages: 4

Brands by name

Popular brands

Load more brands