HPE Apollo k6000, User Manual

Page 1: ...installation and configuration information for the HPE Apollo Chassis This document is for the person who installs administers and troubleshoots the system Hewlett Packard Enterprise assumes that you are qualified in the servicing of computer equipment and trained in using safe practices when dealing with hazardous energy levels ...

Page 2: ...tial computer software Valid license from Hewlett Packard Enterprise required for possession use or copying Consistent with FAR 12 211 and 12 212 Commercial Computer Software Computer Software Documentation and Technical Data for Commercial Items are licensed to the U S Government under vendor s standard commercial license Links to third party websites take you outside the Hewlett Packard Enterpri...

Page 3: ...ule LED 13 I O module bay numbering 13 Switch bay numbering 14 Chassis controller or HPE Apollo Platform Manager components 18 Chassis controller or HPE Apollo Platform Manager LEDs and buttons 18 Power supply LED 19 Installing the chassis 20 Installation overview 20 Unpacking the system 20 Determining the chassis rack spacing 20 Installing the rack rails 20 Installing the chassis in the rack 24 I...

Page 4: ...c discharge 48 Grounding methods to prevent electrostatic discharge 48 Specifications 49 Chassis environmental specifications 49 Chassis specifications 49 Power specifications 49 DC power 50 Single phase power 50 Hot plug power supply calculations 51 Websites 52 Support and other resources 53 Accessing Hewlett Packard Enterprise Support 53 Accessing updates 53 Customer self repair 54 Remote suppor...

Page 5: ...ower and cooling requirements based on location and installed components Power requirements Installation of this equipment must comply with local and regional electrical regulations governing the installation of IT equipment by licensed electricians This equipment is designed to operate in installations covered by NFPA 70 1999 Edition National Electric Code and NFPA 75 1992 code for Protection of ...

Page 6: ...e following documents before attempting installation HPE Apollo k6000 Chassis Quick Setup Instructions HPE Apollo k6000 Chassis Rail Kit for HPE and Third Party Racks Installation Instructions These documents provide required important safety information and decision making steps for configuration To access these documents see the Hewlett Packard Enterprise website http www hpe com info Apollok600...

Page 7: ...UTION Always be sure that equipment is properly grounded and that you follow proper grounding procedures before beginning any installation procedure Improper grounding can result in ESD damage to electronic components For more information refer to Electrostatic discharge on page 48 CAUTION When performing non hot plug operations you must power down the server and or the system However it may be ne...

Page 8: ...ilation Side The clearance between the installed rack component and the side panels of the rack must be a minimum of 7 cm 2 75 in Temperature requirements To ensure continued safe and reliable equipment operation install or position the rack in a well ventilated climate controlled environment The operating temperature inside the rack is always higher than the room temperature and is dependent on t...

Page 9: ...ge or rear I O blanks1 6 Chassis power supplies 2 7 Chassis controller or chassis controller with optional HPE Apollo Platform Manager 8 Data switches 2 9 High speed fabric switches2 HPE Apollo k6000 Chassis Rail kit 3 Cables per chassis 2 3 Power supply cables 2 5M 20 Pin Consolidated Management w Latch Cable APM USB to DB9 cable1 1 The quantity depends on the configuration ordered 2 The quantity...

Page 10: ...3 Not shown Front chassis components Item Description 1 Server bays 2 Front chassis fan module bays Server bay numbering 10 Front chassis components ...

Page 11: ... module bays and install power supplies into all power supply bays Rear panel components Item Description 1 I O module bays 2 Rear dual rotor fan modules 3 Chassis controller or HPE Apollo Platform Manager 4 Power supply bays 5 Data switch bays 6 High speed fabric switch bays Front chassis fan module numbering 11 ...

Page 12: ...ply numbering Rear fan module numbering Before powering up the chassis install fan modules into all front and rear fan module bays and install power supplies into all power supply bays 12 Power supply numbering ...

Page 13: ...is off Solid amber The fan module has failed I O module bay numbering I O modules are installed in the rear of the chassis in the bay that corresponds to its server tray If an I O bay is populated an I O enabled server must be installed in the corresponding bay Rear fan module LED 13 ...

Page 14: ...ing Item Description 1 Data switch bay A 2 Data switch bay B 3 High speed fabric switch bay A 4 High speed fabric switch bay B HPE Apollo InfiniBand EDR 36 port Unmanaged Switch buttons and LEDs 14 Switch bay numbering ...

Page 15: ...ess for three seconds for a soft reset 4 Health LED Solid green Normal Solid amber Module degraded Off No power present HPE Apollo InfiniBand EDR 36 port Unmanaged Switch components Item Description 1 12 QSFP28 ports HPE Apollo 100Gb 48 port Intel Omni Path Architecture Unmanaged Switch buttons and LEDs HPE Apollo InfiniBand EDR 36 port Unmanaged Switch components 15 ...

Page 16: ... Off No power present HPE Apollo 100Gb 48 port Intel Omni Path Architecture Unmanaged Switch components Item Description 1 24 QSFP28 ports HPE Apollo Ethernet 10GbE Pass thru Module buttons and LEDs Item Description 1 Link status LEDs Each LED is numbered 1 through 24 and illuminates when there is a valid link to the corresponding tray on the front of the chassis Table Continued 16 HPE Apollo 100G...

Page 17: ...rt Server bay mapping Port 1 Bay 1 Server bays 13 1 14 2 Bay 2 Server bays 24 12 23 11 Port 2 Bay 1 Server bays 15 3 16 4 Bay 2 Server bays 22 10 21 9 Port 3 Bay 1 Server bays 17 5 18 6 Bay 2 Server bays 20 8 19 7 Port 4 Bay 1 Server bays 19 7 20 8 Bay 2 Server bays 18 6 17 5 Port 5 Bay 1 Server bays 21 9 22 10 Bay 2 Server bays 16 4 15 3 Port 6 Bay 1 Server bays 23 11 24 12 Bay 2 Server bays 14 2...

Page 18: ...0 Environmental controller port 11 iLO port2 12 Consolidated Management Port2 1 Available only on the HPE Apollo Platform Manager 2 If you have a display port cable connected to each chassis controller module up to three modules per rack from the HPE Apollo Platform Manager do not connect the iLO Ethernet port on the standalone chassis controller module When using an APM in the rack rack level iLO...

Page 19: ... seconds or longer the APM enters recovery mode For more information see the HPE Apollo Platform Manager User Guide on the Hewlett Packard Enterprise website http www hpe com support apm_ug_en Power supply LED Power LED Condition Off1 No input power to the power supply Power supply failure Solid green Normal operation Flashing amber1 Warning 1Log in to the APM or the server iLO to check for power ...

Page 20: ...so ship with the HPE Apollo k6000 Chassis Start Here for Important Setup Information Safety Compliance and Warranty Information Determining the chassis rack spacing The HPE 1 2 m standard rack supports installation of up to three chassis For more information on installing the chassis into the rack see the HPE Apollo k6000 Chassis Rail Kit for HPE and Third Party Racks Installation Instructions Ins...

Page 21: ... Install the rails onto the rack paying attention to the labeling on the rails Front Left and Front Right 2 Install the screws through the rear extension and the vertical brace attaching the screws to the threaded holes in the rear of the rail 3 Install the cage nuts for the front brackets Installing the chassis 21 ...

Page 22: ...ts to the rack a Secure the top two screws to the cage nuts A installed in the previous step b Secure the bottom two screws to the threaded holes of the rail 5 Install the cage nuts for the rear brace 22 Installing the chassis ...

Page 23: ...6 Secure the rear brace to the rack Installing the chassis 23 ...

Page 24: ...leveling feet extend to the floor The full weight of the rack rests on the leveling feet The racks are coupled together in multiple rack installations Only one component is extended at a time If more than one component is extended a rack might become unstable WARNING To reduce the risk of personal injury or equipment damage be sure that the rack is adequately stabilized before installing the chass...

Page 25: ... is at the top of the chassis to ensure proper orientation in the rack Prerequisites Install the HPE Apollo k6000 Chassis Rail Kit into the rack Installing the rack rails on page 20 Procedure 1 Install the chassis into the rack 2 Secure the chassis to the front of the rack Installing the chassis 25 ...

Page 26: ...3 Tighten the thumbscrew at the rear of the chassis 26 Installing the chassis ...

Page 27: ...ssis to secure all the servers Procedure 1 Eject the servers but do not remove them from the chassis 2 Line up the slots on the shipping bracket with the server release levers 3 Insert the end of the server release level into the corresponding slot on the shipping bracket 4 Secure the shipping bracket to the chassis by tightening the thumbscrews on the bracket Installing the shipping bracket 27 ...

Page 28: ...fic maintenance and service guides on the Hewlett Packard Enterprise website http www hpe com info Apollok6000 docs Installing a server To ensure proper air flow always populate the chassis from bottom to top beginning with bay 1 CAUTION To prevent improper cooling and thermal damage do not operate the chassis unless all bays are populated with a component or a blank Procedure Install the server W...

Page 29: ...t sides of the chassis are oriented 180 from each other Components that are installed on one side of the chassis must be turned 180 when they are installed on the opposite side Procedure Install the rear fan module Installing the power supplies Before powering up the chassis populate all power supply bays with a power supply Installing the rear chassis fan modules 29 ...

Page 30: ...r the switch modules to power on from a cold boot for the first time If the chassis controller is not installed the switches will not power on After the chassis controller or APM power on the switches the chassis controller can be removed Procedure Install the chassis controller or HPE Apollo Platform Manager 30 Installing the chassis controller or HPE Apollo Platform Manager ...

Page 31: ...odule CAUTION Remove the server from the chassis before installing the I O module Failure to do so can result in damage to both components After the I O module is installed install the server Procedure 1 Power down the server associated with the I O module 2 Remove the server from the chassis 3 Remove the I O module blank Installing an I O module 31 ...

Page 32: ...I O module into the bay that corresponds to the server bay For more information see I O module bay numbering on page 13 5 If not installed install the dual rotor fan module Installing the rear chassis fan modules on page 29 Installing data switch options The chassis supports installation of the following data switches 10GbE Integrated Switch HPE Apollo Ethernet 10GbE Pass Thru Module 32 Installing...

Page 33: ...a second pass thru module in bay 2 When the pass thru module is installed in bay 1 the ports and LEDs map to specific server bays as shown in the following table QSFP Port LED to Server bay mapping Port 1 LED 1 Server bay 13 LED 2 Server bay 1 LED 3 Server bay 14 LED 4 Server bay 2 Port 2 LED 5 Server bay 15 LED 6 Server bay 3 LED 7 Server bay 16 LED 8 Server bay 4 Port 3 LED 9 Server bay 17 LED 1...

Page 34: ...ap to specific server bays as shown in the following table QSFP Port LED to Server bay mapping Port 1 LED 1 Server bay 24 LED 2 Server bay 12 LED 3 Server bay 23 LED 4 Server bay 11 Port 2 LED 5 Server bay 22 LED 6 Server bay 10 LED 7 Server bay 21 LED 8 Server bay 9 Port 3 LED 9 Server bay 20 LED 10 Server bay 8 LED 11 Server bay 19 LED 12 Server bay 7 Port 4 LED 13 Server bay 18 LED 14 Server ba...

Page 35: ...nectors carefully note the orientation in the following diagrams before you install the switch IMPORTANT The chassis controller or HPE Apollo Platform Manager must be installed for a switch to power on for the first time Once the switch is powered on by the chassis controller or HPE Apollo Platform Manager you can remove the chassis controller if needed Always install the data switch in bay 1 If r...

Page 36: ...tation of the release lever is correct for installation in bay 2 and is fully open b Install the data switch close the release lever and then tighten the captive screw Installing high speed fabric switch options The chassis supports installation of the following high speed fabric switches HPE Apollo InfiniBand EDR 36 port Unmanaged Switch HPE Apollo 100 Gb 48 port Intel Omni Path Architecture Unma...

Page 37: ... 3 HPE Apollo 100 Gb 48 port Intel Omni Path Architecture Unmanaged Switch 2 OPA mezzanine cards connected by a dual mezzanine cable Bay 3 HPE Apollo 100 Gb 48 port Intel Omni Path Architecture Unmanaged Switch Bay 4 HPE Apollo 100 Gb 48 port Intel Omni Path Architecture Unmanaged Switch 1 EDR mezzanine card connected by a single mezzanine cable Bay 3 HPE Apollo InfiniBand EDR 36 port Unmanaged Sw...

Page 38: ... thermal damage do not operate the chassis unless all device bays are populated with either a component or a blank CAUTION To prevent damage to the connectors carefully note the orientation in the following diagrams before you install the switch IMPORTANT The chassis controller or HPE Apollo Platform Manager must be installed for a switch to power on for the first time Once the switch is powered o...

Page 39: ...The switch will slide smoothly into the slot and connect to the backplane Forcing the switch into the slot or into the connector will damage components 3 To Install the switch in bay 4 a Make sure that the orientation of the release lever is correct for installation in bay 4 b Prepare the switch for installation Make sure that the release lever is fully open c Install the switch close the release ...

Page 40: ...CAUTION The switch will slide smoothly into the slot and connect to the backplane Forcing the switch into the slot or into the connector will damage components 40 Installing the chassis ...

Page 41: ...n a rack One HPE Apollo Platform Manager serial to DB9 cable for initial APM setup 869324 001 One Ethernet cable per rack for iLO connectivity Cabling the chassis WARNING Be sure that all circuit breakers are in the off position before connecting any power components CAUTION To avoid damaging the fiber cables do not drape cables from one side of the rack to the other and do not run cables over a h...

Page 42: ...consolidated management ports on the chassis controllers orange HPE Apollo Platform Manager to network pink iLO connection to network blue HPE Apollo Platform Manager serial cable used for initial APM setup 869324 001 green 42 Cabling ...

Page 43: ... are using one PDU per chassis that has a minimum capacity of 17 28 kVA and a dedicated circuit breaker for each power supply in the chassis Connecting two or more power supplies to a single breaker will cause the breaker to trip You might need to add PDUs to your configuration to meet the requirement of one breaker per power supply to avoid loss of data or damage to the PDU Cabling 43 ...

Page 44: ...3 Apply power to the chassis 44 Cabling ...

Page 45: ...s the maximum number of nodes to run by engaging power capping if the power draw from the chassis attempts to exceed the load supported by the active power supplies In this mode the system is expected to survive with the possibility of degraded performance an unexpected power loss to one or more of the power supplies Mode 3 User Configurable Mode The user can specify a valid power cap value from a...

Page 46: ...connected to the APM enter the following command at the prompt SET POWER CAP wattage NONE zone_name The wattage value if provided represents the total wattage to be allocated among all the chassis that are part of the baseline or partial baseline of a zone if specified This value is divided by the total maximum wattage established by the baseline to calculate a percentage cap value This percentage...

Page 47: ...ntenance Error Message Guide for HPE ProLiant Gen10 servers and HPE Synergy provides a list of error messages and information to assist with interpreting and resolving error messages Integrated Management Log Messages and Troubleshooting Guide for HPE ProLiant Gen10 and HPE Synergy provides IML messages and associated troubleshooting information to resolve critical and cautionary IML events To acc...

Page 48: ...unding methods to prevent electrostatic discharge Several methods are used for grounding Use one or more of the following methods when handling or installing electrostatic sensitive parts Use a wrist strap connected by a ground cord to a grounded workstation or computer chassis Wrist straps are flexible straps with a minimum of 1 megohm 10 percent resistance in the ground cords To provide proper g...

Page 49: ...ating limit is 3 048 m 10 000 ft or 70 kPa 10 1 psia Upper nonoperating limit is 9 144 m 30 000 ft 2 Storage maximum humidity of 95 is based on a maximum temperature of 45 C 113 F Altitude maximum for storage corresponds to a pressure minimum of 70 kPa 10 1 psia Chassis specifications Specification Value Height 53 14 cm 20 92 in Depth 102 60 cm 40 39 in Width 44 80 cm 17 64 in Weight fully loaded ...

Page 50: ...ltage 200 VAC to 240 VAC Rated input frequency 50 Hz to 60 Hz Rated input current per power supply maximum 14 4 A at 200 VAC 13 8 A at 208 VAC 13 1 A at 220 VAC 12 5 A at 230 VAC 12 0 A at 240 VAC Rated input power per power supply maximum 2880 VA HPE 2650W 277VAC Hot Plug Power Supply Specification HPE 2650W 277VAC Hot Plug Power Supply Power cord Anderson Power Products SDG 300 dual ended 2 m 6 ...

Page 51: ...400 W per power supply Input requirements Rated input voltage 200 VDC to 240 VDC Rated input frequency 50 to 60 Hz Rated input current per power supply maximum 15 8 A at 200 VDC 15 6 A at 208 VDC 15 7 A at 220 VDC 15 9 A at 230 240 VDC 15 2 A at 240 VDC Rated input power per power supply maximum 3620 VA Hot plug power supply calculations For hot plug power supply specifications and calculators to ...

Page 52: ...ibrary www hpe com info EIL Single Point of Connectivity Knowledge SPOCK Storage compatibility matrix www hpe com storage spock Storage white papers and analyst reports www hpe com storage whitepapers For additional websites see Support and other resources 52 Websites ...

Page 53: ...omponents Accessing updates Some software products provide a mechanism for accessing software updates through the product interface Review your product documentation to identify the recommended software update method To download product updates Hewlett Packard Enterprise Support Center www hpe com support hpesc Hewlett Packard Enterprise Support Center Software downloads www hpe com support downlo...

Page 54: ...on your product s service level Hewlett Packard Enterprise strongly recommends that you register your device for remote support If your product includes additional remote support details use search to locate that information Remote support and Proactive Care information HPE Get Connected www hpe com services getconnected HPE Proactive Care services www hpe com services proactivecare HPE Proactive ...

Page 55: ...arliament and the Council A chemical information report for this product can be found at www hpe com info reach For Hewlett Packard Enterprise product environmental and safety information and compliance data including RoHS and REACH see www hpe com info ecodata For Hewlett Packard Enterprise environmental information including company programs product recycling and energy efficiency see www hpe co...