Bull Novascale Blade BL465, Installation And User Manual

Page 1: ...novascale Blade BL465 Installation and User s Guide novascale Blade REFERENCE 86 A1 68FE 03...

Page 2: ......

Page 3: ...novascale Blade novascale Blade BL465 Installation and User s Guide Hardware November 2011 BULL CEDOC 357 AVENUE PATTON B P 20845 49008 ANGERS CEDEX 01 FRANCE REFERENCE 86 A1 68FE 03...

Page 4: ...ical Publications you are invited to use the Ordering Form also provided at the end of this book Trademarks and Acknowledgements We acknowledge the rights of the proprietors of the trademarks mentione...

Page 5: ...er 2 Power controls and indicators 15 2 1 Turning on the blade server 15 2 2 Turning off the blade server 16 2 3 Blade server controls and LEDs 16 2 4 Scalability indicators 20 2 5 Blade server connec...

Page 6: ...blade server 65 4 1 Partitioning a novascale Blade BL465 complex 66 4 2 Using the Setup Utility 66 4 3 Using the PXE boot agent utility program 71 4 4 Using the Boot Selection Menu program 71 4 5 Usin...

Page 7: ...105 Using the documentation 106 Appendix B Notices 107 Particulate contamination 108 Product recycling and disposal 109 Electronic emission notices 110 Industry Canada Class A emission compliance stat...

Page 8: ...panel 39 Figure 3 14 Installing the access panel 40 Figure 3 15 Removing a hypervisor key 41 Figure 3 16 Removing the access panel 42 Figure 3 17 Cards supported in a blade server 43 Figure 3 18 Insta...

Page 9: ...Safety vii Safety...

Page 10: ...viii novascale Blade BL465 Installation and User s Guide Safety statements...

Page 11: ...Safety ix...

Page 12: ...x novascale Blade BL465 Installation and User s Guide...

Page 13: ...Safety xi...

Page 14: ...xii novascale Blade BL465 Installation and User s Guide...

Page 15: ...hrough the management module Web interface For more information about FlexNode partitioning see Working with a BL465 Complex on page 12 For more information about the Management module Web interface s...

Page 16: ...on a label on the side of the blade server that is visible when the blade server is not in the Blade Chassis Note The illustrations in this document might differ slightly from the hardware Figure 1 1...

Page 17: ...is in PDF on the Resource DVD It contains translated caution and danger statements Each caution and danger statement that appears in the documentation has a number that you can use to locate the corr...

Page 18: ...s provide information or advice that might help you avoid inconvenient or problem situations Attention These notices indicate possible damage to programs devices or data An attention notice is placed...

Page 19: ...system board If two BL465 blade servers are assembled into a BL465 complex up to 512 GB is available to the BL465 complex Note The BL465 blade server supports memory sparing Drives Supports up to 2 s...

Page 20: ...rver on 10 to 32 C 50 to 89 6 F Altitude 914 4 to 2133 6 m 3000 to 7000 ft Blade server off 10 to 43 C 50 to 109 4 F Altitude 914 4 to 2133 6 m 3000 to 7000 ft Blade server shipping 40 to 60 C 40 to 1...

Page 21: ...n Information Model CIM Web browser For more information see Chapter 6 Accessing the IMM on page 99 Dynamic System Analysis DSA Dynamic Systems Analysis DSA collects and analyses system information to...

Page 22: ...Low Profile VLP form factor DIMMs installed on the system board Note If two BL465 blade servers are assembled in a BL465 complex up to 512 GB of system memory is available to the BL465 complex Light...

Page 23: ...1 Introduction 9 You can configure and monitor the power environment by using the management module For more information about configuring and using power throttling see the management module documen...

Page 24: ...Advanced Configuration and Power Interface ACPI Automatic server restart ASR Built in diagnostics using DSA Preboot which is stored in integrated USB memory Built in monitoring for temperature voltag...

Page 25: ...ents of the blade server You must remove the blade server from the Blade Chassis and remove the cover to access the components The following illustration shows the major components of the blade server...

Page 26: ...ins up to four multi core processors and up to 32 DIMMs When the complex is implemented as a single hardware partition the leftmost blade server as installed in a Blade chassis is called the primary b...

Page 27: ...e You can toggle the BL465 complex to stand alone mode through the Web interface In stand alone mode you can install a different operating system on each blade server and run different applications on...

Page 28: ...ed in the secondary blade server However the I O expansion cards in the secondary blade server cannot be used for a Serial Over LAN connection If you press the power button on one blade server both bl...

Page 29: ...on on the blade server does not respond This process can take approximately 90 seconds after the blade server has been installed While the blade server is starting the power LED on the front of the bl...

Page 30: ...button on the blade server see Blade server controls and LEDs on page 16 This starts an orderly shutdown of the operating system if this feature is supported by the operating system If the operating...

Page 31: ...ver Flashing rapidly The LED flashes rapidly for one of the following reasons The blade server has been installed in a chassis When you install the blade server the LED flashes rapidly for up to 90 se...

Page 32: ...to determine whether local control has been disabled on the blade server Notes The operating system in the blade server must provide USB support for the blade server to recognize and use the keyboard...

Page 33: ...amber LED is lit it indicates that an Automatic BIOS recovery ABR has occurred The blade server starts up using the backup UEFI image See the Problem Determination and Service Guide The information L...

Page 34: ...alone mode The scalability indicators show whether a BL465 blade server is a stand alone blade server or a node in a BL465 complex operating as a single hardware partition When a BL465 blade server is...

Page 35: ...chassis See the documentation that comes with the Blade chassis for information about the input output connectors The blade server has two selection buttons on the control panel the media tray select...

Page 36: ...22 novascale Blade BL465 Installation and User s Guide...

Page 37: ...r new blade server take the opportunity to download and apply the most recent firmware updates This step will help to ensure that any known issues are addressed and that your blade server is ready to...

Page 38: ...rge observe the following precautions When you work on a Blade Chassis that has an electrostatic discharge ESD connector use a wrist strap when you handle modules optional devices or blade servers To...

Page 39: ...a blade server into a different bay from the one it was removed from could have unintended consequences Some configuration information and update options are established according to bay number if yo...

Page 40: ...Figure 3 2 Opening the blade server cover 1 Read the safety information that begins on page vii and Installation guidelines on page 23 2 If the blade server is installed in a Blade Chassis remove it...

Page 41: ...s BL465 complex to use the blade servers as independent stand alone blade servers see the Problem Determination and Service Guide To disassemble a BL465 complex complete the following steps 1 Before...

Page 42: ...2 node scalability card see Removing the 2 node scalability card on page 29 for instructions 6 Press the blade server cover release on each side of the blade server and lift the topmost node from the...

Page 43: ...ge vii and Installation guidelines on page 23 2 Loosen each screw on the 2 node scalability card using the provided 3 16 hex driver Alternate the loosening of each screw until both screws are removed...

Page 44: ...ard into the expansion card standoffs on the blade server and rotate the expansion card down toward the system board Note The expansion card standoff in the middle of the blade server has two slots Th...

Page 45: ...n that begins on page vii and Installation guidelines on page 23 2 Locate the blue expansion card lever on the SSD expansion card and lift the lever to release the SSD expansion card from the blade ex...

Page 46: ...31 for instructions 2 Turn over the SSD expansion card Figure 3 8 Installing a solid state drive 3 Touch the static protective package that contains the solid state drive to any unpainted metal surfa...

Page 47: ...an SSD expansion card on page 31 for instructions 3 Turn over the SSD expansion card Figure 3 9 Removing a solid state drive 4 Press down on the blue tab The retention lever automatically opens so tha...

Page 48: ...IMM Connector Buffer Buffer Buffer Buffer Buffer Buffer Buffer Buffer Installed DIMMs 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 4 DIMMs X X X X 6 DIMMs X X X X X X 8 DIMMs X X X X X X X X 10 DIMMs X X X...

Page 49: ...DIMMs 3 If the blade server is installed in a Blade Chassis unit remove it see Removing the blade server from the Blade Chassis on page 25 for instructions 4 Carefully lay the blade server on a flat...

Page 50: ...ention To avoid breaking the retaining clips or damaging the DIMM connectors handle the clips gently c Press the DIMM into the DIMM connector The retaining clips will lock the DIMM into the connector...

Page 51: ...server is installed in a Blade Chassis remove it see Removing the blade server from the Blade Chassis on page 25 3 Open the blade server cover see Removing the blade server cover on page 26 4 Locate t...

Page 52: ...y you might have to install a hypervisor key in each blade To determine whether you need a hypervisor key see the documentation that comes with your virtualization software The following illustration...

Page 53: ...ge of the hypervisor interposer to disengage the hypervisor interposer from the hypervisor interposer card guide c Carefully lift the hypervisor interposer up from the system board 7 Touch the static...

Page 54: ...dapter into the connector on the blade server Attention Be careful not to damage the pins on the hypervisor interposer 10 Install the access panel Figure 3 14 Installing the access panel a Make sure t...

Page 55: ...sor key complete the following steps 1 Before you begin read the safety information that begins on page vii and Installation guidelines on page 23 2 If the blade server is installed in a Blade Chassis...

Page 56: ...hile you lift the back of the access panel slide the panel away from the bezel 6 Locate the hypervisor interposer on the system board see Major components of the blade server on page 11 7 Press down o...

Page 57: ...nsion card Broadcom 4 Port 10 Gb Ethernet Expansion Card CFFh Emulex 10 Gb Virtual Network Adapter CIOv expansion cards for example Ethernet Expansion Card QLogic 8 Gb Fibre Channel Expansion Card QLo...

Page 58: ...talled in a Blade Chassis remove it see Removing the blade server from the Blade Chassis on page 25 for instructions 3 Carefully lay the blade server on a flat static protective surface 4 Open the bla...

Page 59: ...assis Enterprise only Use these instructions to install a compact form factor expansion card in the blade server The blade server supports a horizontal combination form factor CFFh expansion card The...

Page 60: ...npainted metal surface on any other grounded rack component for at least 2 seconds then remove the I O expansion card from its static protective package 9 Orient the expansion card and slide the slots...

Page 61: ...d in a Blade Chassis remove it see Removing the blade server from the Blade Chassis on page 25 3 Carefully lay the blade server on a flat static protective surface 4 Open the blade server cover see Re...

Page 62: ...that begins on page vii and Installation guidelines on page 23 2 If the blade server is installed in a Blade Chassis remove it see Removing the blade server from the Blade Chassis on page 25 3 Careful...

Page 63: ...o install a microprocessor and heat sink in the blade server Figure 3 22 Installing the microprocessor Attention 1 Do not use any tools or sharp objects to lift the locking lever on the microprocessor...

Page 64: ...essor socket release lever and retainer a Rotate the release lever on the microprocessor socket from its closed and locked position until it stops in the fully open position approximately a 135 angle...

Page 65: ...e static protective bag and the foam surrounding the bag from the box b Touch the static protective bag that contains the new microprocessor to any unpainted surface on the Blade chassis or any unpain...

Page 66: ...th the alignment notches in the microprocessor socket as a guide The alignment holes on the tool will not sit flush on the microprocessor bracket screws However the holes can be used as a guide to ens...

Page 67: ...in the retention bracket thermal material side down Press firmly on the heat sink c Align the three screws on the heat sink with the holes on the heat sink retention module d Press firmly on the capt...

Page 68: ...ssive force If you are using a torque wrench tighten the screws to 1 13 0 13 Newton meters Nm 10 0 15 in lbs 12 Make sure that at a minimum memory modules are installed in DIMM connectors 1 and 4 See...

Page 69: ...apter 4 Configuring the blade server on page 65 See the documentation that comes with your optional device for additional information 3 17 1 Assembling the BL465 complex Use this information to assemb...

Page 70: ...he 2 node scalability card see Installing the 2 node scalability card on page 58 3 17 1 1 Installing the scalability tray Use this information to install the scalability tray on a blade server To inst...

Page 71: ...e tray slide the scalability tray forward toward the bezel until there is an audible click on each side of the blade server 5 Attempt to pull the scalability tray back to ensure that the scalability t...

Page 72: ...nd Installation guidelines on page 23 2 Stand the blade servers upright on a clean flat work surface with the scalability connector on the blade servers facing up 3 Release the lower handles rotate th...

Page 73: ...screws on the 2 node scalability card by hand to ensure that the screw threads start properly mportant Always hand tighten each screw before you use the 3 16 hex drive 8 Alternately tighten each screw...

Page 74: ...install and close the blade server cover complete the following steps 1 Before you begin read the safety information that begins on page vii and Installation guidelines on page 23 2 Carefully lay the...

Page 75: ...lling and closing the blade server cover 4 Pivot the cover to the closed position as shown in the illustration until it clicks into place 5 Install the blade server into the Blade Chassis see Installi...

Page 76: ...de Chassis might be different see the documentation for your Blade Chassis for additional information To install a blade server in a Blade Chassis complete the following steps Figure 3 29 Installing t...

Page 77: ...the closed position Note After the blade server is installed the IMM in the blade server initializes and synchronizes with the management module This process takes approximately two minutes to complet...

Page 78: ...e Setup Utility on page 66 for more information about the Setup Utility Some options have device drivers that you must install See the documentation that comes with each option for information about i...

Page 79: ...evel 0 striping or RAID level 1 mirror arrays in operating systems For the BL465 you must configure the RAID by using the LSI Configuration Utility program see Using the LSI Logic Configuration Utilit...

Page 80: ...rn on the blade server see Turning on the blade server on page 15 2 Immediately give the blade server control of the Blade Chassis shared keyboard video and mouse ports If you are managing the blade s...

Page 81: ...update the firmware for your blade server See Updating firmware and device drivers on page 62 for information about how to update the firmware for your blade server To configure a UEFI compatible exp...

Page 82: ...ther the Ethernet over USB interface is enabled or disabled Note This option is primarily for older operating systems that have problems with USB communications device class CDC Ethernet interfaces Di...

Page 83: ...he server The date is set in month day year format The time is set in 24 hour format hour minute second This choice is on the full UEFI Setup Utility menu only Start Options Select this choice to view...

Page 84: ...set change and delete a power on password and an administrator password through this selection If you set a power on password you must type the power on password to complete the system startup and to...

Page 85: ...at your blade server can manage To start the PXE boot agent utility program complete the following steps 1 Turn on the server 2 When the Broadcom NetXtreme Boot Agent vX X X prompt is displayed press...

Page 86: ...e Identifier UUID must be updated when the system board is replaced Use the Advanced Settings Utility ASU to update the UUID in the UEFI based server The ASU is an online tool that supports several op...

Page 87: ...ess method ASU will automatically use the unauthenticated KCS access method The following commands are examples of using the userid and password default values and not using the default values Example...

Page 88: ...DMI SMBIOS data The Desktop Management Interface DMI must be updated when the system board is replaced Use the Advanced Settings Utility ASU to update the DMI The ASU is an online tool that supports s...

Page 89: ...se from the following methods Online authenticated LAN access type the command host ltimm_internal_ip gt user ltimm_user_id password imm_password Where imm_internal_ip The IMM internal LAN USB IP addr...

Page 90: ...set SYSTEM_PROD_DATA SYsEncloseAssetTag ltasset_tag Remote LAN access type the command Note When using the remote LAN access method to access IMM using the LAN from a client the host and the imm_exter...

Page 91: ...ng steps Note The LSI controller on your blade server is a UEFI compatible device It can be configured through the Setup utility for your blade server see see Using the Setup Utility on page 66 1 Turn...

Page 92: ...download the firmware and device drivers from http support bull com Follow the instructions that come with the firmware and device drivers to install them mportant To avoid problems and to maintain sy...

Page 93: ...ry blade server are applied to the secondary blade server 4 7 2 Updating firmware for each blade server independently If you are updating firmware for blade servers that are operating as independent p...

Page 94: ...ou place the files you will need that location to run the Expect type script 2 Generate an Expect type script that will log in to the advanced management module CLI update the firmware for the BL465 a...

Page 95: ...txt exp_internal f directory ExpectDiag txt 0 Temp hack proc log_init_custom logfile global fm_logfile global g_module_name global g_test_results_base_dir Cache the module name set g_module_name logfi...

Page 96: ...to resume set amm_id set rv amm_login save_amm save_userid save_password set rv amm_restore_save_target Save off the current target value proc amm_save_target string global save_target set save_targe...

Page 97: ...ssis proc reset_all_blades global blade_presence_bits for set slot 1 slot 15 incr slot 1 if info exists blade_presence_bits slot continue set present blade_presence_bits slot if present 1 set rv reset...

Page 98: ...rv amm_save_target system mm mm return 0 return 1 Set the CLI target to system Returns 0 on success and 1 on failure proc amm_set_system_target global amm_id send i amm_id env T system r expect i amm...

Page 99: ...d send password r Make sure we made it expect exact system Log out of the AMM Be nice to the CLI it won t run commands some times if you close the connection on it too soon proc amm_logout global amm_...

Page 100: ...ommand usr bin curl set arg1 silent set arg2 user set arg3 userid password set arg4 ftp amm remote_directory filename set arg5 o set arg6 local_copy set run_command list exec command arg1 arg2 arg3 ar...

Page 101: ...es found lappend multinode_complex multinode_entry Return a list element for a given slot configuration proc get_multinode_list_for_slot slot_no global multinode_complex set empty list set temp list R...

Page 102: ...e T system blade slot sp r n Process results set rv 1 expect i amm_id successful set rv 0 i amm_id meant set rv 1 i amm_id failed set rv 1 i amm_id nable set rv 1 if rv 0 ft_log AMM reports flash succ...

Page 103: ...loop will flash all blades in a given chassis to a given level of IMM or uEFI firmware via the AMM proc flash_all_blades firmware global blade_presence_bits for set slot 1 slot 15 incr slot 1 if info...

Page 104: ...nit 1 set rv amm_login amm userid password set rv purge_old_upd_files set rv populate_complex_list set rv amm_set_mm_target set rv flash_update_mn_blade blade_no tftp_filename Display user output data...

Page 105: ...the server operation to the primary bank complete the following steps 1 Download the blade server UEFI firmware update from the Bull support web site see Updating firmware and device drivers on page 7...

Page 106: ...lected by the relevant blade server See Installing the blade server cover on page 60 and Installing the blade server in a Blade Chassis on page 62 19 Restart the blade server see Turning off the blade...

Page 107: ...page 15 The system begins the power on self test POST 9 Boot the server to the operating system or the F1 UEFI configuration menu 10 Log into the Advanced Management s web interface 11 After you log i...

Page 108: ...and Installing the blade server in a Blade Chassis on page 62 28 Restart the blade server see Turning on the blade server on page 15 The system begins the power on self test POST 4 8 3 In band automat...

Page 109: ...server see Updating firmware and device drivers on page 78 2 Log into the Advanced Management Module s web interface 3 After you log in select MM Control Network Protocols and ensure that TFTP is ena...

Page 110: ...96 novascale Blade BL465 Installation and User s Guide...

Page 111: ...ating system installation instructions from the Bull Support web site http support bull com and install the operating system mportant The operating system in the blade server must provide USB support...

Page 112: ...98 novascale Blade BL465 Installation and User s Guide...

Page 113: ...le shows the IP addresses for each of the modules in a BL465 Blade server Logical node ID IMM IP address Host address Host subnet Host subnet mask Keyboard Controller Style KCS address Primary 0 169 2...

Page 114: ...Select the check boxes next to the blade or blades that you want to enable or disable 5 Click the Disable button to disable the LAN over USB interface on the selected blades 6 3 Configuring the LAN ov...

Page 115: ...ver_os inf file and install the device 4 Go to Computer Management then Device Manager and right click on Network adapters and select Scan for hardware changes A small pop up confirms that the Etherne...

Page 116: ...detect the LAN over USB interface and might require manual configuration For information about configuring LAN over USB on specific Linux distributions see the white paper Transitioning to UEFI and I...

Page 117: ...and solve hardware related problems POST codes error messages and error logs The POST error codes indicate the detection of a problem See the Problem Determination and Service Guide for more informati...

Page 118: ...ssor status and configuration System configuration Vital product data firmware and Unified Extensible Firmware Interface UEFI configuration Microprocessor input output hub and UEFI error logs Scalabil...

Page 119: ...tware and firmware if the problem has a documented solution within a software upgrade Use the troubleshooting information in your system documentation and use the diagnostic tools that come with your...

Page 120: ...files and help files See the troubleshooting information in your system documentation for instructions for using the diagnostic programs The troubleshooting information or the diagnostic programs migh...

Page 121: ...nvironments Maximum internal hard disk drive capacities assume the replacement of any standard hard disk drives and population of all hard disk drive bays with the largest currently supported drives a...

Page 122: ...ronment have caused damage to the server Bull may condition provision of repair or replacement of servers or parts on implementation of appropriate remedial measures to mitigate such environmental con...

Page 123: ...tiquette du syst me respecte la Directive europ enne 2002 96 EC en mati re de D chets des Equipements Electriques et Electroniques DEEE qui d termine les dispositions de retour et de recyclage applica...

Page 124: ...by using other than recommended cables and connectors or by unauthorized changes or modifications to this equipment Unauthorized changes or modifications could void the user s authority to operate th...

Page 125: ...ion cards This product has been tested and found to comply with the limits for Class A Information Technology Equipment according to CISPR 22 European Standard EN 55022 The limits for Class A equipmen...

Page 126: ...112 novascale Blade BL465 Installation and User s Guide...

Page 127: ......

Page 128: ...BULL CEDOC 357 AVENUE PATTON B P 20845 49008 ANGERS CEDEX 01 FRANCE REFERENCE 86 A1 68FE 03...