IBM Brocade, Installation And User Manual

Page 1: ...Brocade 2 Port 10GbE Converged Network Adapter for IBM BladeCenter Installation and User s Guide ...

Page 2: ......

Page 3: ...Brocade 2 Port 10GbE Converged Network Adapter for IBM BladeCenter Installation and User s Guide ...

Page 4: ... provided with the product and general information in the Notices appendix of this guide First Edition June 2010 Copyright International Business Machines Corporation 2010 US Government Users Restricted Rights Use duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp ...

Page 5: ...ds 8 FCoE features 9 CEE and networking features 10 Adapter specifications 13 WoL and SoL limitations 15 For more information 15 Chapter 2 Installing and removing an adapter Installation guidelines 18 System reliability guidelines 19 Handling static sensitive devices 19 Installing the high speed adapter in a blade server 20 Configuring a command session 22 Removing the high speed adapter from a bl...

Page 6: ...ng problems Hardware problems 38 Software problems 39 System configuration problems 40 Ethernet device problems 40 Fibre Channel device problems 41 Appendix A Getting help and technical assistance Before you call 43 Using the documentation 43 Getting help and information from the World Wide Web 44 Software service and support 44 Hardware service and support 44 IBM Taiwan product service 44 Appendi...

Page 7: ... statement 53 European Union EMC Directive conformance statement 53 Germany Class A statement 54 Japanese VCCI Class A statement 55 Japan Electronics and Information Technology Industries Association JEITA statements 55 Korea Communications Commission KCC statement 55 Russia Electromagnetic Interference EMI Class A statement 56 People s Republic of China Class A electronic emission statement 56 Ta...

Page 8: ...vi Brocade 2 Port 10GbE Converged Network Adapter for IBM BladeCenter Installation and User s Guide ...

Page 9: ...r du installerer dette produkt Lees voordat u dit product installeert eerst de veiligheidsvoorschriften Ennen kuin asennat tämän tuotteen lue turvaohjeet kohdasta Safety Information Avant d installer ce produit lisez les consignes de sécurité Vor der Installation dieses Produkts die Sicherheitshinweise lesen Prima di installare questo prodotto leggere le Informazioni sulla Sicurezza Les sikkerhets...

Page 10: ...ed with a number This number is used to cross reference an English language caution or danger statement with translated versions of the caution or danger statement in the Safety Information document For example if a caution statement is labeled Statement 1 translations for that caution statement are in the Safety Information document under Statement 1 Be sure to read all caution and danger stateme...

Page 11: ... fire water or structural damage Disconnect the attached power cords telecommunications systems networks and modems before you open he device covers unless instructed otherwise in the installation and configuration procedures Connect and disconnect cables as described in the following table when installing moving or opening covers on this product or attached devices To Connect To Disconnect 1 Turn...

Page 12: ... the power source Always replace the blade server cover before installing the blade server This device is intended for use only with UL Listed IBM BladeCenter units United Kingdom telecommunications safety requirement Notice to Customers This apparatus is approved under approval number NS G 1234 J 100003 for indirect connection to public telecommunication systems in the United Kingdom ...

Page 13: ... Notes 1 Unless otherwise stated references to the Brocade 2 Port 10GbE Converged Network Adapter for IBM BladeCenter is also referred to throughout this document as the adapter or expansion card 2 Unless otherwise stated references to the blade server apply to all blade servers that support the I O modules and adapter 3 The illustrations in this document might differ slightly from your hardware 4...

Page 14: ...entation might vary slightly from what is described in this document Notes Any I O modules that are installed in bay 8 and bay 10 of a Multi Switch Interconnect Module for IBM BladeCenter MSIM must support Fibre Channel operation Any I O modules that are installed in bay 7 and bay 9 of an MSIM must support Ethernet operation If you install the adapter into a IBM BladeCenter Storage Expansion Unit ...

Page 15: ...t contain references or links to other companies Web sites also known as non IBM Web sites As of the date of this document the addresses of non IBM Web sites are correct However these addresses might be updated after this document has been published Certain conditions apply to the use of non IBM Web sites For additional information see Appendix C Notices You can find detailed hardware and software...

Page 16: ...ces Thus this adapter is also known as a combo high speed expansion card The adapter uses FCoE to converge standard data and storage networking data onto a shared Ethernet link Both Ethernet and Fibre Channel communications are routed through the CEE ports on the adapter to the BladeSystem midplane and onto I O modules installed in the BladeCenter unit The Brocade 2 Port 10GbE Converged Network Ad...

Page 17: ...ons for installing removing configuring and troubleshooting the adapter This document also contains information about updating the firmware and device drivers for the adapter This document is included on the Documentation CD that comes with the adapter In addition to this Installation and User s Guide the following IBM documents are available to help with the installation configuration and use of ...

Page 18: ...mation Center To access this information complete the following steps 1 Go to http publib boulder ibm com infocenter bladectr documentation index jsp 2 In the Contents pane select Combined IBM Systems Information 3 Select Systems hardware 4 Select BladeCenter information The IBM Documentation CD The IBM Documentation CD contains documentation for your BladeCenter product in Portable Document Forma...

Page 19: ...rch all the documents type a word or word string in the Search field and click Search The documents in which the word or word string appears are listed in order of the most occurrences Click a document to view it and press Crtl F to use the Acrobat search function or press Alt F to use the xpdf search function within the document Click Help for detailed information about using the Documentation Br...

Page 20: ...tems RoHS 6 Storage Management Initiative Specification SMI S Specification supporting the Common Information Model CIM Provider which allows any standard Common Information Model CIM and SMI S based management software to manage installed Brocade adapters NOTE Although SMI S Provider and CIM Provider may be used interchangeably CIM is the more generic term while SMI S is storage specific Switch f...

Page 21: ... single physical port and reduce SAN hardware requirements Boot over SAN This feature provides the ability to boot the host operating system from a boot device located somewhere on the SAN instead of the host s local disk or direct attached storage Specifically this boot device is a logical unit number LUN located on a storage device Fabric based boot LUN discovery a feature that allows the host t...

Page 22: ...CEE Network administrators can change the jumbo packet size from the default setting using host operating system commands as described in the Adapter Configuration appendix in the Brocade Adapters Installation and Reference Manual Note that the MTU size refers to the MTU for network configuration only Internally hardware will always be configured to support FCoE frames that require mini Jumbo size...

Page 23: ...ck or 802 3ad Failover mode provides fault tolerance Only one port in a team is active at a time primary port and the others are in standby mode If the primary port goes down a secondary port is chosen using a round robin algorithm as the next primary This port continues to be primary even if the original primary port returns Failback mode is an extension of the Failover mode In addition to the ev...

Page 24: ...or switch Specific CEE attributes including priorities for FCoE traffic are configured on the FCoE switch These attributes propagate to the adapter CEE port through the DCBCXP adapter firmware processes this information and derives priorities for network traffic The network driver is notified of the network priority and tags both FCoE and Network frames with their priorities Priority based flow co...

Page 25: ... NetQueue Improves performance in 10 GbE virtualized environments Requires MSI X support on host system Adapter specifications Table 2 contains additional specifications for the adapter TABLE 2 Additional adapter specifications Feature Description Port speeds 10 312 Gbps ASIC Provides the FCoE functionality for the Brocade 2 Port 10GbE Converged Network Adapter Two on board processors each operati...

Page 26: ...1 DCBCXP DCBX protocol 1 0 and 1 1 RSS with support for IPV4TCP IPV4 IPV6TCP IPV6 hash types HDS header data split Syslog Jumbo frames Interrupt coalescing Interrupt moderation Network Priority VLAN Discovery using proprietary logic VLAN discovery for untagged priority tagged FIP frames LKA Link Keep Alive protocol Supported FCoE protocols and features preFIP FIP 1 03 and FIP 2 0 FC BB5 rev 2 comp...

Page 27: ...NIC included on the IBM server blades For more information For more information on the Brocade 2 Port 10GbE Converged Network Adapter for IBM BladeCenter refer to the Brocade Adapters Installation and Reference Manual located on the following link http www brocade com sites dotcom services support drivers downloads CNA IBM page See the following chapters and information Introduction chapter This c...

Page 28: ...16 Brocade 2 Port 10GbE Converged Network Adapter for IBM BladeCenter Installation and User s Guide For more information 1 ...

Page 29: ...following devices IBM10Gb Intelligent Pass thru Module for IBM BladeCenter IBM 10Gb Ethernet Switch Blade for IBM BladeCenter NOTE For detailed information about I O modules see the Installation and User s Guide and other documents that come with compatible I O modules The maximum number of adapters that you can install in the BladeCenter unit varies according to the type of BladeCenter unit that ...

Page 30: ...ve devices on page 19 and the safety statements in the BladeCenter unit documentation This information will help you work safely Observe good housekeeping in the area where you are working Place removed covers and other parts in a safe place Blue on a component indicates touch points where you can grip the component to remove it from or install it in the blade server or BladeCenter unit open or cl...

Page 31: ...liability make sure that the following requirements are met Each of the module bays on the rear of the BladeCenter unit contains either a module or a filler module A removed hot swap module is replaced with an identical module or filler module within 1 minute of removal A removed hot swap blade server is replaced with another blade server or filler blade within 1 minute of removal The ventilation ...

Page 32: ... blade server is installed in the BladeCenter unit remove it For instructions see the documentation that comes with your BladeCenter unit 4 Carefully place the blade server on a flat static protective surface 5 Remove the cover from the blade server or storage expansion unit For instructions see the Installation and User s Guide that comes with your blade server or storage expansion unit and the d...

Page 33: ... 12 Make sure that you are using the latest versions of device drivers utilities firmware code and BIOS code for the high speed adapter your blade server the management module and the I O modules that are used by the high speed adapter If these items are not current the BladeCenter unit might not recognize the high speed adapter and might not turn it on If necessary install the latest versions of ...

Page 34: ...mmand session with the blade server Removing the high speed adapter from a blade server To remove the high speed adapter from a blade server or storage expansion unit complete the following steps 1 Read the safety information that begins on page vii and Installation guidelines on page 18 2 Turn off the blade server if you have not already done so 3 If the blade server is installed in the BladeCent...

Page 35: ...n page 21 If you are not replacing the high speed adapter continue with step 8 8 Reinstall the cover on the blade server or storage expansion unit For instructions see the Installation and User s Guide that comes with your blade server or storage expansion unit and the documentation that comes with your BladeCenter unit 9 Reinstall the blade server in the BladeCenter unit For instructions see the ...

Page 36: ...24 Brocade 2 Port 10GbE Converged Network Adapter for IBM BladeCenter Installation and User s Guide Removing the high speed adapter from a blade server 2 ...

Page 37: ...s and additional documentation for the Brocade 2 Port 10Gb Converged Network Adapter go to the following location http www brocade com sites dotcom services support drivers downloads CNA IBM page Installing the device drivers and HCM The Brocade 2 Port 10Gb Converged Network Adapter for IBM BladeCenter requires installation of both the storage FC FCoE and the network Ethernet NIC driver Both of th...

Page 38: ... a host system with a large number of adapters could take much longer than normal On Linux SLES 10 and 11 systems when installing the source based driver packages brocade_driver_linux_ version tar gz or when using the Brocade Adapter Software Installer and the kernel has been upgraded to a version without pre compiled binaries perform the following tasks to make sure the drivers will load on syste...

Page 39: ...n a GUI based application Installing software with the Brocade Adapter Software Installer automatically starts the HCM Agent Installing software Use these steps to install software using the GUI based BASI application 1 Obtain software from the following location http www brocade com sites dotcom services support drivers downloads CNA IBM page Download the appropriate Brocade Adapter Software Inst...

Page 40: ...he message box The Choose Install Set screen displays 8 Select which software you want to install then click Next 9 If the Choose Install Folder screen displays prompting you to choose a destination folder for the software select either of the following options If this screen does not display go on to step 10 Enter a location for installing the software Select Choose to browse to a location on you...

Page 41: ...with the driver packages However whenever you update drivers you should also update with the latest boot code image The latest boot code image and additional documentation for supported operating systems are provided at the following location http www brocade com sites dotcom services support drivers downloads CNA IBM page You can update boot code using BCU commands or HCM For instructions to inst...

Page 42: ...30 Brocade 2 Port 10GbE Converged Network Adapter for IBM BladeCenter Installation and User s Guide Customizing the configuration of the high speed adapter 3 ...

Page 43: ...xpansion Card CFFh for IBM BladeCenter you can use the following tools Brocade BIOS Configuration Utility Brocade Host Connectivity Manager HCM Brocade Command Line Utility BCU Other networking tools for Windows Linux and VMware Brocade BIOS Configuration Utility The Brocade BIOS Configuration Utility allows you to perform the following operations on selected adapters Enable or disable BIOS to sup...

Page 44: ...ns on local and remote host systems The Brocade Command Line Utility BCU which loads with the driver package provides commands that perform comparable functions on a local host system These functions include the following Discovery using the agent software running on the servers attached to the SAN which enables you to contact the devices in your SAN Configuration management which enables you to c...

Page 45: ...er s information and the Advanced tab to set specific parameters including jumbo packet size flow control autorecovery and more To open the Windows Device Manager 1 Run the devmgmt msc command to open the Device Manager window 2 Expand Network Adapters An instance of the adapter model should display for each installed adapter port 3 Right click an adapter instance and select Properties 4 Select th...

Page 46: ... ethtool to enable or disable interrupt moderation VM Client interface to enable or disable NetQueue For VMware you can list all module parameters that you can configure for the network driver using the vmkload_mod s bna command For more information on how use these tools refer to the Brocade Adapters Installation and Reference Manual and help documentation in the VMware environments ...

Page 47: ...able 4 are Tier 1 CRUs If other BladeCenter components require replacement see the following documentation that comes with these devices Problem Determination and Service Guide Installation and User s Guide Notes 1 The latest versions of these documents are at http www ibm com systems support 2 Cables are not required for the Brocade 2 Port 10Gb Converged Network Expansion Card CFFh If you must in...

Page 48: ...36 Brocade 2 Port 10GbE Converged Network Adapter for IBM BladeCenter Installation and User s Guide Parts listing 5 ...

Page 49: ... BIOS code for the following devices If these items are not at the latest levels the BladeCenter unit might not recognize one or more of the following devices and the BladeCenter unit or these devices might not be able to start The high speed adapters in the BladeCenter unit and in the blade servers The blade servers The management module The I O modules and controller that are used by the high sp...

Page 50: ...em is caused by the hardware perform the following tasks Before you begin your system hardware installation activities make sure that you have all the hardware devices that are required to support the system configuration that you plan to use Include the following preinstallation requirements For additional information see the documentation that comes with the devices that you are using Make sure ...

Page 51: ...combinations in the BladeCenter unit Make sure that all peripheral devices are correctly connected to the I O modules turned on and operating correctly Notes 1 For additional information see the documentation that comes with the peripheral devices 2 If the high speed adapter is installed in a supported BladeCenter blade server see the documentation that comes with the blade server for information ...

Page 52: ...determine whether the system board in the blade server requires a special configuration To determine whether the system board requires a special configuration see the documentation that comes with your BladeCenter unit and blade server or contact your IBM technical support representative Note For additional information about configuration requirements see the documentation that comes with your Bla...

Page 53: ...ule in case one I O module fails Both I O modules must be of the same type in the previously specified I O module bay combinations in the BladeCenter unit Make sure that the blade server is turned on Make sure that the BladeCenter expansion card settings are the correct values If the adapter is installed in a blade server that supports the video function see Using HCM and BCU on page 32 If the ada...

Page 54: ...42 Brocade 2 Port 10GbE Converged Network Adapter for IBM BladeCenter Installation and User s Guide Fibre Channel device problems 6 ...

Page 55: ...out outside assistance by following the troubleshooting procedures that IBM provides in the online help or in the documentation that is provided with your IBM product The documentation that comes with IBM systems also describes the diagnostic tests that you can perform Most systems operating systems and programs come with documentation that contains troubleshooting procedures and explanations of e...

Page 56: ...workstations and appliances For information about which products are supported by Support Line in your country or region see http www ibm com services sl products For more information about Support Line and other IBM services see http www ibm com services or see http www ibm com planetwide for support telephone numbers In the U S and Canada call 1 800 IBM SERV 1 800 426 7378 Hardware service and s...

Page 57: ...ed targets Review adapter properties such as the following Port speed PWWN NWWN BIOS version You can also perform many of these tasks using the Host Connectivity Manager HCM and Brocade Command Line Utility BCU commands For information on these tools as well as details on adapter boot support updating boot code configuring boot over SAN and configuring fabric based boot LUN discovery refer to the ...

Page 58: ...maximum of 8 ports can display on a screen Select Page Up to go to a previous screen or Page Down to go to the next screen 2 Select a port that you want to configure A screen similar to the following displays In the following example port 0 on the Brocade 1020 adapter was selected 3 Select one of the following Adapter Settings Use the Adapter Settings screen to enable BIOS port speed HBAs only and...

Page 59: ...t over SAN If this setting is set to Disable the system will not boot from the Fibre Channel disk drives that are connected to the selected adapter port NOTE The default setting for all adapter ports is enabled BIOS Version Displays the Brocade BIOS boot code version installed on the card Boot LUN Auto Discover When enabled LUN information such as the location of the boot LUN is provided by the fa...

Page 60: ...ure boot devices select Boot Device Settings from the initial menu screen for the adapter port step 3 and press Enter to designate a discovered LUN as a boot device A list of up to four boot devices display showing the PWWN of the storage port and the LUN number designated as a boot LUN The first device listed is the primary boot device The host first tries to boot from the primary device then the...

Page 61: ... PWWN and LUN values for the boot device Press M to exit Select a device and press Enter This displays additional screens that allow you to select discovered LUNs as boot devices If you select a device under Boot Device Settings and press Enter a screen similar to the following displays listing all discovered boot targets 8 Select a target on which you want to designate a boot LUN and press Enter ...

Page 62: ...apter port using the storage system s management or configuration utility NOTE You only need to select the bootable LUN once After the first boot the same LUN will be used until changed through the BIOS Configuration Utility 10 Press Enter The selected device will be added to the list of boot devices for the adapter 11 Save or exit the configuration utility To save the configuration press the Alt ...

Page 63: ...allow disclaimer of expressed or implied warranties in certain transactions therefore this statement may not apply to you This information could include technical inaccuracies or typographical errors Changes are periodically made to the information herein these changes will be incorporated in new editions of the publication IBM may make improvements and or changes in the product s and or the progr...

Page 64: ...croprocessor other factors also affect application performance CD or DVD drive speed is the variable read rate Actual speeds vary and are often less than the possible maximum When referring to processor storage real and virtual storage or channel volume KB stands for 1024 bytes MB stands for 1 048 576 bytes and GB stands for 1 073 741 824 bytes When referring to hard disk drive capacity or communi...

Page 65: ...quipment This device complies with Part 15 of the FCC Rules Operation is subject to the following two conditions 1 this device may not cause harmful interference and 2 this device must accept any interference received including interference that may cause undesired operation Industry Canada Class A emission compliance statement This Class A digital apparatus complies with Canadian ICES 003 Avis de...

Page 66: ...e Einhaltung der Schutzanforderungen wenn das Produkt ohne Zustimmung der IBM verändert bzw wenn Erweiterungskomponenten von Fremdherstellern ohne Empfehlung der IBM gesteckt eingebaut werden EN 55022 Klasse A Geräte müssen mit folgendem Warnhinweis versehen werden Warnung Dieses ist eine Einrichtung der Klasse A Diese Einrichtung kann im Wohnbereich Funk Störungen verursachen in diesem Fall kann ...

Page 67: ...luntary Control Council for Interference VCCI If this equipment is used in a domestic environment radio interference may occur in which case the user may be required to take corrective actions Japan Electronics and Information Technology Industries Association JEITA statements Japanese Electronics and Information Technology Industries Association JEITA Confirmed Harmonics Guideline products less t...

Page 68: ...n mistakenly sold or purchased please exchange it for equipment certified for home use Please note that this equipment has obtained EMC registration for commercial use In the event that it has been mistakenly sold or purchased please exchange it for equipment certified for home use Russia Electromagnetic Interference EMI Class A statement People s Republic of China Class A electronic emission stat...

Page 69: ...31 determine version 45 enable boot options 45 enable or disable boot over SAN 45 select boot LUNs 45 support 8 BIOS configuration utility 45 field descriptions 47 information 32 blade server configuration requirements 40 support for adapter 3 BladeCenter compatibility 1 documentation 18 35 documentation CD 6 firmware and documentation updates 2 H I O module bays 2 I O module information 18 IBM we...

Page 70: ...ission selection 10 Ethernet flow control 11 European Union EMC directive 53 F FCC statement 53 FCoE features 9 FC SP 9 features of adapter 8 FIP support 9 flow control 12 G Germany Class A statement 54 guidelines adapter installation 18 handling static sensitive devices 19 system reliability 19 H handling static sensitive devices 19 header data split 11 help and information from world wide web 44...

Page 71: ...erface 8 Peoples Republic of China Class A statement 56 persistent binding 9 port throughput 9 priority based flow control 12 product description 1 4 product information recording 4 protocols supported by adapter 13 R receive side scaling RSS 12 removing adapter from blade server 22 replaceable BladeCenter components 35 RoHS 6 8 Russia EMI Class A statement 56 S safety information vii server produ...

Page 72: ...heral devices correctly connected 39 U United Kingdom telecommunications notice x upgrading device drivers firmware and BIOS code for BladeCenter components 19 V virtual function level statistics 12 VLAN 12 VLAN filtering and tagging 13 VMware networking tools 34 W web site adapter blade server support 3 adapter Installation and Reference Manual 15 blade server support for adapter 3 BladeCenter an...

Page 73: ......

Page 74: ...Part Number 60Y1589 Printed in USA P N 60Y1589 60Y1589 ...