Dell SwitchX M4001F, User Manual

Page 1: ...www mellanox com Third party information brought to you courtesy of Dell SwitchX InfiniBand Blade Switch I O Module for PowerEdge M Series User Manual PN M4001F M4001T M4001Q Rev 1 2 ...

Page 2: ...D SOLELY FOR THE PURPOSE OF AIDING THE CUSTOMER IN TESTING APPLICATIONS THAT USE THE PRODUCTS IN DESIGNATED SOLUTIONS THE CUS TOMER S MANUFACTURING TEST ENVIRONMENT HAS NOT MET THE STANDARDS SET BY MELLANOX TECHNOLOGIES TO FULLY QUALIFY THE PRODUCTO S AND OR THE SYSTEM USING IT THEREFORE MELLANOX TECHNOLOGIES CAN NOT AND DOES NOT GUARANTEE OR WARRANT THAT THE PRODUCTS WILL OPERATE WITH THE HIGHEST...

Page 3: ... Module Blank From the Chassis 14 2 2 3 Installing the Mellanox M4001 F T Q Switch Into the Dell Chassis 14 2 3 Power Connections and Initial Power On 14 2 4 InfiniBand Cable Installation 14 2 4 1 Supported Approved Cables 15 Chapter 3 Cluster Management and Firmware 16 3 1 Network Management and Clustering Software 16 3 2 Updating Firmware 16 3 2 1 Instructions for Reprogramming Over the InfiniBa...

Page 4: ...Technologies 4 Revision History Table 1 Revision History Table Date Revision Description June 2012 1 2 Added graphics to section 2 4 Added section2 4 1 May 2012 1 1 Added M4001T switch November 2011 1 0 Initial release ...

Page 5: ...Resources Mellanox Technologies Web pages http www mellanox com Dell Support Web pages http support dell com Conventions Throughout this manual the names M4001F M4001T and M4001Q and the terms switch I O module and IOM are used to describe the M4001F FDR M4001T FDR10 and the M4001Q QDR InfiniBand blade switch I O modules unless explicitly indicated otherwise Table 2 Reference Documents InfiniBand ...

Page 6: ...t to the user This symbol makes recommendations to the user This symbol indicates information that is helpful to the user This symbol indicates a situation that can potentially cause damage to hardware or software BEWARE This symbol indicates a situation that can potentially cause personal injury or damage to hardware or software ...

Page 7: ...I O module comes pre installed with all necessary firmware and configured for standard operation within an InfiniBand fabric and only requires an InfiniBand compliant Subnet Manager running from one of the hosts All that is required for normal operation is to follow the usual pre cautions for installation and connection from the switch to the HCAs or other switches Once con nected the Subnet Manag...

Page 8: ...h the Midplane Connector out of the back of the switch Figure 1 shows the front 16 ports Each of the InfiniBand ports has two LEDs located between the connectors and the I2C interface The green LED when lit indicates that a valid physical connection to the other system switch or HCA port exists See Figure 2 Physical and Logical Link Indication LEDs for more details Locking Mechanism Switch Status ...

Page 9: ...ns LED Switch Status Indication Green Status OFF OFF OFF ON OFF Boot in Progress Switch not ready LED Name Connection Status Physical Link Green Off No Physical Link ON Physical Link Data Activity Yellow Blinking indicates Data Transfer Constant on indicates Link exists with no Data Transfer taking place Off with green LED lit indicates that the Subnet Manager may not be running The IO Module is o...

Page 10: ...er is MTUSB 1 These switches are Plug and Play and all firmware updates should be done in band The I2C con nection should only be used if the FW image was corrupted to the point that the regular FW tools cannot successfully reburn the correct image Blinking Blue ON BLINKING BLUE The CMC is identifying the newly installed switch ON ON BLUE Switch is on and operating Normally ON ON or BLINKING AMBER...

Page 11: ...nings sub section carefully before carrying on with installation procedures 2 1 Installation Safety Warnings 1 Installation Instructions 2 Over temperature 3 Stacking the Chassis 4 During Lightning Electrical Hazard Suitable electrical mechanical and fire enclosure shall be provided by the end user Read all installation instructions before connecting the equipment to the power source This equipmen...

Page 12: ...he rack and a cable management system Refer to the cable manufacturer for special warnings and instructions When this product is mounted or serviced in a rack special precautions must be taken to ensure that the system remains stable In general you should fill the rack with equip ment starting from the bottom to the top This equipment should be installed replaced or serviced only by trained and qu...

Page 13: ...2 or B2 2 2 1 Removing an Old Switch From the Chassis 1 Remove any locking cables or screws that secure the old switch into the chassis 2 Disconnect all of the InfiniBand cables from the front of the switch to be removed 3 Unlock the switch from the chassis by pushing the red latch release button 4 Pull the locking arm down to a position perpendicular to the front of the chassis 5 Pull the switch ...

Page 14: ... I O module will automatically power up when AC power is applied There is no power switch Immediately upon closing the latching mechanism check to make sure that the green switch LED is lit 2 4 InfiniBand Cable Installation All cables can be inserted or removed with the unit powered on To insert a cable press the con nector into the port receptacle until the connector is firmly seated The green LE...

Page 15: ...receptacle Both LED indicators will turn off when the cable is unseated Care should be taken not to impede the air exhaust flow through the chassis 2 4 1 Supported Approved Cables For a list of all approved cables see www mellanox com related docs user_manuals Mellanox_approved_cables pdf Cables in theBelly to Belly right side should be inserted up side down in relation to the how the cables are i...

Page 16: ... configuration network administration and diagnostic tools for network management 3 2 Updating Firmware The switch is delivered with the latest Firmware available at the time of production New firmware versions will be posted on the Mellanox firmware download page Firmware can be updated in band using the Mellanox Firmware Tools MFT You will need the Mellanox Firmware Tools package available in ML...

Page 17: ...replace the switch The link LED for the InfiniBand connector does not come on 1 Check that both ends of the cable are connected 2 Check that the locks on the ends are secured 3 Make sure that the latest FW version is installed on both the Mezzanine I O card and the switch 4 Make sure that at least one blade has a matching Mezzanine I O card installed to support data flow 5 If media adapters are us...

Page 18: ...e connectors Typ Power FDR Passive Active FDR10 Passive Active QDR Passive Active Max Power FDR Passive Active FDR10 Passive Active QDR Passive Active Dissipated Power Power through connector Temperature Humidity 80 66W or 275 22BTUs hr 108 26W or 369 40BTUs hr 60 42W or 206 16BTUs hr 88 02W or 300 34BTUs hr 60 42W or 206 16BTUs hr 88 02W or 300 34BTUs hr 84 46W or 288 19BTUs hr 112 06 or 382 36BT...

Page 19: ...and Management Safety EMC ENVIRONMEN TAL US Canada cTUVus EU IEC60950 International CB TUV Bauart USA FCC Class A Canada ICES Class A EU CE Mark EN55022 Class A EN55024 EN61000 3 2 EN61000 3 3 Japan VCCI Class A Korea RRL MIC Class A Australia New Zealand C Tick Class A EU IEC 60068 2 64 Random Vibration EU IEC 60068 2 29 Shocks Type I II EU IEC 60068 2 32 Fall Test Scalability and Performance Swi...

Page 20: ...ommercial environment This equipment generates uses and can radiate radio frequency energy and if not installed and used in accordance with the instruc tion manual may cause harmful interference to radio communications Operation of this equipment in a residential area is likely to cause harmful interference in which case the user will be required to correct the interference at his own expense Appe...

Page 21: ...a s Regulation for Certification of Information and Communication Equipment requires EMC testing and certification for many electronic products Korean EMC certifications are issued by Radio Research Laboratory RRL which is organized under the Ministry of Information and Com munications MIC EMC testing includes electromagnetic emissions EMI and susceptibility EMS Certified equipment is labeled with...

Page 22: ...etL Module Reset 10 Vcc Rx 3 3 V Power supply receiver 11 SCL 2 wire serial interface clock 12 SDA 2 wire serial interface data 13 GND Ground 14 Rx3p Receiver Non Inverted Data Output 15 Rx3n Receiver Inverted Data Output 16 GND Ground 17 Rx1p Receiver Non Inverted Data Output 18 Rx1n Receiver Inverted Data Output 19 GND Ground 20 GND Ground 21 Rx2n Receiver Inverted Data Output 3 22 Rx2p Receiver...

Page 23: ...2 3 4 5 6 7 8 9 2 2 2 2 2 2 2 2 2 1 2 3 4 5 6 7 8 3 3 3 3 3 3 3 3 RX4p GND GND GND RX4n RX2p RX2n TX1n GND TX1p GND TX3n TX3p GND IntL ModPrsL VccTx Vcc1 LPMode 18 35 8 50 Top ResetL SDA SCL ModSelL RX3p TX2n GND VccRx 1 2 3 4 5 6 7 8 9 1 0 1 2 3 4 5 6 7 8 9 TX2p GND TX4n TX4p GND 1 1 1 1 1 1 1 1 1 1 20 GND GND GND RX3n RX1p RX1n 30 RX4p GND GND GND RX4n RX2p RX2n TX1n GND TX1p GND TX3n TX3p GND I...

Page 24: ...oit pas être empilé sur un autre matériel Si le châssis tombe il peut provoquer des blessures corporelles et des dégradations de biens Pendant un orage il ne faut pas utiliser le matériel et il ne faut pas brancher ou débrancher les câbles Les câbles InfiniBand en cuivre sont lourds et ne sont pas flexibles il faut donc faire très attention en les branchant et en les débranchant des connecteurs Co...

Page 25: ...d Blade Switch I O Module for PowerEdge M Series Rev 1 2 Mellanox Technologies 25 9 Codes électriques locaux et nationaux Ce matériel doit être installé dans le respect des codes électriques locaux et nationaux ...

Page 26: ... auf andere Geräte gestapelt werden Wenn das Chassis herunterfällt kann es zu Verletzungen und Beschädigungen an Geräten führen Arbeiten Sie während eines Gewitters und Blitzschlag nicht am Gerät schließen Sie keine Kabel an oder ab InfiniBand Kupferkabel sind schwer und nicht flexible Deshalb müssen sie vorsichtig an die Anschlüsse angebracht bzw davon getrennt werden Lesen Sie die speziellen War...

Page 27: ... O Module for PowerEdge M Series Rev 1 2 Mellanox Technologies 27 9 Regionale und nationale elektrische Bestimmungen Dieses Gerät sollte unter Beachtung der regionalen und nationalen elektrischen Bestimmungen installiert werden ...