Mellanox Technologies MNPH18-XTC, User Manual

Page 1: ...Mellanox Technologies ConnectX EN Dual Port Ethernet Network Interface Cards with SFP Connectors User s Manual P N MNPH18 XTC MNPH28B XTC MNPH28B XSC MNPH29B XTC MNPH29B XSC Rev 1 4 ...

Page 2: ...All other marks and names mentioned herein may be trademarks of their respective companies ConnectX EN Dual Port Ethernet Adapter Cards with SFP Connectors User s Manual Document Number 2943 2900 Stender Way Santa Clara CA 95054 U S A www mellanox com Tel 408 970 3400 Fax 408 970 3403 Mellanox Technologies Ltd PO Box 586 Hermon Building Yokneam 20692 Israel Tel 972 4 909 7200 Fax 972 4 959 3245 ...

Page 3: ...faces 18 4 2 I2C Compatible Interface 19 4 3 Power 19 4 4 Memory 19 4 5 VPDs 20 Chapter 5 SFP Transceiver Module 22 Chapter 6 Connectivity 22 Appendix A Specifications 23 A 1 Board Mechanical Drawing and Dimensions 23 A 2 EMC Certification Statements 23 A 3 MNPH28B XTCSpecifications 26 A 4 MNPH28B XSCSpecifications 27 A 5 MNPH29B XTCSpecifications 28 A 6 MNPH29B XSCSpecifications 29 Appendix B Int...

Page 4: ...s 13 Table 6 Jumper Configuration 19 Table 7 VPD layout for MNPH28B X ST C 20 Table 8 VPD Layout for MNPH29B X ST C 21 Table 9 Max Cable Lengths 22 Table 10 Adapter Cards EMC Certification Status 23 Table 11 Specifications for MNPH28B XTC 26 Table 12 Specifications for MNPH28B XSC 27 Table 13 Specifications for MNPH29B XTC 28 Table 14 Specifications for MNPH29B XSC 29 Table 15 I2C Compatible Conne...

Page 5: ...ure 5 SFP Transceiver Module 22 Figure 6 Schematic of the Ethernet NIC With 10GBASE SR SFP Connectors 23 Figure 7 I2C Compatible Connector 30 Figure 8 SFP Connector Pinout 30 Figure 9 SFP Module and Cage Pinout Configuration 31 Figure 10 Adapter Card 33 Figure 11 Adapter card With Bracket Removed 33 Figure 12 Placing the Bracket on the Card 34 Figure 13 Module With Locking Mechanism Closed 35 Figu...

Page 6: ...ber 2008 1 4 Fixed typo in Specifications tables August 2008 1 3 Added EMC and Safety Certs for MNPH28 XSC MNPH29 XTC and MNPH29 XSC August 2008 1 2 Added EMC and Safety Certs August 2008 1 1 Added Safety warnings in German added hazardous radiation warning Added Driver software and Firmware sections 3 2 3 3 and 3 4 August 2008 1 0 Initial release ...

Page 7: ...wnloads Mellanox Technologies Document Distribution System DDS http docs mellanox com requires a customer login account Document Conventions When discussing memory sizes MB and MBytes are used in this document to mean size in mega bytes The use of Mb or Mbits small b indicates size in mega bits ConnectX EN MTNIC PRM Document Number DOC18348 Reference describing the interface used by developers to ...

Page 8: ...d in this manual have the following main fea tures IEEE 802 3ae compliant Two 10GBASE SR or 10GBASE LR optical ports for connecting Ethernet traffic Supports 10GBASE CR Twinax copper cables PCI Express 2 0 1 1 compatible through an x8 edge connector up to 5GT s EU Restriction of Hazardous Substances RoHS compliant The cards differ in Bracket height short or tall PCI Express 2 0 with SerDes speed 2...

Page 9: ...IC Part Number NIC Photo MNPH18B XSC 2 5 PCIe Gen1 10 10 Gb s 1 ports Short RoHS R5 with exemption MT25408A0 FCC SE MNPH28B XSC 2 5 PCIe Gen1 10 10 Gb s 2 ports Short RoHS R5 with exemption MT25408A0 FCC SE MNPH28B XTC 2 5 PCIe Gen1 10 10 Gb s 2 ports Tall RoHS R5 with exemption MT25408A0 FCC SE MNPH19B XSC 5 0 PCIe Gen2 10 10 Gb s 1 ports Short RoHS R5 with exemption MT25408A0 FCC TE MNPH29B XSC ...

Page 10: ...urchased separately from Mellanox Technologies The Ordering Part Numbers for the Mellanox SFP optical modules are shown in the table below Note SR and LR modules not recommended by Mellanox may not work with the adapter Figure 1 SFP Optical Module Spec Model number Module 10GBASE SR MFM1T02A SR 10GBASE LR MFM1T02A LRM ...

Page 11: ...X X to indicate no on board memory field B T to indicate a tall bracket and field R C to indicate RoHS R5 w Exemptions compliance 1 3 Finding the Mac Address and Serial Number on the Adapter Card All Mellanox Ethernet NICs have a label on the printed side of the adapter card that has the card serial number and the card MAC address Table 2 Mellanox Adapter Cards Part Numbering Key Adapter Card OPN ...

Page 12: ...12 Rev 1 4 Mellanox Technologies Figure 2 Product Label Serial number MAC address ...

Page 13: ...dapter card will not provide the optimum data transfer Table 3 Hardware and Software Requirements Requirement Description Hardware Minimum 3 GB of available space PCI Express x8 or x16 slots Firmware and Software Operating Systems Distributions For the latest firmware available please check http www mellanox com support firmware_download php Management Tools and Drivers Mellanox management tools c...

Page 14: ...ntee proper air flow allow at least 8cm 3 inches of clearance around the ventilation openings During periods of lightning activity do not work on the equipment or connect or dis connect cables This equipment should be installed replaced or serviced only by trained and qualified personnel Disposal of this equipment should be in accordance to all national laws and regula tions This equipment should ...

Page 15: ...nox website http www mellanox com products software php 2 Install the driver tar xzf mlnx_en X X tgz cd mlnx_en X X install sh The driver installation procedure performs the following Uninstalls previous version of mlnx_en or mtnic driver Builds and installs driver kernel modules Copies all files to tmp mlnx_en src Applies backport patches for particular kernel OS Runs make to generate mlx4_core k...

Page 16: ...e is updated occasionally and the most recent firmware can be obtained from http www mellanox com through the Firmware downloads link or you can download the latest firmware at http www mellanox com support firmware_table_ConnectXEN php 3 2 2 Single Adapter Card Firmware Update Firmware can be updated on the stand alone single card using the flint tool of the Mellanox Firmware Tools MFT package Th...

Page 17: ...er s Manual 17 Rev 1 4 Mellanox Technologies 3 Choose FW image matching you card OPN PSID 4 Burn latest FW mstflint d lspci grep Ethernet controller Mellanox cut f1 d i FW image b Where FW image is a binary file for example fw 25408 2_5_000 MNEH28 XTC_A1 bin 5 Reboot the server ...

Page 18: ... is the logical link The yellow LED illuminates when the network is discovered over the physical link A valid data activity link without data transfer is designated by a constant yellow LED indication A valid data activity link with data transfer is designated by a blinking yellow LED indication If the LEDs are not active either the physical link or the logical link or both connections have not be...

Page 19: ... information and packet data on the system memory 4 4 2 Flash Each of the NICs includes one 2MB SPI Flash device P N M25P16 VME6G by ST Microelectronics accessible via the Flash interface of the MT25408 ConnectX EN device There is a jumper on each adapter card that indicates to the device whether an on board Flash device exists or is to be used Table 4 provides information on this jumper See Figur...

Page 20: ...rt Number 22 Length 0x15 23 PN PN STR_SPC 44 VPD Keyword EC STR Engineering Change Level of the card rev 46 Length 0x2 47 Revision RV STR PCB revision 49 VPD Keyword SN STR Serial Number 51 Length 0x18 52 SerialNumber STR_SPC 00 00XXXX XX 76 VPD Keyword V0 STR Misc Information 78 Length 0x10 79 Data PCIe x8 STR_SPC 95 VPD Keyword RV STR 97 Length 0x1 98 Data 0 97 CS0 99 Large Resource Type VPD W T...

Page 21: ...SPC 44 VPD Keyword EC STR Engineering Change Level of the card rev 46 Length 0x2 47 Revision RV STR PCB revision 49 VPD Keyword SN STR Serial Number 51 Length 0x18 52 SerialNumber STR_SPC 00 00XXXX XX 76 VPD Keyword V0 STR Misc Information 78 Length 0x10 79 Data PCIe Gen2 x8 STR_SPC 95 VPD Keyword RV STR 97 Length 0x1 98 Data 0 97 CS0 99 Large Resource Type VPD W Tag 0x11 0x91 100 Length 7 0 LSB 0...

Page 22: ...iver Module 6 Connectivity This adapter card can be connected to switches and routers using cable lengths as specified in the table below This adapter card can be connected to switches and routers using up to 100meters of OM 2 or 300meters of OM 3 multi mode fiber cable with duplex LC connectors connected through XFP Transceiver modules These cards are able to support Twinax cables Check with your...

Page 23: ...Certification Statements Table 1 lists the approved EMC certification status per adapter card in different regions of the world Table 1 Adapter Cards EMC Certification Status Adapter Card P N FCC Class USA EN Class Europe ICES Class Canada VCCI Japan Australia New Zealand MNPH28B XSC Class A Class A Class A Class A Class A MNPH28B XTC Class A Class A Class A Class A Class A MNPH29B XSC Class A Cla...

Page 24: ...s equipment generates uses and can radiate radio frequency energy and if not installed and used in accordance with the instruction manual may cause harmful inter ference to radio communications Operation of this equipment in a residential area is likely to cause harmful interfer ence in which case the user will be required to correct the interference at his own expense A 2 3 EN Statements Europe E...

Page 25: ...sed on the standard of the Voluntary Control Council for Interference by Information Technology Equipment VCCI If this equipment is used in a domestic environment radio interference may occur in which case the user may be required to take corrective actions A 2 6 CLASS 1 LASER PRODUCT This product complies with all of the following standards IEC 60 825 1 1993 A1 1997 A2 2001 EN 60825 1 1994 A1 199...

Page 26: ...ernet IEEE Std 802 3ae 10 GBASE SR Multicast and Jumbo Frame Support 4X 3 125Gb s 8 Virtual Lanes for each port Dual Yes 2 0 SerDes 2 5 GT s EMC Safety EMI Environmental RoHS FCC 47 CFR part 15 2007 subpart B class A ICES 003 2004 issue 4 class A VCCI V 3 2008 04 class A AS NZ CISPR 22 2006 class A EN 55022 1998 A1 2000 A2 2003 class A EN 55024 1998 A1 2001 A2 2003 EN 61000 3 2 2006 EN 61000 3 3 1...

Page 27: ...t PCI Express IEEE Std 802 3ae 10 Gigabit Ethernet IEEE Std 802 3ae 10 GBASE SR Multicast and Jumbo Frame Support 4X 3 125Gb s 8 Virtual Lanes for each port Dual Yes 2 0 SerDes 2 5 GT s EMC Safety EMI Environmental RoHS FCC 47 CFR part 15 2007 subpart B class A ICES 003 2004 issue 4 class A VCCI V 3 2008 04 class A AS NZ CISPR 22 2006 class A EN 55022 1998 A1 2000 A2 2003 class A EN 55024 1998 A1 ...

Page 28: ...hernet IEEE Std 802 3ae 10 GBASE SR Multicast and Jumbo Frame Support 4X 3 125Gb s 8 Virtual Lanes for each port Dual Yes 2 0 SerDes 2 5 GT s EMC Safety EMI Environmental RoHS FCC 47 CFR part 15 2007 subpart B class A ICES 003 2004 issue 4 class A VCCI V 3 2008 04 class A AS NZ CISPR 22 2006 class A EN 55022 1998 A1 2000 A2 2003 class A EN 55024 1998 A1 2001 A2 2003 EN 61000 3 2 2006 EN 61000 3 3 ...

Page 29: ...rt PCI Express IEEE Std 802 3ae 10 Gigabit Ethernet IEEE Std 802 3ae 10 GBASE SR Multicast and Jumbo Frame Support 4X 3 125Gb s 8 Virtual Lanes for each port Dual Yes 2 0 SerDes 2 5 GT s EMC Safety EMI Environmental RoHS FCC 47 CFR part 15 2007 subpart B class A ICES 003 2004 issue 4 class A VCCI V 3 2008 04 class A AS NZ CISPR 22 2006 class A EN 55022 1998 A1 2000 A2 2003 class A EN 55024 1998 A1...

Page 30: ...Connector Pin Number Adapter Card Signal Name 1 SPSDA 2 SPSCL 3 GND 4 NC 5 NC VEER VEER VEER VEET VEET VEET RD RD VCCR VCCT TD TD RX_LOS RS1 TX_FAULT TX_DISABLE SDA SCL MOD_ABS RS0 1 2 3 4 5 6 7 8 9 0 1 1 2 3 4 5 6 7 8 9 0 1 1 1 1 1 1 1 1 1 2 1 2 3 4 5 6 7 8 9 0 1 1 2 3 4 5 6 7 8 9 0 1 1 1 1 1 1 1 1 1 2 GND GND GND GND GND GND GND GND GND GND GND GND GND GND GND GND GND GND GND GND G G G G G G G G...

Page 31: ...ation 13 70 8 50 Top VeeT VeeT VeeT TX_Fault TX_Disable SDA SCL MOD_ABS RS0 RX_LOS RS1 VeeR VeeR VeeR VccT VccR TD TD RD RD 1 2 3 4 5 6 7 8 9 1 2 3 4 5 6 7 8 9 0 1 1 1 1 1 1 1 1 1 2 10 VeeT VeeT VeeT TX_Fault TX_Disable SDA SCL MOD_ABS RS0 RX_LOS RS1 VeeR VeeR VeeR VccT VccR TD TD RD RD 1 2 3 4 5 6 7 8 9 1 2 3 4 5 6 7 8 9 0 1 1 1 1 1 1 1 1 1 2 10 SFP Cage SFP Module ...

Page 32: ...Name Connector 2 1 VEET GND GND 2 TX_FAULT TX_FAULT_A TX_FAULT_B 3 TX_DISABLE TXDISABLE_A TXDISABLE_B 4 SDA SFP_SDA_A SFP_SDA_B 5 SCL SFP_SCL_A SFP_SCL_B 6 MOD_ABS MOD_DEF0_A MOD_DEF0_B 7 RS0 RS0_A RS0_B 8 RX_LOS RXLOSB_I_A RXLOSB_I_B 9 RS1 RS1_A RS1_B 10 VEER GND GND 11 VEER GND GND 12 RD SFPA_RD N SFPB_RD N 13 RD SFPA_RD P SFPB_RD P 14 VEER GND GND 15 VCCR SFPP_VCCR_A SFPP_VCCR_B 16 VCCT SFPP_VC...

Page 33: ...bracket the 2 fiber washers saved from the removal of the bracket C 1 1 Remove the Existing Bracket from the Adapter Card Figure 1 Adapter Card 1 Remove the two screws holding the bracket in place 2 Simultaneously push on both ends of the bracket until the bracket comes loose from the card Note Be careful not to put stress on the LEDs 3 Save the two screws and the two fiber washers Figure 2 Adapte...

Page 34: ...nto the card You may have to gently push the LEDs using a small screw driver to align the LEDs with the holes in the bracket 5 Take the screws and washers saved from Step 1 Place the screws and washers into the holes and screw them in snug Figure 3 Placing the Bracket on the Card 6 Make sure that the LEDs are aligned onto the bracket holes 7 Use a torque driver to apply up to 2 lbs in torque on th...

Page 35: ... the male connectors on the module will align with the female connectors inside of the cage Also check that there is no dirt or foreign matter in the module or in the cage Figure 4 Module With Locking Mechanism Closed Figure 5 Module With Locking Mechanism Open 3 Insert the module into the Adapter card module cage 4 Close the locking Mechanism To remove the module from the cage 1 Unlock the lockin...

Page 36: ... The Ordering Part Numbers for the Mellanox SFP optical modules are shown in the table below Note SR and LR modules not recommended by Mellanox may not work with the adapter Figure 6 XFP Optical Module Spec Model number Module 10GBASE SR MFM1T02A SR 10GBASE LR MFM1T02A LRM ...

Page 37: ...écessaire En outre pour garantir un bon écoulement de l air laissez au moins 8 cm 3 pouces d espace libre autour des ouver tures de ventilation Pendant un orage il ne faut pas utiliser le matériel et il ne faut pas brancher ou déb rancher les câbles Ce matériel ne doit être installé remplacé ou entretenu que par du personnel formé et qualifié L élimination de ce matériel doit s effectuer dans le r...

Page 38: ... einen ein wandfreien Luftstrom zu gewährleisten Arbeiten Sie während eines Gewitters und Blitzschlag nicht am Gerät schließen Sie keine Kabel an oder ab Diese Gerät sollte nur von geschultem und qualifiziertem Personal installiert ausge tauscht oder gewartet werden Die Entsorgung dieses Geräts sollte unter Beachtung aller nationalen Gesetze Bestim mungen erfolgen Dieses Gerät sollte unter Beachtu...