Supermicro SuperServer 520P-WTR, User Manual

Page 1: ...USER S MANUAL Revision 1 0 SuperServer 520P WTR ...

Page 2: ...lass A device or in residential environment for Class B device This equipment generates uses and can radiate radio frequency energy and if not installed and used in accordance with the manufacturer s instruction manual may cause harmful interference with radio communications Operation of this equipment in a residential area is likely to cause harmful interference in which case you will be required...

Page 3: ...nd utilities https www supermicro com wdl driver Product safety info http www supermicro com about policies safety_information cfm If you have any questions please contact our support team at support supermicro com This manual may be periodically updated without notice Please check the Supermicro website for possible updates to the manual revision level Secure Data Deletion A secure data deletion ...

Page 4: ...able 17 Chipset Block Diagram 19 Chapter 2 Server Installation 2 1 Overview 20 2 2 Unpacking the System 20 2 3 Preparing for Setup 20 Choosing a Setup Location 20 Rack Precautions 21 Server Precautions 21 Rack Mounting Considerations 21 Ambient Operating Temperature 21 Airflow 22 Mechanical Loading 22 Circuit Overloading 22 Reliable Ground 22 2 4 Installing the Rails 23 Separating the Sections of ...

Page 5: ...U Socket for Installation 34 Installing the Processor Heatsink Module 35 Removing the Processor Heatsink Module 37 3 4 Memory 38 Memory Support 38 General Guidelines for Optimizing Memory Performance 39 DIMM Installation 40 DIMM Removal 40 3 5 Motherboard Battery 41 3 6 Storage Drives 42 Front Bezel 42 Hard Drives 42 Installing Drives 42 Hard Drive Carrier Indicators 45 3 7 System Cooling 46 Insta...

Page 6: ...3 5 to 2 5 Converter Trays 74 6 4 2x 2 5 SATA SAS Cage Rear 74 6 5 2x 2 5 NVMe Cage Rear 74 6 6 Storage Control Cards and Cable s 74 6 7 CacheVault s 75 Installing the SuperCap Kit via the PCIe Bracket 75 6 8 TPM Security Module 75 6 9 Intel Virtual RAID on CPU VROC 76 Requirements and Restrictions 76 Supported SSDs and Operating Systems 76 Additional Information 77 Hardware Key 77 Enabling NVMe R...

Page 7: ...e 85 Memory Errors 85 Losing the System s Setup Configuration 86 When the System Becomes Unstable 86 7 4 Crash Dump Using IPMI 88 7 5 CMOS Clear 89 7 6 Where to Get Replacement Components 90 7 7 Reporting an Issue 90 Technical Support Procedures 90 Returning Merchandise for Service 90 Vendor Support Filing System 91 7 8 Feedback 91 7 9 Contacting Supermicro 92 Appendix A Standardized Warning State...

Page 8: ...B V Het Sterrenbeeld 28 5215 ML s Hertogenbosch The Netherlands Tel 31 0 73 6400390 Fax 31 0 73 6416525 Email sales supermicro nl General Information support supermicro nl Technical Support rma supermicro nl Customer Support Website www supermicro nl Asia Pacific Address Super Micro Computer Inc 3F No 150 Jian 1st Rd Zhonghe Dist New Taipei City 235 Taiwan R O C Tel 886 2 8226 3990 Fax 886 2 8226 ...

Page 9: ...MM LRDIMM 3DS with speeds up to 3200MHz Drive Support Up to eight 3 5 hot swap SATA3 hard drives or SAS3 drives with optional AOCs and cables Expansion Slots 2 PCIe 4 0 x16 FHFL 2 PCIe 4 0 x8 LP 1 M 2 for PCIe 3 0 x4 or SATA 3 0 M Key 2280 22110 I O Ports 2 LAN 10GbE ports 1 dedicated IPMI KVM LAN port 1 VGA port 1 Serial port 2 USB 3 2 Gen 1 ports 2 USB 2 0 ports System Cooling 3 8cm cooling fans...

Page 10: ...the table below For OS RAID or non RAID configurations some LED indications are not supported such as hot spare For VROC configurations refer to the VROC appendix in this manual Drive Carrier LED Indicators Color Blinking Pattern Behavior for Device Activity LED Blue Solid On Idle SAS NVMe drive installed Blue Blinking I O activity Off Idle SATA drive Status LED Red Solid On Failure of drive with ...

Page 11: ...nated when the system is operating Reset Button The reset button is used to reboot the system Power Button The main power button is used to apply or remove power from the power supply to the server Turning off system power with this button removes the main power but maintains standby power To perform many maintenance tasks you must also unplug system before servicing Information LED Status Descrip...

Page 12: ...s Two redundant power supply modules PWS1 on the top PWS2 on the bottom SATA NVMe Drives Two SATA or NVMe drives require an optional kit COM Serial port IPMI LAN IPMI LAN port when speed indicator is green connection is 100Mb s USB Two USB 3 2 Gen 1 ports two USB 2 0 ports LAN Two LAN ports VGA Video port UID Switch LED UID button see Control panel description 3 2 1 Power Supply 2 COM Port IPMI LA...

Page 13: ...ower supply critical events causing a shutdown failure OCP OVP fan failure OTP UVP Off On Power supply warning events when the power supply continues to operate high temperature over voltage under voltage etc Off Blinking at 1Hz AC present and only 12VSB on PS off Blinking at 1Hz Off Output ON and OK On Off AC cord unplugged and in redundant mode Off On ...

Page 14: ...x4 SATA3 M 2 SuperDOM ports Disk on Module port allows for flash cards to be mounted directly on the motherboard DIMM slots Dual in line memory module DIMM slots Processor Intel Xeon Scalable Processor System fans Three 8cm heavy duty fans used to provide cooling for the system 8 DIMM Slots 2 SuperDOM Ports 3 System Fans Processor Power Supply Module s 1 M 2 Slot ...

Page 15: ...n covers the locations of the system electrical components a cable routing diagram and block diagrams of the motherboard and the overall system Main Components Figure 1 5 Main Component Locations RSC W2 66G4 RSC W2R 88G4 X12SPW TF Storage Backplane BPN SAS3 825TQ ...

Page 16: ...E2 3 MH16 MH15 JPI2C1 JIPMB1 JNVI2C JI2C_EXP1 MH4 MH6 MH1 MH9 MH5 MH3 MH2 JPME1 JPL2 JMP2 JMP1 JPL1 JPL3 SXB2 PCI E 4 0 X16 SXB1A SXB1B PCI E 4 0 X16 X16 SXB1C COM2 I SATA4 7 M 2 H COM1 DIMMG1 DIMMH1 DIMME1 DIMMF1 DIMMA1 DIMMB1 DIMMD1 DIMMC1 CPU USB6 7 3 0 USB4 5 3 0 USB2 3 LAN2 LAN1 CMOS CLEAR I SATA0 3 TPM PORT80 UID SW UID LED VGA USB0 1 IPMI_LAN USB8 3 0 LE3 LEDBMC LE4 FAN2 DIMMC1 DIMMD1 DIMMA...

Page 17: ...gement Bus SMBus I2 C JIPMB1 4 pin IPMI External I2 C Header for an IPMI card JL1 Chassis Intrusion Header JNCSI1 NC SI Header for BMC Support NVME0 1 NVME2 3 PCIe 4 0 x8 Slimline SAS Connector JNVI2 C NVMe I2 C Header JPI2 C1 Power System Management Bus SMB I2 C Header JPWR1 8 pin Power Connector JPWR2 4 pin Power Connector JPWR3 24 pin ATX Power Connector JRK1 Intel RAID Key Header JSD1 JSD2 SAT...

Page 18: ...SB0 1 Back Panel Universal Serial Bus USB 2 0 Ports USB2 3 Front Accessible USB 2 0 Headers USB4 5 3 2 Gen 1 Back Panel USB 3 2 Gen 1 Ports USB6 7 3 2 Gen 1 Front Accessible USB 3 2 Gen 1 Header USB8 3 2 Gen 1 USB 3 2 Gen 1 Type A Header VGA VGA Port ...

Page 19: ...G4 2666 2933 3200 2666 2933 3200 2666 2933 3200 PCI E GEN4 X16 PCI E GEN3 X8 CPLD PFR SPI SPI NAND FLASH 1 G 1 U P C 1 F 1 U P C CPU1 H1 DDR4 DDR4 DDR4 DDR4 2666 2933 3200 2666 2933 3200 2666 2933 3200 2666 2933 3200 CPU1 E1 PCI E X16 WIOR 3A PCI E GEN4 X8 PCI E GEN4 X8 PCI E TWO X4 G4 WIOL PCI E X32 PCI E TWO X4 G4 6 0 Gb S 1 0 sSATA SATA DOM Mini SAS HD SATA 0 7 SSATA0 PCI E X4 G3 0 3 PCI E X4 G...

Page 20: ...the server It should be situated in a clean dust free area that is well ventilated Avoid areas where heat electrical noise and electromagnetic fields are generated It will also require a grounded AC power outlet nearby Be sure to read the precautions and considerations noted in Appendix A 2 3 Preparing for Setup The box in which the system was shipped should include the rackmount hardware needed t...

Page 21: ...ty precautions in Appendix A Determine the placement of each component in the rack before you install the rails Install the heaviest server components at the bottom of the rack first and then work your way up Use a regulating uninterruptible power supply UPS to protect the server from power surges and voltage spikes and to keep your system operating in case of a power failure Allow any drives and ...

Page 22: ... be maintained at all times To ensure this the rack itself should be grounded Particular attention should be given to power supply connections other than the direct connections to the branch circuit i e the use of power strips etc To prevent bodily injury when mounting or servicing this unit in a rack you must take special precautions to ensure that the system remains stable The following guidelin...

Page 23: ...of two sections an inner fixed chassis rail that secures directly to the server chassis and an outer fixed rack rail that secures directly to the rack itself see Figure 2 1 To separate the inner and outer rails follow the below steps Warning Do not pick up the server with the front handles They are designed to pull the system from a rack only Figure 2 1 Separating the Rack Rails screw the handles ...

Page 24: ...ce the inner rail extensions on the side of the server aligning the hooks of the chassis with the rail extension holes Make sure the extension faces outward just like the pre attached inner rail 2 Slide the extension toward the front of the server 3 Optional Secure the server with 2 screws as illustrated Repeat steps for the other inner rail extension Figure 2 2 Installing the Inner Rail Extension...

Page 25: ...es and 33 inches To install the outer rails to the rack follow the below steps 1 Secure the back end of the outer rail to the rack using the screws provided 2 Press the button where the two outer rails are joined to retract the smaller outer rail 3 Hang the hooks of the rails onto the rack holes and if desired use screws to secure the front of the outer rail onto the rack 4 Repeat steps 1 3 for th...

Page 26: ...o the outer rails keeping the pressure even on both sides When the server has been pushed completely into the rack it should click into the locked position Figure 2 5 Installing the Server into a Rack Note Figure is for illustrative purposes only Always install servers to the bottom of a rack first Slide rail mounted equipment is not to be used as a shelf or a work space screw the handles the oute...

Page 27: ... Please follow the procedures given in each section 3 1 Removing Power Use the following procedure to ensure that power has been removed from the system This step is necessary when removing or installing non hot swap components or when replacing a non redundant power supply 1 Use the operating system to power down the system 2 After the system has completely shut down disconnect the AC power cord ...

Page 28: ...ull the unit straight out until it locks you will hear a click 3 Depress the two buttons on the top of the chassis to release the top cover and at the same time push the cover away from you until it stops 4 Lift the top cover from the chassis to gain full access to the inside of the server Check that all ventilation openings on the top cover and the top of the chassis are clear and unobstructed Ca...

Page 29: ...plastic protective cover is on the CPU socket and none of the socket pins are bent If they are contact your retailer When handling the processor avoid touching or placing direct pressure on the LGA lands gold contacts Improper installation or socket misalignment can cause serious damage to the processor or CPU socket which may require manufacturer repairs Thermal grease is pre applied on a new hea...

Page 30: ...rocessor Carrier Assembly The processor carrier assembly contains the Intel Xeon processor and a processor carrier 1 Plastic Protective Cover 2 CPU Socket 1 Processor 2 Processor Carrier Overview of the CPU Socket The CPU socket is protected by a plastic protective cover ...

Page 31: ...Installation Overview of the Processor Heatsink Module The Processor Heatsink Module PHM contains a heatsink a processor carrier and the processor Heatsink with Thermal Grease Processor Carrier Processor Processor Heatsink Module Bottom View ...

Page 32: ...e on the processor carrier These triangles indicate pin 1 The triangles can be found on the top and bottom of the processor See the images below 2 Using the triangles as a guide carefully align and place Point A of the processor into the carrier Then gently snap in the other side of the carrier for the processor to fasten into Point B 3 Examine all corners to ensure that the processor is firmly at...

Page 33: ...h the thermal grease facing up Note the two triangle cutouts A B located at the diagonal corners of the heatsink as shown in the drawing below 2 On the processor carrier assembly find pin 1 as noted by the triangles Hold the processor carrier assembly over so that the gold LGA is facing up 3 Align clip a pin 1 on the carrier assembly with the triangular cutout A on the heatsink and b c d on the ca...

Page 34: ...stic protective cover installed on the CPU socket Remove it from the socket to install the Processor Heatsink Module PHM Gently squeeze the grip tabs then pull the cover off Remove the plastic protective cover from the CPU socket Do not touch or bend the socket pins Socket Pins CPU Socket with Plastic Protective Cover Grip Tabs ...

Page 35: ...ur PEEK nuts A B C D and four rotating wires 1 2 3 4 on the heatsink as shown below a b c d a b c d Threaded Fasteners CPU Socket Pin1 Threaded Fastener CPU Socket Heatsink d a b c A B C D Peek Nut 1 2 3 4 Rotating Wire a b c d Threaded Fastener Peek Nut Unlatched latched Rotating Wire 3 Peek Nut A B C D Rotating Wire 1 2 Rotating Wire Rotating Wire 4 Threaded Fastener CPU Socket 3 Check that the ...

Page 36: ...y place the heatsink on the CPU socket making sure that each nut is properly aligned with its corresponding threaded fastener 3 Press all four rotating wires outward to latch the PHM onto the CPU socket 4 With a t30 bit screwdriver tighten all PEEK nuts in the sequence of A B C and D with even pressure not greater than 12 lbf in a b c d Threaded Fastener on the CPU socket A B C D Peek Nut on the H...

Page 37: ... shut down the system and then unplug the AC power cord from all power supplies Then follow the steps below 1 Use a t30 bit screwdriver to loosen the four PEEK nuts on the heatsink in the sequence of A B C and D A B C D Peek Nut 2 Press the four rotating wires inward to unlatch the PHM as shown below 3 Gently lift the PHM upward to remove it from the CPU socket ...

Page 38: ... DIMMA1 DIMME1 DIMMC1 DIMMG1 6 DIMMA1 DIMME1 DIMMC1 DIMMG1 DIMMB1 DIMMF1 8 DIMMA1 DIMME1 DIMMC1 DIMMG1 DIMMB1 DIMMF1 DIMMD1 DIMMH1 Type Ranks Per DIMM and Data Width DIMM Capacity GB Speed MT s Voltage V Slot Per Channel SPC and DIMM Per Channel DPC Data below assumes 2 SPC unless otherwise noted 1DPC 8 Gb 16 Gb 1 2V RDIMM SRx8 8 GB 16 GB 3200 SRx4 16 GB 32 GB DRx8 16 GB 32 GB DRx4 32GB 64 GB RDIM...

Page 39: ...ormance use DDR4 memory of the same type size and speed Mixed DIMM speeds can be installed However all DIMMs will run at the speed of the slowest DIMM The motherboard will support odd numbered modules one or three modules installed However to achieve the best memory performance a balanced memory population is recommended ...

Page 40: ...ID LED VGA USB0 1 IPMI_LAN USB8 3 0 FAN2 DIMM Installation 1 Insert the desired number of DIMMs into the memory slots based on the recommended DIMM population table on page 38 2 Push the release tabs outwards on both ends of the DIMM slot to unlock it 3 Align the key of the DIMM module with the receptive point on the memory slot 4 Align the notches on both ends of the module against the receptive ...

Page 41: ...he motherboard Replacing the Battery Begin by removing power from the system 1 Push aside the small clamp that covers the edge of the battery When the battery is released lift it out of the holder 2 To insert a new battery slide one edge under the lip of the holder with the positive side facing up Then push the other side down until the clamp snaps over it Note Handle used batteries carefully Do n...

Page 42: ...bays 1 Unlock the front of the chassis and then press the release knob 2 Carefully remove the bezel with both hands A filter located within the bezel can be removed for replacement cleaning It is recommended that you keep a maintenance log to list filter cleaning replacement dates since its condition affects the airflow throughout the whole system Hard Drives Your server may or may not have come w...

Page 43: ...ves are installed all drive carriers must remain in the drive bays to maintain proper airflow Note Enterprise level hard disk drives are recommended for use in Supermicro chassis and servers For information on recommended HDDs visit the Supermicro website Removing a Hot Swap Drive Carrier from the Chassis 1 Press the release button on the drive carrier which will extend the drive carrier handle 2 ...

Page 44: ...ndicates that the carrier has been fully seated and connected to the midplane which automatically makes the power and logic connections to the hard drive Figure 3 6 Mounting a Drive in a Carrier Removing a Drive from a Drive Carrier 1 Remove the screws that secure the hard drive to the carrier and separate the hard drive from the carrier 2 Replace the carrier back into the drive bay Note Your oper...

Page 45: ...tor remains off See the table below for details LED Color State Status Activity LED Blue Solid On SAS drive installed Blue Blinking I O activity Status LED Red Solid On Failed drive for SAS SATA with RSTe support Red Blinking at 1Hz Rebuild drive for SAS SATA with RSTe support Red Blinking with two blinks and one stop at 1Hz Hot spare for SAS SATA with RSTe support Red On for five seconds then off...

Page 46: ...e cooling air circulates properly through the chassis Figure 3 7 Fan Positions Installing Fans The 520P WTR chassis includes three pre installed fans These fans are NOT redundant hot plug and so must be replaced when they fail Fan speed is controlled by system temperature via IPMI If a fan fails the remaining fans will ramp up to full speed Replace any failed fan at your earliest convenience with ...

Page 47: ...an wires to the same chassis fan header as the previous fan 7 Power up the system and check that the fan is working properly before replacing the chassis cover Release Tab Figure 3 8 System Fan 1 Open the chassis while the system is running to determine which fan has failed Never run the server for an extended period of time with the chassis open 2 Turn off the power to the system and unplug the p...

Page 48: ...upply has been removed Replacement units can be ordered directly from Supermicro Replacing the Power Supply 1 Unplug the AC power cord from the failed power supply module with the red LED lit up 2 Push the release tab on the back of the power supply as illustrated then pull the power supply out using the handle provided 3 Push the new power supply module into the power bay until you hear a click r...

Page 49: ...he power supply from the motherboard backplane and other components Also remove both power supplies 3 Locate the power distributor between the power supply and the fan row 4 Remove the three screws securing the power supply 5 Gently pull the power distributor from the chassis Gently guide all the cables through the power distributor housing 6 Slide the new power distributor module into the power d...

Page 50: ... blinks at 2Hz The BMC resets and the reset duration is 250ms Then the BMC starts to boot Restore factory default configuration Hold the button for 12 seconds The LED blinks at 4Hz while defaults are configured Firmware update When the BMC firmware is updated the UID LED blinks at 10Hz dur ing the update BMC Reset Options Event LED Reset Blinks at 2Hz Restore Defaults Blinks at 4Hz Update Blinks a...

Page 51: ...nnecting cables to add or replace components refer to this diagram when adding or replacing components so you can reroute them in the same manner Proper cable routing is important in maintaining proper airflow through the system Online Cable Matrix NVMe Cable Optional CBL SAST 1149 85 SATA Cable CBL SAST 0699 SAS Cable for 3808 3908 Optional CBL SAST 1270 100 Figure 3 12 Cable Routing Diagram ...

Page 52: ...ions in Appendix A before installing or removing components 4 1 Power Connections Two power connections supply the motherboard and several more supply for onboard devices ATX Power Supply Connector The 24 pin power supply connector JPWR3 meets the ATX SSI EPS 12V specification You must also connect the 8 pin JPWR1 and 4 pin JPWR2 processor power connector to the power supply Required Connection AT...

Page 53: ...rtant To provide adequate power supply to the motherboard be sure to connect the 24 pin ATX PWR the 8 pin PWR and 4 pin PWR connectors to the power supply Failure to do so may void the manufacturer warranty on your power supply and motherboard Required Connection 4 pin Power Pin Definitions Pin Definition 1 2 Ground 3 4 P12V 12V Power 4 Pin Power Connector JPWR2 is an 4 pin 12V DC power input for ...

Page 54: ...ck 2 2 5A 12V Red 3 Tachometer 4 PWM_Control SGPIO Headers There is one Serial Link General Purpose Input Output S SGPIO1 header located on the motherboard S SGPIO is for sSATA use Refer to the tables below for pin definitions SGPIO Header Pin Definitions Pin Definition Pin Definition 1 NC 2 NC 3 Ground 4 Data 5 Load 6 Ground 7 Clock 8 NC NC No Connection Disk On Module Power Connector Two power c...

Page 55: ...ated at JIPMB1 Connect the appropriate cable here to use the IPMB I2 C connection on your system Refer to the table below for pin definitions External I2 C Header Pin Definitions Pin Definition 1 Data 2 Ground 3 Clock 4 No Connection Standby Power The Standby Power header is located at JSTBY1 on the motherboard You must have a card with a Standby Power connector and a cable to use this feature Ref...

Page 56: ...on card that supports NC SI and also need to have a special cable Please contact Supermicro at www supermicro com to purchase the cable for this header Refer to the table below for pin definitions NCSI Pin Definition Pin Definition Pin Definition 1 NCSI Clock 2 Ground 3 NCSI_CRS_DV 4 Ground 5 NCSI_RX_D0 6 Ground 7 NCSI_RX_D1 8 Ground 9 NCSI_TX_D0 10 Ground 11 NCSI_TX_D1 12 Ground 13 NCSI_TX_EN 14 ...

Page 57: ...Definitions Pin Definition 1 Clock 2 Data 3 PMBUS_Alert 4 Ground 5 3 3V M 2 Slot The X12SPW TF F motherboard has one M 2 slot M 2 was formerly known as Next Generation Form Factor NGFF and serves to replace mini PCIe M 2 allows for a variety of card sizes increased functionality and spatial efficiency The M 2 socket on the motherboard supports PCIe 3 0 x4 SSD cards in the 2280 and 22110 form facto...

Page 58: ...Ground Power Fail LED NIC2 Active LED NMI 3 3V OH Fan Fail LED 3 3V Stby Reset Button Pin Definitions JF1 Pins Definition 3 Reset 4 Ground Power Button Pin Definitions JF1 Pins Definition 1 Signal 2 Ground Power Button The Power Button connection is located on pins 1 and 2 of JF1 Momentarily contacting both pins will power on off the system This button can also be configured to function as a suspe...

Page 59: ...JF1 Refer to the table below for pin definitions Power Fail LED Pin Definitions JF1 Pin Definition 5 3 3V 6 PWR Supply Fail NIC1 NIC2 LAN1 LAN2 The NIC Network Interface Controller LED connection for LAN port 1 is located on pins 11 and 12 of JF1 and LAN port 2 is on pins 9 and 10 Attach the NIC LED cables here to display network activity Refer to the table below for pin definitions LAN1 LAN2 LED ...

Page 60: ...fer to the table below for pin definitions Power LED Pin Definitions JF1 Pins Definition 15 3 3V 16 PWR LED NMI Button The non maskable interrupt NMI button header is located on pins 19 and 20 of JF1 Refer to the table below for pin definitions NMI Button Pin Definitions JF1 Pins Definition 19 Control 20 Ground ...

Page 61: ... 3 USB 0 4 USB 1 5 USB 4 3 2 Gen 1 6 USB 5 3 2 Gen 1 7 LAN1 8 LAN2 9 VGA 10 UID switch 1 4 6 VGA Port A video VGA port is located next to LAN2 on the I O back panel Refer to the board layout below for the location COM Ports There are two COM connection on this motherboard COM1 is located on the I O back panel COM2 is located next to MH1 COM Port Pin Definitions Pin Definition Pin Definition 1 DCD ...

Page 62: ... 1000 LED Amber 13 TD1 23 SGND 14 TD2 24 SGND 15 TD2 25 SGND 16 TD3 26 SGND 17 TD3 18 GND Unit Identifier Switch UID LED Indicator A Unit Identifier UID switch and an LED Indicator are located on the motherboard The UID switch is located at UID SW which is next to the VGA port on the back panel The UID LED is located next to the switch When you press the UID switch the UID LED will be turned on Pr...

Page 63: ...a_SSRX B5 USB3_RN A6 Stda_SSRX B6 USB3_RP A7 GND B7 GND A8 Stda_SSTX B8 USB3_TN A9 Stda_SSTX B9 USB3_TP Back Panel USB 0 1 2 0 Pin Definitions Pin Definition Pin Definition 1 5V 5 5V 2 USB_N 6 USB_N 3 USB_P 7 USB_P 4 Ground 8 Ground Front Panel USB 2 3 2 0 Pin Definitions Pin Definition Pin Definition 1 5V 2 5V 3 USB_N 4 USB_N 5 USB_P 6 USB_P 7 Ground 8 Ground 9 Key 10 NC Front Panel USB 6 7 3 2 G...

Page 64: ...er or shorting device 6 Replace the cover reconnect the power cord s and power on the system Note Clearing CMOS will also clear all passwords Do not use the PW_ON connector to clear CMOS 4 4 Jumpers Explanation of Jumpers To modify the operation of the motherboard jumpers are used to choose between optional settings Jumpers create shorts between two pins to change the function associated with it P...

Page 65: ... must also be enabled in the BIOS Watchdog Jumper Settings Jumper Setting Definition Pins 1 2 Reset Pins 2 3 NMI Open Disabled ME Manufacturing Mode Close pins 2 3 of jumper JPME1 to bypass SPI flash security and force the system to operate in the manufacturing mode which will allow the user to flash the system firmware from a host server for system setting modifications Refer to the table below f...

Page 66: ...LED is located near the UID switch on the I O back panel This UID indicator provides easy identification of a system unit that may need service IPMI LAN LEDs In addition to LAN1 and LAN2 an IPMI LAN is also located on the I O back panel The amber LED on the right indicates activity while the LED on the left indicates the speed of the connection Refer to the table below for more information IPMI LA...

Page 67: ...support manuals NVM Express Connections There are two Slimline SAS connectors located on the motherboard to support two PCIe 4 0 x4 NVMe connections This connector provides high speed and low latency connections directly from the CPU to NVMe Solid State SSD drives This greatly increases SSD data throughput performance and significantly reduces PCIe latency by simplifying driver software requiremen...

Page 68: ...supermicro com support manuals Installing the OS 1 Create a method to access the MS Windows installation ISO file That might be a DVD perhaps using an external USB SATA DVD drive or a USB flash drive or the IPMI KVM console 2 Retrieve the proper RST RSTe driver Go to the Supermicro web page for your motherboard and click on Download the Latest Drivers and Utilities select the proper driver and cop...

Page 69: ...river browse the USB flash drive for the proper driver files For RAID choose the SATA sSATA RAID driver indicated then choose the storage drive on which you want to install it For non RAID choose the SATA sSATA AHCI driver indicated then choose the storage drive on which you want to install it 5 Once all devices are specified continue with the installation 6 After the Windows OS installation has c...

Page 70: ...nother option is to go to the Supermicro website at http www supermicro com products Find the product page for your motherboard and Download the Latest Drivers and Utilities Insert the flash drive or disk and the screenshot shown below should appear Figure 5 3 Driver Tool Installation Screen Note Click the icons showing a hand writing on paper to view the readme files for each item Click the compu...

Page 71: ...vides alerts via email or Simple Network Management Protocol SNMP SuperDoctor 5 comes in local and remote management versions and can be used with Nagios to maximize your system monitoring needs With SuperDoctor 5 Management Server SSM Server you can remotely control power on off and reset chassis intrusion for multiple systems with SuperDoctor 5 or IPMI SD5 Management Server monitors HTTP FTP and...

Page 72: ...ker on the motherboard The sticker also displays the BMC MAC address Figure 5 5 BMC Password Label BIOS LICENSE 1 BAR CODE IPMI CODE MAC CODE SAN MAC DESIGNED IN USA X12SPW TF F REV 2 00 JNCSI1 S SGPIO1 JBT1 JPWR2 JSD2 JSD1 S SATA1 S SATA0 JSTBY1 JRK1 JPWR3 JPWR1 JF1 JVRM2 JVRM1 JPFR3 JPFR2 JPFR1 JL1 JD1 JPRG1 JWD1 JP4 FAN6 FAN7 FAN4 FAN3 FAN5 FAN1 BT1 NVME0 1 NVME2 3 MH16 MH15 JPI2C1 JIPMB1 JNVI2...

Page 73: ...Cage Rear MCP 220 82616 0N 1 2x 2 5 NVMe Cage Rear MCP 220 82619 0N 1x CBL SAST 1154 85 1 Storage Control Card and Cable s AOC S3008L L8I 1 AOC S3008L L8E AOC S3108L H8iR 16DD AOC S3808L L8IT 1x CBL SAST 1270 100 AOC S3908L H8iR 16DD 1x CBL SAST 1270 100 CacheVault s BTR TFM8G LSICVM02 BKT BBU BRACKET 05 for S3108 1 BTR CVPM05 BKT BBU BRACKET 05 for S3908 TPM security module AOM TPM 9670V AOM TPM ...

Page 74: ...n4 16HDD RAID 0 1 5 6 10 50 60 Slimline x8 STR to 8x SATA 70cm 100OHM 6 4 2x 2 5 SATA SAS Cage Rear The server can support two hot swappable 2 5 SATA3 or SAS3 drives installed to the rear of the chassis in a SATA SAS cage The drive kit includes tool less HDD trays and support for 12G drive activity LEDs and status LEDs 6 2 Inlet Thermal Sensor A Universal Thermal sensor kit is available with a 80c...

Page 75: ...th Infineon 9670 controller horizontal form factor The JTPM1 header is used to connect a Trusted Platform Module TPM A TPM is a security device that supports encryption and authentication in hard drives It enables the motherboard to deny access if the TPM associated with the hard drive is not installed in the system Details and installation procedures are at http www supermicro com manuals other T...

Page 76: ...Storage Technology enterprise Intel RSTe Driver for Linux Windows https downloadcenter intel com download 28108 Intel Virtual RAID on CPU Intel VROC and Intel Rapid Storage Technology enterprise Intel RSTe Driver for Windows To enable Intel VROC a hardware key must be inserted on the motherboard and the ap propriate processor s Virtual Management Devices must be enabled in the BIOS setup It is pos...

Page 77: ...The key options are Intel VROC Keys VROC Package Description Part Number Intel MM Number Standard RAID 0 1 10 Supports 3rd party SSDs AOC VROCSTNMOD 951605 Premium RAID 0 1 5 10 Supports 3rd party SSDs AOC VROCPREMOD 951606 Intel SSD only RAID 0 1 5 10 Supports Intel SSDs only AOC VROCINTMOD 956822 Additional Information Additional information is available on the product page for the Supermicro ad...

Page 78: ...e For M 2 NVMe or NVMe AIC enable the VMD according to which add on card or slot it used Examples for some U 2 configurations follow 6 Press F4 to save the configuration and reboot the system 7 Press DEL to enter BIOS 8 Switch to Advanced Intel R Virtual RAID on CPU All Intel VMD Controllers Create RAID Volume 9 Set Name 10 Set RAID Level 11 If cross controller RAID is required select Enable RAID ...

Page 79: ...ther manufacturers Under vSphere ESXi several steps are necessary to avoid potential stability issues See the information at link 1 below Hot unplug 1 Prevent devices from being re detected during rescan esxcli storage core claiming autoclaim enabled false 2 Unmount the VMFS volumes on the device Check 2 for details 3 Detach the device Check 3 for details 4 Physically remove the device Status Indi...

Page 80: ...ps docs vmware com en VMware vSphere 6 5 com vmware vsphere storage doc GUID 1B56EF97 F60E 4F21 82A7 8F2A7294604D html 3 https docs vmware com en VMware vSphere 6 5 com vmware vsphere storage doc GUID F2E75F67 740B 4406 9F0C A2D99A698F2A html 6 10 WIO Riser Cards WIO Riser Card Options Part Number Description RSC W2 688G4 2U LHS with one PCIe 4 0 x16 slot and two PCIe 4 0 x8 slots RSC W2 8888G4 2U...

Page 81: ...on then selecting the Products option The Support option offers downloads manuals BIOS IPMI drivers etc FAQs RMA warranty and other service extensions Direct Links for the 520P WTR System Web SYS 520P WTR specifications page X12SPW TF motherboard page for links to the Quick Reference Guide User Manual validated storage drives etc BPN SAS3 825TQ Backplane Manual Figure 7 1 Supermicro Website Chapte...

Page 82: ...Guide General Memory Configuration Guide X12 IPMI User Guide SuperDoctor5 Large Deployment Guide For validated memory use our Product Resources page Product Matrices page for links to tables summarizing specs for systems motherboards power supplies riser cards add on cards etc Security Center for recent security notices Supermicro Phone and Addresses ...

Page 83: ...he Intelligent Platform Management Interface IPMI IPMI is used to provide remote access monitoring and management There are several BIOS settings that are related to IPMI For general documentation and information on IPMI please visit our website at https www supermicro com solutions IPMI cfm Figure 7 2 IPMI Sample ...

Page 84: ...lly seated and connect the front panel connectors to the motherboard No Power 1 Make sure that there are no short circuits between the motherboard and the chassis 2 Make sure that the ATX power connectors are properly connected 3 Check that the 115V 230V switch if available on the power supply is properly set 4 Turn the power switch on and off to test the system if applicable 5 The battery on your...

Page 85: ...m with only one DIMM module installed If the system boots check for bad DIMM modules or slots by following the Memory Errors Troubleshooting procedure in this chapter Memory Errors When a no memory beep code is issued by the system check the following 1 Make sure that the memory modules are compatible with the system and are properly installed See Chapter 2 for installation instructions For memory...

Page 86: ...port Make sure that all hard disk drives HDDs work properly Replace the bad HDDs with good ones 4 System cooling Check the system cooling to make sure that all heatsink fans and CPU system fans etc work properly Check the hardware monitoring settings in the IPMI to make sure that the CPU and system temperatures are within the normal range Also check the front panel Overheat LED and make sure that ...

Page 87: ...tion to make sure that it works properly Replace a bad component with a good one 5 Check and change one component at a time instead of changing several items at the same time This will help isolate and identify the problem 6 To find out if a component is good swap this component with a new one to see if the system will work properly If so then the old component is bad You can also install the comp...

Page 88: ...u can download a crash dump of status information using IPMI The IPMI manual is available at https www supermicro com solutions IPMI cfm Check IPMI Error Log 1 Access the IPMI web interface 2 Click the Server Health tab then Event Log to verify an IERR error checked BOM Figure 7 1 IPMI Event Log In the event of an IERR the IPMI executes a crash dump You must download the crash dump and save it ...

Page 89: ...wn the system completely 2 Remove the cover of the chassis to access the motherboard 3 Remove the onboard battery from the motherboard 4 Short the CMOS pads with a metal object such as a small screwdriver for at least four seconds 5 Remove the screwdriver or shorting device 6 Replace the cover reconnect the power cords and power on the system Notes Clearing CMOS will also clear all passwords Do no...

Page 90: ... boot block code 3 If you still cannot resolve the problem include the following information when contacting us for technical support System motherboard and chassis model numbers and PCB revision number BIOS release date version this can be seen on the initial display when your system first boots up System configuration An example of a Technical Support form is posted on our website Distributors F...

Page 91: ...lure due to the alteration misuse abuse or improper maintenance of products During the warranty period contact your distributor first for any product problems Vendor Support Filing System For issues related to Intel use the Intel IPS filing system https www intel com content www us en design support ips training welcome html For issues related to Red Hat Enterprise Linux since it is a subscription...

Page 92: ...om Europe Address Super Micro Computer B V Het Sterrenbeeld 28 5215 ML s Hertogenbosch The Netherlands Tel 31 0 73 6400390 Fax 31 0 73 6416525 Email sales supermicro nl General Information support supermicro nl Technical Support rma supermicro nl Customer Support Website www supermicro nl Asia Pacific Address Super Micro Computer Inc 3F No 150 Jian 1st Rd Zhonghe Dist New Taipei City 235 Taiwan R ...

Page 93: ...ring components in the Supermicro chassis These warnings may also be found on our website at http www supermicro com about policies safety_information cfm Warning Definition 警告の定義 この警告サインは危険を意味します 人身事故につながる可能性がありますので いずれの機器でも動作させる前に 電気回路に含まれる危険性に注意して 標準的な事故防止策に精通して下さい 此警告符号代表危险 您正处于可能受到严重伤害的工作环境中 在您使用设备开始工作之前 必须充分意识到触电 的危险 并熟练掌握防止事故发生的标准工作程序 请根据每项警告结尾的声明号码找到此设 备的安全性警告说明的翻译文本 此警告符號代表危險 您正處於可能身體可能會受...

Page 94: ... número que le ayudará a encontrar el texto traducido en el apartado de traducciones que acompaña a este dispositivo GUARDE ESTAS INSTRUCCIONES IMPORTANTES INFORMATIONS DE SÉCURITÉ Ce symbole d avertissement indique un danger Vous vous trouvez dans une situation pouvant entraîner des blessures ou des dommages corporels Avant de travailler sur un équipement soyez conscient des dangers liés aux circ...

Page 95: ...risico s en dient u op de hoogte te zijn van de standaard procedures om ongelukken te voorkomen Gebruik de nummers aan het eind van elke waarschuwing om deze te herleiden naar de desbetreffende locatie BEWAAR DEZE INSTRUCTIES Installation Instructions Warning Read the installation instructions before connecting the system to the power source 設置手順書 システムを電源に接続する前に 設置手順書をお読み下さい 警告 将此系统连接电源前 请先阅读安装说明 ...

Page 96: ...를 읽어주십시오 Waarschuwing Raadpleeg de installatie instructies voordat u het systeem op de voedingsbron aansluit サーキッ ト ブレーカー この製品は 短絡 過電流 保護装置がある建物での設置を前提としています 保護装置の定格が250 V 20 Aを超えないこ とを確認下さい 警告 此产品的短路 过载电流 保护由建筑物的供电系统提供 确保短路保护设备的额定电流不大于 250V 20A 警告 此產品的短路 過載電流 保護由建築物的供電系統提供 確保短路保護設備的額定電流不大於 250V 20A Warning This product relies on the building s installation for short circuit overcurrent protection...

Page 97: ...ension ce produit dépend de l installation électrique du local Vérifiez que le courant nominal du dispositif de protection n est pas supérieur à 250 V 20 A 경고 이 제품은 전원의 단락 과전류 방지에 대해서 전적으로 건물의 관련 설비에 의존합니다 보호장치의 정격이 반드시 250V 볼트 20A 암페어 를 초과하지 않도록 해야 합니다 Waarschuwing Dit product is afhankelijk van de kortsluitbeveiliging overspanning van uw electrische installatie Controleer of het beveiligde apara...

Page 98: ... zu entfernen Advertencia El sistema debe ser disconnected de todas las fuentes de energía y del cable eléctrico quitado de los módulos de fuente de alimentación antes de tener acceso el interior del chasis para instalar o para quitar componentes de sistema Attention Le système doit être débranché de toutes les sources de puissance ainsi que de son cordon d alimentation secteur avant d accéder à l...

Page 99: ...ied personnel should be allowed to install replace or service this equipment 機器の設置 トレーニングを受け認定された人だけがこの装置の設置 交換 またはサービスを許可されていま す 警告 只有经过培训且具有资格的人员才能进行此设备的安装 更换和维修 警告 只有經過受訓且具資格人員才可安裝 更換與維修此設備 Warnung Das Installieren Ersetzen oder Bedienen dieser Ausrüstung sollte nur geschultem qualifiziertem Personal gestattet werden امداد وحدة من انكهرباء سهك انت ز وإ انطاقت مصادر جميع من اننظاو فصم يجب قبم ان...

Page 100: ...rtencia Solamente el personal calificado debe instalar reemplazar o utilizar este equipo Attention Il est vivement recommandé de confier l installation le remplacement et la maintenance de ces équipements à des personnels qualifiés et expérimentés Warning This unit is intended for installation in restricted access areas A restricted access area can be accessed only through the use of a special too...

Page 101: ...ès réservés L accès à une zone d accès réservé n est possible qu en utilisant un outil spécial un mécanisme de verrouillage et une clé ou tout autre moyen de sécurité 경고 이 장치는 접근이 제한된 구역에 설치하도록 되어있습니다 특수도구 잠금 장치 및 키 또는 기타 보안 수단을 통해서만 접근 제한 구역에 들어갈 수 있습니다 Waarschuwing Dit apparaat is bedoeld voor installatie in gebieden met een beperkte toegang Toegang tot dergelijke gebieden kunnen alleen verkrege...

Page 102: ... incorrecta Reemplazar la batería exclusivamente con el mismo tipo o el equivalente recomendado por el fabricante Desechar las baterías gastadas según las instrucciones del fabricante 電池の取り扱い 電池交換が正しく行われなかった場合 破裂の危険性があります 交換する電池はメーカーが推 奨する型 または同等のものを使用下さい 使用済電池は製造元の指示に従って処分して下さ い 警告 电池更换不当会有爆炸危险 请只使用同类电池或制造商推荐的功能相当的电池更换原有电 池 请按制造商的说明处理废旧电池 警告 電池更換不當會有爆炸危險 請使用製造商建議之相同或功能相當的電池更換原有電池 請按 照製造商的說明指示處理廢棄...

Page 103: ...upplies Warning This unit might have more than one power supply connection All connec tions must be removed to de energize the unit 冗長電源装置 このユニッ トは複数の電源装置が接続されている場合があります ユニッ トの電源を切るためには すべての接続を取り外さなければなりません 警告 此部件连接的电源可能不止一个 必须将所有电源断开才能停止给该部件供电 警告 此裝置連接的電源可能不只一個 必須切斷所有電源才能停止對該裝置的供電 Warnung Dieses Gerät kann mehr als eine Stromzufuhr haben Um sicherzustellen dass der Einheit kein trom zugeführt wir...

Page 104: ...exión para fuentes de alimentación Para cortar por completo el suministro de energía deben desconectarse todas las conexiones Attention Cette unité peut avoir plus d une connexion d alimentation Pour supprimer toute tension et tout courant électrique de l unité toutes les connexions d alimentation doivent être débranchées אחד מספק יותר קיים אם אזהרה לרוקן מנת על החיבורים כל את להסיר יש ספק של אחד ...

Page 105: ... bei der Wartung Advertencia Cuando el sistema está en funcionamiento el voltaje del plano trasero es peligroso Tenga cuidado cuando lo revise Attention Lorsque le système est en fonctionnement des tensions électriques circulent sur le fond de panier Prendre des précautions lors de la maintenance Warning Hazardous voltage or energy is present on the backplane when the system is operating Use cauti...

Page 106: ...에는 위험한 전압이나 에너지가 발생 합니다 서비스 작업 시 주의하십시오 Waarschuwing Een gevaarlijke spanning of energie is aanwezig op de backplane wanneer het systeem in gebruik is Voorzichtigheid is geboden tijdens het onderhoud Attention L équipement doit être installé conformément aux normes électriques nationales et locales 警告 设备安装必须符合本地与本国电气法规 警告 設備安裝必須符合本地與本國電氣法規 Warning Installation of the equipment must comply with loc...

Page 107: ...有國家的法律和規章進行 Warnung Die Entsorgung dieses Produkts sollte gemäß allen Bestimmungen und Gesetzen des Landes erfolgen Warning Ultimate disposal of this product should be handled according to all national laws and regulations Advertencia Al deshacerse por completo de este producto debe seguir todas las leyes y reglamentos nacionales הארצי החשמל חוקי תיאום אזהרה והארציים המקומיים החשמל לחוקי תואמת להי...

Page 108: ...eep away from moving fan blades The fans might still be turning when you remove the fan assembly from the chassis Keep fingers screwdrivers and other objects away from the openings in the fan assembly s housing ファン ホッ トスワップの警告 警告 回転部品に注意 運転中は回転部 羽根 に触れないでく ださい シャーシから冷却ファン装 置を取り外した際 ファンがまだ回転している可能性があります ファンの開口部に 指 ドライバ ー およびその他のものを近づけないで下さい 警告 警告 危险的可移动性零件 请务必与转动的风扇叶片保持距离 当您从机架移除风扇装置 风扇可能仍在转动 小心不要将...

Page 109: ...enez garde à ce que doigts tournevis et autres objets soient éloignés du logement du bloc ventilateur 경고 움직이는 위험한 부품 회전하는 송풍 날개에 접근하지 마세요 섀시로부터 팬 조립품을 제거할 때 팬은 여전히 회전하고 있을 수 있습니다 팬 조림품 외관의 열려있는 부분들로부터 손가락 및 스크류드라이버 다른 물체들이 가까이 하지 않도록 배치해 주십시오 Waarschuwing Gevaarlijk bewegende onderdelen Houd voldoende afstand tot de bewegende ventilatorbladen Het is mogelijk dat de ventilator nog draait tijdens he...

Page 110: ...下さい 他のケー ブルやアダプタを使用すると故障や火災の原因になるこ とがあります 電気用品安全法は ULまたはCSA認定のケーブル UL CSAマークがコードに表記 を Supermicro が指定する製品以外に使用するこ とを禁止しています 警告 安装此产品时 请使用本身提供的或指定的或采购的连接线 电源线和电源适配器 包含遵照当 地法规和安全要求的合规的电源线尺寸和插头 使用其它线材或适配器可能会引起故障或火灾 除了Supermicro所指定的产品 电气用品和材料安全法律规定禁止 使用未经UL或CSA认证的线材 线材上会显示UL CSA符号 警告 安裝此產品時 請使用本身提供的或指定的或採購的連接線 電源線和電源適配器 包含遵照當 地法規和安全要求的合規的電源線尺寸和插頭 使用其它線材或適配器可能會引起故障或火災 除了Supermicro所指定的產品 電氣用品和材料安全法律規定禁止 ...

Page 111: ... שמתשהל םילבכב םיכמסומה ב UL וא ב CSA רשאכ עיפומ םהילע דוק לש UL CSA רובע לכ רצומ ילמשח רחא אלא קר רצומב רשא םאתוה י ע Supermicro דבלב دنع بيكرت جتنملا مق مادختساب تاليصوتلا ةرفوتملا وأ ةددحملا وأ مق ءارشب تالباكلا ةيئابرهكلا تالوحمو رايتلا ددرتملا عم مازتلالا نيناوقب تابلطتمو ةمالسلا ةيلحملا امب يف كلذ مجح لصوملا سباقلاو ميلسلا مادختسا يأ تالباك تالوحمو ىرخأ دق ببستي يف لطع وأ قيرح رظحي نوناق ةما...

Page 112: ...n van het Product uitsluitend gebruik maken van de geleverde Kabels of een andere geschikte aan te schaffen Aansluitmethode deze moet altijd voldoen aan de lokale voorschriften en veiligheidsnormen inclusief de juiste kabeldikte en stekker Het gebruik van niet geschikte Kabels en of Adapters kan een storing of brand veroorzaken Wetgeving voor Elektrische apparatuur en Materiaalveiligheid verbied h...

Page 113: ... FHFL Two PCIe 4 0 x8 LP One M 2 slot for PCIe 3 0 x4 or SATA 3 0 supports M Key 2280 22110 FF Input Output Network Two 10GbE LAN ports IPMI Dedicated LAN port USB Two USB 3 2 Gen 1 ports two USB 2 0 ports Video One VGA port Serial One serial port one serial header Motherboard X12SPW TF 8 W x 13 L 203 2mm x 330 2mm Chassis 825BTQC R609WB 2U Rackmount 17 2 x 3 5 x 25 5 437 x 89 x 647mm W x H x D Sy...

Page 114: ...N BS 61000 4 5 EN BS 61000 4 6 EN BS 61000 4 8 EN BS 61000 4 11 Product Safety 2014 35 EU LVD Directive UL CSA 62368 1 USA and Canada Electrical Equipment Safety Regulations 2016 IEC EN BS 62368 1 Environment 2011 65 EU RoHS Directive EC 1907 2006 REACH 2012 19 EU WEEE Directive California Proposition 65 Perchlorate Warning California Best Management Practices Regulations for Perchlorate Materials...