xFusion Digital Technologies FusionServer 1288H V5, Technical Paper

Page 1: ...FusionServer 1288H V5 Server Technical White Paper Issue 08 Date 2023 02 28 xFusion Digital Technologies Co Ltd...

Page 2: ...bear any liability resulting from the use of xFusion The purchased products services and features are stipulated by the contract made between xFusion and the customer All or part of the products serv...

Page 3: ...dicators 20 5 2 3 Ports 22 5 3 Processor 23 5 4 Memory 24 5 4 1 DDR4 Memory 24 5 4 1 1 Memory Identifier 24 5 4 1 2 Memory Subsystem Architecture 26 5 4 1 3 Memory Compatibility 27 5 4 1 4 DIMM Instal...

Page 4: ...7 2 PCIe Slots 48 5 7 3 PCIe Slot Description 49 5 8 PSUs 50 5 9 Fans 51 5 10 Boards 52 5 10 1 Mainboard 52 5 10 2 Drive Backplane 55 6 Product Specifications 57 6 1 Technical Specifications 57 6 2 En...

Page 5: ...el of risk which if not avoided will result in death or serious injury Indicates a hazard with a medium level of risk which if not avoided could result in death or serious injury Indicates a hazard wi...

Page 6: ...5 1 2 Indicators and Buttons 04 2022 08 12 Optimized 6 3 Physical Specifications 03 2022 06 25 Added a figure that shows how to measure dimensions Added the description of the enhanced management chi...

Page 7: ...erprise and telecom applications The 1288H V5 is ideal for IT core services cloud computing high performance computing distributed storage big data processing enterprise or telecom applications and ot...

Page 8: ...s operating system OS vendors to better use hardware to address virtualization workloads Intel Advanced Vector Extensions 512 Intel AVX 512 significantly accelerates floating point performance for com...

Page 9: ...rs system parameters in real time triggers alarms and performs recovery actions in case of failures minimizing system downtime For more information about the warranty in the Chinese market see Warrant...

Page 10: ...Plus Platinum power supply units PSUs of multiple power ratings provide 94 power efficiency at 50 load The server supports active standby power supplies and high voltage DC HVDC for improved power su...

Page 11: ...5 physical structure example 8 x 2 5 drives 1 Power supply unit PSU 2 Chassis 3 Fan module bracket 4 Fan module 5 Front drive backplane 6 Drive 7 DVD drive 8 Indicator board 9 VGA board 10 Heat sink 1...

Page 12: ...nks at a speed of up to 10 4 GT s Two PCIe riser cards connect to the processors through PCIe buses to provide ease of expandability and connection The RAID controller card on the mainboard connects t...

Page 13: ...4 Logical Structure 2023 02 28 13 Uses the BMC management chip and supports a VGA a management network port a debugging serial port and other management ports The BMC management chip can be an enhance...

Page 14: ...escription 5 1 Front Panel 5 2 Rear Panel 5 3 Processor 5 4 Memory 5 5 Storage 5 6 Network 5 7 I O Expansion 5 8 PSUs 5 9 Fans 5 10 Boards 5 1 Front Panel 5 1 1 Appearance 4 x 3 5 drive configuration...

Page 15: ...VD drive 3 Slide out label plate with an SN label 10 x 2 5 drive configuration Figure 5 3 Front view 1 Drives 2 Slide out label plate with an SN label 5 1 2 Indicators and Buttons Indicator and Button...

Page 16: ...2 5 drive configuration Figure 5 5 Indicators and buttons on the front panel 1 Fault diagnosis LED 2 Health status indicator 3 Reserve 4 NMI button 5 Power button indicator 6 UID button indicator 10...

Page 17: ...cator is steady yellow Steady yellow The device is standby Power button When the device is powered on you can press this button to gracefully shut down the OS NOTE For different OSs you may need to sh...

Page 18: ...riggered to stop the OS for debugging To trigger an NMI press this button or click the button on the iBMC WebUI NOTICE Press the NMI button only when the OS is abnormal Do not press this button when t...

Page 19: ...ont panel Port Type QuantityNote Description VGA port DB15 1 Used to connect a display terminal such as a monitor or KVM USB port USB 2 0 1 Used to connect to a USB device NOTICE Before connecting an...

Page 20: ...t 1 2 PCIe slot 2 3 PCIe slot 3 4 Optional FlexIO card 5 PSU 1 6 PSU 2 5 2 2 Indicators Indicator Positions Figure 5 11 Indicators on the rear panel 1 LOM port indicator 2 LOM port indicator 3 Data tr...

Page 21: ...OTE The possible causes of no power output are as follows Power supply overtemperature protection Power output overcurrent or short circuit Output overvoltage Short circuit protection Device failure e...

Page 22: ...iption LOM port 1 10GE SFP or 10GE BASE T 2 10GE LOM service ports optical electrical Use the optical or electrical ports based on service requirements For details see 5 6 1 LOMs LOM port 2 1000BASE T...

Page 23: ...abnormally if an abnormal USB device is connected PSU socket 2 Used to connect to the power distribution unit PDU in the cabinet You can select the number of power supply units PSUs as required NOTE W...

Page 24: ...cal White Paper 5 Hardware Description 2023 02 28 24 Figure 5 13 Processor positions 5 4 Memory 5 4 1 DDR4 Memory 5 4 1 1 Memory Identifier You can determine the memory module properties based on the...

Page 25: ...y module 8 GB 16 GB 32 GB 64 GB 128 GB 2 Number of ranks of the memory module 1R single rank 2R dual rank 4R quad rank 8R octal rank 3 Data width on the DRAM X4 4 bit X8 8 bit 4 Type of the memory int...

Page 26: ...ed the memory modules in secondary memory channels cannot be used Table 5 5 Memory channels CPU Memory Channel Memory Slot CPU 1 A primary DIMM000 A A DIMM001 G B primary DIMM010 B B DIMM011 H C prima...

Page 27: ...ket Cascade Lake processors L processors 4 5 TB socket M processors 2 TB socket Other processors 1 TB socket The total memory capacity is the sum of the capacity of all DDR4 DIMMs The total memory cap...

Page 28: ...channel d If the Cascade Lake processor is used the maximum operating speed of a DIMM can reach 2933 MT s If the Skylake processor is used the maximum operating speed of a DIMM can reach 2666 MT s onl...

Page 29: ...and 2 or channels 1 2 and 3 The installed memory modules must be identical in size and organization For a multi processor configuration each processor must have a valid memory mirroring configuration...

Page 30: ...28 30 Figure 5 16 DDR4 memory installation guidelines 1 processor Figure 5 17 DDR4 memory installation guidelines 2 processors 5 4 1 6 Memory Protection Technologies The following memory protection t...

Page 31: ...ttling Memory address parity protection Memory demand patrol scrubbing Device tagging Data scrambling Adaptive double device data correction ADDDC ADDDC 1 5 4 2 DCPMM 5 4 2 1 Memory Identifier Figure...

Page 32: ...el supports up to one DCPMM DCPMMs must be used with DDR4 memory modules Table 5 7 Memory channels CPU Memory Channel Memory Slot CPU 1 A primary DIMM000 A A DIMM001 G B primary DIMM010 B B DIMM011 H...

Page 33: ...cessor model L processors 4 5 TB socket M processors 2 TB socket Other processors 1 TB socket The DCPMM can work only in App Direct Mode AD and Memory Mode MM The total supported memory capacity is ca...

Page 34: ...rence only For details consult the local sales representative 5 4 2 4 DIMM Installation Rules The following are general guidelines for DCPMM installation The DDR4 memory modules used with the DCPMMs i...

Page 35: ...emory Capacity Supported by a CPU DDR4 and DCPMM Capacities M series 2 TB L series 4 5 TB 5 4 2 5 Memory Installation Positions A 1288H V5 supports a maximum of 12 DCPMMs The DCPMMs must be used with...

Page 36: ...DDR4 memory configuration guidelines 2 processors Figure 5 22 DCPMM and DDR4 memory configuration guidelines 5 4 2 6 Memory Protection Technologies The following memory protection technologies are sup...

Page 37: ...on Front drive 8 x 2 5 Slots 0 to 7 support only SAS SATA drives 1 x RAID controller card PCHa Screw in RAID controller card installed in the RAID controller card connector on the mainboard PCIe RAID...

Page 38: ...d or PCH can be used to manage common drives The PCH supports only SATA drives b The drives can be managed only by the Avago SAS3516 RAID controller card Contact your local sales representative or use...

Page 39: ...6 4 ATA7 5 ATA8 6 ATA9 7 ATA10 10 x 2 5 drive configuration Figure 5 25 Drive numbering 5 5 3 Drive Indicators SAS SATA Drive Indicators Figure 5 26 SAS SATA drive indicators Table 5 12 Description of...

Page 40: ...ady on Steady on The drive is faulty NVMe Drive Indicators Figure 5 27 NVMe drive indicators If the VMD function is enabled and the latest VMD driver is installed the NVMe drives support surprise hot...

Page 41: ...s complete and the NVMe drive is removable Steady on Off Steady on The NVMe drive is faulty M 2 FRU Indicators Figure 5 28 M 2 FRU indicators Table 5 15 M 2 FRU indicator description Indicator Descrip...

Page 42: ...n 1000 Mbit s full duplex 1000M 10 100M Auto negoti ation 10 000 Mbit s full duplex 10000M 10 100M GE electrical port 2 Auto negoti ation 1000 Mbit s full duplex 1000M 10 100M Use Compatibility Checke...

Page 43: ...port 3 6 GE electrical port LOM GE port 4 Indicator Positions Figure 5 30 LOM indicators 1 Connection status indicator Data transmission status indicator for a 10GE optical port 2 Data transmission ra...

Page 44: ...t is not connected Steady green The data transmission rate of the link is 10 Gbit s Steady yellow The data transmission rate of the link is 1 Gbit s Connection status indicator of a GE electrical port...

Page 45: ...electrical port 4 SM211 i350 GE electrical port 2 SM212 i350 GE electrical port 4 SM233 X540 10GE electrical port 2 SM251 CX3 56G IB optical port 2 SM252 CX3 56G IB optical port 1 SM330 X710 10GE opt...

Page 46: ...indicators SM252 with one 56G IB optical port Figure 5 35 SM252 network port indicators SM330 with two 10GE optical ports SM380 with two 25GE optical ports Figure 5 36 SM330 SM380 network port indica...

Page 47: ...rate indicator Off The network port is not connected or the data transmission rate is 100 Mbit s Steady green The data transmission rate is 10 Gbit s Steady yellow The data transmission rate is 1 Gbi...

Page 48: ...n electrical port to a PoE device may cause link communication failure or even damage the NIC Contact your local sales representative or use the Compatibility Checker to determine the components to be...

Page 49: ...288H V5 Server Technical White Paper 5 Hardware Description 2023 02 28 49 PCIe Riser Modules Figure 5 38 PCIe riser modules 5 7 3 PCIe Slot Description The PCIe slots mapping to a vacant CPU socket ar...

Page 50: ...the server is not fully configured with PCIe devices or if a PCIe card with a PCI bridge is configured Root Port B D F indicates the B D F of an internal PCIe root port of the processor Device B D F...

Page 51: ...local sales representative or use the Compatibility Checker to determine the components to be used When one or two 900 W AC Titanium PSUs are configured and the input voltage ranges from 100 V AC to...

Page 52: ...escription 2023 02 28 52 Figure 5 40 Fan module positions 5 10 Boards 5 10 1 Mainboard BOM code for mainboards of enhanced management chip VB 0302Y074 0302Y075 BOM code for mainboards of normal manage...

Page 53: ...2Y075 06410417 06410421 1 USB 3 0 port USB 3 0 CONN J169 2 UID indicator D6020 3 Serial port 4 Management network port 5 GE electrical port 6 GE electrical port 7 VGA connector VGA CONN J112 8 10GE op...

Page 54: ...nector CPU2 SLIMLINE A J140 30 CPU2 slimline B connector CPU2 SLIMLINE B J139 31 PSU 2 connector J157 32 PSU 1 connector J156 33 RTC battery CMOS BATTERY U4042 34 Jumper J176 d 35 I O NIC connectors I...

Page 55: ...ctor PORT1 J3 5 Power connector HDD POWER J24 6 SATA signal connector PORT0 J2 7 Backplane signal cable connector HDD_BP J1 8 x 2 5 drive backplane 8 x SAS SATA Figure 5 43 8 x 2 5 drive backplane 8 x...

Page 56: ...onnector SLIM B J9 9 Power connector HDD POWER J1 10 Backplane signal cable connector HDD BP J22 10 x 2 5 drive backplane 10 x SAS SATA or 6 x SAS SATA 2 x SAS SATA NVMe 2 x NVMe This drive backplane...

Page 57: ...ors Intel Xeon Scalable Skylake and Cascade Lake processors Built in memory controller and six memory channels Built in PCIe controller supporting PCIe 3 0 and 48 lanes per processor Two UPI buses bet...

Page 58: ...ve letter of the M 2 SSDs managed by the Avago SAS3004iMR RAID controller card can be set to sda by modifying the GRUB parameters only when the RAID controller card is used with an SR130 SR760IT M Sma...

Page 59: ...iple types of networks LOM Supports two 10GE optical ports and two GE electrical ports via the NIC chip integrated on the mainboard Supports two 10GE electrical ports and two GE electrical ports via t...

Page 60: ...ker to obtain specific information Port Supports a variety of ports Ports on the front panel One USB 2 0 port One USB 3 0 port One DB15 VGA port NOTE For the server that uses 10 x 2 5 drive configurat...

Page 61: ...ina TPM Secure boot Front bezel optional 6 2 Environmental Specifications Table 6 2 Environmental specifications Category Specifications Temperature Operating temperature 5 C to 45 C 41 F to 113 F ASH...

Page 62: ...d at an altitude of over 3050 m 10006 44 ft Corrosive gaseous contaminant Maximum corrosion product thickness growth rate Copper corrosion rate test 300 month meeting level G1 requirements of the ANSI...

Page 63: ...with data stored Maximum preservation duration of HDDs 6 months in unpacked packed and powered off state The maximum preservation duration is determined according to the preservation specifications p...

Page 64: ...abinets with a distance of 543 5 mm to 848 5 mm 21 40 in to 33 41 in between the front and rear mounting bars Ball bearing rail kit applies to cabinets with a distance of 610 mm to 914 mm 24 02 in to...

Page 65: ...c middleware software and hardware The slight differences of the application software middleware basic software and hardware may cause performance inconsistency between the application layer and test...

Page 66: ...n installing hardware Follow them in conjunction with these Safety Instructions Only qualified personnel are allowed to perform special tasks such as performing high voltage operations and driving a f...

Page 67: ...n Figure 8 1 Figure 8 1 Safety work wear Before touching a device wear ESD clothing and gloves or wrist strap and remove any conductive objects such as watches and jewelry Figure 8 2 shows conductive...

Page 68: ...ion Equipment Safety Use the recommended power cables at all times Use power cables only for dedicated servers Do not use them for other devices Before operating equipment wear ESD clothes and gloves...

Page 69: ...ight Carried by a Person To reduce the risk of personal injury comply with local regulations with regard to the maximum weight one person is permitted to carry Table 8 1 lists the maximum weight one p...

Page 70: ...and protocols KVM and text console redirection Remote virtual media IPMI SNMP Common information model CIM Redfish Browser based login Specifications Table 9 1 iBMC specifications Specifications Desc...

Page 71: ...eproduction Reproduces faults to facilitate fault diagnosis Screen snapshots and videos Allows users to view screenshots and videos without login facilitating routine preventive maintenance inspection...

Page 72: ...7 EMC EN 55032 2015 A11 2020 CISPR 32 2015 A1 2019 EN IEC 61000 3 2 2019 A1 2021 EN 61000 3 3 2013 A1 2019 EN 55035 2017 A11 2020 CISPR 35 2016 EN 55024 2010 A1 2015 CISPR 24 2010 A1 2015 ETSI EN 300...

Page 73: ...2017 A11 2020 CISPR 35 2016 EN 55024 2010 A1 2015 CISPR 24 2010 A1 2015 ETSI EN 300 386 V1 6 1 2012 ETSI EN 300 386 V2 1 1 2016 RoHS BS EN IEC 63000 2018 ErP Commission Regulation EU 424 2019 China CC...

Page 74: ...re for reference only For details see the actual product A 1 1 On the Front Top Figure A 1 Chassis head label 1 Nameplate 2 Certificate 3 Quick access tag 4 SN NOTE For details see A 2 Product SN 5 Re...

Page 75: ...5 A 1 1 1 Nameplate Figure A 2 Nameplate example Table A 1 Nameplate description No Description 1 Server Model For details see A 4 Nameplate 2 Device names 3 Power Supply Requirements 4 Vendor Informa...

Page 76: ...is Z which is fixed 3 Y indicates a server B indicates a semi finished server N indicates a spare part 4 The value is 0 This digit is a reserved digit 5 Indicates the year two digits 6 Indicates the...

Page 77: ...icates the manufacturing serial number five digits A 1 1 3 Sample Quick Access Tags Figure A 5 Sample quick access tags Table A 4 Quick access tab description No Description 1 IP address of the iBMC m...

Page 78: ...guide is located on the inside of the chassis cover It describes how to remove the mainboard components important components of the chassis precautions and QR codes of technical resources The pictures...

Page 79: ...Y indicate years 2023 to 2032 respectively NOTE The years from 2010 are represented by upper case letters excluding I O and Z because the three letters are similar to the digits 1 0 and 2 The second...

Page 80: ...280M 82 68 and Gold 6154 6254 processors PCIe SSD cards NVMe drives Passive GPU cards Options supported Platinum 8153 Gold 6152 6140 6126 5118 5215 Silver 4216 4215 4214 and other processors lower tha...

Page 81: ...Throttling Automatically adjusts the memory temperature to prevent the memory from being damaged due to overheat Rank Sparing Uses some memory ranks for backup to prevent the system from breaking dow...

Page 82: ...rove system reliability Architected Error Records With the features such as eMCA the BIOS collects error information recorded in hardware registers in compliance with UEFI specifications notifies the...

Page 83: ...e CPUN N indicates the CPU number The value is 1 or 2 CPUN DTS CPU DTS value CPUN N indicates the CPU number The value is 1 or 2 CPUN Margin CPU Margin CPUN N indicates the CPU number The value is 1 o...

Page 84: ...PU number The value is 1 or 2 CPUN VCCIO CPU VCCIO voltage Mainboard N indicates the CPU number The value is 1 or 2 CPUN VMCP CPU VMCP voltage Mainboard N indicates the CPU number The value is 1 or 2...

Page 85: ...gnosis health status Mainboard CPUN QPI Link CPU QPI link fault diagnosis health status Mainboard or CPUN N indicates the CPU number The value is 1 or 2 CPUN Prochot CPU Prochot CPUN N indicates the C...

Page 86: ...backplane health status Drive backplane RiserN Card Entity presence Riser card N N indicates the riser card number The value is 1 or 2 FANN F Presence Fan presence Fan module N N indicates the fan mo...

Page 87: ...ink Down LOM LOM LOM P3 Link Down LOM LOM LOM P4 Link Down LOM LOM PCIe RAID Temp PCIe RAID controller card temperature PCIe RAID controller card M2 Temp PCIe Maximum temperature of all M 2 drives of...

Page 88: ...Intel and DEC Ethernet uses the Carrier Sense Multiple Access Collision Detection CSMA CD access method and allows data transfer over various cables at 10 Mbit s The Ethernet specification is the basi...

Page 89: ...ystem Intel is the main sponsor for PCIe PCIe is used only for internal interconnection A PCI system can be transformed to a PCIe one by modifying the physical layer instead of software PCIe delivers...

Page 90: ...Glossary 2023 02 28 90 B 5 U Z U U A unit defined in International Electrotechnical Commission IEC 60297 1 to measure the height of a cabinet or chassis 1 U 44 45 mm UltraPath Interconnect UPI A poin...

Page 91: ...nating current AES Advanced Encryption Standard New Instruction Set ARP Address Resolution Protocol AVX Advanced Vector Extensions B BBU backup battery unit BIOS Basic Input Output System C CD calenda...

Page 92: ...ss memory DVD digital video disc E ECC error checking and correcting ECMA European Computer Manufacturer Association EDB Execute Disable Bit EN European Efficiency ERP enterprise resource planning ETS...

Page 93: ...MP Internet Control Message Protocol IDC Internet Data Center IEC International Electrotechnical Commission IEEE Institute of Electrical and Electronics Engineers IGMP Internet Group Message Protocol...

Page 94: ...erface C 4 P T P PCIe Peripheral Component Interconnect Express PDU power distribution unit PHY physical layer PMBUS power management bus POK power OK PWM pulse width modulation PXE Preboot Execution...

Page 95: ...lizer SGMII serial gigabit media independent interface SMI serial management interface SMTP Simple Mail Transfer Protocol SNMP Simple Network Management Protocol SOL serial over LAN SONCAP Standards O...

Page 96: ...ory module UEFI Unified Extensible Firmware Interface UID unit identification light UL Underwriter Laboratories Inc USB Universal Serial Bus V VCCI Voluntary Control Council for Interference by Inform...