Dell EMC ECS EX Series, Hardware Manual

Page 1: ...ECS EXSeries Version 3 4 Hardware Guide 08 February 2020 ...

Page 2: ...S PUBLICATION AND SPECIFICALLY DISCLAIMS IMPLIED WARRANTIES OF MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE USE COPYING AND DISTRIBUTION OF ANY DELL SOFTWARE DESCRIBED IN THIS PUBLICATION REQUIRES AN APPLICABLE SOFTWARE LICENSE Dell Technologies Dell EMC Dell EMC and other trademarks are trademarks of Dell Inc or its subsidiaries Other trademarks may be the property of their respective owne...

Page 3: ...ng 32 EX500 iDRAC cabling 41 EX500 network cabling 43 Network connections between multiple ECS appliances in a single site 50 EX300 Platform 55 EX300 hardware components 56 EX300 configurations 57 EX300 upgrade paths 60 EX300 server 60 Server front view 62 Server rear view 64 EX300 disk drives 65 EX300 power cabling 66 EX300 iDRAC cabling 75 EX300 network cabling 77 Network connections between mul...

Page 4: ...front view 94 Server rear view 98 EX3000 disk drives 100 EX3000 power cabling 100 EX3000 iDRAC cabling 111 EX3000 network cabling 115 Third Party Rack Requirements 125 Third party rack requirements 126 Chapter 6 Contents 4 ECS EXSeries Hardware Guide ...

Page 5: ...t brain topology 50 Inter rack switch connectivity linear topology daisy chain between EX Series racks 51 Inter rack switch connectivity linear topology daisy chain between an EX Series rack and a Gen2 U Series D Series or C Series rack 51 Ring topology 52 Inter rack switch connectivity ring topology 52 Star topology 53 Inter rack switch connectivity star topology 53 EX300 minimum and maximum conf...

Page 6: ...s 96 Front panel features and indicators 96 EX3000D server rear view in rack 98 Back panel features and indicators 98 EX3000 disk drive in carrier 100 PDU outlet numbers 101 PDU single phase diagram 103 EX3000S single phase AC power cabling 104 EX3000D single phase AC power cabling 105 PDU three phase diagram 106 EX3000S three phase delta AC power cabling 107 EX3000D three phase delta AC power cab...

Page 7: ...00 servers 61 Decoding of LEDs in light bar 63 Server Panel Ports and Slots 64 EX300 0U PDU cabling 67 EX300 2U PDU cabling 67 EX300 node iDRAC port to BE1 port mapping 75 EX3000 hardware components 88 EX3000S single node chassis configurations 91 EX3000D dual node chassis configurations 92 EX3000 physical dimensions 93 Server indicators buttons or connectors 96 Server indicators buttons or connec...

Page 8: ...Tables 8 ECS EXSeries Hardware Guide ...

Page 9: ...s and users and the creation and configuration of buckets Monitoring Guide The Monitoring Guide supports the ECS administrator s use of the ECS Portal to monitor the health and performance of ECS and to view its capacity utilization Data Access Guide The Data Access Guide describes the protocols that are supported by ECS for user access to ECS object storage In addition to the S3 EMC Atmos OpenSta...

Page 10: ...Welcome to ECS 10 ECS EXSeries Hardware Guide ...

Page 11: ...CHAPTER 1 EX Series Hardware Overview l Introduction 12 l Rack and node host names 12 ECS EXSeries Hardware Guide 11 ...

Page 12: ...his platform starts at a 2 2 PB RAW minimum configuration and scales to 8 6 PB RAW per rack Note In this document the term node is used interchangeably with server and the term appliance refers to a cluster of nodes running ECS software Hardware generations ECS appliances are characterized by hardware generation Gen3 l EX500 Gen3 models featuring 8TB or 12 TB disks 12 or 24 x HDD per node became a...

Page 13: ... gray 32 aquamarine 49 avocado 16 beige 33 baby 50 bubblegum 17 silver 34 eggplant Nodes are assigned node names based on their order within the server chassis and within the rack itself The following table lists the default node names Table 2 Default node names Node Node name Node Node name 1 provo 9 boston 2 sandy 10 chicago 3 orem 11 houston 4 ogden 12 phoenix 5 layton 13 dallas 6 logan 14 detr...

Page 14: ... a unique combination of node name and rack name For example node 4 in rack 1 is identified as ogden red and can be pinged using its NAN resolvable through mDNS name ogden red nan local EX Series Hardware Overview 14 ECS EXSeries Hardware Guide ...

Page 15: ...CHAPTER 2 Switches l Dell EMC S5148F switch 16 ECS EXSeries Hardware Guide 15 ...

Page 16: ...ocess In this case the customer must provide the appropriate VLT cables SFPs or external connection cables CAUTION It is required to have connections from the customer s network to both front end switches rabbit and hare in order to maintain the high availability architecture of the ECS appliance If the customer chooses not to connect to their network in the required HA manner there is no guarante...

Page 17: ...orts 39 and 40 Ports 39 and 40 are only used in the scenario where there is Gen2 hardware series integration with EX Series hardware in the VDC When Gen2 hardware is mixed with EX Series hardware ports 39 and 40 are the only ports used for connectivity All iDRAC cables from nodes and all front end switch management cable connections route to the Fox BE1 switch Figure 3 Back end switches Fox Switch...

Page 18: ... when the ECS system has more than one rack 10 25 GbE 45 48 Out to EX Series rack when the ECS system has more than one rack 10 25 GbE 49 50 VLT ports 100 GbE 51 54 Not designated 100 GbE Front end and back end switch connections The front end switch management ports connect to back end switch ports via two CAT6 cable and two 1GBaseT SFP These two cables and two SFP are used for Dell EMC switches ...

Page 19: ...tches is used for the inbound connection and port 45 is used for the outbound connection These ports are used for linear and ring topology rack to rack connectivity For more information see Network connections between multiple ECS appliances in a single site on page 50 Figure 5 Back end switch connections between EX Series racks Switches ECS EXSeries Hardware Guide 19 ...

Page 20: ...Figure 6 Front end switch connections to customer switches example Switches 20 ECS EXSeries Hardware Guide ...

Page 21: ...configurations 23 l EX500 upgrade paths 26 l EX500 server 27 l EX500 disk drives 31 l EX500 power cabling 32 l EX500 iDRAC cabling 41 l EX500 network cabling 43 l Network connections between multiple ECS appliances in a single site 50 ECS EXSeries Hardware Guide 21 ...

Page 22: ...ide their own 10 GbE or 25 GbE HA pair for the front end l If the customer provides their own front end switches they must supply all VLT cables SFPs or external connection cables l If Dell EMC S5148F 25 GbE front end switches are used the 25 GbE ports are configured to run at 25G to connect to the EX500 nodes and 2 x 100 GbE VLT cables are provided Nodes l Minimum number of nodes per rack is 1 n ...

Page 23: ...EX500 configurations Learn about the EX500 ECS appliance configurations EX500 Platform ECS EXSeries Hardware Guide 23 ...

Page 24: ...appliance is available in the following configurations within a Dell EMC rack or a customer provided rack EX500 supports 5 nodes in the same configuration You can combine 8 and 12 TB disks with a minimum of 5 nodes of the same disk configuration Lists the nodes disks in each node disk size and the RAW storage capacity Table 6 EX500 configurations Nodes Disks in each node Disk Size RAW Storage capa...

Page 25: ...2 l 8 TB l 12 TB l 96 TB l 144 TB 24 l 8 TB l 12 TB l 192 TB l 288 TB 8 12 l 8 TB l 12 TB l 96 TB l 144 TB 24 l 8 TB l 12 TB l 192 TB l 288 TB 9 12 l 8 TB l 12 TB l 96 TB l 144 TB 24 l 8 TB l 12 TB l 192 TB l 288 TB 10 12 l 8 TB l 12 TB l 96 TB l 144 TB 24 l 8 TB l 12 TB l 192 TB l 288 TB 11 12 l 8 TB l 12 TB l 96 TB l 144 TB 24 l 8 TB l 12 TB l 192 TB l 288 TB EX500 Platform ECS EXSeries Hardware...

Page 26: ...B 24 l 8 TB l 12 TB l 192 TB l 288 TB 16 maximum configuration 12 l 8 TB l 12 TB l 96 TB l 144 TB 24 l 8 TB l 12 TB l 192 TB l 288 TB EX500 upgrade paths Learn about the EX500 ECS appliance upgrade paths l Disk upgrade kits are available in 12 disk increments l EX500 upgrades 12 to 24 disks l To add disk capacity to an EX500 disk upgrade kits per node must be ordered based on the existing disk cap...

Page 27: ... eight PCI express PCIe Gen3 expansion cards that can be installed on the system board using three expansion card risers l Config 1 1B 2B l Four x8 slots and rear storage Processors 2x Xeon Silver 10 core 20 thread 85W Memory 8 x 8GB RDIMM 2666MT s Single Rank x8 Data Width Disk Controller HBA330 mini IOC JBOD PCIe Slot 1 Broadcom 57414 2x25GbE QSFP28 PCIe Slot 2 BOSS controller card with 1 M 2 st...

Page 28: ...erver physical dimensions continued Server front view Learn about the EX500 front view The following figure shows the EX500 2U server chassis front with 12 x 3 5 SATA HDDs EX500 Platform 28 ECS EXSeries Hardware Guide ...

Page 29: ...r Status ID button Indicates that the system is turned on system is healthy and system ID mode is not active Press the system health and system ID button to switch to system ID mode Solid Blue Indicates that the system is in fail safe mode If the problem persists see the Getting help section Solid Amber Indicates that the system is experiencing a fault Check the System Event Log for specific error...

Page 30: ...ystem health mode Blink Blue There are two status LEDs to indicate and identify any failed hardware components Figure 11 Status LEDs decoded view 1 System health and system ID indicator 2 Drive indicator Figure 12 Right control panel 1 Power button 2 USB 2 0 compliant port 3 Micro USB for iDRAC Direct 4 iDRAC LED indicator EX500 Platform 30 ECS EXSeries Hardware Guide ...

Page 31: ...Front end switch 1 Server x FE 1 6 Power cable black AC PS1 7 Power cable grey AC PS2 EX500 disk drives Learn about the disk drives that are integrated into the server chassis of the EX500 appliance EX500 nodes contain 24 3 5 inch SATA front accessible hot swappable drives in disk bay 1 slots 0 11 and disk bay 2 slots 12 23 Disk size can be 8TB or 12TB All drives within a node must be of the same ...

Page 32: ...le phase AC power and three phase delta and wye AC power Use the power and weight calculator to refine the power and heat values to more closely match the hardware configuration for your system The calculator contains the latest information for power and weight planning EX500 Platform 32 ECS EXSeries Hardware Guide ...

Page 33: ...ty 3 35 12 Empty 3 34 12 Empty 3 33 11 Node 16 3 32 11 Node 15 3 31 11 Node 14 3 30 10 Empty 2 29 10 Empty 2 28 10 Empty 2 27 9 Empty 2 26 9 Empty 2 25 9 Node 13 2 24 8 Node 12 2 23 8 Node 11 2 22 8 Node 10 2 21 7 Node 9 2 20 7 Node 8 2 19 7 Node 7 2 18 6 Empty 1 17 6 Empty 1 16 6 Empty 1 15 5 Empty 1 14 5 Empty 1 13 5 Empty 1 12 4 FE Switch 2 1 11 4 FE Switch 1 1 10 4 Tray Light Bar 1 9 3 BE Swit...

Page 34: ...PDU three phase Delta and WYE zone A B mapping PDU outlet Branch Component Line cord per zone 37 12 Empty 1 36 12 Empty 1 35 12 Empty 1 34 12 Empty 1 33 11 Empty 1 32 11 Empty 1 31 11 Empty 1 30 10 Empty 1 29 10 Empty 1 28 10 Empty 1 27 9 Empty 1 26 9 Empty 1 25 9 Empty 1 24 8 Empty 1 23 8 Empty 1 22 8 Empty 1 21 7 Node 16 1 20 7 Node 15 1 19 7 Node 14 1 18 6 Node 13 1 17 6 Node 12 1 16 6 Node 11 ...

Page 35: ...1 2 1 Node 2 1 1 1 Node 1 1 The table describes EX500 2U PDU single phase zone A B mapping Table 12 EX500 2U PDU single phase zone A B mapping PDU outlet Branch Component Line cord per zone 24 6 Empty 3 23 6 Empty 3 22 6 Empty 3 21 6 Node 16 3 20 5 Node 11 2 19 5 Node 10 2 18 5 Node 9 2 17 5 Node 8 2 16 4 Node 4 1 15 4 Node 3 1 14 4 FE Switch2 1 13 4 FE Swtich 1 1 12 3 Node 15 3 11 3 Node 14 3 10 ...

Page 36: ... 13 EX500 2U PDU three phase Delta and Wye zone A B mapping PDU outlet Branch Component Line cord per zone 24 6 Empty 1 23 6 Empty 1 22 6 Empty 1 21 6 Node 16 1 20 5 Node 11 1 19 5 Node 10 1 18 5 Node 9 1 17 5 Node 8 1 16 4 Node 4 1 15 4 Node 3 1 14 4 FE Switch2 1 13 4 FE Swtich 1 1 12 3 Node 15 1 11 3 Node 14 1 10 3 Node 13 1 9 3 Node 12 1 8 2 Tray Light Bar 1 7 2 Node 7 1 6 2 Node 6 1 5 2 Node 5...

Page 37: ...ued PDU outlet Branch Component Line cord per zone 1 1 BE Switch 1 1 In the following diagrams the switches plug into the front of the rack and route through the rails to the rear Figure 15 EX500 Single Phase AC Cabling Diagram EX500 Platform ECS EXSeries Hardware Guide 37 ...

Page 38: ...Figure 16 EX500 Three Phase Delta AC Cabling Diagram EX500 Platform 38 ECS EXSeries Hardware Guide ...

Page 39: ...EX500 Platform ECS EXSeries Hardware Guide 39 ...

Page 40: ...Figure 17 EX500 Three Phase Wye AC Cabling Diagram EX500 Platform 40 ECS EXSeries Hardware Guide ...

Page 41: ...nnections are listed in the following table Table 14 EX500 node iDRAC port to BE1 port mapping Node 1 iDRAC port BE1 Port 17 Node 2 iDRAC port BE1 Port 18 Node 3 iDRAC port BE1 Port 19 Node 4 iDRAC port BE1 Port 20 Node 5 iDRAC port BE1 Port 21 Node 6 iDRAC port BE1 Port 22 Node 7 iDRAC port BE1 Port 23 Node 8 iDRAC port BE1 Port 24 Node 9 iDRAC port BE1 Port 25 Node 10 iDRAC port BE1 Port 26 Node...

Page 42: ...Figure 19 iDRAC cabling EX500 Platform 42 ECS EXSeries Hardware Guide ...

Page 43: ...tch has a nickname l Hare The top S5148F 1U 25GbE front end switch This switch runs 25GbE SFP28 ports to EX500 nodes It is located above the Rabbit switch in U22 of the EX500 rack l Rabbit The bottom S5148F 1U 25GbE front end switch This switch runs 25GbE SFP28 ports to EX500 nodes It is located below the Hare switch in U20 of the EX500 rack l Hound The top S5148F 1U 25GbE back end switch running ...

Page 44: ... end switch and back end switch connections to an EX500 node are shown in the following diagram Figure 20 Front end and back end switch connections to an EX500 node EX500 Platform 44 ECS EXSeries Hardware Guide ...

Page 45: ...13 15 17 19 21 23 25 27 29 35 31 33 37 39 41 43 45 47 VLT1 VLT2 customer ports 51 52 52 51 53 53 54 54 Figure 22 Network cable and labeling In the table below x is the server number Network Cable Description Labeling 1 iDRAC management port back end switch 1 Server x iDRAC 2 Back end switch 1 Server x BE 1 3 Back end switch 2 Server x BE 2 4 Front end switch 2 Server x FE 2 5 Front end switch 1 Se...

Page 46: ...2 20 18 16 14 12 10 8 4 6 2 3 5 7 9 11 13 15 17 19 21 23 25 27 29 35 31 33 37 39 41 43 45 47 VLT1 VLT2 1 48 46 44 42 40 38 36 34 32 30 28 26 24 22 20 18 16 14 12 10 8 4 6 2 3 5 7 9 11 13 15 17 19 21 23 25 27 29 35 31 33 37 39 41 43 45 47 VLT1 VLT2 51 52 53 54 51 52 53 54 EX500 Platform 46 ECS EXSeries Hardware Guide ...

Page 47: ... node port to the iDRAC back end switch and front end switch port connections are listed in the following table Figure 24 EX500 node network port cabling connections EX500 Platform ECS EXSeries Hardware Guide 47 ...

Page 48: ...The EX500 node network cable labeling is listed in the following table Figure 25 EX500 node network cable labeling EX500 Platform 48 ECS EXSeries Hardware Guide ...

Page 49: ...Figure 26 EX500 network cabling EX500 Platform ECS EXSeries Hardware Guide 49 ...

Page 50: ...r rack network is created Through these connections nodes from any intra rack network can communicate to any other node on the inter rack network There are three types of topologies you can use to connect the intra rack LANs into an inter rack network l Daisy chain or line topology l Ring topology l Star topology Linear or daisy chain topology The simplest topology to connect the intra racks toget...

Page 51: ...ent for mixing Gen2 and Gen3 racks in the same VDC Ports 39 and 40 are not used in an all Gen3 environment with EX Series racks Figure 30 Inter rack switch connectivity linear topology daisy chain between an EX Series rack and a Gen2 U Series D Series or C Series rack Ring topology For a more reliable network the ends of the daisy chain topology can be connected together to create a ring network a...

Page 52: ...ommended topology is to use two aggregation switches with port channel VLT vPC MLAG connectivity between them If you use a single aggregation switch both the Fox switch BE1 and the Hound switch BE2 are connected to the single switch The impact of using only one aggregation switch is the loss of high availability for the aggregation switch For connectivity to aggregation switches use the inbound po...

Page 53: ... must be set up as a trunk and allow VLAN traffic to flow between all ports in the inter rack network The inter rack star topology between EX Series racks are shown in the following figure Figure 34 Inter rack switch connectivity star topology EX500 Platform ECS EXSeries Hardware Guide 53 ...

Page 54: ...EX500 Platform 54 ECS EXSeries Hardware Guide ...

Page 55: ...configurations 57 l EX300 upgrade paths 60 l EX300 server 60 l EX300 disk drives 65 l EX300 power cabling 66 l EX300 iDRAC cabling 75 l EX300 network cabling 77 l Network connections between multiple ECS appliances in a single site 83 ECS EXSeries Hardware Guide 55 ...

Page 56: ...heir own 10 GbE or 25 GbE HA pair for the front end l If the customer provides their own front end switches they must supply all VLT cables SFPs or external connection cables l If Dell EMC S5148F 25 GbE front end switches are used the 25 GbE ports are configured to run at 10 GbE to connect to the EX300 nodes and 2 x 100 GbE VLT cables are provided Nodes l Minimum number of nodes per rack is 5 with...

Page 57: ...EX300 configurations Describes the EX300 ECS appliance configurations EX300 Platform ECS EXSeries Hardware Guide 57 ...

Page 58: ... view requires a brace wherever there is empty space above or below an EX300 server Figure 35 EX300 minimum and maximum configurations The EX300 appliance is available in the following configurations within a Dell EMC rack or a customer provided rack Lists the nodes disks in each node disk size and RAW storage capacity EX300 Platform 58 ECS EXSeries Hardware Guide ...

Page 59: ... TB l 2 TB l 4 TB l 8 TB l 84 TB l 168 TB l 336 TB l 672 TB 8 12 l 1 TB l 2 TB l 4 TB l 8 TB l 96 TB l 192 TB l 384 TB l 768 TB 9 12 l 1 TB l 2 TB l 4 TB l 8 TB l 108 TB l 216 TB l 432 TB l 864 TB 10 12 l 1 TB l 2 TB l 4 TB l 8 TB l 120 TB l 240 TB l 480 TB l 960 TB 11 12 l 1 TB l 2 TB l 4 TB l 8 TB l 132 TB l 264 TB l 528 TB l 1 06 PB 12 12 l 1 TB l 2 TB l 4 TB l 8 TB l 144 TB l 288 TB l 576 TB l...

Page 60: ...on node has the same disk size or the total disk capacity of the existing nodes For example you have an EX300 appliance with five nodes containing 1TB disks or have a total disk capacity of 12TB You can add a single node with 1TB disks or a total disk capacity of 12TB If you are adding nodes that have different disk sizes than the nodes currently in the system you must add a minimum of four nodes ...

Page 61: ...expansion card risers l Config 1 1B 2B l Four x8 slots and rear storage Processors 1 x Intel Xeon Bronze 3106 8 core 8 thread 1 7Ghz 85W 11 MB cache 2400Mhz DIMMs Memory 4 x 16 GB RDIMM 2667MT s Dual Rank x8 Data Width Disk Controller HBA330 mini IOC JBOD NDC Foster Flat Quad Port 10G SFP Intel X710 PCIe Slot 1 BOSS controller card with 1 M 2 stick 480 GB FH Management iDRAC9 Enterprise Power 2 x ...

Page 62: ...ont view The following figure shows the EX300 2U server chassis front with 12 x 3 5 SATA HDDs Figure 37 EX300 server chassis front view LED indicators are on the left and right side of the server front panels EX300 Platform 62 ECS EXSeries Hardware Guide ...

Page 63: ...ton The light bar indicates chassis health and also functions as System ID when pressed Table 18 Decoding of LEDs in light bar Status ID button Healthy Solid Blue Fault Blink Amber System ID Blink Blue There are five status LEDs to indicate and identify any failed hardware components Figure 39 Status LEDs decoded view EX300 Platform ECS EXSeries Hardware Guide 63 ...

Page 64: ...r chassis rear view Table 19 Server Panel Ports and Slots Item Panel Ports and Slots Description 1 Full height PCIe expansion card slot 3 The PCIe expansion card slot riser 1 connects up to three full height PCIe expansion cards to the system The Boot Optimized Storage Subsystem BOSS controller card with one M 2 stick is in the top PCIe slot slot 1 2 Half height PCIe expansion card slot The PCIe e...

Page 65: ... 9 Serial port Enables you to connect a serial device to the system 10 iDRAC9 dedicated port Enables you to remotely access iDRAC For more information see the Integrated Dell Remote Access Controller 9 iDRAC9 User s Guide 11 System identification button The System Identification ID button is available on the front and back of the systems Press the button to identify a system in a rack by turning o...

Page 66: ...e phase AC power and three phase delta and wye AC power Use the power and weight calculator to refine the power and heat values to more closely match the hardware configuration for your system The calculator contains the latest information for power and weight planning EX300 Platform 66 ECS EXSeries Hardware Guide ...

Page 67: ...ode 13 18 18 1 Node 12 17 17 1 Node 11 16 16 1 Node 10 15 15 1 Node 9 14 14 1 Node 8 13 13 1 FE 2 12 12 1 FE 1 11 11 1 Service Tray and Light Bar 10 10 1 BE 2 9 9 1 BE 1 8 8 1 Node 7 7 7 1 Node 6 6 6 1 Node 5 5 5 1 Node 4 4 4 1 Node 3 3 3 1 Node 2 2 2 1 Node 1 1 1 1 Table 21 EX300 2U PDU cabling 2U PDU cabling PS1 outlet numbers PS2 outlet numbers Line cord per zone Single phase Zone B Zone A Blac...

Page 68: ...12 9 9 3 Node 11 20 20 2 Node 10 19 19 2 Node 9 18 18 2 Node 8 17 17 2 FE 2 13 13 1 FE 1 1 1 1 Service Tray and Light Bar 8 8 2 BE 2 14 14 1 BE 1 2 2 1 Node 7 7 7 2 Node 6 6 6 2 Node 5 5 5 2 Node 4 16 16 1 Node 3 15 15 1 Node 2 4 4 1 Node 1 3 3 1 In the following diagrams the switches plug into the front of the rack and route through the rails to the rear EX300 Platform 68 ECS EXSeries Hardware Gu...

Page 69: ...Figure 43 EX300 single phase AC power cabling EX300 Platform ECS EXSeries Hardware Guide 69 ...

Page 70: ...Figure 44 ECSv3 740xd Single Phase AC Cabling Diagram EX300 Platform 70 ECS EXSeries Hardware Guide ...

Page 71: ...Figure 45 Three phase Delta AC power cabling EX300 Platform ECS EXSeries Hardware Guide 71 ...

Page 72: ...Figure 46 ECSv3 740xd Three Phase Delta AC Cabling Diagram EX300 Platform 72 ECS EXSeries Hardware Guide ...

Page 73: ...Figure 47 Three phase WYE AC power cabling EX300 Platform ECS EXSeries Hardware Guide 73 ...

Page 74: ...Figure 48 ECSv3 740xd Three Phase Wye AC Cabling Diagram EX300 Platform 74 ECS EXSeries Hardware Guide ...

Page 75: ...nections are listed in the following table Table 22 EX300 node iDRAC port to BE1 port mapping Node 1 iDRAC port BE1 Port 17 Node 2 iDRAC port BE1 Port 18 Node 3 iDRAC port BE1 Port 19 Node 4 iDRAC port BE1 Port 20 Node 5 iDRAC port BE1 Port 21 Node 6 iDRAC port BE1 Port 22 Node 7 iDRAC port BE1 Port 23 Node 8 iDRAC port BE1 Port 24 Node 9 iDRAC port BE1 Port 25 Node 10 iDRAC port BE1 Port 26 Node ...

Page 76: ...Figure 50 iDRAC cabling EX300 Platform 76 ECS EXSeries Hardware Guide ...

Page 77: ...h has a nickname l Hare The top S5148F 1U 25 GbE front end switch This switch runs 10 GbE SFP28 ports to EX300 nodes It is located above the Rabbit switch in U22 of the EX300 rack l Rabbit The bottom S5148F 1U 25 GbE front end switch This switch runs 10 GbE SFP28 ports to EX300 nodes It is located below the Hare switch in U20 of the EX300 rack l Hound The top S5148F 1U 25 GbE back end switch runni...

Page 78: ... end switch and back end switch connections to an EX300 node are shown in the following diagram Figure 51 Front end and back end switch connections to an EX300 node EX300 Platform 78 ECS EXSeries Hardware Guide ...

Page 79: ...47 VLT1 VLT2 customer ports 51 52 52 51 53 53 54 54 Figure 53 Back end switch front end switch and iDRAC ports on an EX300 node The numbered back end switch ports used for connecting to the ports on the EX300 nodes are shown in the following diagram Port 1 on the Hound switch BE2 connects to port 2 on Node 1 Port 2 on the Hound switch BE2 connects to port 2 on Node 2 and so on Similarly Port 1 on ...

Page 80: ... node port to the iDRAC back end switch and front end switch port connections are listed in the following table Figure 55 EX300 node network port cabling connections EX300 Platform 80 ECS EXSeries Hardware Guide ...

Page 81: ...The EX300 node network cable labeling is listed in the following table Figure 56 EX300 node network cable labeling EX300 Platform ECS EXSeries Hardware Guide 81 ...

Page 82: ...Figure 57 EX300 network cabling EX300 Platform 82 ECS EXSeries Hardware Guide ...

Page 83: ...r rack network is created Through these connections nodes from any intra rack network can communicate to any other node on the inter rack network There are three types of topologies you can use to connect the intra rack LANs into an inter rack network l Daisy chain or line topology l Ring topology l Star topology Linear or daisy chain topology The simplest topology to connect the intra racks toget...

Page 84: ...ent for mixing Gen2 and Gen3 racks in the same VDC Ports 39 and 40 are not used in an all Gen3 environment with EX Series racks Figure 61 Inter rack switch connectivity linear topology daisy chain between an EX Series rack and a Gen2 U Series D Series or C Series rack Ring topology For a more reliable network the ends of the daisy chain topology can be connected together to create a ring network a...

Page 85: ...ommended topology is to use two aggregation switches with port channel VLT vPC MLAG connectivity between them If you use a single aggregation switch both the Fox switch BE1 and the Hound switch BE2 are connected to the single switch The impact of using only one aggregation switch is the loss of high availability for the aggregation switch For connectivity to aggregation switches use the inbound po...

Page 86: ... must be set up as a trunk and allow VLAN traffic to flow between all ports in the inter rack network The inter rack star topology between EX Series racks are shown in the following figure Figure 65 Inter rack switch connectivity star topology EX300 Platform 86 ECS EXSeries Hardware Guide ...

Page 87: ...0 hardware components 88 l EX3000 configurations 89 l EX3000 upgrade paths 93 l EX3000 server 93 l EX3000 disk drives 100 l EX3000 power cabling 100 l EX3000 iDRAC cabling 111 l EX3000 network cabling 115 ECS EXSeries Hardware Guide 87 ...

Page 88: ... server chassis in a rack l Chassis are in one and two node configurations Each server chassis contains either one or two nodes One node chassis configuration is referred to as EX3000S and dual node chassis configuration is referred to as EX3000D l Chassis have the following disk configurations all disks are 12 TB n EX3000S single node with 45 60 and 90 disks n EX3000D dual node with 60 or 90 disk...

Page 89: ...e l LSI 9361 8i SAS Controller l Each node has 4 x 25 GbE networking EX3000 configurations Describes the EX3000 ECS appliance configurations The front views of an EX3000S appliance and an EX3000D appliance in both DellEMC and customer provided racks with the minimum and maximum node configurations are shown in the following diagrams EX3000 Platform ECS EXSeries Hardware Guide 89 ...

Page 90: ...Figure 66 EX3000S minimum and maximum configurations for single node chassis EX3000 Platform 90 ECS EXSeries Hardware Guide ...

Page 91: ...X3000S single node with 45 60 or 90 12 TB HDDs l EX3000D dual nodes with 60 or 90 12 TB HDDs total EX3000S and EX3000D chassis cannot be mixed within a customer provided rack The EX3000 appliance is available in the following configurations in both DellEMC and customer provided rack Lists the nodes disks in each node disk size and RAW storage capacity EX3000 Platform ECS EXSeries Hardware Guide 91...

Page 92: ...B l 4 32 PB l 5 76 PB l 8 64 PB Lists the nodes disks in each node disk size and RAW storage capacity Table 25 EX3000D dual node chassis configurations Nodes Disks in each node Disk Size RAW Storage capacity 6 minimum configuration l 30 l 45 12 TB l 2 16 PB l 3 24 PB 8 l 30 l 45 12 TB l 2 88 PB l 4 32 PB 10 l 30 l 45 12 TB l 3 60 PB l 5 40 PB 12 l 30 l 45 12 TB l 4 32 PB l 6 48 PB 14 l 30 l 45 12 ...

Page 93: ...rver The EX3000 4U server contains the EX3000 chassis and either one server sled in the EX3000S single node configuration or two server sleds in the EX3000D dual node configuration EX3000 servers have the following standard features l One node or two node servers 4U with two CPUs per node l Dual 8 core Broadwell CPU per node E5 2620v4 8 core 16 thread 2 1GHz 20M cache 85W l 4x16GB RDIMM 2400MT s D...

Page 94: ...Server front view Figure 68 EX3000 server front view in rack EX3000 Platform 94 ECS EXSeries Hardware Guide ...

Page 95: ...s view 1 Server sled one or two depending on whether the EX3000 system is single or dual node chassis configuration 2 Fan module 6 3 3 5 inch HDDs up to 90 4 PSU unit 2 for an EX3000S single node and 4 for an EX3000D dual node EX3000 Platform ECS EXSeries Hardware Guide 95 ...

Page 96: ... system is turned on 2 ID indicator When a system identification button is pressed the ID indicator blinks blue to help locate a particular system within a rack 3 Sled A HDD fault status indicator The indicator blinks amber if an HDD experiences an issue 4 System board status indicator If the system is on and in good health the indicator glows solid blue The indicator blinks amber if the system is...

Page 97: ...e indicator blinks amber if an HDD experiences an issue l Note Features of Sled B are for dual node systems only 10 System board status indicator If the system is on and in good health the indicator glows solid blue The indicator blinks amber if the system is in standby and if any issue exists for example a failed fan or HDD 11 Power button l The power button controls the PSU output to the system ...

Page 98: ... rear view Figure 73 EX3000D server rear view in rack Figure 74 Back panel features and indicators Note Items numbers 4 5 7 11 12 and 15 are not in use on EX3000 EX3000 Platform 98 ECS EXSeries Hardware Guide ...

Page 99: ...n button can be used to locate a particular system within a rack l Press to toggle the system ID on and off l If the system stops responding during POST press and hold the system ID button for more than five seconds to enter BIOS progress mode l To reset iDRAC if not disabled in F2 iDRAC setup press and hold the button for more than 15 seconds 11 Ethernet connector 3 Integrated 10 100 1000 Mbps NI...

Page 100: ...here is a 2 5 480 GB 1DWPD SATA SSD in each EX3000 node for the OS You cannot mix single and dual node chassis within the same rack Note EX3000 and EX300 drive carriers are not compatible Figure 75 EX3000 disk drive in carrier 1 release button 2 3 5 inch HDD 3 HDD carrier handle 4 HDD carrier EX3000 power cabling Provides EX3000S and EX3000D ECS appliance cabling diagrams for single phase AC power...

Page 101: ... PS2 outlet numbers Switch PS1 outlet numbers Line cord number per zone single phase Zone B Zone A Zone B Zone A Black cables Gray cables Black cables Gray cables FE 2 13 13 1 FE 1 1 1 1 Chassis 8 22 22 3 Chassis 7 11 11 3 Chassis 6 9 9 3 Chassis 5 18 18 2 BE 2 14 14 1 BE 1 2 2 1 Service tray 8 2 Light Bar 20 2 Chassis 4 7 7 2 Chassis 3 5 5 2 Chassis 2 15 15 1 Chassis 1 3 3 1 Lists the EX3000D PDU...

Page 102: ... phase Zone B Zone A Zone B Zone A Zone B Zone A Black cables Gray cables Black cables Gray cables Black cables Gray cables FE 2 13 13 1 FE 1 1 1 1 Chassis 8 22 23 23 22 3 Chassis 7 11 21 21 11 3 Chassis 6 9 10 10 9 3 Chassis 5 18 19 19 18 2 BE 2 14 14 1 BE 1 2 2 1 Service tray 8 2 Light Bar 20 2 Chassis 4 7 17 17 7 2 Chassis 3 5 6 6 5 2 Chassis 2 15 16 16 15 1 Chassis 1 3 4 4 3 1 EX3000 Platform ...

Page 103: ...hould only use the appropriate length cable per the cabinet position being installed as shown in the following diagrams EX3000 systems shipped for a third party rack require the extra 118 cables while Dell EMC racks only need the 93 cables After you complete the power cabling for the EX3000 appliance you will always have an extra pair of unused power cords In the following diagram the switches plu...

Page 104: ...Figure 78 EX3000S single phase AC power cabling EX3000 Platform 104 ECS EXSeries Hardware Guide ...

Page 105: ...Figure 79 EX3000D single phase AC power cabling EX3000 Platform ECS EXSeries Hardware Guide 105 ...

Page 106: ...Three phase AC power cabling Figure 80 PDU three phase diagram The legends in the following diagrams map colored cables to part numbers and cable lengths EX3000 Platform 106 ECS EXSeries Hardware Guide ...

Page 107: ...Figure 81 EX3000S three phase delta AC power cabling EX3000 Platform ECS EXSeries Hardware Guide 107 ...

Page 108: ...Figure 82 EX3000D three phase delta AC power cabling EX3000 Platform 108 ECS EXSeries Hardware Guide ...

Page 109: ...Figure 83 EX3000S three phase WYE AC power cabling EX3000 Platform ECS EXSeries Hardware Guide 109 ...

Page 110: ...Figure 84 EX3000D three phase WYE AC power cabling EX3000 Platform 110 ECS EXSeries Hardware Guide ...

Page 111: ...on The EX3000S node iDRAC port to the Fox switch BE1 port connections are listed in the following table Table 31 EX3000S node iDRAC port to BE1 port mapping Node 1 iDRAC port BE1 Port 17 Node 2 iDRAC port BE1 Port 18 Node 3 iDRAC port BE1 Port 19 Node 4 iDRAC port BE1 Port 20 Node 5 iDRAC port BE1 Port 21 Node 6 iDRAC port BE1 Port 22 Node 7 iDRAC port BE1 Port 23 Node 8 iDRAC port BE1 Port 24 EX3...

Page 112: ...Figure 85 EX3000S iDRAC cabling The EX3000D node iDRAC port to the Fox switch BE1 port connections are listed in the following table EX3000 Platform 112 ECS EXSeries Hardware Guide ...

Page 113: ...assis 3 BE1 Port 22 Node 7 iDRAC port chassis 4 BE1 Port 23 Node 8 iDRAC port chassis 4 BE1 Port 24 Node 9 iDRAC port chassis 5 BE1 Port 25 Node 10 iDRAC port chassis 5 BE1 Port 26 Node 11 iDRAC port chassis 6 BE1 Port 27 Node 12 iDRAC port chassis 6 BE1 Port 28 Node 13 iDRAC port chassis 7 BE1 Port 29 Node 14 iDRAC port chassis 7 BE1 Port 30 Node 15 iDRAC port chassis 8 BE1 Port 31 Node 16 iDRAC ...

Page 114: ...Figure 86 EX3000D iDRAC cabling EX3000 Platform 114 ECS EXSeries Hardware Guide ...

Page 115: ...eir own front end switches To distinguish between the two front end switches and the two back end switches each switch has a nickname l Hare The top S5148F 1U 25 GbE front end switch This switch runs 25 GbE SFP28 ports to EX3000 nodes l Rabbit The bottom S5148F 1U 25 GbE front end switch This switch runs 25 GbE SFP28 ports to EX3000 nodes l Hound The top S5148F 1U 25 GbE back end switch running 25...

Page 116: ...d switch and back end switch connections to an EX3000S node are shown in the following diagram Figure 87 Front end and back end switch connections to an EX3000S node EX3000 Platform 116 ECS EXSeries Hardware Guide ...

Page 117: ... Node 2 and so on Similarly Port 1 on the Rabbit switch FE1 connects to port 3 on Node 1 Port 2 on the Rabbit switch FE1 connects to port 3 on Node 2 and so on Figure 89 Node ports on front end switches Rabbit Switch FE1 Hare Switch FE2 1 48 46 44 42 40 38 36 34 32 30 28 26 24 22 20 18 16 14 12 10 8 4 6 2 3 5 7 9 11 13 15 17 19 21 23 25 27 29 35 31 33 37 39 41 43 45 47 VLT1 VLT2 1 48 46 44 42 40 3...

Page 118: ...port 2 on Node 1 Port 2 on the Hound switch BE2 connects to port 2 on Node 2 and so on Similarly Port 1 on the Fox switch BE1 connects to port 1 on Node 1 Port 2 on the Fox switch BE1 connects to port 1 on Node 2 and so on Figure 91 Node ports on back end switches Fox Switch BE1 Hound Switch BE2 1 48 46 44 42 40 38 36 34 32 30 28 26 24 22 20 18 16 14 12 10 8 4 6 2 3 5 7 9 11 13 15 17 19 21 23 25 2...

Page 119: ...node port to the iDRAC back end switch and front end switch port connections are listed in the following table Figure 92 EX3000 node network port cabling connections EX3000 Platform ECS EXSeries Hardware Guide 119 ...

Page 120: ...The EX3000 node network cable labeling is listed in the following table Figure 93 EX3000 node network cable labeling EX3000 Platform 120 ECS EXSeries Hardware Guide ...

Page 121: ...Figure 94 EX3000S network cabling EX3000 Platform ECS EXSeries Hardware Guide 121 ...

Page 122: ...Figure 95 EX3000D network cabling EX3000 Platform 122 ECS EXSeries Hardware Guide ...

Page 123: ...For information on connecting multiple ECS appliances see Network connections between multiple ECS appliances in a single site on page 50 EX3000 Platform ECS EXSeries Hardware Guide 123 ...

Page 124: ...EX3000 Platform 124 ECS EXSeries Hardware Guide ...

Page 125: ...CHAPTER 6 Third party rack requirements l Third party rack requirements 126 ECS EXSeries Hardware Guide 125 ...

Page 126: ...ed rack s Customers who want to assemble an ECS EX300 appliance using their own racks must ensure that the racks meet the requirements described in the ECS EX300 Third Party Rack Installation Guide A Request for Product Qualification RPQ is required for transfers of Dell EMC racked EX300 systems to customer provided rack s EX3000 appliances must be installed in customer provided racks in accordanc...