Dell EMC CX3 Series, Hardware Installation And Troubleshooting Manual

Page 1: ...w w w d e l l c o m s u p p o r t d e l l c o m Dell EMC CX3 series Fibre Channel Storage Arrays With Microsoft Windows Server Failover Clusters Hardware Installation and Troubleshooting Guide ...

Page 2: ...sstrictlyforbidden Trademarks used in this text Dell the DELL logo PowerEdge PowerVault and Dell OpenManage are trademarks of Dell Inc Active Directory Microsoft Windows Windows Server and Windows NTareeithertrademarksorregisteredtrademarksofMicrosoftCorporationintheUnited States and or other countries EMC EMC ControlCenter Navisphere and PowerPath are registered trademarks and Access Logix Mirror...

Page 3: ...r 13 Other Documents You May Need 14 2 Cabling Your Cluster Hardware 17 Cabling the Mouse Keyboard and Monitor 17 Cabling the Power Supplies 17 Cabling Your Cluster for Public and Private Networks 19 Cabling the Public Network 20 Cabling the Private Network 21 NIC Teaming 21 Cabling the Storage Systems 22 Cabling Storage for Your Direct Attached Cluster 22 Cabling Storage for Your SAN Attached Clu...

Page 4: ...ining Multiple Hosts 43 Using Worldwide Port Name Zoning 43 Installing and Configuring the Shared Storage System 45 Access Logix 45 Access Control 47 Storage Groups 47 Navisphere Manager 49 Navisphere Agent 49 EMC PowerPath 49 Enabling Access Logix and Creating Storage Groups Using Navisphere 6 x 50 Configuring the Hard Drives on the Shared Storage System s 51 Optional Storage Features 55 Updating...

Page 5: ...Contents 5 A Troubleshooting 57 B Cluster Data Form 63 C Zoning Configuration Form 65 ...

Page 6: ...6 Contents ...

Page 7: ...series fibre channel storage array with one or more Failover Clusters It provides specific configuration tasks that enable you to deploy the shared storage for your cluster For more information on deploying your cluster with Windows Server 2003 operating systems see the Dell Failover Clusters with Microsoft Windows Server 2003 Installation and Troubleshooting Guide located on the Dell Support webs...

Page 8: ...g the entire cluster offline Implementing Fibre Channel technology in a cluster provides the following advantages Flexibility Fibre Channel allows a distance of up to 10 km between switches without degrading the signal Availability Fibre Channel components use redundant connections providing multiple data paths and greater availability for clients Connectivity Fibre Channel allows more device conn...

Page 9: ...n your cluster nodes determines the minimum required amount of system RAM HBA ports Two Fibre Channel HBAs per node unless the server employs an integrated or supported dual port Fibre Channel HBA Where possible place the HBAs on separate PCI buses to improve availability and performance NICs At least two NICs one NIC for the public network and another NIC for the private network NOTE It is recomm...

Page 10: ...systems Can share one or more supported storage systems using optional software that is available for your storage system See Installing and Configuring the Shared Storage System on page 45 Table 1 3 Dell EMC Storage System Requirements Processor Enclosure Minimum Storage Possible Storage Expansion SPS CX3 10c SPE One DAE3P OS with at least five and up to 15 hard drives Up to three DAE with a maxi...

Page 11: ...SPE One DAE3P OS with at least five and up to 15 hard drives Up to 15 DAE with a maximum of 15 hard drives each Two per SPE and DAE3P OS CX3 80 SPE One DAE3P OS with at least five and up to 15 hard drives Up to 31 DAE with a maximum of 15 hard drives each Two per SPE and DAE3P OS Table 1 4 Navisphere Manager Storage Views View Description Storage Shows the logical storage components and their rela...

Page 12: ...t CPU cycles or local area network LAN bandwidth For more information about Navisphere Manager EMC Access Logix MirrorView SnapView and SAN Copy see Installing and Configuring the Shared Storage System on page 45 Supported Cluster Configurations The following sections describe the supported cluster configurations Direct Attached Cluster In a direct attached cluster both nodes of the cluster are di...

Page 13: ...ge system Because of the single port limitation PowerPath can provide only failover protection not load balancing in a direct attached configuration SAN Attached Cluster In a SAN attached cluster all nodes are attached to a single storage system or to multiple storage systems through a SAN using redundant switch fabrics SAN attached clusters are superior to direct attached clusters in configuratio...

Page 14: ...t located on the Dell Support website at support dell com The Rack Installation Guide included with your rack solution describes how to install your system into a rack The Getting Started Guide provides an overview of initially setting up your system For more information on deploying your cluster with Windows Server 2003 operating systems see the Dell Failover Clusters with Microsoft Windows Serve...

Page 15: ...parately provides information to configure and install those options The Dell PowerVault tape library documentation provides information for installing troubleshooting and upgrading the tape library Any other documentation that came with your server or storage system The EMC PowerPath documentation that came with your HBA kit s and Dell EMC Storage Enclosure User s Guides Updates are sometimes inc...

Page 16: ...16 Introduction ...

Page 17: ...s See the documentation for each component in your cluster solution and ensure that the specific power requirements are satisfied The following guidelines are recommended to protect your cluster solution from power related failures For nodes with multiple power supplies plug each power supply into a separate AC circuit Use uninterruptible power supplies UPS For some environments consider having ba...

Page 18: ...ower Supply in the PowerEdge Systems redundant power supplies on one AC power strip or on one AC PDU not shown primary power supplies on one AC power strip or on one AC PDU not shown NOTE This illustration is intended only to demonstrate the power distribution of the components ...

Page 19: ...ribed in Table 2 1 NOTE To configure Dell blade server modules in a Dell PowerEdge cluster see the Using Dell Blade Servers in a Dell PowerEdge High Availability Cluster document located on the Dell Support website at support dell com redundantpowersupplies on one AC power strip or on one AC PDU not shown NOTE This illustration is intended only to demonstrate the power distribution of the componen...

Page 20: ...e public network segments You can install additional network adapters to support additional public network segments or to provide redundancy in the event of a faulty primary network adapter or switch port Table 2 1 Network Connections Network Connection Description Public network All connections to the client LAN At least one public network must be configured for Mixed mode for private network fai...

Page 21: ...o or more NICs to provide load balancing and fault tolerance Your cluster supports NIC teaming only in a public network NIC teaming is not supported in a private network Use the same brand of NICs in a team Do not mix brands in NIC teaming Table 2 2 Private Network Hardware Components and Connections Method Hardware Components Connection Network switch Fast Ethernet or Gigabit Ethernet network ada...

Page 22: ...dant Fibre Channel host bus adapter HBA ports cabled directly to a Dell EMC storage system Direct attached configurations are self contained and do not share any physical resources with other server or storage systems outside of the cluster Figure 2 4 shows an example of a direct attached single cluster configuration with redundant HBA ports installed in each cluster node Figure 2 4 Direct Attache...

Page 23: ...at achieve the same type of redundant connectivity may be acceptable Cabling a Two Node Cluster to a Dell EMC Storage System 1 Connect cluster node 1 to the storage system a Install a cable from cluster node 1 HBA port 0 to SP A Fibre port 0 first fibre channel port b Install a cable from cluster node 1 HBA port 1 to SP B Fibre port 0 first fibre channel port 2 Connect cluster node 2 to the storag...

Page 24: ... CX3 10c Storage System Figure 2 6 Cabling the Cluster Nodes to a CX3 20 Storage System cluster node 1 cluster node 2 0 1 1 0 HBA ports 2 HBA ports 2 CX3 10c storage system SP B SP A cluster node 1 cluster node 2 0 1 1 0 HBA ports 2 HBA ports 2 CX3 20 storage system SP B SP A ...

Page 25: ...ode Cluster to a CX3 20f CX3 40f and CX3 80 Storage System 1 Connect cluster node 1 to the storage system a Install a cable from cluster node 1 HBA port 0 to SP A Fibre port 0 first Fibre Channel port b Install a cable from cluster node 1 HBA port 1 to SP B Fibre port 0 first Fibre Channel port 2 Connect cluster node 2 to the storage system a Install a cable from cluster node 2 HBA port 0 to SP A ...

Page 26: ...ached configuration Similarly the six fibre channel ports per processor on Dell EMC CX3 20f storage system allows you to connect three two node clusters in a direct attached environment NOTE EMC Access Logix is required if the CX series storage system is connected to more than one cluster in a direct attached configuration Cabling Two Two Node Clusters to a CX3 20f CX3 40f or CX3 80 Storage System...

Page 27: ...luster nodes that are attached to a single storage system or to multiple storage systems through SAN use a redundant switch fabric SAN attached cluster configurations provide more flexibility expandability and performance than direct attached configurations See Implementing Zoning on a Fibre Channel Switched Fabric on page 42 for more information on Fibre Channel switch fabrics Figure 2 8 shows an...

Page 28: ...ster Hardware Figure 2 8 Two Node SAN Attached Cluster cluster node cluster node private network Fibre Channel connections storage system Fibre Channel switch Fibre Channel switch public network Fibre Channel connections ...

Page 29: ...Cabling Your Cluster Hardware 29 Figure 2 9 Eight Node SAN Attached Cluster public network storage system cluster nodes 2 8 Fibre Channel switch Fibre Channel switch private network ...

Page 30: ... on the duplex LC multimode fibre optic connector Each HBA port is cabled to a port on a Fibre Channel switch One or more cables connect from the outgoing ports on a switch to a storage processor on a Dell EMC storage system NOTE Dell EMC CX3 20f CX3 40f and CX3 80 storage systems have more than two fibre channel ports per SP You can also connect the additional ports to the redundant fabrics to ac...

Page 31: ...SAN a Connect a cable from Fibre Channel switch 0 sw0 to SP A Fibre port 0 first Fibre Channel port b Connect a cable from Fibre Channel switch 0 sw0 to SP B Fibre port 1 second Fibre Channel port c Connect a cable from Fibre Channel switch 1 sw1 to SP A Fibre port 1 second Fibre Channel port d Connect a cable from Fibre Channel switch 1 sw1 to SP B Fibre port 0 first Fibre Channel port Figure 2 1...

Page 32: ...rt 1 to Fibre Channel switch 1 sw1 2 Repeat step 1 for each node 3 Connect the storage system to the SAN a Connect a cable from Fibre Channel switch 0 sw0 to SP A Fibre port 0 first Fibre Channel port b Connect a cable from Fibre Channel switch 0 sw0 to SP A Fibre port 2 third Fibre Channel port c Connect a cable from Fibre Channel switch 0 sw0 to SP B Fibre port 1 second Fibre Channel port cluste...

Page 33: ...hannel switch 1 sw1 to SP A Fibre port 3 fourth Fibre Channel port g Connect a cable from Fibre Channel switch 1 sw1 to SP B Fibre port 0 first Fibre Channel port h Connect a cable from Fibre Channel switch 1 sw1 to SP B Fibre port 2 third Fibre Channel port Figure 2 12 Cabling a SAN Attached Cluster to the CX3 80 sw0 sw1 cluster node 2 cluster node 1 Fibre Channel switch 0 1 0 1 HBA ports 2 SP A ...

Page 34: ... Figure 2 10 Figure 2 11 and Figure 2 12 as examples for cabling additional clusters Cabling Multiple SAN Attached Clusters to the CX3 10c CX3 20 or CX3 40c Storage System 1 In the first cluster connect cluster node 1 to the SAN a Connect a cable from HBA port 0 to Fibre Channel switch 0 sw0 b Connect a cable from HBA port 1 to Fibre Channel switch 1 sw1 2 In the first cluster repeat step 1 for ea...

Page 35: ...itch 0 sw0 to SP B Fibre port 3 fourth Fibre Channel port e Connect a cable from Fibre Channel switch 1 sw1 to SP A Fibre port 1 second Fibre Channel port f Connect a cable from Fibre Channel switch 1 sw1 to SP A Fibre port 3 fourth Fibre Channel port g Connect a cable from Fibre Channel switch 1 sw1 to SP B Fibre port 0 first Fibre Channel port h Connect a cable from Fibre Channel switch 1 sw1 to...

Page 36: ...ple storage systems with your cluster the following rules apply There is a maximum of four storage systems per cluster The shared storage systems and firmware must be identical Using dissimilar storage systems and firmware for your shared storage is not supported MSCS is limited to 22 drive letters Because drive letters A through D are reserved for local disks a maximum of 22 drive letters E to Z ...

Page 37: ...ll EMC Fibre Channel switch Figure 2 14 shows a supported Failover Cluster configuration using redundant Fibre Channel switches and a tape library In this configuration each of the cluster nodes can access the tape library to provide backup for your local disk resources as well as your cluster disk resources Using this configuration allows you to add more servers and storage systems in the future ...

Page 38: ...d backup for your clusters by sharing your SAN with multiple clusters storage systems and a tape library Figure 2 15 provides an example of cabling the cluster nodes to your storage systems and SAN backup with a tape library Figure 2 15 Cluster Configuration Using SAN Based Backup cluster node tape library storage system cluster node private network Fibre Channel switch Fibre Channel switch cluste...

Page 39: ...ailover Clusters with Microsoft Windows Server 2003 Installation and Troubleshooting Guide or Dell Failover Clusters with Microsoft Windows Server 2008 Installation and Troubleshooting Guide located on the Dell Support website at support dell com 3 Deploy the operating system including any relevant service packs and hotfixes network adapter drivers and storage adapter drivers including Multipath I...

Page 40: ...08 Failover cluster Ensure that this LUN is presented to the systems that you are configuring as cluster nodes NOTE For security reasons it is recommended that you configure the LUN on a single node as mentioned in step 8 when you are setting up the cluster Later you can configure the LUN as mentioned in step 9 so that other nodes in the cluster can access it 8 Select one of the systems and form a...

Page 41: ...epending on the operating system configured on your cluster For a list of Dell PowerEdge Servers Fibre Channel HBAs and switches and recommended list of operating system variants specific driver and firmware revisions see the Dell Cluster Configuration Support Matrix on the Dell High Availability website at www dell com ha For a general overview of cluster configuration tasks and more detailed inf...

Page 42: ...ort website at support dell com For more information about supported HBA controllers and drivers see the Dell Cluster Configuration Support Matrix on the Dell High Availability website at www dell com ha Implementing Zoning on a Fibre Channel Switched Fabric A Fibre Channel switched fabric consists of one or more Fibre Channel switches that provide high speed connections between servers and storag...

Page 43: ...storage system Using Worldwide Port Name Zoning PowerEdge cluster configurations support worldwide port name zoning A worldwide name WWN is a unique numeric identifier assigned to Fibre Channel interfaces such as HBA ports storage processor SP ports and Fibre Channel to SCSI bridges or storage network controllers SNCs A WWN consists of an 8 byte hexadecimal number with each byte separated by a col...

Page 44: ...ou create your single initiator zones follow these guidelines Create a zone for each HBA port and its target storage devices Each CX3 series storage processor port can be connected to a maximum of 64 HBA ports in a SAN attached environment Each host can be connected to a maximum of four storage systems The integrated bridge SNC or fibre channel interface on a tape library can be added to any zone ...

Page 45: ...and Creating Storage Groups Using Navisphere 6 x on page 50 for more information The following subsections provide an overview of the storage management software and procedures for connecting the host systems to the storage systems Access Logix Fibre Channel topologies allow multiple clusters and stand alone systems to share a single storage system However if you cannot control access to the share...

Page 46: ...cess Logix is required if The server modules are configured in dissimilar configurations These configurations include Two or more stand alone systems non clustered hosts Two or more clusters Any combination of server modules configured as cluster nodes and stand alone systems non clustered hosts MirrorView SnapView or SAN Copy are installed on your attached storage system s and running in the clus...

Page 47: ...u are using Access Logix After you enable Access Control the host system can only read from and write to specific LUNs on the storage system This organized group of LUNs and hosts is called a storage group Storage Groups A storage group is a collection of one or more LUNs that are assigned to one or more host systems Managed by Navisphere Manager storage groups provide an organized method of assig...

Page 48: ...e host system NOTE In a clustered environment all nodes of a cluster must be connected to the same storage group Used host connection paths An additional storage group feature that performs the following tasks Lists all of the paths from the host server to the storage group Displays whether the path is enabled or disabled Each path contains the following fields HBA Device name of the HBA in the ho...

Page 49: ...s components to your system and runs in the web browser Optionally you can run Navisphere Management Server for Windows This software component installs on a host system connected to a Dell EMC storage system allowing you to run Navisphere Storage Management Server on the host system Using Navisphere Manager you can Create storage groups for your host systems Create bind and unbind LUNs Change con...

Page 50: ...t cannot be disabled 1 Ensure that Navisphere Agent is started on all host systems a Click the Start button and select Programs Administrative Tools and then select Services b In the Services window verify the following In the Name column Navisphere Agent appears In the Status column Navisphere Agent is set to Started In the Startup Type column Navisphere Agent is set to Automatic 2 Open a Web bro...

Page 51: ...k Apply 15 Add new hosts to the Sharable storage group a In the Storage Group Properties dialog box click the Hosts tab b In the Available Hosts window pane click the host system that you want to add to the storage group c Using the right arrow button move the selected host to the Hosts to be Connected window pane d Repeat step b and step c to add additional hosts e Click Apply 16 Click OK to exit...

Page 52: ... deploying your cluster with Windows Server 2003 operating systems see the Dell Failover Clusters with Microsoft Windows Server 2003 Installation and Troubleshooting Guide located on the Dell Support website at support dell com For more information on deploying your cluster with Windows Server 2008 operating systems see the Dell Failover Clusters with Microsoft Windows Server 2008 Installation and...

Page 53: ...node has access to hard drives that are in a common storage array each node must have identical drive letters assigned to each hard drive Using volume mount points in Windows Server 2003 your cluster can access more than 22 volumes NOTE Drive letters A through D are reserved for the local system To ensure that hard drive letter assignments are identical 1 Ensure that your cables are attached to th...

Page 54: ...same icon right click and select Change Drive Letter and Path from the submenu Click Edit select the letter you want to assign the drive for example Z and then click OK Click Yes to confirm the changes e Turn off the node If the cables are connected properly the drive order is the same as is on each node and the drive letter assignments of all the cluster nodes follow the same order as is on node ...

Page 55: ...ates copies of LUNs using either snapshots or clones Snapshots are virtual copies that create an image of the source LUN at the time the snapshot was created This snapshot is retained independently of subsequent changes to the source LUN Clones are duplicate copies of a source LUN You can use snapshots and clones to facilitate backups or to allow multiple hosts to access data without affecting the...

Page 56: ...e Dell High Availability website at www dell com ha Installing and Configuring a Failover Cluster After you have established the private and public networks and have assigned the shared disks from the storage array to the cluster nodes you can configure the operating system services on your Dell Failover Cluster The procedure to configure the Failover Cluster depends on the version of the Windows ...

Page 57: ...storage system See Cabling Your Cluster for Public and Private Networks on page 19 for more information The length of the interface cables exceeds the maximum allowable length Ensure that the fibre optic cables do not exceed 300 m multimode or 10 km single mode switch to switch connections only One of the cables is faulty Replace the faulty cable Access Control is not enabled correctly Verify the ...

Page 58: ...between the nodes Configure the Internet Connection Firewall to allow communications that are required by the Microsoft Cluster Service MSCS and the clustered applications or services See Microsoft Knowledge Base article KB883398 at the Microsoft Support website at support microsoft com for more information Long delays in node to node communications may be normal Verify that the nodes can communic...

Page 59: ...sfully joined the cluster If these events do not appear in Event Viewer see the Microsoft Cluster Service Administrator s Guide for instructions on setting up the cluster on your system and starting the Cluster Service The cluster network name is not responding on the network because the Internet Connection Firewall is enabled on one or more nodes Configure the Internet Connection Firewall to allo...

Page 60: ...ailover Clusters with Microsoft Windows Server 2008 Installation and Troubleshooting Guide The private point to point network is disconnected Ensure that all systems are powered on so that the NICs in the private network are available Using Microsoft Windows NT 4 0 to remotely administer a Windows Server 2003 cluster generates error messages Some resources in Windows Server 2003 are not supported ...

Page 61: ...e the Internet Connection Firewall enabled blocking RPC communications between the nodes Configure the Internet Connection Firewall to allow communications that are required by the MSCS and the clustered applications or services See Microsoft Knowledge Base article KB883398 at the Microsoft Support website at support microsoft com for more information The disks on the shared cluster storage appear...

Page 62: ...nformation on how to configure your cluster with the Windows Internet Connection Firewall enabled see Microsoft Base KB articles 258469 and 883398 at the Microsoft Support website at support microsoft com and the Microsoft Windows Server 2003 Technet website at www microsoft com technet Public network clients cannot access the applications or services that are provided by the cluster One or more n...

Page 63: ... information about the cluster Use the form when you call for technical support Table B 1 Cluster Information Cluster Information Cluster Solution Cluster name and IP address Server type Installer Date installed Applications Location Notes Table B 2 Cluster Node Information Node Name Service Tag Number Public IP Address Private IP Address ...

Page 64: ...64 Cluster Data Form Additional Networks Table B 3 Storage Array Information Array Array xPE Type Array Service Tag Number or World Wide Name Seed Number of Attached DAEs 1 2 3 4 ...

Page 65: ...Zoning Configuration Form 65 Zoning Configuration Form Node HBA WWPNs or Alias Names Storage WWPNs or Alias Names Zone Name Zone Set for Configuration Name ...

Page 66: ...66 Zoning Configuration Form ...

Page 67: ... 22 SAN attached 13 cluster storage requirements 10 clustering overview 7 D Dell EMC CX3 40 Cabling a two node cluster 23 Dell EMC CX3 80 cabling to two clusters 26 Dell EMC CX3 20 Cabling a two node cluster 23 Dell EMC CX3 80 cabling the cluster nodes 23 cabling the cluster nodes in a SAN attached environment 30 cabling to one SAN attached cluster 30 configuring 45 installing 45 updating for clus...

Page 68: ...ng to hosts 53 configuring and managing 52 M MirrorView about 12 monitor cabling 17 mouse cabling 17 MSCS installing and configuring 56 N Navisphere Agent about 49 Navisphere Manager about 11 49 hardware view 11 storage view 11 network adapters cabling the private network 20 21 cabling the public network 20 O operating system Windows Server 2003 Enterprise Edition installing 41 P power supplies ca...

Page 69: ...tting drives 53 single initiator zoning about 44 SnapView about 12 storage groups about 47 storage management software Access Control 47 Access Logix 45 Navisphere Agent 49 Navisphere Manager 49 PowerPath 49 storage system configuring and managing LUNs 52 configuring drives on multiple shared storage systems 53 configuring the hard drives 51 using dynamic disks and volumes 52 T tape library connec...

Page 70: ...70 Index W warranty 14 worldwide port name zoning 43 Z zones implementing on a Fibre Channel switched fabric 42 in SAN configurations 43 using worldwide port names 43 ...