Fujitsu ETERNUS HX2000 Series, Installation And Cabling Manual

Page 1: ...A3CA08733 A348 01 FUJITSU Storage ETERNUS AX HX Series Installation and Cabling Guide ...

Page 2: ... cabling examples for multipath HA configurations with quad port SAS HBAs 20 Controller to stack cabling worksheets and cabling examples for multipath HA configurations with four onboard SAS ports 23 Controller to stack cabling worksheets and cabling examples for common HX2000 configurations 27 Controller to stack cabling worksheet and cabling example for a quad path HA configuration with two quad...

Page 3: ...ast two stacks the disk shelf containing the root aggregates for the second stack has the shelf ID preset to 10 You must set shelf IDs so they are unique within the HA pair or single controller configuration You can manually set shelf IDs or have shelf IDs automatically assigned for all disk shelves in the HA pair or single controller configuration using a command in maintenance mode Instructions ...

Page 4: ...ifications define the minimum bend radius however a general guideline for minimum bend radius is 10 times the cable diameter Using Velcro wraps instead of tie wraps to bundle and secure system cables allows for easier cable adjustments Installing disk shelves with IOM12 modules for a new system installation You install the disk shelves in a rack using the rack mount kits that came with the disk sh...

Page 5: ...lf with 30 drives the remaining ten drives are distributed evenly throughout the shelf in slots 1 and 10 of each drawer The following illustration shows how the drives are numbered from 0 to 11 in each drive drawer within the shelf Slots 0 3 6 9 and in a shelf containing 30 drives slots 1 and 10 in each drawer must contain drives a Reinstall any power supplies and IOMs you removed prior to install...

Page 6: ...array h Close the drive drawer by pushing both levers towards the center i Repeat these steps for each drawer in the disk shelf 4 If you are adding multiple disk shelves repeat this procedure for each disk shelf you are installing Note Do not power on the disk shelves at this time Cabling disk shelves with IOM12 modules for a new system installation You cable disk shelf SAS connections shelf to sh...

Page 7: ...ning with the logical first shelf in the stack connect IOM A port 4 to the next shelf s IOM A port 2 until each IOM A in the stack is connected c Repeat substeps a and b for IOM B d Repeat substeps a through c for each stack 2 Identify the controller SAS port pairs that you can use to cable the controller to stack connections a Check the controller to stack cabling worksheets and cabling examples ...

Page 8: ...em shelf ID assignment begins with the internal disk shelf a Power on the controllers b As the controllers start booting press Ctrl C to abort the AUTOBOOT process when you see the message Starting AUTOBOOT press Ctrl C to abort Note If you miss the prompt and the controllers boot to ETERNUS AX HX Series halt both controllers and then boot both controllers to the boot menu by entering boot_ETERNUS...

Page 9: ...gn more than one disk at once 7 Download and run Config Advisor as instructed by the Installation and Setup Instructions to verify SAS connections are cabled correctly and there are no duplicate shelf IDs within the system If any SAS cabling or duplicate shelf ID errors are generated follow the corrective actions provided Fujitsu Downloads Config Advisor You can also run the storage shelf show fie...

Page 10: ...ur system cannot have any SAS cabling error messages You must correct any cabling errors using the corrective actions provided by the error messages Using mini SAS HD SAS optical cables If you are using mini SAS HD SAS optical cables or a mix of mini SAS HD SAS optical cables and SAS copper cables in the stack of disk shelves you must have met the rules in the Mini SAS HD SAS optical cable rules s...

Page 11: ...s a snap shot of the SAS connectivity verifies disk shelf IOM firmware versions and allows you to verify shelf IDs already in use on your system Running Config Advisor after hot adding a disk shelf allows you to verify SAS connections are cabled correctly and that shelf IDs are unique within the HA pair or single controller configuration If any SAS cabling or duplicate shelf ID errors are generate...

Page 12: ...r DS460C disk shelves you can also use the four detachable handles that shipped with your disk shelf Handles two on each side of the chassis are installed by pushing up until they click into place As you slide the disk shelf onto the rails detach handles using the thumb latch It is recommended that you use a mechanical hoist or lift if you are moving a fully loaded DS460C disk shelf Attention A fu...

Page 13: ...de of the drive carrier with the matching gap in the drive channel on the drive drawer Table 4 1 Raised button on the right side of the drive carrier e Lower the drive straight down and then rotate the cam handle down until the drive snaps into place under the orange release latch f Repeat the previous substeps for each drive in the drawer You must be sure that slots 0 3 6 and 9 in each drawer con...

Page 14: ...helf ID button behind the left end cap c Change the shelf ID to a valid ID 00 through 99 d Power cycle the disk shelf to make the shelf ID take effect Wait at least 10 seconds before turning the power back on to complete the power cycle The shelf ID blinks and the operator display panel amber LED blinks until you power cycle the disk shelf e Repeat substeps a through d for each disk shelf you are ...

Page 15: ...multipath single path HA or single path connectivity to the controllers Cable the shelf to shelf connections as standard connectivity using IOM ports 3 and 1 1 Beginning with the logical first shelf in the stack connect IOM A port 3 to the next shelf s IOM A port 1 until each IOM A in the stack is connected 2 Repeat substep i for IOM B You are cabling a stack with quad path HA or quad path connect...

Page 16: ... controller to stack connections a Cable the shelf to shelf connection between IOM A of the disk shelf in the stack and IOM A of the disk shelf you are hot adding b Verify that the cable is securely fastened c Repeat applicable substeps for IOM B 4 If you hot added a disk shelf with mini SAS HD SAS optical cables to a stack of disk shelves connected with SAS copper cables replace the SAS copper ca...

Page 17: ...sign each disk storage disk assign disk disk_name owner owner_name You can use the wildcard character to assign more than one disk at once c Reenable disk ownership automatic assignment if needed storage disk option modify node node_name autoassign on You need to reenable disk ownership automatic assignment on both controllers in an HA pair 8 If your configuration is running in band ACP verify tha...

Page 18: ...s as described later in this procedure Procedure 1 Turn on the power to the disk shelf if it is not already on 2 Remove the left end cap to locate the button near the shelf LEDs 3 Change the first number of the shelf ID by pressing and holding the orange button until the first number on the digital display blinks which can take up to three seconds Note If the ID takes longer than three seconds to ...

Page 19: ...hrough 9 on page 19 for each additional disk shelf 11 Verify that your system does not have duplicate shelf IDs When two or more disk shelves have the same ID the system assigns the duplicate disk shelf a soft ID number equal to or greater than 100 You must change the soft ID duplicate number a Run Active IQ Config Advisor to check for duplicate shelf ID alerts or run the storage shelf show fields...

Page 20: ...y section Cabling examples show controller to stack cables as solid or dashed to distinguish controller A and C port connections from controller B and D port connections Cables in the cabling examples and their corresponding port pairs in the worksheets are color coded to distinguish connectivity to each stack in the HA pair Worksheets and cabling examples show cabling port pairs in the order in w...

Page 21: ...abling worksheets and cabling examples for common multipath HA configurations Multipath HA with one quad port SAS HBA and two single shelf stacks The following worksheet and cabling example uses port pairs 1a 1d and 1c 1b 21 ...

Page 22: ...airs Note When you have more port pairs than you need to cable the stacks in your system the best practice is to skip port pairs to optimize the SAS ports on your system By optimizing SAS ports you optimize your system s performance The following worksheet and cabling example shows port pairs being used in the order in which they are listed in the worksheet 1a 2b 2a 1d 1c 2d and 2c 1b The followin...

Page 23: ...s for multipath HA configurations with four onboard SAS ports You can use the completed controller to stack cabling worksheets and cabling examples to cable common multipath HA configurations that have four onboard SAS ports Multipath HA with four onboard SAS ports and one single shelf stack The following worksheet and cabling example uses port pair 0a 0d 23 ...

Page 24: ...bling worksheets and cabling examples for common multipath HA configurations Multipath HA with four onboard SAS ports and two single shelf stacks The following worksheet and cabling example uses port pairs 0a 0d and 0c 0b 24 ...

Page 25: ...kip port pairs Note When you have more port pairs than you need to cable the stacks in your system the best practice is to skip port pairs to optimize the SAS ports on your system By optimizing SAS ports you optimize your system s performance The following worksheet and cabling example shows port pairs being used in the order in which they are listed in the worksheet 0a 1b 1a 0d 0c 1d and 1c 0b Th...

Page 26: ... Controller to stack cabling worksheets and cabling examples for common multipath HA configurations 26 ...

Page 27: ...ty and controller to shelf connectivity including HX2000 port 0b same domain connectivity Cabling examples show controller to stack cables as solid or dashed to distinguish controller 0b port connections from controller 0a port connections Cabling examples show controller to stack connections and shelf to shelf connections in two different colors to distinguish connectivity through IOM A domain A ...

Page 28: ...one multi shelf stack The following worksheets and cabling examples use port pair 0a 0b In this example the controller is installed in slot A of the chassis When a controller is located in slot A of the chassis its internal storage port 0b is in domain A IOM A therefore port 0b must connect to domain A IOM A in the stack 28 ...

Page 29: ...common HX2000 configurations In this example the controller is installed in slot B of the chassis When a controller is located in slot B of the chassis its internal storage port 0b is in domain B IOM B therefore port 0b must connect to domain B IOM B in the stack 29 ...

Page 30: ... Controller to stack cabling worksheets and cabling examples for common HX2000 configurations 30 ...

Page 31: ... in the cabling examples and their corresponding port pairs in the worksheets are color coded to distinguish connectivity to each stack in the HA pair The cabling example visually distinguishes the two sets of multipathed cabling needed to achieve quad pathed connectivity for each controller to each stack in an HA pair or single controller configuration The first set of multipathed cabling is refe...

Page 32: ...guration with two quad port SAS HBAs Quad path HA with two quad port SAS HBAs and two multi shelf stacks The following worksheet and cabling example uses port pairs 1a 2b multipathed and 2a 1d quad pathed for stack 1 and port pairs 1c 2d multipathed and 2c 1b quad pathed for stack2 32 ...

Page 33: ...ility and minimize the reliance on controller takeovers You should avoid deviating from the rules deviations might reduce reliability universality and commonality Configuration rules Disk shelves with IOM12 modules are supported in specific types of HA pair and single controller configurations HA pair configurations must be cabled as multipath HA or quad path HA configurations with the following e...

Page 34: ...ble standard or double wide shelf to shelf cabling Your use of standard or double wide shelf to shelf cabling depends on the configuration you have Standard shelf to shelf connectivity Standard shelf to shelf connectivity is used in multipath HA multipath single path HA and single path configurations Standard shelf to shelf connectivity is what is being used in existing SAS storage configurations ...

Page 35: ...s 0b and 0a are connected to stacks SAS disk shelf software based disk ownership rule SAS disk shelves use software based disk ownership not hardware based disk ownership This means that disk drive ownership is stored on the disk drive rather than it being determined by the topology of the storage system s physical connections as it is for hardware based disk ownership Specifically disk drive owne...

Page 36: ...th configurations Controller 1 B and D ports always connect to IOM B domain B Controller 2 B and D ports always connect to IOM A domain A B and D ports are connected to the stacks by offsetting the order of the PCI slots by one so that the first port on the first slot is cabled last The following illustration highlights how controller ports B and D connect in a multipath HA configuration with one ...

Page 37: ...orts listed in step 1 to the D and B ports listed in step 2 in the order that they are listed For example 1a 2b 2a 3b 3a 1d 1c 2d 2c 3d 3c 1b Note For an HA pair the list of port pairs you identify for the first controller is also applicable to the second controller When cabling your system you can use port pairs in the order in which you identified them or you can skip port pairs Use port pairs i...

Page 38: ...t domains you expose your system to resiliency issues that prevent you from performing nondisruptive procedures safely Controller 0b port internal storage port Controller 1 0b port always connects to IOM A domain A Controller 2 0b port always connects to IOM B domain B Port 0b is always the primary path Port 0b always connects to the logical last disk shelf in a stack Port 0b always connect to dis...

Page 39: ...nnections For quad path HA and quad path configurations if you use multimode breakout cables for the shelf to shelf double wide connections between two disk shelves the best practice is to use identically paired breakout cables You must connect all eight four pairs of the LC breakout connectors to the patch panel You need to supply the patch panels and inter panel cables The inter panel cables mus...

Page 40: ...BAs and two stacks of disk shelves with IOM12 modules is used for the worksheet examples The worksheet template allows for up to six stacks you need to add more columns if needed If needed you can refer to the SAS cabling rules section for information about supported configurations the controller slot numbering convention shelf to shelf connectivity and controller to shelf connectivity including u...

Page 41: ...t SAS ports and two stacks port pair 1a 2b is cabled to stack 1 and port pair 1c 2d is cabled to stack 2 If two additional stacks are hot added later port pair 2a 1d is cabled to stack 3 and port pair 2c 1b is cabled to stack 4 Note When you have more port pairs than you need to cable the stacks in your system the best practice is to skip port pairs to optimize the SAS ports on your system By opti...

Page 42: ...ck connections The configuration used in this example is a multipath HA configuration with two quad port SAS HBAs eight SAS ports on each controller and two stacks of disk shelves with IOM12 modules Port pairs are cabled by skipping every other port pair in the worksheet Note When you have more port pairs than you need to cable the stacks in your system the best practice is to skip port pairs to o...

Page 43: ...irst shelf IOM B port 1 c Cable controller 1 port 2b to stack 1 last shelf IOM B port 3 d Cable controller 2 port 2b to stack 1 last shelf IOM A port 3 2 Cable port pair 1c 2d on each controller to stack 2 a Cable controller 1 port 1c to stack 2 first shelf IOM A port 1 b Cable controller 2 port 1c to stack 2 first shelf IOM B port 1 c Cable controller 1 port 2d to stack 2 last shelf IOM B port 3 ...

Page 44: ...this set of cabling gives you the quad pathed connectivity from a controller to a stack in an HA pair or single controller configuration Disk shelf IOM ports 1 and 3 are always used for multipathed cabling and IOM ports 2 and 4 are always used for quad pathed cabling as designated by the worksheet column headings In the worksheet examples port pairs are designated for multipathed cabling or quad p...

Page 45: ...ir 1a 2b for the multipathed cabling and port pair 2a 1d for the quad pathed cabling to stack 1 5 Identify the two sets of port pairs to connect to stack 2 by drawing an oval around the first set of port pairs and a rectangle around the second set of port pairs Both sets of cabling are needed to achieve quad pathed connectivity from each controller to stack 1 in your HA pair or single controller c...

Page 46: ...llowing worksheet and cabling example to demonstrate how to read a worksheet to cable controller to stack connections The configuration used in this example is a quad path HA configuration with two quad port SAS HBAs on each controller and two stacks of disk shelves with IOM12 modules If you have a single controller configuration skip substeps b and d for cabling to a second controller If needed y...

Page 47: ...irst shelf IOM B port 2 c Cable controller 1 port 1d to stack 1 last shelf IOM B port 4 d Cable controller 2 port 1d to stack 1 last shelf IOM A port 4 3 Cable port pair 1c 2d on each controller to stack 2 This is the multipathed cabling for stack 2 a Cable controller 1 port 1c to stack 2 first shelf IOM A port 1 b Cable controller 2 port 1c to stack 2 first shelf IOM B port 1 c Cable controller 1...

Page 48: ...tables list the recommended conductor size for 2 percent voltage drop for a particular distance measured in feet taken from the Radio Engineer s Handbook The circuits in the following tables are described in American Wire Gauge AWG measurements Table 7 110V single phase 20A circuit 30A circuit 40A circuit 50A circuit 25 feet 12 AWG 10 AWG 8 AWG 8 AWG 50 feet 8 AWG 6 AWG 6 AWG 4 AWG 75 feet 6 AWG 4...

Page 49: ...xample corrected the port pair used to connect to a fourth stack The correct port pair is 2c 1b In the Changing the disk shelf ID procedure added information clarifying what state disk drives need to be in to nondisruptively change a shelf ID Table 11 Feature release date Feature updates May 2019 For DS460C disk shelves information about using the detachable handles was added to the new system ins...

Page 50: ... for multipathed connectivity section to include an example for skipping port pairs Updated the How to read a worksheet to cable controller to stack connections for multipathed connectivity section to include an example for skipping port pairs Added a bullet item in the Considerations for hot adding disk shelves with IOM12 modules stating that nondisruptive stack consolidation is not supported Upd...

Page 51: ... system installation Installing a disk shelf with IOM12 modules for a hot add and Changing the disk shelf ID sections to state a valid shelf ID is 00 99 00 is not reserved for the internal disk shelf Added the new Controller to stack cabling worksheet template for quad pathed connectivity section Added the new How to read a worksheet to cable controller to stack connections for quad pathed connect...

Page 52: ... NO EVENT SHALL FUJITSU BE LIABLE FOR ANY DIRECT INDIRECT INCIDENTAL SPECIAL EXEMPLARY OR CONSEQUENTIAL DAMAGES INCLUDING BUT NOT LIMITED TO PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES LOSS OF USE DATA OR PROFITS OR BUSINESS INTERRUPTION HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY WHETHER IN CONTRACT STRICT LIABILITY OR TORT INCLUDING NEGLIGENCE OR OTHERWISE ARISING IN ANY WAY OUT OF THE USE OF ...

Page 53: ...rk FUJITSU FUJITSU logo and ETERNUS are trademarks of Fujitsu All other trademarks are the property of their respective owners https www fujitsu com global products computing storage eternus trademarks html 53 ...

Page 54: ... documentation and receive update notifications The latest version of this document and the latest information related to this device are available at the following site https www fujitsu com global support products computing storage manuals list html If necessary refer to the manuals for your model 54 ...

Page 55: ...the utmost attention to detail However Fujitsu shall assume no responsibility for any operational problems as the result of errors omissions or the use of information in this manual Fujitsu assumes no liability for damages to third party copyrights or other rights arising from the use of any information in this manual The content of this manual may not be reproduced or distributed in part or in it...