IBM 6.1.8.2, Hardware Planning And Installation Manual

Page 1: ...IBM Storage Scale System Utility Node 6 1 8 2 Hardware Planning and Installation Guide IBM SC28 3469 00...

Page 2: ...duct number 5765 DME IBM Storage Scale Data Access Edition for IBM ESS product number 5765 DAE IBM welcomes your comments see the topic How to submit your comments on page xix When you send informatio...

Page 3: ...for Interference VCCI Notice 14 Korea Notice 14 People s Republic of China Notice 14 Russia Notice 15 Taiwan Notice 15 United States Federal Communications Commission FCC Notice 15 Chapter 2 Technical...

Page 4: ...BM SSR task 61 Installing support rails for the IBM Storage Scale System Utility Node IBM SSR task 62 Installing enclosures IBM SSR task 62 Installing cable management assembly IBM SSR task 65 Chapter...

Page 5: ...f the rack 33 12 Mark selected EIA in the rear of the rack 33 13 Rack specifications top down view 35 14 Model MTM 5149 23E rear rack clearance 37 15 Server enclosure model 5141 FN2 rear rack clearanc...

Page 6: ...ion 58 33 Pulling out the middle rails to mount the server 59 34 Inserting the server into the server rack 59 35 Securing the server on the rack 60 36 Aligning the enclosure 62 37 Inserting the enclos...

Page 7: ...of the utility node 72 51 Close view of the PSU LEDs in the rear of the enclosure of the utility node 72 52 Slot placement rules AK1P Dual socket protocol node 75 53 Slot placement rules AK1N Single s...

Page 8: ...viii...

Page 9: ...t exchanger 33 12 System maximum measured power specifications 43 13 Temperature requirements for the utility node 44 14 Physical characteristics of the utility node 44 15 Rack space requirements for...

Page 10: ...24 Link and activity LED scheme for the 10 Gbps LAN port 73 25 Link and activity LED scheme for the 1 Gbps LAN port 73 26 Cable matrix 78 x...

Page 11: ...ides IBM Storage Scale System Utility Node information including servicing and parts listings System administrators and IBM support team Problem Determination Guide This unit provides ESS information...

Page 12: ...xperienced with IBM Storage Scale systems and familiar with the terminology and concepts in the XDSM standard IBM Elastic Storage System ESS 3000 documentation consists of the following information un...

Page 13: ...es This unit provides information including initial hardware installation and setup and removal and installation of field replaceable units FRUs customer replaceable units CRUs for ESS 5000 Expansion...

Page 14: ...nit provides IBM Storage Scale RAID information including administering monitoring commands and scripts System administrators of IBM Storage Scale systems Application programmers who are experienced w...

Page 15: ...orage Scale clusters who are very experienced with the operating systems on which each IBM Storage Scale cluster is based Service Guide This unit provides ESS 3500 information including servicing and...

Page 16: ...xperienced with IBM Storage Scale systems and familiar with the terminology and concepts in the XDSM standard IBM Elastic Storage System ESS 3000 documentation consists of the following information un...

Page 17: ...orage enclosures This unit provides information including initial hardware installation and setup and removal and installation of field replaceable units FRUs customer replaceable units CRUs for ESS 5...

Page 18: ...n the XDSM standard Conventions used in this information Table 1 on page xviii describes the typographic conventions used in this information UNIX file name conventions are used throughout this inform...

Page 19: ...scriptions Ctrl x The notation Ctrl x indicates a control character sequence For example Ctrl c means that you hold down the control key while pressing c item Ellipses indicate that you can repeat the...

Page 20: ...xx IBM Storage Scale System Utility Node Hardware Planning and Installation Guide...

Page 21: ...M Japan Ltd 19 21 Nihonbashi Hakozakicho Chuo ku Tokyo 103 8510 Japan INTERNATIONAL BUSINESS MACHINES CORPORATION PROVIDES THIS PUBLICATION AS IS WITHOUT WARRANTY OF ANY KIND EITHER EXPRESS OR IMPLIED...

Page 22: ...programming techniques on various operating platforms You may copy modify and distribute these sample programs in any form without payment to IBM for the purposes of developing using marketing or dist...

Page 23: ...ing moderate or minor personal injury C001 DANGER A danger notice indicates the presence of a hazard that has the potential of causing death or serious personal injury D002 2 Locate the IBM Systems Sa...

Page 24: ...ing moderate or minor personal injury C001 2 After you download the IBM System Safety Notices document open it 3 Under the language find the matching identification number Review the topics about the...

Page 25: ...ures when installing moving or opening covers on this product or attached devices To disconnect 1 Turn off everything unless instructed otherwise 2 For AC power remove the power cords from the outlets...

Page 26: ...ld terminate at this main protective earthing terminal or at points marked with R010 Caution notices for the system Ensure that you understand the caution notices for the system Use the reference numb...

Page 27: ...erify stabilizer brake function before each use Do not over force moving or rolling the LIFT TOOL with stabilizer brake engaged Do not raise lower or slide platform load shelf unless stabilizer brake...

Page 28: ...position before releasing handle Read instruction page before operating this winch Never allow winch to unwind freely Freewheeling will cause uneven cable wrapping around winch drum damage cable and...

Page 29: ...he system battery contains lithium manganese dioxide If the battery pack is not handled properly there is risk of fire and burns Do not disassemble crush puncture short external contacts or dispose of...

Page 30: ...he safety checks If unsafe conditions are present determine how serious the hazards are and whether you can continue before you correct the problem Before you start the safety inspection make sure tha...

Page 31: ...erations that expose the internal parts of the device 7 Check the bottom of the external cover for any loose or broken feet 8 Contact technical support if there are any issues Checking internal device...

Page 32: ...netic compatibility notices The following Class A statements apply to IBM products and their features unless designated as electromagnetic compatibility EMC Class B in the feature information When att...

Page 33: ...men zu ergreifen und daf r aufzukommen Deutschland Einhaltung des Gesetzes ber die elektromagnetische Vertr glichkeit von Ger ten Dieses Produkt entspricht dem Gesetz ber die elektromagnetische Vertr...

Page 34: ...This statement applies to products greater than 20 A per phase three phase Japan Voluntary Control Council for Interference VCCI Notice Korea Notice People s Republic of China Notice 14 IBM Storage S...

Page 35: ...mful interference in which case the user will be required to correct the interference at his own expense Properly shielded grounded and approved cables and connectors must be used in order to meet FCC...

Page 36: ...Armonk NY 10504 Contact for FCC compliance information only fccinfo us ibm com 16 IBM Storage Scale System Utility Node Hardware Planning and Installation Guide...

Page 37: ...Ie bus implementation This document explains a single socket EMS node and dual socket protocol node The EMS supports up to 512 GB RDIMM whereas the protocol node supports up to 1 TB RDIMM The system i...

Page 38: ...system are as follows IBM Storage Scale software all inclusive software feature licensing Onboard ports 2 USB 3 1 Gen 1 ports at front 2 USB 3 1 Gen 1 ports at rear to attach keyboard for KVM access...

Page 39: ...EN02 with QFSP and SFP adapters EB47 5 m LC LC Passive Fibre Cable FC ECBD with 25 GbE transceivers EBBA 10 m HDR IB QFSP56 AOC You can configure a utility node with a single cluster ESS 3500 only Ent...

Page 40: ...pabilities The EMS node also runs a container with Ansible playbook that can provide orchestration of complex tasks such as cluster configuration file system creation and code update Power supply unit...

Page 41: ...U rackmount Chassis model MTM 5149 23E Chassis dimension D x W x H 25 in x 17 26 in x 3 43 in 640 x 438 4 x 87 mm Processor socket type 2 x SP3 LGA4094 Gross weight 25 kg 55 lb Net weight 16 kg 35 2 l...

Page 42: ...tage 1 2 V Expansion slots PCIe One PCIe Gen 4 x16 slot HH 10 5 in L One PCIe Gen 4 x16 slot HH HL Preinstalled 2U riser card PCIe Gen 4 One CARISER T75 L24 riser card for one HH 10 5 in L PCIe Gen 4...

Page 43: ...t rear VGA One D Sub 15 pin port RJ 45 Two 10 GbE ports One 1 GbE dedicated for IPMI System monitoring Chipset Aspeed AST2500 Temperature Monitors temperature for CPU and memory and system environment...

Page 44: ...35 C 50 F 95 F Nonoperating temperature 40 C 70 C 40 F 158 F Transit temperature 40 C 60 C 40 F 140 F Operating nonoperating altitude1 2 61 3048 m 200 to 10000 ft Transit altitude 61 12192 m 200 to 4...

Page 45: ...ng that adequate space is available and that requirements for power network and environmental conditions are met Important The IBM SSR refers to these system configuration details when they perform th...

Page 46: ...e front door and rear door 600 mm 23 6 in 1201 mm 47 3 in 2020 mm 79 5 in 181 kg 398 lb 42 EIA units Table 5 Weight capacity limits Characteristics Maximum weight EIA unit capacity Dynamic rolling 113...

Page 47: ...0 F Humidity range 5 5 C 42 F dew point DP to 60 relative humidity RH and 15 C 59 F dew point 12 0 C 10 4 F DP and 8 80 RH 8 80 RH Maximum dew point 24 C 75 F 27 C 80 F Maximum operating altitude 3050...

Page 48: ...supply units PSUs on page 20 Caster and leveler locations The following diagram provides the caster and leveler locations for the 7965 S42 rack Figure 6 Caster and leveler locations Cabling the 7965 S...

Page 49: ...re 7 Cabling within the rack Cabling under the floor Cables can be routed straight down through the side channels of the rack or routed towards the center of the opening Chapter 3 Planning for hardwar...

Page 50: ...e routed up and out of the rack Cable access covers on the rear are adjustable by loosening the side screws and sliding the covers forward or backward Because of the smaller size of the cable openings...

Page 51: ...cks can be attached together For racks that are on a 600 mm 23 6 in pitch you can use screws to clamp the racks together For racks that are on a 609 mm 24 0 in pitch two spacer brackets must be added...

Page 52: ...f the rack enclosure where you plan to place the EIA units for this activity For each server identify and mark EIA locations for each pair of rails for the servers to be installed left and right front...

Page 53: ...that is equivalent to the heat that is generated by the devices that is removed by the heat exchanger and the average air temperature that is leaving the heat exchanger is identical to that entering t...

Page 54: ...specifications are provided as an aid to help you understand the requirements to install IBM systems into racks It is your responsibility working with your rack manufacturer to ensure that the rack th...

Page 55: ...op down view The vertical distance between mounting holes must consist of sets of three holes spaced from bottom to top 15 9 mm 0 625 in 15 9 mm 0 625 in and 12 7 mm 0 5 in on center making each three...

Page 56: ...must support an average load of 20 kg 44 lb of product weight per EIA unit For example a four EIA drawer has a maximum drawer weight of 80 kg 176 lb The system requires space at the rear of the rack f...

Page 57: ...clearance Only AC power drawers are supported in the rack or cabinet It is strongly recommended to use a power distribution unit that meets the same specifications as IBM power distribution units to s...

Page 58: ...oors must be fully perforated to provide proper front to back airflow for mounted information technology IT equipment The total door area must result in a minimum of 45 opening area Rear doors must no...

Page 59: ...nd power ratings are rated at 80 of the building supply circuit as required by the National Electrical Code and the Canadian Electrical Code The total load that is connected to the power distribution...

Page 60: ...Reviewing IBM Storage Scale System Utility Node location guidelines Consult these guidelines when you plan the location of a utility node and any existing IBM Elastic Storage System in your environme...

Page 61: ...I which is a web accessible graphical user interface GUI that supports flexible and rapid access to storage management information The utility node GUI also provides a directed maintenance procedure D...

Page 62: ...irected to disconnect power during servicing Connect all devices installed in a rack cabinet to power devices installed in the same rack cabinet Do not plug a power cord from a device installed in one...

Page 63: ...In addition remember The rack design must support the total weight of the installed enclosures and incorporate stabilizing features suitable to prevent the rack from tipping or being pushed over durin...

Page 64: ...listed in the following table Table 13 Temperature requirements for the utility node Environment Ambient temperature Altitude Relative humidity Operating 10 C to 35 C1 50 F to 95 F 61 to 3048 m2 3 20...

Page 65: ...th Maximum rail depth including cable management arm 660 mm 26 in 940 mm 37 in Service Envelope Illustration The following figure provides a close up view of the utility node mounting envelope Figure...

Page 66: ...f the room see Computer room layout See the Site preparation and physical planning section to help you prepare your physical site for the installation of a utility node Additional space requirements E...

Page 67: ...r IP address requirements and service access for the system The utility node uses 100 GbE 200 GbE 100 Gb EDR 200 Gb HDR network for cluster communication and data transport For IP port usage requireme...

Page 68: ...standard that allows the adapters to transfer data directly to or from the endpoints in a connection without using CPU resources on either of the endpoints These transfers occur simultaneously with o...

Page 69: ...nly Reserved for service 8 BMC display port Provides one RJ45 1 GbE port for BMC connection 9 Management port Provides one RJ45 10 GbE port for management or campus connection 10 SSR port Provides one...

Page 70: ...de server has two PCIe interface slots to support extra adapters Supported environment Refer to the IBM support website for up to date information about the supported environment for your system Envir...

Page 71: ...rk connection diagram on the IBM Worldwide Customized Installation Instructions WCII website Management Server overview For information about the Management Server description and feature table see Se...

Page 72: ...ht posts of the rack posts front and rear where the rails are engaged Ensure that the markings are visible from the front and the rear of the rack 1 Mark the EIA locations in the front of the rack lef...

Page 73: ...nt the MTM 5149 23E server rack chassis into a rack Figure 22 Rail kit right and left rails Figure 23 Outer middle and inner rails left rail The rails can be used in racks with either round or square...

Page 74: ...rails x 2 Rail screw pack includes 4 rail screws 4 rack screws 2 washers Figure 25 Screws and washers included in the rail kit 1 Remove the inner rail from both the right and the left rail a Slide the...

Page 75: ...ddle rail backward Figure 27 Replacing the middle rail into the outer rail left rail 2 Install the inner rail onto the chassis Do the next steps for both sides of the chassis a Align the inner rail ho...

Page 76: ...ure 28 Aligning the inner rail in the chassis b Push the inner rails to secure the hooks as shown in the following figure 56 IBM Storage Scale System Utility Node Hardware Planning and Installation Gu...

Page 77: ...inner rail onto the chassis 3 Fix the outer rail or bracket assembly to the frame You must secure the outer rails to the rack both on the front and on the rear sides one rail at a time For each rail f...

Page 78: ...ts position on the rack post See the following figure Figure 32 Securing the outer rails click the bracket into position 4 Mount the server on the rack a Pull the middle rail until it is fully extende...

Page 79: ...rver b Horizontally insert the chassis into middle outer rails as shown in the next figure Figure 34 Inserting the server into the server rack c Use the washers and rack screws to secure the chassis t...

Page 80: ...IBM Storage Scale System Utility Node MTM 5149 23E Table 20 Ports on the utility node Item number Feature Description 1 Riser C Provides for riser card C to plug in CX 6 network adapter 2 CX 6 VPI ada...

Page 81: ...followed all the related instructions The utility node and related parts are shipped preinstalled in the enclosure The utility node comes preinstalled with the following components One AMD EPYC 7003...

Page 82: ...Following your enclosure location plan install the utility node system CAUTION To lift a utility node requires at least two people To reduce the enclosure weight to permit one person to safely lift t...

Page 83: ...sure and align the mounting holes as shown in the following figure Figure 38 Replacing left ear cap b Install the two screws on the rear side of the left bezel ear cap as shown in the following figure...

Page 84: ...Figure 41 Release tab 7 Secure the enclosure on the left and right front of the enclosure to the left and right front rack posts by using the two M5 X 9 shipping screws as shown in the following figu...

Page 85: ...ment without disconnecting the cables from the power supply units PSU or server canisters A properly installed CMA prevents cable tangling and interference with other components in the rack allowing f...

Page 86: ...nsportation to avoid damage This strap must be removed before installation Remove zip tie before use Cable Figure 43 Cable management assembly 2 Verify the direction of the CMA arm as shown in the fol...

Page 87: ...management assembly installation 3 To change the direction of the arm for use on the opposite side of the enclosure press the release buttons on the outside of the CMA elbow and rotate the arm 180 deg...

Page 88: ...shown in the following figure D C Figure 47 Installing outer CMA arm connector on outer rail connector 6 Slide the CMA body connector E onto the lower left CMA body rail F as shown in the following f...

Page 89: ...n each cable through the loops on the CMA 9 Test the CMA to ensure smooth operation Ensure that the cables do not have pinching or bindings Note When you pull the enclosure from the rack the rails loc...

Page 90: ...70 IBM Storage Scale System Utility Node Hardware Planning and Installation Guide...

Page 91: ...tus of the utility node Six status LEDs are available on the front of the enclosure distributed as shown in the following figure Figure 49 System status LEDs on the front panel of the utility node Tab...

Page 92: ...r supply unit PSU LEDs These LEDs on the rear of the enclosure are used to monitor the power supply units PSUs of the utility node The following figure highlights the location of the status LEDs of PS...

Page 93: ...nd amber LEDs indicate the LAN status as described in the following tables Note The LAN port images that are included in the next tables are viewed from the rear panel Table 24 Link and activity LED s...

Page 94: ...y LED scheme for the 1 Gbps LAN port continued 1000 Mbps 1 Gbps Link Solid green Solid amber Active Blinking green Solid amber No link Off Off 74 IBM Storage Scale System Utility Node Hardware Plannin...

Page 95: ...23E Each slot number and its usage as well as VM usage when setup are explained in the slot placement summary Figure 52 Slot placement rules AK1P Dual socket protocol node Figure 53 Slot placement ru...

Page 96: ...76 IBM Storage Scale System Utility Node Hardware Planning and Installation Guide...

Page 97: ...supports connecting to an HDR 200 Gb switch by using HDR 100 Gb splitter cables such as Direct Attach Copper DAC or Active Optical Cables AOC Splitter cables allow a single HDR 200 Gb switch port to c...

Page 98: ...s Table 26 Cable matrix Feature Description EB50 Copper EDR 100 GbE cable 0 5 M EB51 Copper EDR 100 GbE cable 1 M EB54 Copper EDR 100 GbE cable 1 5 M EB52 Copper EDR 100 GbE cable 2 M EB5A Optical EDR...

Page 99: ...Power Systems Prerequisites IBM System Storage Interoperation Center SSIC The latest version of the device driver or IBM Power RAID adapter utilities iprutils can be downloaded from the IBM Service a...

Page 100: ...80 IBM Storage Scale System Utility Node Hardware Planning and Installation Guide...

Page 101: ...used by screen readers Keys that are discernible by touch but do not activate just by touching them Industry standard devices for ports and connectors The attachment of alternative input and output d...

Page 102: ...82 IBM Storage Scale System Utility Node Hardware Planning and Installation Guide...

Page 103: ...entral processor complex CPC central processor complex CPC A physical collection of hardware that consists of channels timers main storage and one or more central processors cluster A loosely coupled...

Page 104: ...at attaches to the storage enclosure drives In the case of multiple drawers in a storage enclosure the ESM attaches to drawer control modules ESM See environmental service module ESM F failback Cluste...

Page 105: ...qualified domain name FQDN The complete domain name for a specific computer or host on the Internet The FQDN consists of two parts the hostname and the domain name G GPFS cluster A cluster of nodes de...

Page 106: ...contains programs for such tasks as input output management and control of hardware and the scheduling of user tasks L LACP See Link Aggregation Control Protocol LACP Link Aggregation Control Protocol...

Page 107: ...An individual operating system image within a cluster Depending on the way in which the computer system is partitioned it can contain one or more nodes In a Power Systems environment synonymous with l...

Page 108: ...ving either one s operating system This permits high throughput low latency networking which is especially useful in massively parallel computer clusters RGD See recovery group data RGD remote key man...

Page 109: ...TCP See Transmission Control Protocol TCP Transmission Control Protocol TCP A core protocol of the Internet Protocol Suite that provides reliable ordered and error checked delivery of a stream of oct...

Page 110: ...90 IBM Storage Scale System Utility Node Hardware Planning and Installation Guide...

Page 111: ...information xi P power requirements power continued requirements continued system 43 preface xi Q Quorum 20 R requirements additional space 46 electrical 43 environmental 44 power 43 space 44 S safet...

Page 112: ...92 IBM Storage Scale System Utility Node Hardware Planning and Installation Guide...

Page 113: ......

Page 114: ...IBM Product Number 5765 DME 5765 DAE SC28 3469 00...