Lenovo ThinkAgile CP, Hardware Part Replacement And Component Maintenance Procedures

Page 1: ...Lenovo ThinkAgile CP Hardware Part Replacement and Component Maintenance Procedures Models CP4000 CP6000 ...

Page 2: ...ition be sure that you are familiar with the terms and conditions of the Lenovo warranty for your solution which can be found at the following address http datacentersupport lenovo com warrantylookup Second Edition March 2020 Copyright Lenovo 2018 2020 LIMITED AND RESTRICTED RIGHTS NOTICE If data or software is delivered pursuant to a General Services Administration GSA contract use reproduction o...

Page 3: ...cement 70 Enclosure replacement 78 Complete the parts replacement 84 Compute block maintenance procedures 85 Shutting off a compute node 85 Migrating VMs from a compute node 85 Migrate a VM between compute nodes 86 Replacing compute block hardware 87 Hardware replacement procedures 87 Replace compute network cables 87 Enable or Disable Maintenance Mode 88 Hot swap drive replacement 91 Hot swap pow...

Page 4: ...ii Lenovo ThinkAgile CP Hardware Part Replacement and Component Maintenance Procedures ...

Page 5: ...9 40 Disable Maintenance Mode for a Node 90 41 Drive removal 92 42 Drive installation 93 43 Hot swap power supply removal 96 44 Hot swap power supply installation 99 45 Fan fault LEDs 101 46 60x60x56mm fan removal 102 47 80x80x80mm fan removal 103 48 60x60x56mm fan installation 105 49 80x80x80mm fan installation 106 50 EIOM ports and corresponding node number 107 51 EIOM removal 108 52 EIOM instal...

Page 6: ...iv Lenovo ThinkAgile CP Hardware Part Replacement and Component Maintenance Procedures ...

Page 7: ...sponding node number 107 5 DIMM installation sequence Independent mode normal mode 114 6 DIMM installation sequence mirror mode lockstep mode 114 7 DIMM installation sequence mirror mode lockstep mode for 3 6 9 and 12 identical DIMMs 114 8 DIMM installation sequence sparing mode 114 Copyright Lenovo 2018 2020 v ...

Page 8: ...vi Lenovo ThinkAgile CP Hardware Part Replacement and Component Maintenance Procedures ...

Page 9: ...key features Modular and scalable ThinkAgile CP Series configurations of an on premises cloud platform featuring the second generation of the Intel Xeon Processor Scalable Family that are designed to optimize your workload s performance and provide the IT agility for your business demands Factory preloaded ready to go cloud platform that is delivered with all the infrastructure you need for your w...

Page 10: ...ise class storage functionality and enables linear performance and capacity scaling Figure 1 Storage block Compute Blocks A Compute Block is a modular 2U enclosure that contains up to four nodes and it delivers processor and memory resources to the cloud The compute nodes run the cloud hypervisor that combines open KVM based virtualization software hardware integration and automation to orchestrat...

Page 11: ... to provide out of band OOB management for the Interconnect Compute Blocks and Storage Blocks The switch can be supplied by Lenovo ThinkSystem NE0152T RackSwitch or customers may provide their own switch Figure 4 Management switch Cloud Controller Cloud Controller orchestrates and manages the on premises infrastructure and workloads however it resides in the cloud It automates and orchestrates inf...

Page 12: ... Compute block on page 5 Interconnect switch on page 5 Management switch on page 5 Services on page 6 Software on page 6 Storage block 1 Storage Block SB S10 Dual controller single CPU per controller 8x SFP Base T SFP transceivers 8x CAT6 cables 1 5m and other lengths permitted 2x CAT5e cables 1 5m and other lengths permitted 32 GB RAM per controller 8 16 24 drives 8 drives per drive pack 800 GB 1...

Page 13: ... lengths permitted Boot 1x SATA 240 GB Dimensions 41 0 x 562 0 x 222 0 mm 1 7 x 22 2 x 8 8 inches Maximum weight 55 kg 121 2 lb Interconnect switch 1 or 2 CP I 10 interconnect switches 48x 10 Gb SFP fabric ports 6x 40 Gb QSFP fabric ports Dimensions 438 4 x 473 x 43 4 mm 17 26 x 18 62 x 1 71 inches Maximum weight 8 95 kg 19 73 lb with two installed PSUs Management switch Lenovo ThinkSystem NE0152T...

Page 14: ...ou must provide an OOB management switch with the correct configuration Services Lenovo Deployment Services are mandatory Lenovo Hardware Installation Service is optional Software Software is preloaded on compute storage and switch 6 Lenovo ThinkAgile CP Hardware Part Replacement and Component Maintenance Procedures ...

Page 15: ...ge 8 Management switch on page 8 Services on page 9 Software on page 9 Storage block 1 Storage Block a maximum 5 blocks SB D20 Dual controller 2CPU per controller 8x SFP Base T SFP adapters 8x CAT6 cables per storage block 1 5m and other lengths permitted 64 GB RAM per controller 8 16 24 drives 8 drives per drive pack 1 6 TB 3 2 TB 6 4 TB NVMe drives per controller Drives must be consistent within...

Page 16: ...er lengths permitted Boot 1x SATA 240 GB Dimensions 41 0 x 562 0 x 222 0 mm 1 7 x 22 2 x 8 8 inches Maximum weight 55 kg 121 2 lbs Interconnect switch 2 CP I 10 Interconnect switches 48x 10 Gb SFP fabric ports 6x 40 Gb QSFP fabric ports Dimensions 438 4 x 473 x 43 4 mm 17 26 x 18 62 x 1 71 inches Maximum weight 8 95 kg 19 73 lb with two installed PSUs Management switch Lenovo ThinkSystem NE0152T R...

Page 17: ...novo NE0152T is not used you must provide an OOB management switch with the correct configuration Services Lenovo Deployment Services are mandatory Lenovo Hardware Installation Service is optional Software Software is preloaded on compute storage and switch Chapter 1 ThinkAgile CP Overview 9 ...

Page 18: ...f or request Lenovo to install it at no additional charge under the warranty service type designated for your storage Field replaceable unit FRU FRUs must be installed only by trained service technicians Consumable and structural parts Purchase and replacement of consumable and structural parts components such as a cover or bezel is your responsibility If Lenovo acquires or installs a structural c...

Page 19: ...Figure 5 Storage block components For more information about ordering the parts shown here see the following website Lenovo Data Center Support page 7Y66 Chapter 1 ThinkAgile CP Overview 11 ...

Page 20: ...uires or installs a structural component at your request you will be charged for the service Table 2 Compute block part listing Index Description Tier 1 CRU Tier 2 CRU FRU Consuma ble and Structural part 1 PCIe adapter 2 Air baffle 3 Processor and heat sink assembly 85mm heat sink 4 Processor and heat sink assembly 108mm heat sink 5 Processor and heat sink assembly 108mm heat sink 6 Processor and ...

Page 21: ...Figure 6 Compute block components For more information about ordering the parts shown here see the following website Lenovo Data Center Support page 7X20 Chapter 1 ThinkAgile CP Overview 13 ...

Page 22: ...ited States and Canada are listed by Underwriter s Laboratories UL and certified by the Canadian Standards Association CSA For units intended to operate at 115 volts Use a UL listed and CSA certified cord set consisting of a minimum 18 AWG type SVT or SJT three conductor cord a maximum of 15 feet 4 6 meters in length and a parallel blade grounding type attachment plug rated 15 amperes 125 volts Fo...

Page 23: ...r Customer or field service Lenovo Support Shutting off a compute node on page 85 Shuts down compute node on Cloud Controller web portal Migrating VMs from a compute node on page 85 Turns on Maintenance Mode Uses Migrate tool OR Enables Support Mode for ThinkAgile Advantage Support assistance Optional If customer wants assistance Accesses node remotely via Support Mode Turns on Maintenance Mode Us...

Page 24: ...10 Performs all steps in task Replace the SD530 system board on page 120 Performs all steps in task Shutting off a storage controller on page 34 Physically connects to storage controller Enters shutdown commands in hardware console OR Optional Enables Support Mode for ThinkAgile Advantage Support assistance Optional If customer wants assistance Accesses storage controller remotely via Support Mode...

Page 25: ...nect and runs command Registers storage blocks Update the storage node VPD on page 74 Performs all steps in task Hot swap drive replacement on page 36 Performs all steps in task Hot swap power supply replacement on page 62 Performs all steps in task Hot swap drive replacement on page 36 Performs all steps in task Optional Performs all steps in task at customer request Charges may apply depending o...

Page 26: ...figuration on page 133 Physically replaces and cables interconnect Powers on replacement interconnect Requests interconnect settings from Lenovo Configures to be replaced and replacement interconnects Hardware management network cable replacement on page 142 Physically replaces cables connecting the hardware management network to other components Replacing the management switch optional on page 14...

Page 27: ...u install an optional component Keep the working area clean and place removed components on a flat and smooth surface that does not shake or tilt Do not attempt to lift an object that may be too heavy for you If you have to lift a heavy object read the following precautions carefully Make sure that you can stand steadily without slipping Distribute the weight of the object equally between your fee...

Page 28: ...come with more than one air baffle Operating the server with a missing air baffle might damage the processor All processor sockets must contain either a socket cover or a processor with heat sink When more than one processor is installed fan population rules for each server must be strictly followed Do not operate the enclosure without the System Management Module SMM assembly installed Operating ...

Page 29: ...increases static electricity Always use an electrostatic discharge wrist strap or other grounding system especially when working inside the solution with the power on While the device is still in its static protective package touch it to an unpainted metal surface on the outside of the solution for at least two seconds This drains static electricity from the package and your body Remove the device...

Page 30: ...22 Lenovo ThinkAgile CP Hardware Part Replacement and Component Maintenance Procedures ...

Page 31: ...or firewall rule must be applied to prevent any SSH outbound connection on port 22 By default SSH outbound is disabled or prevented Note The commands described here must be run on all interconnect switches in your ThinkAgile CP solution Enable Support Mode in the Cloud Controller Complete this procedure to enable Support Mode on the Cloud Controller Procedure performed by Customer Execution Web Po...

Page 32: ... Support Mode Follow this procedure to gain access to the customer s system via Support Mode Step 1 SSH into the proxy server tacp proxy cp lenovo com using a valid Support ID For example Note marc lavergne is an example Support ID in the following Figure 10 Virtual Office sign in page Step 2 The SSH session CLI displays Enter the following command s ss sh h p p u us se er r s s p po or rt t n nu ...

Page 33: ...Chapter 4 Managing Support Mode 25 ...

Page 34: ...looking up the Multi enclosure Link Aggregation Group MLAG IP for the switch you can run the following commands s so ou ur rc ce e e et tc c t ta ac cp p t ta ac cp p_ _s sw wiit tc ch h_ _r re es so ou ur rc ce e s sh h e ec ch ho o M ML LA AG G_ _V VL LA AN N_ _I IP P s ss sh h b b M ML LA AG G_ _V VL LA AN N_ _I IP P ii s ss sh h pri_file c clld dt tx x_ _s su up pp po or rt t ip Place a suppor...

Page 35: ...ry Note The port number used to connect to the interconnect switch is provided when the customer enables Support Mode Step 8 Establish an SSH session with the primary interconnect switch s ss sh h p p port_number c clld dt tx x_ _s su up pp po or rt t llo oc ca allh ho os st t o o S St tr riic ct tH Ho os st tK Ke ey yC Ch he ec ck kiin ng g n no o Step 9 Verify that the files that you copied are ...

Page 36: ...eps Step 1 In the Cloud Controller click the Support button in the top right corner of the toolbar and then click Turn off Support Mode from the drop down menu Figure 12 Cloud Controller Support Mode menu item Step 2 A dialog box appears on screen Click theTurn Off Support Mode button Figure 13 Turn Off Support Mode dialog box 28 Lenovo ThinkAgile CP Hardware Part Replacement and Component Mainten...

Page 37: ...ge block maintenance Refer to Chapter 2 Roles and responsibilities on page 15 to determine who can perform these procedures Storage block component indicators This section describes the ThinkAgile CP storage block component indicators Before performing maintenance procedures on your ThinkAgile CP storage controller familiarize yourself with the following indicators to identify the storage block co...

Page 38: ... enclosure is receiving power Off the enclosure is not receiving power Identification LED indicator On the enclosure is identified Off the enclosure is not identified Error Warning LED indicator On fault conditions are present Off the enclosure is operating under normal conditions Figure 14 Enclosure indicators 30 Lenovo ThinkAgile CP Hardware Part Replacement and Component Maintenance Procedures ...

Page 39: ...indicator Constant On fault conditions are present 4 Hz blink rate four times a second locating the drive 1 Hz blink rate once a second rebuilding the drive Constant Off the drive is operating under normal conditions Each drive also has the following drive tray label drive bay number written on the enclosure drive tray latch release Figure 15 Drive indicators Chapter 5 Part replacement and mainten...

Page 40: ...icators Operation LED indicator On the controller is receiving power Off the controller is not receiving power Identification LED indicator Constant On the controller is identified 1 Hz blink rate once a second the controller is not identified Constant Off the controller is operating under normal conditions Error Warning LED indicator On fault conditions are present Off the controller is operating...

Page 41: ...k Each Ethernet port has two LED indicators Activity LED indicator On traffic is present on the port Off no traffic is present Error Warning LED indicator On fault conditions are present Off the port is operating under normal conditions Figure 17 Storage controller port indicators Chapter 5 Part replacement and maintenance procedures 33 ...

Page 42: ...n in execute the following commands to shut down the storage controller at the node level OS s su ud do o u us sr r b biin n t ta ac cp p s st to or ra ag ge e c co on nt tr ro olllle er r s sa af fe e s st to op p s su ud do o s sh hu ut td do ow wn n h h n no ow w When you initiate shutoff of the entire storage block the Cloud Controller lists the VMs that have disks exported to the storage bloc...

Page 43: ...wn the storage block Procedure to power off the ThinkAgile CP storage block Procedure performed by Solution administrator Execution Web Portal only You shut down a storage block shutting down all storage controllers directly in the Cloud Controller In the Hardware page in the storage block Action menu select Power off At that point if there are VMs running and using disks exported by the storage b...

Page 44: ...e interconnect in the chassis disconnecting all cables results in taking the storage offline as there is no failover option Hot swap drive replacement This section covers information about replacing a hot swap drive Use this information to remove and install a hot swap drive You can remove or install a hot swap drive without turning off the storage which helps you avoid significant interruption to...

Page 45: ...paring the drives on page 38 section Can I prepare the drives on the storage enclosure where I want to add the disks No How many drives I can replace at a time You can replace one drive at a time Can the drives be of different capacity than the drives already present No Should all drives have the same firmware level Yes Note To check the drive firmware level use the following command and check the...

Page 46: ... ThinkAgile CP storage block array follow these steps to destroy the namespace 1 Execute the following command u us sr r s sh ha ar re e t ta ac cp p e en nc cr ry yp pt tiio on n iig gn niit te e_ _b bu uiilld d_ _s se ed d f f d d v v 2 Rescan the PCI bus by executing the following commands m mo od dp pr ro ob be e r r n nv vm me e e ec ch ho o 1 1 s sy ys s b bu us s p pc cii r re es sc ca an n...

Page 47: ...id0 vdo_data 253 9 0 4 3T 0 dm vdo 253 10 0 43 4T 0 vdo CBS_POOL_data 253 8 0 43 3T 0 dm CBS_POOL 253 12 0 43 3T 0 dm SPECIAL_METADATA_STORE_4bd8d3ce75b1465082619c1f3fc15fb2 253 13 0 1G 0 dm SPECIAL_TEMPLATE_STORE_cd6d34c281054ef690a89030bef839ec 253 14 0 43 3T 0 dm CBS_POOL_meta 253 11 0 16G 0 dm CBS_POOL 253 12 0 43 3T 0 dm SPECIAL_METADATA_STORE_4bd8d3ce75b1465082619c1f3fc15fb2 253 13 0 1G 0 dm...

Page 48: ...TORE_cd6d34c281054ef690a89030bef839ec 253 14 0 43 3T 0 dm nvme4n1 259 8 0 740 4G 0 disk sed4 253 4 0 740 4G 0 crypt md125 9 125 0 4 3T 0 raid5 md124 9 124 0 4 3T 0 raid0 vdo_data 253 9 0 4 3T 0 dm vdo 253 10 0 43 4T 0 vdo CBS_POOL_data 253 8 0 43 3T 0 dm CBS_POOL 253 12 0 43 3T 0 dm SPECIAL_METADATA_STORE_4bd8d3ce75b1465082619c1f3fc15fb2 253 13 0 1G 0 dm SPECIAL_TEMPLATE_STORE_cd6d34c281054ef690a8...

Page 49: ... dm SPECIAL_METADATA_STORE_4bd8d3ce75b1465082619c1f3fc15fb2 253 13 0 1G 0 dm SPECIAL_TEMPLATE_STORE_cd6d34c281054ef690a89030bef839ec 253 14 0 43 3T 0 dm CBS_POOL_meta 253 11 0 16G 0 dm CBS_POOL 253 12 0 43 3T 0 dm SPECIAL_METADATA_STORE_4bd8d3ce75b1465082619c1f3fc15fb2 253 13 0 1G 0 dm SPECIAL_TEMPLATE_STORE_cd6d34c281054ef690a89030bef839ec 253 14 0 43 3T 0 dm To check the status of the RAID array...

Page 50: ...3 0 0 active sync dev dm 0 1 253 1 1 active sync dev dm 1 2 253 2 2 active sync dev dm 2 3 253 3 3 active sync dev dm 3 4 253 4 4 active sync dev dm 4 5 253 5 5 active sync dev dm 5 6 253 6 6 active sync dev dm 6 7 253 7 spare dev dm 7 To check the SED mappings use the following command lls s ll d de ev v m ma ap pp pe er r s se ed d Following is an example output lrwxrwxrwx 1 root root 7 Aug 20 1...

Page 51: ...795 00 GB 795 00 GB 512 B 0 B GPNA9B3Q dev nvme7n1 S3HCNX0JC02195 1 795 00 GB 795 00 GB 512 B 0 B GPNA9B3Q To display the current RAID configuration use the following command u us sr r s sh ha ar re e t ta ac cp p lle en no ov vo o t ta ac cp p n nv vm me e c co on nt tr ro oll p py y d diis sp plla ay y Following is an example output discovering NVMe disks this operation will take a few seconds C...

Page 52: ...ware GPNA9B3Q Capacity 800166076416 bytes 800 166076416 GB Drive Temp 40 C Drive Health Ok Total namespaces 1 Namespace id s 1 Namespace 1 size 794996768768 bytes 794 996768768 GB Namespace 1 is attached to controller id s 33 NVMe control device dev nvme4 Slot 4 Manufacturer SAMSUNG MZWLL800HEHP 00003 Serial number S3HCNX0JC02189 Firmware GPNA9B3Q Capacity 800166076416 bytes 800 166076416 GB Drive...

Page 53: ...768 bytes 794 996768768 GB Namespace 1 is attached to controller id s 33 NVMe control device dev nvme7 Slot 1 Manufacturer SAMSUNG MZWLL800HEHP 00003 Serial number S3HCNX0JC02195 Firmware GPNA9B3Q Capacity 800166076416 bytes 800 166076416 GB Drive Temp 39 C Drive Health Ok Total namespaces 1 Namespace id s 1 Namespace 1 size 794996768768 bytes 794 996768768 GB Namespace 1 is attached to controller...

Page 54: ...KB chunk md126 active raid1 sda 1 sdb 0 118778880 blocks super external md127 0 2 2 UU md127 inactive sda 1 S sdb 0 S 6306 blocks super external imsm unused devices none To view detailed information about the status of the RAID array use the following command m md da ad dm m d de et ta aiill d de ev v m md d m md d5 5 Following is an example output dev md md5 Version 1 2 Creation Time Mon Aug 20 1...

Page 55: ...20 11 03 dev mapper sed2 dm 2 lrwxrwxrwx 1 root root 7 Aug 20 11 03 dev mapper sed3 dm 3 lrwxrwxrwx 1 root root 7 Aug 20 11 03 dev mapper sed4 dm 4 lrwxrwxrwx 1 root root 7 Aug 20 11 03 dev mapper sed5 dm 5 lrwxrwxrwx 1 root root 7 Aug 20 11 03 dev mapper sed6 dm 6 lrwxrwxrwx 1 root root 7 Aug 20 11 03 dev mapper sed7 dm 7 In this example dm 3 is mapped to sed3 Step 2 Determine the NVME namespace ...

Page 56: ...me1 Slot 7 Manufacturer SAMSUNG MZWLL800HEHP 00003 Serial number S3HCNX0JC02193 Firmware GPNA9B3Q Capacity 800166076416 bytes 800 166076416 GB Drive Temp 41 C Drive Health Ok Total namespaces 1 Namespace id s 1 Namespace 1 size 794996768768 bytes 794 996768768 GB Namespace 1 is attached to controller id s 33 NVMe control device dev nvme2 Slot 6 Manufacturer SAMSUNG MZWLL800HEHP 00003 Serial number...

Page 57: ... Namespace 1 is attached to controller id s 33 NVMe control device dev nvme6 Slot 1 Manufacturer SAMSUNG MZWLL800HEHP 00003 Serial number S3HCNX0JC02188 Firmware GPNA9B3Q Capacity 800166076416 bytes 800 166076416 GB Drive Temp 39 C Drive Health Ok Total namespaces 1 Namespace id s 1 Namespace 1 size 794996768768 bytes 794 996768768 GB Namespace 1 is attached to controller id s 33 NVMe control devi...

Page 58: ...sh 26 4min speed 202487K sec bitmap 0 6 pages 0KB 65536KB chunk md126 active raid1 sda 1 sdb 0 118778880 blocks super external md127 0 2 2 UU md127 inactive sda 1 S sdb 0 S 6306 blocks super external imsm unused devices none To view detailed information about the status of the RAID array use the following command m md da ad dm m d de et ta aiill d de ev v m md d m md d5 5 Following is an example o...

Page 59: ... 7 3 spare rebuilding dev dm 7 4 253 4 4 active sync dev dm 4 5 253 5 5 active sync dev dm 5 6 253 6 6 active sync dev dm 6 Step 5 Close the SED c cr ry yp pt ts se et tu up p c cllo os se e s se ed d3 3 The drive is now removed from the RAID array The drive can now be physically removed from storage block slot 5 Follow the steps in Removing a hot swap drive on page 52 Chapter 5 Part replacement a...

Page 60: ...thout either a drive or a filler panel installed in each bay Before you make changes to the drives back up all important data stored on them If one or more NVMe solid state drives need to be removed disable them in the OS before removing them Procedure performed by customer or field service To remove a hot swap drive complete the following steps Step 1 To open the drive tray handle press the tab F...

Page 61: ...e0eca08057b00 Number of canisters 2 This is the bottom primary canister and has the controller id 33 The top secondary canister has the controller id 34 This chassis has the following controller ids 33 34 NVMe devices 7 NVMe control device dev nvme0 Slot 8 Manufacturer SAMSUNG MZWLL800HEHP 00003 Serial number S3HCNX0JC02194 Firmware GPNA9B3Q Capacity 800166076416 bytes 800 166076416 GB Drive Temp ...

Page 62: ...96768768 GB Namespace 1 is attached to controller id s 33 NVMe control device dev nvme4 Slot 4 Manufacturer SAMSUNG MZWLL800HEHP 00003 Serial number S3HCNX0JC02189 Firmware GPNA9B3Q Capacity 800166076416 bytes 800 166076416 GB Drive Temp 40 C Drive Health Ok Total namespaces 1 Namespace id s 1 Namespace 1 size 794996768768 bytes 794 996768768 GB Namespace 1 is attached to controller id s 33 NVMe c...

Page 63: ...e in slot 5 Step 4 Check that the NVME namespace to verify that nvme3 is deleted lls s ll d de ev v n nv vm me e Following is an example output crw 1 root root 243 0 Aug 20 11 02 dev nvme0 crw 1 root root 243 1 Aug 20 11 02 dev nvme1 crw 1 root root 243 2 Aug 20 11 02 dev nvme2 crw 1 root root 243 4 Aug 20 11 02 dev nvme4 crw 1 root root 243 5 Aug 20 11 02 dev nvme5 crw 1 root root 243 6 Aug 20 11...

Page 64: ...tarting from number 01 Follow this installation order when you install a drive You cannot mix drives of different capacities in one system In this procedure dm 3 and nvme3 are used as examples Replace these examples with the appropriate values for the storage drive you are installing To install a hot swap drive complete the following steps Step 1 To open the drive tray handle press the release tab...

Page 65: ...s if necessary Step 6 Check that the new drives are detected by the storage block Check that the NVME namespace to verify that nvme3 appears lls s ll d de ev v n nv vm me e Following is an example output crw 1 root root 243 0 Aug 20 11 02 dev nvme0 crw 1 root root 243 1 Aug 20 11 02 dev nvme1 crw 1 root root 243 2 Aug 20 11 02 dev nvme2 crw 1 root root 243 3 Aug 20 12 32 dev nvme3 crw 1 root root ...

Page 66: ...ched to controller id s 33 NVMe control device dev nvme1 Slot 7 Manufacturer SAMSUNG MZWLL800HEHP 00003 Serial number S3HCNX0JC02193 Firmware GPNA9B3Q Capacity 800166076416 bytes 800 166076416 GB Drive Temp 42 C Drive Health Ok Total namespaces 1 Namespace id s 1 Namespace 1 size 794996768768 bytes 794 996768768 GB Namespace 1 is attached to controller id s 33 NVMe control device dev nvme2 Slot 6 ...

Page 67: ...68768 GB Namespace 1 is attached to controller id s 33 NVMe control device dev nvme6 Slot 1 Manufacturer SAMSUNG MZWLL800HEHP 00003 Serial number S3HCNX0JC02188 Firmware GPNA9B3Q Capacity 800166076416 bytes 800 166076416 GB Drive Temp 39 C Drive Health Ok Total namespaces 1 Namespace id s 1 Namespace 1 size 794996768768 bytes 794 996768768 GB Namespace 1 is attached to controller id s 33 NVMe cont...

Page 68: ...dm m 3 3 Following is an example output Output mdadm added dev dm 3 Step 9 Check the status of the RAID array c ca at t p pr ro oc c m md ds st ta at t Following is an example output Personalities raid1 raid6 raid5 raid4 raid0 md124 active raid0 md125 0 4657247232 blocks super 1 2 512k chunks md125 active raid5 dm 3 8 S dm 7 7 dm 6 6 dm 5 5 dm 4 4 dm 2 2 dm 1 1 dm 0 0 4657379328 blocks super 1 2 l...

Page 69: ...7 26 2018 State clean Active Devices 7 Working Devices 8 Failed Devices 0 Spare Devices 1 Layout left symmetric Chunk Size 16K Consistency Policy bitmap Name any md5 UUID 5f7b873c 16d6d418 7b5f6fde 247566a7 Events 749 Number Major Minor RaidDevice State 0 253 0 0 active sync dev dm 0 1 253 1 1 active sync dev dm 1 2 253 2 2 active sync dev dm 2 7 253 7 3 active sync dev dm 7 4 253 4 4 active sync ...

Page 70: ...ng on page 21 S035 CAUTION Never remove the cover on a power supply or any part that has this label attached Hazardous voltage current and energy levels are present inside any component that has this label attached There are no serviceable parts inside these components If you suspect a problem with one of these parts contact a service technician S002 CAUTION The power control button on the device ...

Page 71: ...ce of fire water or structural damage Disconnect the attached power cords telecommunications systems networks and modems before you open the device covers unless instructed otherwise in the installation and configuration procedures Connect and disconnect cables as described in the following table when installing moving or opening covers on this product or attached devices To Connect To Disconnect ...

Page 72: ...to ensure that the power supply to the storage is not interrupted Do not disconnect the power cord from the second replaced power supply until the power output LED for the first replaced power supply is lit To remove a hot swap power supply complete the following steps Step 1 Disconnect the power cord from the hot swap power supply Step 2 Open the handle Figure 22 Hot swap power supply removal 1 2...

Page 73: ... of the hot swap power supply is now complete After removing the hot swap drive Install a new power supply unit See Install a hot swap power supply on page 66 If you are instructed to return the component or optional device follow all packaging instructions and use any packaging materials for shipping that are supplied to you Chapter 5 Part replacement and maintenance procedures 65 ...

Page 74: ...tached Hazardous voltage current and energy levels are present inside any component that has this label attached There are no serviceable parts inside these components If you suspect a problem with one of these parts contact a service technician S002 CAUTION The power control button on the device and the power switch on the power supply do not turn off the electrical current that is supplied to th...

Page 75: ...he device covers unless instructed otherwise in the installation and configuration procedures Connect and disconnect cables as described in the following table when installing moving or opening covers on this product or attached devices To Connect To Disconnect 1 Turn everything OFF 2 First attach all cables to devices 3 Attach signal cables to connectors 4 Attach power cords to outlet 5 Turn devi...

Page 76: ...ure that the handle is in the open position Step 2 Press the release tab down and slide the new hot swap power supply into the bay at the same time until the release latch clicks into place Figure 24 Hot swap power supply installation 1 2 68 Lenovo ThinkAgile CP Hardware Part Replacement and Component Maintenance Procedures ...

Page 77: ...er installing the power supply Connect one end of the power cord to the new power supply connector Then connect the other end of the power cord into a properly grounded electrical outlet Ensure that the power supply LED is lit indicating that the power supply is operating properly Chapter 5 Part replacement and maintenance procedures 69 ...

Page 78: ...the storage controller to be removed You can find the serial number on the Hardware page of the Web Portal Step 2 If the storage controller is running and is active perform a Storage HA event by following the procedure in Trigger manual storage HA on page 34 Step 3 Shut down the storage controller by following the procedure in Shutting off a storage controller on page 34 The Customer or field serv...

Page 79: ...all a new storage controller See Install a hot swap storage controller on page 71 If you are instructed to return the component or optional device follow all packaging instructions and use any packaging materials for shipping that are supplied to you Install a hot swap storage controller This procedure explains how to add a storage controller to the ThinkAgile CP configuration assuming a storage c...

Page 80: ...72 Lenovo ThinkAgile CP Hardware Part Replacement and Component Maintenance Procedures ...

Page 81: ...er rv viic ce e t ta ac cp p n ne et tw wo or rk k c co on nt tr ro olllle er r r re es st ta ar rt t Step 6 In the Cloud Controller dashboard select Hardware from the left menu Step 7 On the node that you want to register click Register The Register Node page displays Step 8 In the Storage Block Name field enter a unique name for the storage block Step 9 In the Administrator Password field enter ...

Page 82: ...ool and navigate to the tool s root directory thinkagile_cpsb_vpd_tool Step 4 Execute the following command to bring up the parameters for the programmable fields t th hiin nk ka ag giille e_ _c cp ps sb b_ _v vp pd d_ _t to oo oll s sh h h he ellp p Step 5 Execute the following command to begin the reprogramming process for specified FRU fields t th hiin nk ka ag giille e_ _c cp ps sb b_ _v vp pd...

Page 83: ...ng Support Mode Performed By Lenovo Support To access the storage controller using Support Mode follow these steps Step 1 Have the customer or administrator access the Cloud Controller and enable Support Mode see Chapter 4 Managing Support Mode on page 23 Step 2 In the Cloud Controller navigate to the Organizational Viewer topic and select the customer organization A temporary port and password ar...

Page 84: ...p port c clld dt tx x_ _s su up pp po or rt t llo oc ca allh ho os st t Figure 29 Entering the proxy server port Enter yes at the prompt The password is located next to the port number in Cloud Controller Figure 30 Entering the proxy server password 76 Lenovo ThinkAgile CP Hardware Part Replacement and Component Maintenance Procedures ...

Page 85: ...the VPD utility to the storage controller To transfer the VPD utility to the storage controller follow these steps Step 1 In the CLI SSH into one of the storage controllers by entering s ss sh h I I s ss sh h c clld dt t tab to get support controller ID c clld dt tx x_ _s su up pp po or rt t Storage IP Note Use one of the storage controller IP addresses from Obtain storage controller IP addresses ...

Page 86: ...sengage all latches cable clips release tabs or locks on cable connectors before proceeding Failing to release these items before removing the cables damages the cable connectors on the system board Any damage to the cable connectors may require replacing the system board Procedure performed by Solution administrator customer or field service ThinkAgile Advantage Support To remove the enclosure co...

Page 87: ...losure Keep the M5 screws for installing the new enclosure Figure 32 Screws removal Step 4 Slide the storage enclosure out of the rack along the rails and put it in a safe static protective place Figure 33 Enclosure removal from rack Chapter 5 Part replacement and maintenance procedures 79 ...

Page 88: ...e removal of the storage enclosure is now complete After removing the enclosure Install a new enclosure See Install the enclosure on page 81 If you are instructed to return the component or optional device follow all packaging instructions and use any packaging materials for shipping that are supplied to you 80 Lenovo ThinkAgile CP Hardware Part Replacement and Component Maintenance Procedures ...

Page 89: ...cedure performed by customer or field service To install the enclosure complete the following steps Step 1 Install any of the following components that are previously removed back to the new enclosure Hot swap power supply on page 66 Storage controllers on page 71 To install the ThinkAgile CP storage enclosure on the slide rails do the following Step 2 Remove both of the side covers on the enclosu...

Page 90: ...re is fully inserted Figure 35 Installing the enclosure into the rack Step 5 Secure the enclosure with the thumbscrews and the M5 screws on the front Figure 36 Installing screws on front of enclosure 82 Lenovo ThinkAgile CP Hardware Part Replacement and Component Maintenance Procedures ...

Page 91: ...alling the side cover Step 7 Install the hot swap drives that were previously removed See Installing a hot swap drive on page 56 Step 8 Connect all the cables and start the enclosure The installation of the storage enclosure is now complete After installing the enclosure Connect the cables and start the storage Configure the storage Chapter 5 Part replacement and maintenance procedures 83 ...

Page 92: ...install and secure the canisters or power supply in the storage Step 3 Reconnect external cables and power cords to the storage Attention To avoid component damage connect the power cords last Step 4 Update the storage configuration if necessary a Download and install the latest device drivers https datacentersupport lenovo com products solutions and software thinkagile cp b Update the system firm...

Page 93: ...mpute node by going in the compute node from the Hardware page and clicking View All in the Application Instances section Migrating VMs from a compute node This procedure explains how to migrate VMs running on a compute node and prevent the compute node from hosting new VMs Procedure performed by Solution administrator ThinkAgile Advantage Support optional Execution Web portal only This procedure ...

Page 94: ...es VMs to the proper compute node To move one VM to a specific compute node Step 1 Add a new compute tag to the destination compute node Do not reuse an existing tag The best practice is to either use a random number or something like temp_migrate_host_1 Step 2 Add the same tag to the VM you are migrating Step 3 Wait until the VM is running on the destination compute node You can find the VMs runn...

Page 95: ...om us en warrantylookup Hardware replacement procedures This section provides installation and removal procedures for all serviceable system components Each component replacement procedure references any tasks that need to be performed to gain access to the component being replaced The ThinkAgile CP appliances are based on the ThinkSystem SD530 Compute Node and ThinkSystem D2 Enclosure For hardwar...

Page 96: ...he involved block Enable Maintenance Mode This section covers the procedure to enable maintenance mode for compute blocks Complete the following steps to enable Maintenance Mode for a compute block Step 1 Log into your ThinkAgile CP portal Step 2 From the left menu select Hardware Step 3 Navigate to the Compute Block section Step 4 Click the button next to the desired node and select Turn on maint...

Page 97: ...e constraints and migrate Shut down Force shutdown Figure 39 Maintenance Mode dialog box Step 6 If the system encounters any errors when resolving the selected actions a pop up box appears with information about the errors Note The errors must be resolved to turn on Maintenance Mode Maintenance Mode for the selected compute node is now enabled Chapter 5 Part replacement and maintenance procedures ...

Page 98: ...og into your ThinkAgile CP portal Step 2 From the left menu select Hardware Step 3 Navigate to the Compute Block section Step 4 Click the button next to the desired node and select Turn off maintenance mode Figure 40 Disable Maintenance Mode for a Node Maintenance Mode for the compute node is now disabled 90 Lenovo ThinkAgile CP Hardware Part Replacement and Component Maintenance Procedures ...

Page 99: ...NTION Static Sensitive Device Ground package before opening on page 21 Before you remove a drive ensure that you save the data on your drive especially if it is part of a RAID array before you remove it from the node Procedure performed by customer or field service Attention To ensure that there is adequate system cooling do not operate the solution for more than 2 minutes without either a drive o...

Page 100: ...tall a drive Chapter 3 Read the Installation Guidelines on page 19 ATTENTION Static Sensitive Device Ground package before opening on page 21 Before installing a hot swap drive 1 Remove the drive filler from the empty drive bay Keep the filler panel in a safe place 2 Touch the static protective package that contains the drive to any unpainted metal surface on the solution Then remove the drive fro...

Page 101: ...n Step 2 Align the drive with the guide rails in the bay Step 3 Gently push the drive into the bay until the drive stops Step 4 Rotate the tray handle to the closed locked position until you hear a click Figure 42 Drive installation Step 5 Check the drive status LED to verify that the drive is operating correctly If the yellow drive status LED is lit continuously that drive is faulty and must be r...

Page 102: ...t during an electrical storm Connect all power cords to a properly wired and grounded electrical outlet Connect to properly wired outlets any equipment that will be attached to this product When possible use one hand only to connect or disconnect signal cables Never turn on any equipment when there is evidence of fire water or structural damage Disconnect the attached power cords telecommunication...

Page 103: ...at all connections to dc power are disconnected at the dc power input terminals S035 CAUTION Never remove the cover on a power supply or any part that has this label attached Hazardous voltage current and energy levels are present inside any component that has this label attached There are no serviceable parts inside these components If you suspect a problem with one of these parts contact a servi...

Page 104: ...ower supply out of the bay Figure 43 Hot swap power supply removal The removal of the hot swap power supply is now complete After you remove the power supply Install a new power supply unit See Install a hot swap power supply on page 97 If you are instructed to return the component or optional device follow all packaging instructions and use any packaging materials for shipping that are supplied t...

Page 105: ... attached to this product When possible use one hand only to connect or disconnect signal cables Never turn on any equipment when there is evidence of fire water or structural damage Disconnect the attached power cords telecommunications systems networks and modems before you open the device covers unless instructed otherwise in the installation and configuration procedures Connect and disconnect ...

Page 106: ...nal devices for the solution see http www lenovo com us en serverproven 2 Do not install two power supply units with different wattages Related information is available from the following Read the label on the top cover for maximum wattage output of installed power supply units Only replace the existing units with those having the same wattage as marked on the label Check the rear of the node to e...

Page 107: ...llation Note Connect the power cord to the power supply unit Ensure that the cord is properly connected to the power supply The installation of a hot swap power supply is now complete After installing the hot swap power supply 1 Reconnect any cables that you removed 2 If the node is turned off turn it on and ensure that the power supply is replaced successfully The amber warning LED on node front ...

Page 108: ...enclosure Chapter 3 Read the Installation Guidelines on page 19 ATTENTION Static Sensitive Device Ground package before opening on page 21 To avoid possible danger read and follow the following safety statement S017 CAUTION Hazardous moving fan blades nearby S033 CAUTION Hazardous energy present Voltages with hazardous energy might cause heating when shorted with metal which might result in spatte...

Page 109: ...lways use an electrostatic discharge wrist strap or other grounding system when you work inside the solution with the power on Replace the failed fan and reinstall the fan cover in three minutes 2 Identify the failed fan The following illustration shows locations of fan fault LEDs When the LED is lit it indicates the fan is having operational issues Figure 45 Fan fault LEDs Table 3 Fan fault LEDs ...

Page 110: ...e latches together Step 2 Lift the fan out of the enclosure Figure 46 60x60x56mm fan removal The removal of the fan is now complete After the removal of the fan Install a new fan See Install a fan on page 104 If you are instructed to return the component or optional device follow all packaging instructions and use any packaging materials for shipping that are supplied to you 102 Lenovo ThinkAgile ...

Page 111: ...ath the sheet metal flange Step 2 Disconnect the cable Step 3 Grasp the fan and lift it out of the enclosure Figure 47 80x80x80mm fan removal The removal of the fan is now complete After the removal of the fan Install a new fan See Install a fan on page 104 If you are instructed to return the component or optional device follow all packaging instructions and use any packaging materials for shippin...

Page 112: ...h might result in spattered metal burns or both Before you install a fan remove the fan cover see http thinksystem lenovofiles com help topic 7X21 remove_ the_fan_cover html Attention Static electricity released into internal solution components when the solution is powered on may cause the solution to halt which may result in data loss To avoid this problem always use an electrostatic discharge w...

Page 113: ...allation of the fan is now complete After installing a fan complete the following steps 1 Reinstall the fan cover see http thinksystem lenovofiles com help topic 7X21 install_the_fan_cover html 2 Verify that the system fan is replaced successfully The error LED for the replaced system fan is off The amber warning LED on the node front panel is off 3 If you are instructed to return the component or...

Page 114: ... Ensure that the cable is routed in the proper location and that no wire is stuck in the flange The installation of the fan is now complete After installing a fan complete the following steps 1 Reinstall the fan cover see http thinksystem lenovofiles com help topic 7X21 install_the_fan_cover html 2 Verify that the system fan is replaced successfully The error LED for the replaced system fan is off...

Page 115: ... Read the Installation Guidelines on page 19 Power off the compute node on page 119 ATTENTION Static Sensitive Device Ground package before opening on page 21 Before you remove the EIOM 1 Place the node in maintenance mode 2 Power off all compute nodes and peripheral devices 3 Disengage all the compute nodes from the enclosure see http thinksystem lenovofiles com help topic 7X21 remove_a_compute_n...

Page 116: ...u are instructed to return the component or optional device follow all packaging instructions and use any packaging materials for shipping that are supplied to you Install the EIOM Use this information to install the EIOM Chapter 3 Read the Installation Guidelines on page 19 Power off the compute node on page 119 ATTENTION Static Sensitive Device Ground package before opening on page 21 Before you...

Page 117: ...2 If the cable management arm is removed install it see http thinksystem lenovofiles com help topic 7X21 install_the_cable_management_arm html 3 Reconnect the power cords and any cables that you removed 4 Push all compute nodes back into the enclosure see http thinksystem lenovofiles com help topic 7X21 install_a_compute_node_in_the_chassis html 5 Turn on all compute nodes 6 Exit maintenance mode ...

Page 118: ...ed Never hold two or more memory modules together so that they touch Do not stack memory modules directly on top of each other during storage Never touch the gold memory module connector contacts or allow these contacts to touch the outside of the memory module connector housing Handle memory modules with care Never bend twist or drop a memory module Before you remove a DIMM 1 Identify the failed ...

Page 119: ...ectors open and close the clips gently Step 2 Lift the DIMM from its slot Figure 53 DIMM removal The removal of the DIMM is now complete After removal of the DIMM Install a new DIMM See Memory module installation on page 112 If you are instructed to return the component or optional device follow all packaging instructions and use any packaging materials for shipping that are supplied to you Chapte...

Page 120: ... the size and speed of the DIMMs that you install in DIMM connectors 1 and 3 must match each other However they do not have to be the same size and speed as the DIMMs that are installed in DIMM connectors 2 and 4 You can use compatible DIMMs from various manufacturers in the same pair The specifications of a DDR4 DIMM are on a label on the DIMM in the following format gggGBpheRxff PC4 wwwwaa mccd ...

Page 121: ...IMM x64 primary 8 bit ECC module data bus R Registered DIMM RDIMM x64 primary 8 bit ECC module data bus U Unbuffered DIMM UDIMM with no ECC x64 bit primary data bus cc is the reference design file used for this design d is the revision number of the reference design used bb is the JEDEC SPD Revision Encoding and Additions level used on this DIMM The following illustration shows the location of the...

Page 122: ...2 3 10 11 1 8 9 16 If you are installing 3 6 9 or 12 identical DIMMs for the mirroring mode comply with the following installation sequence to achieve the best performance Table 7 DIMM installation sequence mirror mode lockstep mode for 3 6 9 and 12 identical DIMMs Number of processors Installation sequence connectors Processor 1 installed 6 7 8 1 2 3 Processor 1 and 2 installed 6 7 8 14 15 16 1 2...

Page 123: ...s can also be used Never hold two or more memory modules together so that they touch Do not stack memory modules directly on top of each other during storage Never touch the gold memory module connector contacts or allow these contacts to touch the outside of the memory module connector housing Handle memory modules with care never bend twist or drop a memory module Procedure performed by customer...

Page 124: ...M to any unpainted metal surface on the outside of the node Then remove the DIMM from the package Step 3 Turn the DIMM so that the alignment slot align correctly with the alignment tab Step 4 Insert the DIMM into the connector by aligning the edges of the DIMM with the slots at the ends of the DIMM connector Step 5 Firmly press the DIMM straight down into the connector by applying pressure on both...

Page 125: ...help topic 7X21 install_a_compute_ node_in_the_chassis html 4 Check the power LED to make sure it transitions between fast blink and slow blink to indicate the node is ready to be powered on 5 Power on the node 6 Exit maintenance mode 7 Verify that the DIMM memory failure is resolved by reloading the system If successful no POST errors appear during the booting process 8 If you are instructed to r...

Page 126: ...the region the hardware is US or EU Install a compute node This procedure describes how to add a compute node to your ThinkAgile CP configuration Procedure performed by Customer or field service To add a compute node to your ThinkAgile CP configuration perform the following steps Step 1 Physically install the compute node in the compute enclosure and power it on Step 2 Launch the Cloud Controller ...

Page 127: ...source while Cloud Controller is allowed to respond to remote power on requests To completely power off the compute node power status LED off you must disconnect all power cables To power off the compute node that is in a standby state power status LED flashes once per second Start an orderly shutdown using the operating system if supported by your operating system or Press the power button to sta...

Page 128: ...dures html Step 6 Insert the compute node back into the D2 enclosure Step 7 Wait 10 minutes and verify that the compute node is visible again in the web portal Replace the compute enclosure This procedure will explain how to replace a compute enclosure from the system assuming a compute node has been removed before Procedure performed by Solution administrator ThinkAgile Advantage Support Step 1 R...

Page 129: ... via Support Mode or if at the data center with a method provided by the manufacturer The username is admin and the password is the one you set during the installation Step 7 Execute the following command s su ud do o s sh hu ut td do ow wn n h h n no ow w The interconnect switch can now be unplugged safely Make the secondary interconnect switch the primary interconnect Procedure for making the se...

Page 130: ...d by the manufacturer The username is admin and the password is the one you set during installation Step 2 Optional If the primary interconnect is not shut down run the following commands on the primary interconnect to disable the DHCP service s su ud do o s se er rv viic ce e iis sc c d dh hc cp p s se er rv ve er r s st to op p s su ud do o s se er rv viic ce e iis sc c d dh hc cp p s se er rv v...

Page 131: ...ork cable from the former primary interconnect and connect it to the current primary former secondary interconnect Figure 57 Recabling management switch from primary to secondary interconnect Step 6 Start the DHCP server in the new primary interconnect with the following command s su ud do o s se er rv viic ce e iis sc c d dh hc cp p s se er rv ve er r s st ta ar rt t Chapter 5 Part replacement an...

Page 132: ...VLAN_IP_PREFIX DNS 10 0 64 10 SWITCH_HA DS V3 SS V3 SWITCH_HA DS V3 Step 2 Edit etc dhcp vlan mgmt conf on the primary interconnect switch This file is used to specify the hardware management network setting subnet 10 103 31 0 netmask 255 255 255 0 option domain name servers 10 0 64 10 option routers 10 103 31 1 default lease time 43200 max lease time 43200 pool range 10 103 31 2 10 103 31 253 Ste...

Page 133: ...rconnect switch s su ud do o s se er rv viic ce e iis sc c d dh hc cp p s se er rv ve er r s st to op p s su ud do o s se er rv viic ce e iis sc c d dh hc cp p s se er rv ve er r s st ta ar rt t Chapter 5 Part replacement and maintenance procedures 125 ...

Page 134: ...ation about the terms of the warranty visit https datacentersupport lenovo com us en warrantylookup Replace the interconnect switch Procedures for replacing the Lenovo ThinkAgile CP interconnect To replace an interconnect switch first remove the unit from the rack and then install the new interconnect switch as described in the following sections 126 Lenovo ThinkAgile CP Hardware Part Replacement ...

Page 135: ...ews 1 and clip nuts or cage nuts to release the switch and the rail from the rack Step 3 Remove the switch from the rail Step 4 Remove the two screws 2 used to secure each of the rear post brackets at the midpoint on the sides of the rails Step 5 Remove the four screws 3 on the front and rear post brackets Figure 58 Removing the interconnect from the rack Replace the interconnect switch by followi...

Page 136: ...he rack than the primary interconnect The secondary interconnect is labeled with a rack location label that is lower than the rack location label of the primary interconnect Step 1 Unpack the switch and check the contents Component Description 7Y67 switch Rack mounting kit 2 front post brackets 2 rear post brackets 20 screws 2 ear locking screws Console cable RJ 45 to DB 9 CAUTION The switch inclu...

Page 137: ... rails at the midpoint on the sides of the interconnect switch c Use the screws and cage nuts supplied with the rack to secure the switch in the rack Note Make sure that you attach the cage nuts to the rack before installing the interconnect switch Step 3 Adjust the rear post rail flange and then lock the position of the rear post rail flange using the included position locking screws Note You can...

Page 138: ... switch rear panel Then connect the other end of the wire to the rack ground CAUTION The earth connection must not be removed unless all supply connections have been disconnected Step 5 Connect the power a Install one or two AC power modules in the switch The switch supports up to two PSUs that must have the same matching airflow direction as the installed fan tray b Connect an external AC power s...

Page 139: ...sted pair cable b Connect DAC cables to the SFP QSFP slots Or first install SFP QSFP transceivers and then connect fiber optic cabling to the transceiver ports The following transceivers are supported 40G QSFP SR4 Transceiver 90Y3505 10G BASE T RJ45 SFP Transceiver SBB7A02090 10G SFP SR Transceiver 46C3446 Note As connections are made check the port status LEDs to be sure the links are valid Chapt...

Page 140: ...located below SFP ports 7 12 on left side of the front panel Pull the label out to view the product information The installation of the interconnect switch is now complete 132 Lenovo ThinkAgile CP Hardware Part Replacement and Component Maintenance Procedures ...

Page 141: ...to populate the entries based on settings gathered above see Installation documents b Replace etc tacp controller_uuid with the value from the database c Update usr share tacp datastore sqlite using sqlite3 commands with DHCP_RANGE_ START and DHCP_RANGE_END representing values from the database INSERT INTO property name value VALUES DHCP_RANGE_START DHCP_RANGE_START INSERT INTO property name value...

Page 142: ...FP Direct Attach Cable DAC Compute block port C M using a RJ45 patch cable Upper storage block port S U M using a RJ45 patch cable Lower storage block port S L M using a RJ45 patch cable Figure 59 Hardware management network connectivity in a single interconnect configuration Note If not using the Lenovo ThinkSystem NE0152T RackSwitch as the management switch you may require different cables for t...

Page 143: ...lows Front compute node location Back network port mapping Network interconnect port Top left Compute node 3 port 1 C 3 1 Interconnect port 5 Compute node 3 port 2 C 3 2 Interconnect port 6 Top right Compute node 4 port 1 C 4 1 Interconnect port 7 Compute node 4 port 2 C 4 2 Interconnect port 8 Bottom left Compute node 1 port 1 C 1 1 Interconnect port 1 Compute node 1 port 2 C 1 2 Interconnect por...

Page 144: ...Figure 60 Single interconnect configuration compute node and network interconnect connections 136 Lenovo ThinkAgile CP Hardware Part Replacement and Component Maintenance Procedures ...

Page 145: ...mapping Network interconnect port Upper Upper storage controller port 1 S U 1 Interconnect port 17 Upper storage controller port 2 S U 2 Interconnect port 20 Upper storage controller port 3 S U 3 Interconnect port 21 Upper storage controller port 4 S U 4 Interconnect port 24 Lower Lower storage controller port 1 S L 1 Interconnect port 25 Lower storage controller port 2 S L 2 Interconnect port 28 ...

Page 146: ...Cable DAC Compute block port C M using a RJ45 patch cable Upper storage block port S U M using a RJ45 patch cable Lower storage block port S L M using a RJ45 patch cable Figure 62 Hardware management network connectivity in a dual interconnect configuration Note If not using the Lenovo ThinkSystem NE0152T RackSwitch as the management switch you may require different cables for the management netwo...

Page 147: ...ck network port mapping Network interconnect port Top left Compute node 3 port 1 C 3 1 Primary interconnect port 3 Compute node 3 port 2 C 3 2 Secondary interconnect port 3 Top right Compute node 4 port 1 C 4 1 Primary interconnect port 4 Compute node 4 port 2 C 4 2 Secondary interconnect port 4 Bottom left Compute node 1 port 1 C 1 1 Primary interconnect port 1 Compute node 1 port 2 C 1 2 Seconda...

Page 148: ...block port mapping is as follows Front storage controller location Back network port mapping Network interconnect port Upper Upper storage controller port 1 S U 1 Primary interconnect port 17 Upper storage controller port 2 S U 2 Primary interconnect port 20 Upper storage controller port 3 S U 3 Secondary interconnect port 17 Upper storage controller port 4 S U 4 Secondary interconnect port 20 Low...

Page 149: ... interconnect configuration Set up the peer link between the interconnects using the QSFP Direct Attach Cables DACs that are provided with the configuration 1 Connect port 49 on the primary interconnect to port 49 on the secondary interconnect 2 Connect port 50 on the primary interconnect to port 50 on the secondary interconnect Figure 65 Dual interconnect configuration inter interconnect link net...

Page 150: ...le Procedure performed by Customer or field service When replacing cables that connect any Baseboard Management Controller BMC from the compute enclosure storage controllers or the primary interconnect dedicated port to the management switch you are required to unplug all hardware management network cables and then plug back into the management switch to initiate a DHCP renewal This operation can ...

Page 151: ...nagement switch is required for this solution If the Lenovo ThinkSystem NE0152T RackSwitch is not used you must provide an out of band management switch with the correct configuration Disregard this procedure if you are not including the NE0152T as the management switch in your solution Removing the management switch optional This section describes how to remove the ThinkSystem NE0152T RackSwitch ...

Page 152: ...ce the NE0152T from a standard rack complete the following steps Step 1 If the power cord retention clip is installed remove it Figure 66 Power cord retention clip removal 144 Lenovo ThinkAgile CP Hardware Part Replacement and Component Maintenance Procedures ...

Page 153: ...it from the rack Step 4 Slide the switch unit out of the rack Step 5 Loosen and remove the M4 screws attaching the mounting bracket on each side of the switch Figure 68 Removing mounting brackets from switch Install the replacement NE0152T unit by completing the steps in Install the management switch optional on page 146 Chapter 5 Part replacement and maintenance procedures 145 ...

Page 154: ...arts are included in the standard mounting kit Item number Description Quantity 1 Mounting brackets 2 2 M4 screws 8 3 M6 screws 4 4 M6 clip nuts 4 5 M6 cage nuts 4 6 M6 locking washers 4 Attention The rack mounting frame may be unable to support the weight of the switch with only the front post mounting brackets 2 post application If the switch has an undesirable amount of sag it is recommended to...

Page 155: ...tem 2 Torque the screws to approximately 2 0 newton meters Nm 0 1 Nm 17 7 inch pounds Figure 69 Attaching mounting brackets to switch Step 3 From the front slide the switch into the rack at the desired height Step 4 Secure the switch unit to the rack posts with M6 screws item 3 in illustration washers item 6 and either clip nuts item 4 or cage nuts item 5 Torque the screws to approximately 5 7 Nm ...

Page 156: ...ord retention clip Note The power cord retention clip is not used when the 1U air duct option is installed Figure 71 Installing power cord retention clip The installation of the management switch is now complete 148 Lenovo ThinkAgile CP Hardware Part Replacement and Component Maintenance Procedures ...

Page 157: ...y interconnect dedicated port to the management switch you are required to unplug all hardware management network cables and then plug back into the management switch to initiate a DHCP renewal This operation can be done live without any specific pre or post steps During this operation the hardware management network the storage HA feature and hardware detection functionality are unavailable Hardw...

Page 158: ...150 Lenovo ThinkAgile CP Hardware Part Replacement and Component Maintenance Procedures ...

Page 159: ...inkAgile CP Guardian edition Guardian Operating System for compute nodes and storage controllers RHEL 7 Network Operating System for Interconnect Switches Pica8 OS At Rest Encryption Compliance KMIP Compliant FIPS 140 2 Common Criteria USGv6 DOD IPv6 STIG Copyright Lenovo 2018 2020 151 ...

Page 160: ...152 Lenovo ThinkAgile CP Hardware Part Replacement and Component Maintenance Procedures ...

Page 161: ......

Page 162: ......