EMC VNX Series, Replacing Manual

Page 1: ...erved Publication Date July 2013 EMC believes the information in this publication is accurate as of its publication date The information is subject to change without notice THE INFORMATION IN THIS PUBLICATION IS PROVIDED AS IS EMC CORPORATION MAKES NO REPRESENTATIONS OR WARRANTIES OF ANY KIND WITH RESPECT TO THE INFORMATION IN THIS PUBLICATION AND SPECIFICALLY DISCLAIMS IMPLIED WARRANTIES OF MERCH...

Page 2: ...mail Notifications 9 Task 3 Saving Resume PROM Configuration Information 9 Task 4 Halting the Secondary Control Station 11 Task 5 Prepare for Replacement 12 Single Blade system 13 Multi Blade system 13 Task 6 Remove Faulted DME 16 Task 7 Install the Replacement DME 18 Transfer Components to the Replacement DME 19 Removing a Power Cooling module 19 Remove the CPU Filler Assembly 20 Removing a CPU m...

Page 3: ...t System Information and Save SP Logs 32 Task 10 Configure the HBA Initiator Records 35 Set Up the Replacement BE 35 Remove the old initiator records 36 Collect the New WWNs 37 Zone the FC switch s 39 Recreate the initiator records 39 Verify the New Connections 42 Configure the Blades 43 Task 11 Test the Functionality of the System 44 Task 12 Installing the Blade Enclosure Front Bezel 46 Task 13 C...

Page 4: ...rocessor log displays an error message similar to the following Enclosure 0 Disk 5 0x90a Can t Assign Cache Dirty 0 0xafb40 0x14362c If you see this error message contact Customer Service immediately Avoiding Electrostatic Discharge ESD damage When replacing or installing FRUs you can inadvertently damage the sensitive electronic circuits in the equipment by simply touching them Electrostatic char...

Page 5: ... installing or storing FRUs Use the following precautions when you remove handle or store FRUs Do not remove a FRU from the cabinet until you have the replacement available Handle a FRU only when wearing a properly attached ESD wristband Attach the clip of the ESD wristband to the ESD bracket or to a bare metal portion of the FRU s enclosure Secure the wristband around your wrist with the metal bu...

Page 6: ...dules Blades and I O modules from the faulted Blade enclosure to the replacement Blade enclosure So that you can understand what is involved the table of Contents lists the high level tasks required for this procedure Take a moment to become familiar with these tasks If you have any questions contact Customer Support before you begin the procedure CAUTION This procedure takes approximately three h...

Page 7: ... on the Dashboard You can right click on any new alert in the Alerts quadrant and select Details to view the associated error message Note Alerts will not automatically clear Delete old alerts by right clicking on the alert and selecting Delete 2 Use the drop down list at the top left of the Dashboard to select the system that contains faulted hardware 3 Select System Hardware Hardware for File to...

Page 8: ...d Blade enclosure using the management module seven segment LED on the rear of each Blade enclosure and the recorded fault information 9 Check the Blade enclosure fault LED Figure 2 shows the LEDs visible for the Blade enclosure from the front of the Blade enclosure AC AC AC AC Blade enclosure fault LED Blade enclosure power LED CNS 001667 Figure 2 Blade enclosure fault LED frontview 10 If a Blade...

Page 9: ...sk to begin the service activity Task 3 Saving Resume PROM Configuration Information Save the Resume PROM configuration information for the faulted Blade enclosure BE You use this information later to reconfigure the replacement enclosure 1 Open the enclosure_resume enclosure_ Blade_enclosure_number xml file located in nas log directory where Blade_enclosure_number is the ID 0 1 2 or 3 of the faul...

Page 10: ... SYSTEM HARDWARE TLA Rev EMC_SERIAL_NUMBER EMC SYSTEM HARDWARE TLA SN EMC_PRODUCT_PART_NUMBER PRODUCT PN EMC_PRODUCT_SERIAL_NUMBER PRODUCT SN ASSEMBLY_NAME ASSEMBLY_NAME Note 1 All of this information except the ASSEMBLY_NAME should also be on the serial number tag located on the rear of the BE enclosure Note 2 The field names listed in Corresponding Resume PROM Field correspond to the value promp...

Page 11: ...ting as the primary CS you may need to failback and then continue to power down the secondary CS This task halts the secondary control station 1 At the rear of the cabinet connect the null modem cable from a serial port on your management console to the secondary Control Station CS 1 2 Open the HyperTerminal or PuTTY session using the following settings Bits per second 19200 Data bits 8 Parity Non...

Page 12: ...Disconnect the CS 1 power cable from the power distribution panel PDP 9 Close the HyperTerminal or PuTTY session with CS 1 10 Reconnect your management console to the serial port on CS 0 and reopen the HyperTerminal or PuTTY session on CS 0 using the settings found in Step 2 11 The secondary CS is halted and powered off Task 5 Prepare for Replacement To prepare a faulted BE for removal from the sy...

Page 13: ...file systems Verify that the customer is prepared for this action nasmcd sbin t2reset pwroff s 2 4 Wait three minutes for the previous command to complete and then verify that the Blade has powered off Note The getreason command can be augmented to provide continuous monitoring of the system reason codes by adding the watch command Use Ctrl C to stop end the monitoring For example watch nasmcd sbi...

Page 14: ...s Whether the Blade is enabled or disabled and whether it is active 2 Go to Step 4 if the system is configured with only one Blade enclosure otherwise continue 3 For a multi Blade enclosure system prepare each Blade in the faulted BE for removal Repeat this step for each Blade in the faulted enclosure before continuing to the next step a If the Blade is a primary Blade and has no standby Blade con...

Page 15: ...ce nas stop This command will take up to five minutes to complete Make sure it is finished before you continue If this command fails reboot the CS and try again 5 Power off each Blade in the faulted BE CAUTION When you shut down a Blade in a single BE system you will lose access to the public networks and file systems Verify that the customer is prepared for this action nasmcd sbin t2reset pwroff ...

Page 16: ...hould be installed into a rack by two people or a data center lift tool To avoid personal injury and or damage to the equipment do not attempt to lift and install the enclosure without a mechanical lift or help from another person 1 Remove four M5 12 7 mm screws two per side to release the chassis from the cabinet Figure 4 Note The screws also secure the latch brackets mounted on the front of the ...

Page 17: ...EMC VNX Procedure Generator EMC CONFIDENTIAL version 4 5 17 of 51 CL4137a Figure 5 Removing Chassis from Cabinet 4 Place the enclosure on a work surface ...

Page 18: ... 6 When the chassis slides to the back of the cabinet the two notches in the rear of the chassis insert into the rear tabs on each rail The tabs secure and support the rear of the chassis If the chassis does not slide all the way into the cabinet you may need to loosen the screws that hold the rear of the rails in place then adjust the rails to allow the tabs to fit into the notches CL4137b Figure...

Page 19: ...ransfer these components You must transfer the power cooling modules and the CPU modules from the faulted chassis to the same locations in the replacement chassis one component at a time Transfer components from the A side first from the rear of the system this is the right side then transfer components from the B side from the rear of the system this is the left side For each Blade starting with ...

Page 20: ... 8 and place it on an antistatic surface CL3972 Figure 8 Removing a Power Cooling module Remove the CPU Filler Assembly If present remove the CPU filler assembly Otherwise skip to the next task To remove the CPU filler assembly 6 Locate and press the orange latches away from each other to fully release the CPU filler assembly Figure 9 AC AC AC AC Figure 9 CPU Filler assembly Location front 7 Using...

Page 21: ...r supply cooling modules must be removed before the CPU module can be removed from the chassis 11 Press the orange tabs labeled with a 2 toward each other to unlock the latches Figure 10 12 Push the latches away from each other to fully release the CPU module Figure 10 13 Pull the CPU module from the chassis Figure 10 Figure 10 Removing a CPU module Installing a CPU module 14 Align the CPU module ...

Page 22: ...ches toward each other to fully seat and lock the CPU filler assembly into place Installing a Power Cooling Module 18 Align the power cooling module with the chassis Figure 12 19 Push the power cooling module into the chassis The power cooling module is fully seated when the yellow line with caution symbols is no longer visible Figure 12 20 Raise the latch to secure it in place Figure 12 You will ...

Page 23: ...and I O modules Removing a Management Module To remove a management module from a Blade enclosure in the system CAUTION Observe ESD procedures handle the Blade components with care You can remove a management module while the system is powered up 22 Use masking tape or similar material to label each cable to correctly reconnect them later 23 Disconnect the Ethernet cables from the module Carefully...

Page 24: ... If the button remains in the module is fully seated If the button springs back gently push the module further into the chassis the push the button again If the button still does not rest flush with its handle remove the module and repeat the installation process 29 Follow the labeling to reconnect and dress the previously removed cables Removing an I O module Any faulted I O module would display ...

Page 25: ...iller module 33 Align the module with the empty slot Figure 16 Install the replacement I O module in the same slot from which the faulted I O module was removed 34 When the I O module appears seated push and release the small button on the handle Figure 16 If the button remains in the module is fully seated If the button springs back gently push the module further into the chassis then push it aga...

Page 26: ...talled is a replacement for a faulted I O module attach the cables to the replacement I O module in the exact same locations that they were attached in the faulted I O module Transfer the Serial Number Tag 36 Remove the serial number tag from the faulted chassis 37 Attach the serial number tag to the replacement chassis Figure 17 ...

Page 27: ...ning of the cables to the rear of the Blade enclosure by following the cable labels Note Do not reconnect the Blade enclosure power cables at this time Task 8 Configure the replacement BE Resume PROM This task sets up the work environment and configures the replacement BE Resume PROM Set up the Work Environment on the Blade To set up the work environment on a Blade 1 Connect the null modem cable f...

Page 28: ... Auto Detect Telnet terminal ID ANSI CAUTION Do not bend pull or stress any other cabinet cables Dress and secure the cables without damaging the cables 3 Reconnect the BE AC power cords carefully pressing the connector latches to restrain these cables after you connect them Configure the BE Resume PROM To configure the Resume PROM of the replacement BE you use the values you collected in Table 2 ...

Page 29: ... Enter EMC System Hardware TLA SN 16 characters FNM00084100038 13 Enter the EMC_SERIAL_NUMBER from Table 2 of the Resume PROM information you gathered in the Saving Resume PROM configuration information procedure then press Enter 14 The system prompts with Enter EMC System Hardware TLA Rev 3 characters A01 Enter Support Contact Info 128 characters 15 Enter the EMC_ASSEMBLY_REVISION from Table 2 of...

Page 30: ...Continue pressing Enter to accept the default values until the system prompts System Types 0 Agnostic 1 Clariion 2 Celerra 3 Clariion AUX 4 Symmetrix 5 Centera 6 E3 Diag Mode Enter System Type 0 6 2 25 Select Celerra and press Enter The system prompts 26 Enter the Enclosure ID and press Enter Table 4 lists the Enclosure ID and the Blades associated with each enclosure Enter Enclosure ID 0 255 0 En...

Page 31: ... session on the Blade and disconnect the service laptop from the Blade management module Task 9 Collect System Information In this task you set up the work environment on the primary Control Station and save a record of the current Blade port to Storage Processor SP port connections It is important that these records are saved in case they need to be reapplied In this task you will set up the work...

Page 32: ... nas_mcd h nasmcd nas sys nas_mcd cfg 6513 ttyS1 S 0 00 _ grep nas_mcd Sample output with no nas_mcd services running 14085 ttyS1 S 0 00 _ grep nas_mcd b If no nas_mcd services are running skip to Collect System Information and Save SP Logs c If any nas_mcd services are running type killall nas_mcd d If the killall command was used recheck that all nas_mcd services are stopped ps axwf grep nas_mcd...

Page 33: ...aut3 rtp lab emc com CLARiiON SP 8 Collect the SP logs a Collect the port list for SPs Save this output in the event of a rollback nasmcd sbin navicli h SPA_IP_Address port list Example Output nasmcd sbin navicli h 128 221 252 200 port list Information about each HBA HBA UID 50 06 01 60 BC E0 08 9F 50 06 01 60 3C E0 08 9F Server Name Celerra_naut3 Server IP Address 10 6 4 125 HBA Model Description...

Page 34: ... connected This command will display all storage groups implemented on the storage array Ensure that you record only the storage group associated with the correct host name and only for the connections stemming from the faulted Blade enclosure Example nasmcd sbin navicli h 10 6 4 126 storagegroup list host Storage Group Name Celerra_naut3 Storage Group UID 3E 86 BB 3D 70 64 DF 11 9C 6F 00 60 16 36...

Page 35: ...Task 10 Configure the HBA Initiator Records The replacement BE contains a new midplane that is assigned different identifiers than were assigned to the midplane in the faulted BE To configure the HBA Initiator records maintaining the connections running from the replacement BE to the storage array or switch Set up the replacement BE Remove the old initiator records Collect the new WWNs Recreate th...

Page 36: ...rt_HBA_UID IMPORTANT The command requires the HBA UID to be input with the necessary colons as shown in the example below Example nasmcd sbin navicli h 10 6 4 126 port removeHBA o hbauid 50 06 01 60 BC E0 08 9F 50 06 01 61 3C E0 08 9F HBA 50 06 01 60 BC E0 08 9F 50 06 01 61 3C E0 08 9F y n y Warning This is an active HBA Do you still want to remove it y n y 5 Repeat the previous step for each Blad...

Page 37: ...filestorage Sample Output Storage Group Name filestorage Storage Group UID 3E 86 BB 3D 70 64 DF 11 9C 6F 00 60 16 36 9C 7D HLU ALU Pairs HLU Number ALU Number 5 35 4 34 1 31 2 32 0 30 3 33 Shareable YES Collect the New WWNs To collect the WWNs assigned to the replacement enclosure 7 Start the PXE Services by typing nasmcd sbin t2pxe s R 8 8 PXE Boot the Blades in the replacement BE Note If this co...

Page 38: ... sbin t2tty c 2 fcp topology Output FCP HBA 0 FC AL ALPA 000001 Node 50060160c4602075 Port 5006016044602075 FCP HBA 1 FC AL ALPA 000001 Node 50060160c4602075 Port 5006016144602075 nasmcd sbin t2tty c 3 fcp topology Output FCP HBA 0 FC AL ALPA 000001 Node 50060160c4602075 Port 5006016044602075 FCP HBA 1 FC AL ALPA 000001 Node 50060160c4602075 Port 5006016144602075 12 Construct the new Blade port WW...

Page 39: ...Ns of these FC optical ports Follow the instructions in the Zoning FC Switches and Manually Configuring System LUNs appendix in the EMC R VNX TM VG2 VG8 Gateway Configuration Phase 1 and 2 Setup Guide P N 300 012 157 found on www Powerlink EMC com Recreate the initiator records To recreate the initiator records 13 Display the Blade port to SP port FCP records for each Blade in the replacement BE R...

Page 40: ...00 SP b00 50060160BCE02EA7 Class 3 FCP ONLINE HBA 1 S_ID 014700 WWN 5006016144600544 QE8 8G FCP scsi 32 HBA 1 D_ID 043900 SP b01 50060160BCE02EA7 Class 3 FCP scsi 48 HBA 1 D_ID 043d00 SP a01 50060160BCE02EA7 Class 3 nasmcd sbin t2tty c 3 fcp show egrep HBA 0 HBA 1 FCP ONLINE HBA 0 S_ID 014300 WWN 5006016844600544 QE8 8G FCP scsi 0 HBA 0 D_ID 043f00 SP a00 50060160BCE02EA7 Class 3 FCP scsi 16 HBA 0...

Page 41: ...er related Initiator settings for a single host MUST BE CONSISTENTfor all paths from the host to the storage system Please verify after reconnect Do you wish to continue y n y 15 Repeat Step 2 for each necessary initiator record When all initiator records have been created go to Step 4 Note For a fabric connected gateway Step 2 must be issued a total of eight times since each Blade port is fabric ...

Page 42: ...torage Group UID 3E 86 BB 3D 70 64 DF 11 9C 6F 00 60 16 36 9C 7D HBA SP Pairs HBA UID SP Name SPPort 50 06 01 60 C4 60 20 75 50 06 01 68 44 60 20 75 SP B 0 50 06 01 60 C4 60 20 75 50 06 01 69 44 60 20 75 SP B 1 50 06 01 60 C4 60 20 75 50 06 01 60 44 60 20 75 SP A 0 50 06 01 60 C4 60 20 75 50 06 01 61 44 60 20 75 SP A 1 HLU ALU Pairs HLU Number ALU Number 0 0 1 1 2 2 3 3 4 4 5 5 16 16 17 17 Shareab...

Page 43: ...smcd sbin t2tty c slot_number camshowconfig Expected output CAM Devices on scsi 0 TID 00 0 d0 1 d1 2 d2 3 d3 4 d4 5 d5 TID 01 0 d6 1 d7 CAM Devices on scsi 16 TID 00 0 d8 1 d9 2 d10 3 d11 4 d12 5 d13 TID 01 0 d14 1 d15 1278457867 ADMIN 6 Command succeeded camshowconfig 24 Stop the PXE Service nasmcd sbin t2pxe e 25 Restart nbsnas services sbin service nbs restart 26 Check that the nd clnt threads ...

Page 44: ...orrect mounts by typing the following commands for each Blade in the system nas bin server_mount server_name Note If the output for one of the Blades shows unmounted that Blade is configured as a standby Task 11 Test the Functionality of the System This task tests the functionality of the system 1 Reboot CS 0 reboot 2 Wait 10 minutes to allow for the NAS service to completely load then at the logi...

Page 45: ... complete Wait until this command has completed before continuing nas bin server_standby server_name restore mover where server_name is the name of the standby Blade functioning as the primary Blade Example Suppose Blade 3 is a standby Blade for Blade 2 and Blade 2 has failed over to Blade 3 The command to restore Blade 2 as the primary Blade is nas bin server_standby server_2 restore mover Sample...

Page 46: ...ere server_name is the name of the primary Blade Use the nas_server list command to get the server name Example In a two Blade system Blade 2 has failed over to Blade 3 its standby The command to restore Blade 2 as the primary Blade is nas bin server_standby server_2 restore mover 10 Verify the Blades have the correct mounts by entering the following commands for each Blade nas bin server_mount se...

Page 47: ...trol Station Checking if file system usage is under limit Pass Control Station Checking if NAS Storage API is installed correctly Pass Control Station Checking if NBS clients are started Pass Control Station Checking if NBS configuration exists Pass Control Station Checking if NBS devices are accessible Pass Control Station Checking if NBS service is started Pass Storage System Checking for unsupp...

Page 48: ...d Failed FRU Blower Mod B Failed 5 Check the cabling for any enclosure by typing nas sbin setup_enclosure checkCable 6 Check the enclosure system errors by typing nas sbin setup_enclosure checkSystem 7 Open Unisphere using the following URL https control_station Where control_station is the hostname or IP address of the CS 8 Log in with a unified global account For example the sysadmin global acco...

Page 49: ... the Recipient Address es field is populated email notifications was enabled Re enable email notifications a Enable email notifications nas bin nas_emailuser modify enabled yes b Verify that email notification works nas bin nas_emailuser info c Test the configuration and verify that the configured Recipient Address es received the test email nas bin nas_emailuser test The array will now call home ...

Page 50: ... Remote Connection Phone Number AUX Array when applicable TLA Serial Number TLA Part Number FLARE Software Version 3 VNX Hardware Upgrade Conversion when applicable VNX Model Number Change From original To final Added Data Mover or Blade when applicable TLA Serial Number TLA Part Number Added or Changed Data Mover Enclosure when applicable TLA Serial Number TLA Part Number Added or Changed Storage...

Page 51: ...abels for the box appropriate to this returning part Check for any Engineering bulletin and with the Customer to determine if it is FA bound IMPORTANT If Engineering has requested the part to be shipped back for an FA ensure the proper ship to information has been entered and Attention to and or Contact Name is provided in the shipping label 22 Securely tape the box and Ship the failed part back t...