NetApp AFF A700, System Documentation

Page 1: ...FAS System Documentation ONTAP Systems NetApp November 23 2021 This PDF was generated from https docs netapp com us en ontap systems index html on November 23 2021 Always check docs netapp com for the...

Page 2: ...ion 473 Install and setup 473 Maintain 485 AFF A700 and FAS9000 System Documentation 591 Install and setup 591 Maintain 609 AFF A700s System Documentation 744 Install and setup 744 Maintain 744 AFF A8...

Page 3: ...l SAN Array systems 1491 Hardware upgrade 1491 NS224 shelves 1492 Install and cable 1492 Maintain 1514 SAS shelves with IOM12 modules 1539 Install and cable 1539 Maintain 1612 Other platform shelf and...

Page 4: ...AFF and FAS System Documentation 1...

Page 5: ...nstallation and setup PDF poster AFF A200 You can use the PDF poster to install and set up your new system The PDF poster provides step by step instructions with live links to additional content AFF A...

Page 6: ...althy node shows false for eligibility and health you must correct the issue before shutting down the impaired node see the NetApp Encryption overview with the CLI Steps 1 Check the status of the impa...

Page 7: ...disk show If the command output list the drive details with Mode Key ID information NSE is configured and you need to verify the NSE configuration If NVE and NSE are not configured it s safe to shut...

Page 8: ...cation key security key manager key show detail Go to advanced privilege mode and enter y when prompted to continue set priv advanced Enter the command to display the OKM backup information security k...

Page 9: ...p wizard security key manager setup node target impaired node name Enter the customer s OKM passphrase at the prompt If the passphrase cannot be provided contact mysupport netapp com Verify that the R...

Page 10: ...nd the Restored column displays anything other than yes you need to complete some additional steps 2 If the Key Manager type displays onboard and the Restored column displays yes manually backup the O...

Page 11: ...impaired node If the Key Manager type displays onboard and the Restored column displays yes you need to complete some additional steps If the Key Manager type displays external and the Restored colum...

Page 12: ...gement backup information security key manager onboard show backup f Copy the contents of the backup information to a separate file or your log file You ll need it in disaster scenarios where you migh...

Page 13: ...e Steps 1 If you are not already grounded properly ground yourself 2 Loosen the hook and loop strap binding the cables to the cable management device and then unplug the system cables and SFPs if need...

Page 14: ...n a flat stable surface 6 Open the cover by sliding in the blue tabs to release the cover and then swing the cover up and open Step 2 Replace the boot media You must locate the boot media in the contr...

Page 15: ...m during this procedure What you ll need You must have a USB flash drive formatted to FAT32 with at least 4GB capacity A copy of the same image version of ONTAP as what the impaired controller was run...

Page 16: ...ot environment variables and bootargs are properly set for your system type and configuration using the printenv bootarg name command and correct any errors using the setenv variable name value comman...

Page 17: ...ters might be necessary for your interface You can enter help ifconfig at the firmware prompt for details Boot the recovery image AFF A200 You must boot the ONTAP image from the USB drive restore the...

Page 18: ...estore OKM NSE and NVE as needed If your system does not have onboard keymanager NSE or NVE configured complete the steps in this section 6 From the LOADER prompt enter the boot_ontap command If you s...

Page 19: ...oard Key Manager is enabled Steps 1 Connect the console cable to the target node 2 Use the boot_ontap command at the LOADER prompt to boot the node 3 Check the console output If the console displays T...

Page 20: ...ver show command 10 Giveback only the CFO aggregates with the storage failover giveback fromnode local only cfo aggregates true command If the command fails because of a failed disk physically dis eng...

Page 21: ...able to the partner node 16 Give back the target node using the storage failover giveback fromnode local command 17 Check the giveback status 3 minutes after it reports complete using the storage fail...

Page 22: ...that are not on their home node and port If any interfaces are listed as false revert those interfaces back to their home port using the net int revert command 7 Move the console cable to the target...

Page 23: ...he console output If the console displays Then The login prompt Go to Step 7 Waiting for giveback a Log into the partner node b Confirm the target node is ready for giveback with the storage failover...

Page 24: ...g other than yes true use the security key manager onboard sync command to re sync the Key Manager type Use the security key manager key query to verify that the Restored column yes true for all authe...

Page 25: ...ealthy node shows false for eligibility and health you must correct the issue before shutting down the impaired node see the Administration overview with the CLI If AutoSupport is enabled suppress aut...

Page 26: ...are not already grounded properly ground yourself 2 Turn off the power supply and disconnect the power cables a Turn off the power switch on the power supply b Open the power cable retainer and then u...

Page 27: ...re the cables were connected Leave the cables in the cable management device so that when you reinstall the cable management device the cables are organized 2 Remove and set aside the cable management...

Page 28: ...ing it up and against the drive holder Be sure to close the cam handle slowly so that it aligns correctly with the front of the drive carrier It click when it is secure 6 Repeat the process for the re...

Page 29: ...instructed to do so 2 Recable the console to the controller module and then reconnect the management port 3 Repeat the preceding steps if there is a second controller to install in the new chassis 4...

Page 30: ...hen you see the message Press Ctrl C for Boot Menu If you miss the prompt and the controller modules boot to ONTAP enter halt and then at the LOADER prompt enter boot_ontap press Ctrl C when prompted...

Page 31: ...controllers must be in Maintenance mode to run the interconnect test 3 At the LOADER prompt access the special drivers specifically designed for system level diagnostics to function properly boot_dia...

Page 32: ...n both controllers before proceeding any further d Enter the following command on both controllers at the LOADER prompt bye e Return the node to normal operation If your system is running ONTAP Then W...

Page 33: ...e Controller module Replace the controller module AFF A200 You must review the prerequisites for the replacement procedure and select the correct one for your version of the ONTAP operating system Wha...

Page 34: ...suppress automatic case creation by invoking an AutoSupport message system node autosupport invoke node type all message MAINT number_of_hours_downh The following AutoSupport message suppresses automa...

Page 35: ...les to the cable management device and then unplug the system cables and SFPs if needed from the controller module keeping track of where the cables were connected Leave the cables in the cable manage...

Page 36: ...Open the cover by sliding in the blue tabs to release the cover and then swing the cover up and open Step 2 Move the boot media You must locate the boot media and follow the directions to remove it fr...

Page 37: ...locking button on the boot media housing Step 3 Move the NVMEM battery To move the NVMEM battery from the old controller module to the new controller module you must perform a specific sequence of ste...

Page 38: ...upport tabs on the side wall hook into the slots on the battery pack and the battery pack latch engages and clicks into the opening on the side wall Step 4 Move the DIMMs To move the DIMMs you must fo...

Page 39: ...e in the open position and then insert the DIMM squarely into the slot The DIMM fits tightly in the slot but should go in easily If not realign the DIMM with the slot and reinsert it Visually inspect...

Page 40: ...st wait until after the update is complete before interrupting the boot process Steps 1 If you are not already grounded properly ground yourself 2 If you have not already done so replace the cover on...

Page 41: ...into the chassis to avoid damaging the connectors The controller begins to boot as soon as it is seated in the chassis b If you have not already done so reinstall the cable management device c Bind th...

Page 42: ...n boot to Maintenance mode e From the boot menu select the option for Maintenance mode During the boot process you might see the following prompts A prompt warning of a system ID mismatch and asking t...

Page 43: ...re given in GMT Step 2 Verify and set the HA state of the controller module You must verify the HA state of the controller module and if necessary update the state to match your system configuration S...

Page 44: ...sldiag device show dev mb The controller module devices and ports displayed can be any one or more of the following bootmedia is the system booting device cna is a Converged Network Adapter or interf...

Page 45: ...sts that you want to run sldiag device modify dev dev_name selection only selection only disables all other tests that you do not want to run for the device d Run the selected tests sldiag device run...

Page 46: ...ant to run for the device d Verify that the tests were modified sldiag device show e Repeat these substeps for each device that you want to run concurrently f Run diagnostics on all of the devices sld...

Page 47: ...of the considerations identified for running system level diagnostics that cables are securely connected and that hardware components are properly installed in the storage system d Reconnect the powe...

Page 48: ...1 If the replacement node is in Maintenance mode showing the prompt exit Maintenance mode and go to the LOADER prompt halt 2 From the LOADER prompt on the replacement node boot the node entering y if...

Page 49: ...e giveback is vetoed you can consider overriding the vetoes Find the High Availability Configuration Guide for your version of ONTAP 9 b After the giveback has been completed confirm that the HA pair...

Page 50: ...ID which is displayed as part of the disk owner column The following example shows the old system ID of 118073209 disk show a Local System ID 118065481 DISK OWNER POOL SERIAL NUMBER HOME disk_name sy...

Page 51: ...es license clean up unused Step 2 Restore Storage and Volume Encryption functionality After replacing the controller module or NVRAM module for a storage system that you previously configured to use S...

Page 52: ...rly if not you must contact technical support You must replace the failed component with a replacement FRU component you received from your provider Step 1 Shut down the impaired controller To shut do...

Page 53: ...ide the controller you must first remove the controller module from the system and then remove the cover on the controller module 1 If you are not already grounded properly ground yourself 2 Loosen th...

Page 54: ...a flat stable surface 6 Open the cover by sliding in the blue tabs to release the cover and then swing the cover up and open Step 3 Replace the DIMMs To replace the DIMMs locate them inside the contro...

Page 55: ...Look for the following icon 3 If the NVMEM LED is not flashing there is no content in the NVMEM you can skip the following steps and proceed to the next task in this procedure 4 If the NVMEM LED is fl...

Page 56: ...system DIMMs 9 Remove the replacement DIMM from the antistatic shipping bag hold the DIMM by the corners and align it to the slot The notch among the pins on the DIMM should line up with the tab in th...

Page 57: ...rm these steps An HA pair The controller module begins to boot as soon as it is fully seated in the chassis Be prepared to interrupt the boot process a With the cam handle in the open position firmly...

Page 58: ...ode e From the boot menu select the option for Maintenance mode Step 5 Run system level diagnostics After installing a new DIMM you should run diagnostics What you ll need Your system must be at the L...

Page 59: ...ilures a Clear the status logs sldiag device clearstatus b Verify that the log was cleared sldiag device status The following default response is displayed SLDIAG No log messages are present c Exit Ma...

Page 60: ...tified for running system level diagnostics that cables are securely connected and that hardware components are properly installed in the storage system d Boot the controller module you are servicing...

Page 61: ...intenance mode halt The node displays the LOADER prompt d Boot the node from the LOADER prompt bye e Return the node to normal operation If your node is in an HA pair perform a give back storage failo...

Page 62: ...t to the Boot menu If you have two controller modules in the chassis fully seat the controller module you are servicing in the chassis The controller module boots up when fully seated If you have one...

Page 63: ...y invoking an AutoSupport message system node autosupport invoke node type all message MAINT number_of_hours_downh The following AutoSupport message suppresses automatic case creation for two hours cl...

Page 64: ...les were connected Leave the cables in the cable management device so that when you reinstall the cable management device the cables are organized 3 Remove and set aside the cable management devices f...

Page 65: ...ion go to the next step If your system is in a stand alone configuration cleanly shut down the controller module and then check the NVRAM LED identified by the NV icon The NVRAM LED blinks while desta...

Page 66: ...sheet metal side wall 9 Slide the battery pack down along the sheet metal side wall until the support tabs on the side wall hook into the slots on the battery pack and the battery pack latch engages...

Page 67: ...the cam handle to the locked position Do not use excessive force when sliding the controller module into the chassis to avoid damaging the connectors The controller begins to boot as soon as it is sea...

Page 68: ...r halt and then at the LOADER prompt enter boot_ontap press Ctrl C when prompted and then boot to Maintenance mode e From the boot menu select the option for Maintenance mode Step 5 Run system level d...

Page 69: ...ponent 5 Proceed based on the result of the preceding step If the system level diagnostics tests Then Were completed without any failures a Clear the status logs sldiag device clearstatus b Verify tha...

Page 70: ...essing Ctrl C when prompted to get to the Boot menu If you have two controller modules in the chassis fully seat the controller module you are servicing in the chassis The controller module boots up w...

Page 71: ...ed properly ground yourself 3 Turn off the power supply and disconnect the power cables a Turn off the power switch on the power supply b Open the power cable retainer and then unplug the power cable...

Page 72: ...rocedure with all versions of ONTAP supported by your system All other components in the system must be functioning properly if not you must contact technical support Step 1 Shut down the impaired con...

Page 73: ...the controller you must first remove the controller module from the system and then remove the cover on the controller module Steps 1 If you are not already grounded properly ground yourself 2 Loosen...

Page 74: ...t stable surface 6 Open the cover by sliding in the blue tabs to release the cover and then swing the cover up and open Step 3 Replace the RTC battery To replace the RTC battery locate it inside the c...

Page 75: ...e replacement battery from the antistatic shipping bag 5 Locate the empty battery holder in the controller module 6 Note the polarity of the RTC battery and then insert it into the holder by tilting t...

Page 76: ...ap d Reconnect the power cables to the power supplies and to the power sources and then turn on the power to start the boot process e Halt the controller at the LOADER prompt 6 Reset the time and date...

Page 77: ...itial system bring up Use this guide if you are familiar with installing NetApp systems Access the Installation and Setup Instructions PDF poster AFF A220 FAS2700 Systems Installation and Setup Instru...

Page 78: ...NetApp Hardware Universe Find the Release Notes for your version of ONTAP 9 You need to provide the following at your site Rack space for the storage system Phillips 2 screwdriver Additional networkin...

Page 79: ...6 112 00196 5m Management network and Ethernet data Storage order dependent Part number X66030A 112 00435 0 5m X66031A 112 00436 1m X66032A 112 00437 2m X66033A 112 00438 3m Storage Micro USB console...

Page 80: ...agement network UTA2 data network and management ports on the controllers are connected to switches The cluster interconnect ports are cabled on both controllers You must have contacted your network a...

Page 81: ...Step Perform on each controller Cable the cluster interconnect ports to each other with the cluster interconnect cable e0a to e0a e0b to e0b 78...

Page 82: ...to your host network An FC host 0c and 0d or 0e and 0f A 10GbE e0c and e0d or e0e and e0f You can connect one port pair as CNA and one port pair as FC or you can connect both port pairs as CNA or bot...

Page 83: ...interconnect switches You must have contacted your network administrator for information about connecting the system to the switches Be sure to check the illustration arrow for the proper cable connec...

Page 84: ...er interconnect cable Use one of the following cable types to cable the UTA2 data ports to your host network An FC host 0c and 0d or 0e and 0f A 10GbE e0c and e0d or e0e and e0f You can connect one po...

Page 85: ...controllers are connected to switches The cluster interconnect ports are cabled on both controllers You must have contacted your network administrator for information about connecting the system to th...

Page 86: ...on each controller Cable the cluster interconnect ports to each other with the cluster interconnect cable e0a to e0a e0b to e0b Use the Cat 6 RJ45 cable to cable the e0c through e0f ports to your hos...

Page 87: ...connected to switches The cluster interconnect ports are cabled to the cluster interconnect switches You must have contacted your network administrator for information about connecting the system to t...

Page 88: ...rform on each controller module Cable e0a and e0b to the cluster interconnect switches with the cluster interconnect cable Use the Cat 6 RJ45 cable to cable the e0c through e0f ports to your host netw...

Page 89: ...ernal storage If you have a SAS tape drive you can use single path cabling If you have no external shelves MP HA cabling to internal drives is optional not shown if the SAS cables are ordered with the...

Page 90: ...ntroller 2 port 0a to IOM A port 1 on the first drive shelf in the stack mini SAS HD to mini SAS HD cables Connect each node to IOM B in the stack Controller 1 port 0a to IOM B port 1 on first drive s...

Page 91: ...iguration using automatic cluster discovery Steps 1 Use the following animation to set one or more drive shelf IDs Setting drive shelf IDs 2 Plug the power cords into the controller power supplies and...

Page 92: ...configuration go to the ONTAP ONTAP System Manager Documentation Resources page for information about configuring additional features in ONTAP Option 2 Completing system setup and configuration if net...

Page 93: ...e shelf IDs Setting drive shelf IDs 3 Plug the power cords into the controller power supplies and then connect them to power sources on different circuits 4 Turn on the power switches to both nodes In...

Page 94: ...t configuring additional features in ONTAP Maintain Boot media Replace the boot media AFF A220 and FAS2700 The boot media stores a primary and secondary set of system boot image files that the system...

Page 95: ...invoking an AutoSupport message system node autosupport invoke node type all message MAINT number_of_hours_downh The following AutoSupport message suppresses automatic case creation for two hours clu...

Page 96: ...This command is not supported when onboard key management is enabled you need to complete some other additional steps 2 If the Restored column displayed anything other than yes or if any key manager...

Page 97: ...security key manager query If the Restored column displays yes and all key managers display available it s safe to shut down the impaired node If the Restored column displays anything other than yes...

Page 98: ...in your log file This info will be needed in disaster scenarios where OKM might need to be manually recovered Copy the contents of the backup information to a separate file or your log You ll need it...

Page 99: ...to a separate file or your log file You ll need it in disaster scenarios where you might need to manually recover OKM d Return to admin mode set priv admin e Shut down the impaired node 3 If the Key...

Page 100: ...f the Key Manager type displays onboard and the Restored column displays yes manually backup the OKM information a Go to advanced privilege mode and enter y when prompted to continue set priv advanced...

Page 101: ...and FAS2700 Option 1 Most configurations After completing the NVE or NSE tasks you need to complete the shutdown of the impaired node Steps 1 If the impaired node isn t at the LOADER prompt If the im...

Page 102: ...tic case creation for two hours cluster1 system node autosupport invoke node type all message MAINT 2h 2 Disable automatic giveback from the console of the healthy node storage failover modify node lo...

Page 103: ...l the cable management device the cables are organized 3 Remove and set aside the cable management devices from the left and right sides of the controller module 4 Squeeze the latch on the cam handle...

Page 104: ...ate the boot media in the controller and follow the directions to replace it Steps 1 If you are not already grounded properly ground yourself 2 Locate the boot media using the following illustration o...

Page 105: ...g 7 Close the controller module cover Step 3 Transfer the boot image to the boot media You can install the system image to the replacement boot media using a USB flash drive with the image installed o...

Page 106: ...pressing Ctrl C when you see Starting AUTOBOOT press Ctrl C to abort If you miss this message press Ctrl C select the option to boot to Maintenance mode and then halt the node to boot to LOADER 6 For...

Page 107: ...ootarg storageencryption support value bootarg keymanager support value kmip init interface value kmip init ipaddr value kmip init netmask value kmip init gateway value c If Onboard Key Manager is ena...

Page 108: ...update press y 4 Ensure that the environmental variables are set as expected a Take the node to the LOADER prompt b Check the environment variable settings with the printenv command c If an environmen...

Page 109: ...NVE are enabled along with Onboard Key Manager you must restore settings you captured at the beginning of this procedure If NSE or NVE are enabled and Onboard Key Manager is enabled go to Option 1 Re...

Page 110: ...B4jc4A7cvWEFY6lLG6hc6tbKLAHZuvfQ4rIbYAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA H4nPQM0nrDRYRa9...

Page 111: ...board sync a Run the security key manager onboard sync command and then enter the passphrase when prompted b Enter the security key manager key query command to see a detailed view of all keys stored...

Page 112: ...synchronize If the command fails because of an NDMP SnapMirror or SnapVault process disable the process See the appropriate Documentation Center for more information 5 Wait 3 minutes and check the fa...

Page 113: ...Restored column yes for all authentication keys 12 Connect the console cable to the partner node 13 Give back the node using the storage failover giveback fromnode local command 14 Restore automatic...

Page 114: ...key management servers If the Restored column yes true you are done and can proceed to complete the replacement process If the Key Manager type external and the Restored column anything other than ye...

Page 115: ...t in quorum or a healthy node shows false for eligibility and health you must correct the issue before shutting down the impaired node ONTAP 9 System Administration Reference You might want to erase t...

Page 116: ...more than two nodes it must be in quorum If the cluster is not in quorum or a healthy node shows false for eligibility and health you must correct the issue before shutting down the impaired node see...

Page 117: ...1 If you are not already grounded properly ground yourself 2 Loosen the hook and loop strap binding the cables to the cable management device and then unplug the system cables and SFPs if needed from...

Page 118: ...sliding in the blue tabs to release the cover and then swing the cover up and open Step 3 Replace a caching module To replace a caching module referred to as the M 2 PCIe card on the label on your con...

Page 119: ...ground yourself 2 Locate the caching module at the rear of the controller module and remove it a Press the release tab b Remove the heatsink 3 Gently pull the caching module straight out of the housi...

Page 120: ...lace the cover on the controller module 3 Align the end of the controller module with the opening in the chassis and then gently push the controller module halfway into the system Do not completely in...

Page 121: ...into the chassis to avoid damaging the connectors The controller begins to boot as soon as it is seated in the chassis b If you have not already done so reinstall the cable management device c Bind th...

Page 122: ...er boot_ontap press Ctrl C when prompted and then boot to Maintenance mode e From the boot menu select the option for Maintenance mode Step 5 Run system level diagnostics After installing a new cachin...

Page 123: ...y failures a Clear the status logs sldiag device clearstatus b Verify that the log was cleared sldiag device status The following default response is displayed SLDIAG No log messages are present c Exi...

Page 124: ...mpted to get to the Boot menu If you have two controller modules in the chassis fully seat the controller module you are servicing in the chassis The controller module boots up when fully seated If yo...

Page 125: ...urviving cluster 5 Verify that the switchback operation has completed metrocluster show The switchback operation is still running when a cluster is in the waiting for switchback state cluster_B metroc...

Page 126: ...o the new chassis and that the chassis is a new component from NetApp This procedure is disruptive For a two node cluster you will have a complete service outage and a partial outage in a multi node c...

Page 127: ...t you might lose any data that was not saved to disk 3 Where applicable halt the second node to avoid a possible quorum error message in an HA pair configuration system node halt node second_node_name...

Page 128: ...en replacing a chassis involves turning off disconnecting and removing the power supply from the old chassis and installing and connecting it on the replacement chassis 1 If you are not already ground...

Page 129: ...e or modules from the old chassis 1 Loosen the hook and loop strap binding the cables to the cable management device and then unplug the system cables and SFPs if needed from the controller module kee...

Page 130: ...est of the way into the chassis and then lock the cam handle by pushing it up and against the drive holder Be sure to close the cam handle slowly so that it aligns correctly with the front of the driv...

Page 131: ...he cam handle in the open position firmly push the controller module in until it meets the midplane and is fully seated and then close the cam handle to the locked position Do not use excessive force...

Page 132: ...tion 1 In Maintenance mode from either controller module display the HA state of the local controller module and chassis ha config show The HA state should be the same for all components 2 If the disp...

Page 133: ...erconnect test 3 At the LOADER prompt access the special drivers specifically designed for system level diagnostics to function properly boot_diags During the boot process you can safely respond y to...

Page 134: ...on both controllers at the LOADER prompt bye e Return the node to normal operation If your system is running ONTAP Then With two nodes in the cluster Issue these commands node cluster ha modify confi...

Page 135: ...luster configuration you can perform the MetroCluster switchback operation This returns the configuration to its normal operating state with the sync source storage virtual machines SVMs on the former...

Page 136: ...metrocluster config replication resync status show command 6 Reestablish any SnapMirror or SnapVault configurations Step 4 Return the failed part to NetApp After you replace the part you can return t...

Page 137: ...ortant that you apply the commands in these steps on the correct systems The impaired node is the node that is being replaced The replacement node is the new node that is replacing the impaired node T...

Page 138: ...ode storage If you have a cluster with more than two nodes it must be in quorum If the cluster is not in quorum or a healthy node shows false for eligibility and health you must correct the issue befo...

Page 139: ...ust first remove the old controller module from the chassis 1 If you are not already grounded properly ground yourself 2 Loosen the hook and loop strap binding the cables to the cable management devic...

Page 140: ...e 7 Open the cover by sliding in the blue tabs to release the cover and then swing the cover up and open Step 2 Move the NVMEM battery To move the NVMEM battery from the old controller module to the n...

Page 141: ...n the LED turns off If the LED is on and power is on unwritten data is stored on NVMEM This typically occurs during an uncontrolled shutdown after ONTAP has successfully booted 2 Locate the NVMEM batt...

Page 142: ...ss the blue button on the boot media housing to release the boot media from its housing and then gently pull it straight out of the boot media socket Do not twist or pull the boot media straight up be...

Page 143: ...and placement of system DIMMs depends on the model of your system The following illustration shows the location of system DIMMs 4 Repeat these steps to remove additional DIMMs as needed 5 Verify that...

Page 144: ...r module to the corresponding slot in the new one All other components in the storage system must be functioning properly if not you must contact technical support 1 Locate the caching module at the r...

Page 145: ...you to interrupt the boot process which you can typically do at any time after prompted to do so However if the system updates the system firmware when it boots you must wait until after the update is...

Page 146: ...hook and loop strap d Interrupt the boot process only after determining the correct timing You must look for an Automatic firmware update console message If the update message appears do not press Ct...

Page 147: ...appears do not press Ctrl C to interrupt the boot process until after you see a message confirming that the update is complete Only press Ctrl C after you see the Press Ctrl C for Boot Menu message I...

Page 148: ...e replacement node is not at the LOADER prompt halt the system to the LOADER prompt 2 On the healthy node check the system time show date The date and time are given in GMT 3 At the LOADER prompt chec...

Page 149: ...diagnostics to function properly boot_diags During the boot process you can safely respond y to the prompts until the Maintenance mode prompt appears 3 Display and note the available devices on the c...

Page 150: ...ts that you want to run sldiag device modify dev dev_name selection only selection only disables all other tests that you do not want to run for the device d Run the selected tests sldiag device run d...

Page 151: ...nt to run for the device d Verify that the tests were modified sldiag device show e Repeat these substeps for each device that you want to run concurrently f Run diagnostics on all of the devices sldi...

Page 152: ...stem level diagnostics test Complete system restoration AFF A220 and FAS2700 Step 1 Install licenses for the replacement node in ONTAP You must install new licenses for the replacement node if the imp...

Page 153: ...y You can skip this task on storage systems that do not have Storage or Volume Encryption enabled Step 1 Restore Storage or Volume Encryption functionality by using the appropriate procedure in NetApp...

Page 154: ..._A_1 configured enabled heal roots completed cluster_B controller_B_1 configured enabled waiting for switchback recovery 2 entries were displayed 2 Verify that resynchronization is complete on all SVM...

Page 155: ...odes ECC failure to do so causes a system panic All other components in the system must be functioning properly if not you must contact technical support You must replace the failed component with a r...

Page 156: ...storage failover takeover ofnode impaired_node_name When the impaired node shows Waiting for giveback press Ctrl C and then respond y Steps 1 If the impaired node is part of an HA pair disable automat...

Page 157: ...node show Steps 1 If AutoSupport is enabled suppress automatic case creation by invoking an AutoSupport message system node autosupport invoke node type all message MAINT number_of_hours_downh The fo...

Page 158: ...tall the cable management device the cables are organized 3 Remove and set aside the cable management devices from the left and right sides of the controller module 4 Squeeze the latch on the cam hand...

Page 159: ...MEM LED on the controller module You must perform a clean system shutdown before replacing system components to avoid losing unwritten data in the nonvolatile memory NVMEM The LED is located on the ba...

Page 160: ...cated on the board next to each DIMM slot The LED for the faulty blinks every two seconds 7 Note the orientation of the DIMM in the socket so that you can insert the replacement DIMM in the proper ori...

Page 161: ...firmly on the top edge of the DIMM until the ejector tabs snap into place over the notches at the ends of the DIMM 12 Locate the NVMEM battery plug socket and then squeeze the clip on the face of the...

Page 162: ...idplane and is fully seated and then close the cam handle to the locked position Do not use excessive force when sliding the controller module into the chassis to avoid damaging the connectors The con...

Page 163: ...t_ontap press Ctrl C when prompted and then boot to Maintenance mode e From the boot menu select the option for Maintenance mode Step 5 Run system level diagnostics After installing a new DIMM you sho...

Page 164: ...status logs sldiag device clearstatus b Verify that the log was cleared sldiag device status The following default response is displayed SLDIAG No log messages are present c Exit Maintenance mode hal...

Page 165: ...by pressing Ctrl C when prompted to get to the Boot menu If you have two controller modules in the chassis fully seat the controller module you are servicing in the chassis The controller module boots...

Page 166: ...hback command from any node in the surviving cluster 5 Verify that the switchback operation has completed metrocluster show The switchback operation is still running when a cluster is in the waiting f...

Page 167: ...he impaired node you must determine the status of the node and if necessary take over the node so that the healthy node continues to serve data from the impaired node storage About this task If you ha...

Page 168: ...torage failover takeover ofnode impaired_node_name When the impaired node shows Waiting for giveback press Ctrl C and then respond y For a stand alone system system node halt impaired_node_name 6 If t...

Page 169: ...assword prompt enter system password Take over or halt the impaired node For an HA pair take over the impaired node from the healthy node storage failover takeover ofnode impaired_node_name When the i...

Page 170: ...release the cover and then swing the cover up and open Step 3 Replace the NVMEM battery To replace the NVMEM battery in your system you must remove the failed NVMEM battery from the system and replace...

Page 171: ...cket and then unplug the battery cable from the socket 5 Remove the battery from the controller module and set it aside 6 Remove the replacement battery from its package 7 Loop the battery cable aroun...

Page 172: ...repared to interrupt the boot process a With the cam handle in the open position firmly push the controller module in until it meets the midplane and is fully seated and then close the cam handle to t...

Page 173: ...tap press Ctrl C when prompted and then boot to Maintenance mode e From the boot menu select the option for Maintenance mode Step 5 Run system level diagnostics After installing a new NVMEM battery yo...

Page 174: ...r the status logs sldiag device clearstatus b Verify that the log was cleared sldiag device status The following default response is displayed SLDIAG No log messages are present c Exit Maintenance mod...

Page 175: ...by pressing Ctrl C when prompted to get to the Boot menu If you have two controller modules in the chassis fully seat the controller module you are servicing in the chassis The controller module boots...

Page 176: ...hback command from any node in the surviving cluster 5 Verify that the switchback operation has completed metrocluster show The switchback operation is still running when a cluster is in the waiting f...

Page 177: ...the power supply so you must replace the power supply within two minutes of removal to prevent overheating due to reduced airflow Because the chassis provides a shared cooling configuration for the tw...

Page 178: ...lled one way Do not use excessive force when sliding the power supply into the system You can damage the connector 8 Close the cam handle so that the latch clicks into the locked position and the powe...

Page 179: ...urations To shut down the impaired node you must determine the status of the node and if necessary take over the node so that the healthy node continues to serve data from the impaired node storage Ab...

Page 180: ...r eligibility and health you must correct the issue before shutting down the impaired node see the Administration overview with the CLI If you have a MetroCluster configuration you must have confirmed...

Page 181: ...f you are not already grounded properly ground yourself 2 Loosen the hook and loop strap binding the cables to the cable management device and then unplug the system cables and SFPs if needed from the...

Page 182: ...t stable surface 6 Open the cover by sliding in the blue tabs to release the cover and then swing the cover up and open Step 3 Replace the RTC battery To replace the RTC battery locate it inside the c...

Page 183: ...controller module 6 Note the polarity of the RTC battery and then insert it into the holder by tilting the battery at an angle and pushing down 7 Visually inspect the battery to make sure that it is...

Page 184: ...ller at the LOADER prompt 6 Reset the time and date on the controller a Check the date and time on the healthy node with the show date command b At the LOADER prompt on the target node check the time...

Page 185: ...hback command from any node in the surviving cluster 5 Verify that the switchback operation has completed metrocluster show The switchback operation is still running when a cluster is in the waiting f...

Page 186: ...failed part to NetApp as described in the RMA instructions shipped with the kit Contact technical support at NetApp Support 888 463 8277 North America 00 800 44 638277 Europe or 800 800 80 800 Asia Pa...

Page 187: ...ough initial system bring up Use this guide if you are familiar with installing NetApp systems Access the Installation and Setup Instructions PDF poster English AFF A250 Installation and Setup Instruc...

Page 188: ...bout this system NetApp Hardware Universe Customers with specific power requirements must check HWU for their configuration options Find the Release Notes for your version of ONTAP 9 You need to provi...

Page 189: ...6250 15 112 00346 15m X66250 30 112 00347 30m Micro USB console cable Not applicable Console connection during software setup Power cables Not applicable Powering up the system 5 Review the NetApp ONT...

Page 190: ...e switchless cluster method or by using the cluster interconnect network Option 1 Cable a two node switchless cluster The management Fibre Channel and data or host network ports on the controller modu...

Page 191: ...cluster All ports on the controllers are connected to switches cluster interconnect management Fibre Channel and data or host network switches Contact your network administrator for information about...

Page 192: ...ing Cable configuration dependent options You have configuration dependent optional cabling to the Fibre Channel or iSCSI host networks or direct attached storage This cabling is not exclusive you can...

Page 193: ...le drive shelf 3 To complete setting up your system see Step4 Completing system setup and configuration Option 2 Cable to a 25GbE data or host network 25GbE ports on the controllers are connected to 2...

Page 194: ...setup and configuration Option 3 Cable the controllers to a single drive shelf Cable each controller to the NSM modules on the NS224 drive shelf Be sure to check the illustration arrow for the proper...

Page 195: ...ntroller in the system and then connecting to the management switch Option 1 Complete system setup and configuration if network discovery is enabled If you have network discovery enabled on your lapto...

Page 196: ...the NetApp ONTAP Configuration Guide ONTAP Configuration Guide 6 Verify the health of your system by running Config Advisor 7 After you have completed the initial configuration go to the ONTAP ONTAP S...

Page 197: ...on using PuTTY a terminal server or the equivalent for your environment Check your laptop or console s online help if you do not know how to configure PuTTY b Enter the management IP address when prom...

Page 198: ...node on which you are performing maintenance The healthy node is the HA partner of the impaired node Check onboard encryption keys as needed AFF A250 Prior to shutting down the impaired node and check...

Page 199: ...you need to verify the NVE configuration If no volumes are listed check whether NSE is configured 2 Verify whether NSE is configured storage encryption disk show If the command output list the drive...

Page 200: ...pport mysupport netapp com b Verify the Restored column shows yes for all authentication keys security key manager key query c Verify that the Key Manager type shows onboard manually backup the OKM in...

Page 201: ...mysupport netapp com b Verify that the Restored column equals yes for all authentication keys security key manager key query c You can safely shutdown the node 4 If the Key Manager type displays onbo...

Page 202: ...After completing the NVE or NSE tasks you need to complete the shutdown of the impaired node Do not use this procedure if your system is in a two node MetroCluster configuration To shut down the impa...

Page 203: ...place the boot media and transfer the boot image to the boot media AFF A250 To replace the boot media you must remove the impaired controller module install the replacement boot media and transfer the...

Page 204: ...oth hands grasp the controller module sides and gently pull it out of the chassis and set it on a flat stable surface 6 Turn the thumbscrew on the front of the controller module anti clockwise and ope...

Page 205: ...media You need a 1 magnetic Phillips head screw driver to remove the screw that holds the boot media in place Due to the space constraints within the controller module you should also have a magnet to...

Page 206: ...the controller module d Using the 1 magnetic screw driver insert and tighten the screw on the boot media Do not apply force when tightening the screw on the boot media you might crack it Step 3 Transf...

Page 207: ...ervice image from the NetApp Support Site to the USB flash drive a Download the service image to your work space on your laptop b Unzip the service image If you are extracting the contents using Windo...

Page 208: ...3 Close the controller module cover and tighten the thumbscrew 205...

Page 209: ...nto place The controller module begins to boot as soon as it is fully seated in the chassis Be prepared to interrupt the boot process The controller module should be fully inserted and flush with the...

Page 210: ...ge displayed inside the brackets on your screen 3 Restore the var file system If your system has Then A network connection a Press y when prompted to restore the backup configuration b Set the healthy...

Page 211: ...ssion state is changed to Connected for the target iSCSI target type dr_auxiliary address ip address date and time node name iscsi session stateChanged notice iSCSI session state is changed to Connect...

Page 212: ...estore automatic giveback if you disabled it by using the storage failover modify node local auto giveback true command Restore OKM NSE and NVE as needed AFF A250 Once environment variables are checke...

Page 213: ...security key manager onboard show backup command Example of backup data BEGIN BACKUP TmV0QXBwIEtleSBCbG9iAAEAAAAEAAAAcAEAAAAAAADuD byAAAAACEAAAAAAAAA QAAAAAAAAABvOlH0AAAAAMh7qDLRyH1DBz12piVdy9ATSFMT0...

Page 214: ...security key manager onboard sync b Run the security key manager onboard sync command and then enter the passphrase when prompted c Enter the security key manager key query command to see a detailed v...

Page 215: ...P SnapMirror or SnapVault process disable the process See the appropriate Documentation Center for more information 5 Wait 3 minutes and check the failover status with the storage failover show comman...

Page 216: ...is Replace the chassis AFF A250 To replace the chassis you must move the bezel controller modules and NVMe drives from the impaired chassis to the replacement chassis and then remove the impaired chas...

Page 217: ...node node_name in an HA enabled cluster may result in client disruption or data access failure To ensure continuity of service use the storage failover takeover command Are you sure you want to halt...

Page 218: ...e inside by crossing your arms Lever Latching mechanism 5 Using both hands grasp the controller module sides and gently pull it out of the chassis and set it on a flat stable surface 6 Set the control...

Page 219: ...rails in a system cabinet or equipment rack and then set it aside 3 If you are not already grounded properly ground yourself 4 Using two people install the replacement chassis into the equipment rack...

Page 220: ...nd flush with the edges of the chassis 5 Repeat the preceding steps to install the second controller into the new chassis Complete the restoration and replacement process AFF A250 Step 1 Verify and se...

Page 221: ...800 800 80 800 Asia Pacific if you need the RMA number or additional help with the replacement procedure Controller Replace the controller module AFF A250 You must review the prerequisites for the re...

Page 222: ...1 Most systems To shut down the impaired node you must determine the status of the node and if necessary take over the node so that the healthy node continues to serve data from the impaired node sto...

Page 223: ...bility and health you must correct the issue before shutting down the impaired node see the Administration overview with the CLI If you have a MetroCluster configuration you must have confirmed that t...

Page 224: ...dule You must remove the controller module from the chassis when you replace a component inside the controller module Make sure that you label the cables so that you know where they came from Use the...

Page 225: ...oth hands grasp the controller module sides and gently pull it out of the chassis and set it on a flat stable surface 6 Turn the thumbscrew on the front of the controller module anti clockwise and ope...

Page 226: ...y a Open the power cable retainer and then unplug the power cable from the power supply b Unplug the power cable from the power source 2 Rotate the cam handle such that it can be used to pull power su...

Page 227: ...icks into place The power supplies will only properly engage with the internal connector and lock in place one way To avoid damaging the internal connector do not use excessive force when sliding the...

Page 228: ...AFF A250 under the air duct in the controller module You must move it from the impaired controller module to the replacement controller module You need a 1 magnetic Phillips head screw driver to remov...

Page 229: ...out of the socket and align it into place in the replacement controller module c Using the 1 magnetic screw driver insert and tighten the screw on the boot media Do not apply force when tightening the...

Page 230: ...open position and then insert the DIMM squarely into the socket The DIMMs fit tightly in the socket If not reinsert the DIMM to realign it with the socket d Visually inspect the DIMM to verify that i...

Page 231: ...impaired controller module and from the mezzanine card and set them aside safely on the magnet d Gently lift the mezzanine card out of the socket and move it to the same position in the replacement co...

Page 232: ...ler module to the replacement controller module Squeeze the clip on the face of the battery plug Unplug the battery cable from the socket Grasp the battery and press the blue locking tab marked PUSH L...

Page 233: ...wall f Press firmly down on the battery pack to make sure that it is locked into place Step 8 Install the controller module After all of the components have been moved from the impaired controller mo...

Page 234: ...ollowing sections You will connect the rest of the cables to the controller module later in this procedure 5 Insert the controller module into the chassis a Ensure the latching mechanism arms are lock...

Page 235: ...ems The replacement node is the new node that replaced the impaired node as part of this procedure The healthy node is the HA partner of the replacement node Steps 1 If the replacement node is not at...

Page 236: ...e node system node halt node node_name After you issue the command you should wait until the system stops at the LOADER prompt 2 At the LOADER prompt access the special drivers specifically designed f...

Page 237: ...e replacement node and then verify that the change was implemented This procedure applies only to systems running ONTAP in an HA pair 1 If the replacement node is in Maintenance mode showing the promp...

Page 238: ...rage storage failover giveback ofnode replacement_node_name the replacement node takes back its storage and completes booting If you are prompted to override the system ID due to a system ID mismatch...

Page 239: ...fields node systemid command output displays the old system ID until the MetroCluster configuration returns to a normal state 8 If the node is in a MetroCluster configuration depending on the MetroCl...

Page 240: ...available to the replacement node However if the impaired node was the only node in the cluster with a license for the feature no configuration changes to the feature are allowed Also using unlicensed...

Page 241: ...should verify that the LIFs are on their home ports and register the serial number of the replacement node if AutoSupport is enabled and reset automatic giveback 1 Verify that the logical interfaces a...

Page 242: ...is task If you have a cluster with more than two nodes it must be in quorum If the cluster is not in quorum or a healthy node shows false for eligibility and health you must correct the issue before s...

Page 243: ...ibility and health you must correct the issue before shutting down the impaired node see the Administration overview with the CLI If you have a MetroCluster configuration you must have confirmed that...

Page 244: ...controller module Make sure that you label the cables so that you know where they came from 1 If you are not already grounded properly ground yourself 2 Unplug the controller module power supplies fr...

Page 245: ...nd gently pull it out of the chassis and set it on a flat stable surface 6 Turn the thumbscrew on the front of the controller module anti clockwise and open the controller module cover Thumbscrew Cont...

Page 246: ...ace it following the specific sequence of steps Use the following video or the tabulated steps to replace a DIMM Replacing a DIMM 1 Replace the impaired DIMM on your controller module The DIMMs are in...

Page 247: ...components on the DIMM circuit board e Insert the replacement DIMM squarely into the slot The DIMMs fit tightly in the socket If not reinsert the DIMM to realign it with the socket f Visually inspect...

Page 248: ...2 Close the controller module cover and tighten the thumbscrew 245...

Page 249: ...ccess the system to perform the tasks in the following sections You will connect the rest of the cables to the controller module later in this procedure Step 5 Run diagnostics After you have replaced...

Page 250: ...thy node continues to serve data from the impaired node storage About this task If you have a cluster with more than two nodes it must be in quorum If the cluster is not in quorum or a healthy node sh...

Page 251: ...bility and health you must correct the issue before shutting down the impaired node see the Administration overview with the CLI If you have a MetroCluster configuration you must have confirmed that t...

Page 252: ...controller module Make sure that you label the cables so that you know where they came from 1 If you are not already grounded properly ground yourself 2 Unplug the controller module power supplies fro...

Page 253: ...Step 3 Replace a fan To replace a fan remove the failed fan module and replace it with a new fan module Use the following video or the tabulated steps to replace a fan Replacing a fan 1 Identify the...

Page 254: ...then slide the replacement fan module into the controller module Step 4 Reinstall the controller module After you replace a component within the controller module you must reinstall the controller mod...

Page 255: ...n the orange tabs on top of the latching mechanism and gently push the controller module over the stop e Release your thumbs from the top of the latching mechanisms and continue pushing until the latc...

Page 256: ...chnical support Step 1 Shut down the impaired controller You can shut down or take over the impaired controller using different procedures depending on the storage system hardware configuration Option...

Page 257: ...is not in quorum or a healthy node shows false for eligibility and health you must correct the issue before shutting down the impaired node see the Administration overview with the CLI If you have a...

Page 258: ...troller module Make sure that you label the cables so that you know where they came from 1 If you are not already grounded properly ground yourself 2 Unplug the controller module power supplies from t...

Page 259: ...troller module cover Step 3 Replace or install a mezzanine card To replace a mezzanine card you must remove the impaired card and install the replacement card to install a mezzanine card you must remo...

Page 260: ...remove the screws from the face of the controller module and set them aside safely on the magnet d Using the 1 magnetic screw driver loosen the screw on the impaired mezzanine card e Gently lift the...

Page 261: ...t them aside safely on the magnet b Remove the mezzanine card from the antistatic shipping bag and align it to the inside face of the controller module c Gently align the mezzanine card into place d U...

Page 262: ...rn the node to normal operation by giving back its storage storage failover giveback ofnode impaired_node_name 5 If automatic giveback was disabled reenable it storage failover modify node local auto...

Page 263: ...failover modify node local auto giveback false 3 Take the impaired node to the LOADER prompt If the impaired node is displaying Then The LOADER prompt Go to the next step Waiting for giveback Press C...

Page 264: ...tem prompt or password prompt enter system password Take over or halt the impaired node For an HA pair take over the impaired node from the healthy node storage failover takeover ofnode impaired_node_...

Page 265: ...oth hands grasp the controller module sides and gently pull it out of the chassis and set it on a flat stable surface 6 Turn the thumbscrew on the front of the controller module anti clockwise and ope...

Page 266: ...ery into the controller module Use the following video or the tabulated steps to replace the NVMEM battery Replacing the NVMEM battery 1 Locate and replace the impaired NVMEM battery on your controlle...

Page 267: ...ttery plug into the socket e Slide the battery pack down along the sheet metal side wall until the support tabs on the side wall hook into the slots on the battery pack and the battery pack latch enga...

Page 268: ...mbs down on the orange tabs on top of the latching mechanism and gently push the controller module over the stop e Release your thumbs from the top of the latching mechanisms and continue pushing unti...

Page 269: ...If the scan reported no failures select Reboot from the menu to reboot the system Step 6 Return the failed part to NetApp After you replace the part you can return the failed part to NetApp as descri...

Page 270: ...ull power supply out of the controller module while pressing the locking tab CAUTION The power supply is short Always use two hands to support it when removing it from the controller module so that it...

Page 271: ...in the system must be functioning properly if not you must contact technical support Step 1 Shut down the impaired controller You can shut down or take over the impaired controller using different pr...

Page 272: ...e than two nodes it must be in quorum If the cluster is not in quorum or a healthy node shows false for eligibility and health you must correct the issue before shutting down the impaired node see the...

Page 273: ...sis when you replace a component inside the controller module Make sure that you label the cables so that you know where they came from 1 If you are not already grounded properly ground yourself 2 Unp...

Page 274: ...le sides and gently pull it out of the chassis and set it on a flat stable surface 6 Turn the thumbscrew on the front of the controller module anti clockwise and open the controller module cover Thumb...

Page 275: ...de the controller and follow the specific sequence of steps Use the following video or the tabulated steps to replace the RTC battery Replacing the RTC battery 1 Locate the RTC battery between the hea...

Page 276: ...t the battery up Note Make a note of the polarity of the battery The battery should eject out The battery will be ejected out 2 Remove the replacement battery from the antistatic shipping bag 3 Locate...

Page 277: ...4 Reinstall the controller module and setting time date after RTC battery replacement After you replace a component within the controller module you must reinstall the controller module in the system...

Page 278: ...at the LOADER prompt The controller module should be fully inserted and flush with the edges of the chassis 6 Reset the time and date on the controller a Check the date and time on the healthy node wi...

Page 279: ...see either Install MetroCluster IP configuration Install MetroCluster Fabric Attached configuration Installation and setup PDF poster AFF A300 You can use the PDF poster to install and set up your new...

Page 280: ...system is running If you have a cluster with more than two nodes it must be in quorum If the cluster is not in quorum or a healthy node shows false for eligibility and health you must correct the issu...

Page 281: ...ck whether NSE is configured storage encryption disk show If the command output list the drive details with Mode Key ID information NSE is configured and you need to verify the NSE configuration If NV...

Page 282: ...s yes for all authentication key security key manager key show detail Go to advanced privilege mode and enter y when prompted to continue set priv advanced Enter the command to display the OKM backup...

Page 283: ...isplays anything other than yes Run the key manager setup wizard security key manager setup node target impaired node name Enter the customer s OKM passphrase at the prompt If the passphrase cannot be...

Page 284: ...nd the Restored column displays anything other than yes you need to complete some additional steps If the Key Manager type displays onboard and the Restored column displays anything other than yes you...

Page 285: ...y key manager query If the Key Manager type displays external and the Restored column displays yes it s safe to shut down the impaired node If the Key Manager type displays onboard and the Restored co...

Page 286: ...ntinue set priv advanced e Enter the command to display the key management backup information security key manager onboard show backup f Copy the contents of the backup information to a separate file...

Page 287: ...nfiguration you must have confirmed that the MetroCluster Configuration State is configured and that the nodes are in an enabled and normal state metrocluster node show Steps 1 If AutoSupport is enabl...

Page 288: ...according to the following table If the impaired node Then Has automatically switched over Proceed to the next step Has not automatically switched over Perform a planned switchover operation from the...

Page 289: ...d you have the option of reissuing the metrocluster heal command with the override vetoes parameter If you use this optional parameter the system overrides any soft vetoes that prevent the healing ope...

Page 290: ...the controller module keeping track of where the cables were connected Leave the cables in the cable management device so that when you reinstall the cable management device the cables are organized...

Page 291: ...oot media from its housing and then gently pull it straight out of the boot media socket Do not twist or pull the boot media straight up because this could damage the socket or the boot media 4 Align...

Page 292: ...ed When recabling remember to reinstall the media converters SFPs if they were removed 3 Insert the USB flash drive into the USB slot on the controller module Make sure that you install the USB flash...

Page 293: ...The target port you configure is the target port you use to communicate with the impaired node from the healthy node during var file system restore with a network connection You can also use the e0M...

Page 294: ...at are not in a two node MetroCluster configuration 1 From the LOADER prompt boot the recovery image from the USB flash drive boot_recovery The image is downloaded from the USB flash drive 2 When prom...

Page 295: ...store OKM NSE and NVE as needed If your system does not have onboard keymanager NSE or NVE configured complete the steps in this section 6 From the LOADER prompt enter the boot_ontap command If you se...

Page 296: ...Press Ctrl C for Boot Menu message and when the Boot Menu is displayed select option 6 5 Verify that the environmental variables are set as expected a Take the node to the LOADER prompt b Check the e...

Page 297: ...urviving cluster 5 Verify that the switchback operation has completed metrocluster show The switchback operation is still running when a cluster is in the waiting for switchback state cluster_B metroc...

Page 298: ...oard Key Manager is enabled Steps 1 Connect the console cable to the target node 2 Use the boot_ontap command at the LOADER prompt to boot the node 3 Check the console output If the console displays T...

Page 299: ...ver show command 10 Giveback only the CFO aggregates with the storage failover giveback fromnode local only cfo aggregates true command If the command fails because of a failed disk physically dis eng...

Page 300: ...ble to the partner node 16 Give back the target node using the storage failover giveback fromnode local command 17 Check the giveback status 3 minutes after it reports complete using the storage failo...

Page 301: ...that are not on their home node and port If any interfaces are listed as false revert those interfaces back to their home port using the net int revert command 7 Move the console cable to the target...

Page 302: ...e console output If the console displays Then The login prompt Go to Step 7 Waiting for giveback a Log into the partner node b Confirm the target node is ready for giveback with the storage failover s...

Page 303: ...y manager onboard sync command to re sync the Key Manager type Use the security key manager key query to verify that the Restored column yes true for all authentication keys 11 Connect the console cab...

Page 304: ...port is enabled suppress automatic case creation by invoking an AutoSupport message system node autosupport invoke node type all message MAINT number_of_hours_downh The following AutoSupport message s...

Page 305: ...e power supplies turned on at the end of this procedure to provide power to the healthy node Steps 1 Check the MetroCluster status to determine whether the impaired node has automatically switched ove...

Page 306: ...g the metrocluster heal phase root aggregates command mcc1A metrocluster heal phase root aggregates Job 137 Job succeeded Heal Root Aggregates is successful If the healing is vetoed you have the optio...

Page 307: ...you are not already grounded properly ground yourself 2 Turn off the power supply and disconnect the power cables a Turn off the power switch on the power supply b Open the power cable retainer and th...

Page 308: ...Power supply Cam handle release latch Power and Fault LEDs Cam handle 305...

Page 309: ...it all the way into the chassis and then push the cam handle to the closed position making sure that the cam handle release latch clicks into its locked position 8 Reconnect the power cable and secur...

Page 310: ...Set the fan module aside 5 Repeat the preceding steps for any remaining fan modules 6 Insert the fan module into the replacement chassis by aligning it with the opening and then sliding it into the c...

Page 311: ...he system cables and SFPs if needed from the controller module keeping track of where the cables were connected Leave the cables in the cable management device so that when you reinstall the cable man...

Page 312: ...nt rack or system cabinet 6 Secure the front of the chassis to the equipment rack or system cabinet using the screws you removed from the old chassis 7 If you have not already done so install the beze...

Page 313: ...fully seated and then close the cam handle to the locked position Tighten the thumbscrew on the cam handle on back of the controller module Do not use excessive force when sliding the controller modu...

Page 314: ...t of your system 4 The next step depends on your system configuration If your system is in Then A stand alone configuration a Exit Maintenance mode halt b Go to Step 4 Return the failed part to NetApp...

Page 315: ...tests from the Maintenance mode prompt sldiag device modify dev interconnect sel enable The interconnect tests are disabled by default and must be enabled to run separately 5 Run the interconnect diag...

Page 316: ...on both controllers at the LOADER prompt bye e Return the node to normal operation If your system is running ONTAP Then With two nodes in the cluster Issue these commands node cluster ha modify confi...

Page 317: ...luster configuration you can perform the MetroCluster switchback operation This returns the configuration to its normal operating state with the sync source storage virtual machines SVMs on the former...

Page 318: ...he metrocluster config replication resync status show command 6 Reestablish any SnapMirror or SnapVault configurations Step 4 Return the failed part to NetApp After you replace the part you can return...

Page 319: ...he old controller module Any PCIe cards moved from the old controller module to the new controller module or added from existing customer site inventory must be supported by the replacement controller...

Page 320: ...veback press Ctrl C and then respond y Option 2 Controller is in a two node MetroCluster configuration To shut down the impaired node you must determine the status of the node and if necessary switch...

Page 321: ...verride vetoes parameter If you use this optional parameter the system overrides any soft vetoes that prevent the healing operation 4 Verify that the operation has been completed by using the metroclu...

Page 322: ...et the MSID using the instructions in the Returning SEDs to unprotected mode section of Administration overview with the CLI You must leave the power supplies turned on at the end of this procedure to...

Page 323: ...ck the state of the aggregates by using the storage aggregate show command controller_A_1 storage aggregate show Aggregate Size Available Used State Vols Nodes RAID Status aggr_b2 227 1GB 227 1GB 0 on...

Page 324: ...dule you must first remove the old controller module from the chassis 1 If you are not already grounded properly ground yourself 2 Loosen the hook and loop strap binding the cables to the cable manage...

Page 325: ...port the bottom of the controller module as you slide it out of the chassis Step 2 Move the boot device You must locate the boot media and follow the directions to remove it from the old controller an...

Page 326: ...e edges of the boot media with the socket housing and then gently push it into the socket 4 Check the boot media to make sure that it is seated squarely and completely in the socket If necessary remov...

Page 327: ...ng contents to the flash memory when you halt the system After the destage is complete the LED turns off If power is lost without a clean shutdown the NVMEM LED flashes until the destage is complete a...

Page 328: ...teps 1 Locate the DIMMs on your controller module 2 Note the orientation of the DIMM in the socket so that you can insert the DIMM in the replacement controller module in the proper orientation 3 Ejec...

Page 329: ...eps for the remaining DIMMs 7 Move the NVMEM battery to the replacement controller module 8 Align the tab or tabs on the battery holder with the notches in the controller module side and then gently p...

Page 330: ...at the preceding step for the remaining PCIe cards in the old controller module 5 Open the new controller module side panel if necessary slide off the PCIe card filler plate as needed and carefully in...

Page 331: ...hich you can typically do at any time after prompted to do so However if the system updates the system firmware when it boots you must wait until after the update is complete before interrupting the b...

Page 332: ...e when sliding the controller module into the chassis to avoid damaging the connectors The controller begins to boot as soon as it is seated in the chassis b If you have not already done so reinstall...

Page 333: ...ss Ctrl C when prompted and then boot to Maintenance mode e From the boot menu select the option for Maintenance mode Important During the boot process you might see the following prompts A prompt war...

Page 334: ...ate and time on the replacement node show date The date and time are given in GMT Step 2 Verify and set the HA state of the controller module You must verify the HA state of the controller module and...

Page 335: ...ags During the boot process you can safely respond y to the prompts until the Maintenance mode prompt appears 3 Display and note the available devices on the controller module sldiag device show dev m...

Page 336: ...ts that you want to run sldiag device modify dev dev_name selection only selection only disables all other tests that you do not want to run for the device d Run the selected tests sldiag device run d...

Page 337: ...nt to run for the device d Verify that the tests were modified sldiag device show e Repeat these substeps for each device that you want to run concurrently f Run diagnostics on all of the devices sldi...

Page 338: ...l of the considerations identified for running system level diagnostics that cables are securely connected and that hardware components are properly installed in the storage system d Reconnect the pow...

Page 339: ...go to the LOADER prompt halt 2 From the LOADER prompt on the replacement node boot the node entering y if you are prompted to override the system ID due to a system ID mismatch boot_ontap 3 Wait until...

Page 340: ...uration Guide for your version of ONTAP 9 b After the giveback has been completed confirm that the HA pair is healthy and that takeover is possible storage failover show The output from the storage fa...

Page 341: ...st enter Y when prompted to override the system ID due to a system ID mismatch 2 View the old system IDs from the healthy node metrocluster node show fields node systemid dr partner systemid In this e...

Page 342: ...n prompted to continue into advanced mode The advanced mode prompt appears b Verify that the coredumps are saved system node run node local node name partner savecore If the command output indicates t...

Page 343: ...on a From any node s prompt change to the advanced privilege level set privilege advanced You need to respond with y when prompted to continue into advanced mode and see the advanced mode prompt b Per...

Page 344: ...ality After replacing the controller module or NVRAM module for a storage system that you previously configured to use Storage or Volume Encryption you must perform additional steps to provide uninter...

Page 345: ...applies to two node MetroCluster configurations Steps 1 Verify that all nodes are in the enabled state metrocluster node show cluster_B metrocluster node show DR Configuration DR Group Cluster Node St...

Page 346: ...support at NetApp Support 888 463 8277 North America 00 800 44 638277 Europe or 800 800 80 800 Asia Pacific if you need the RMA number or additional help with the replacement procedure Replace a DIMM...

Page 347: ...l C and then respond y when prompted System prompt or password prompt enter system password Take over or halt the impaired node For an HA pair take over the impaired node from the healthy node storage...

Page 348: ...lover takeover ofnode impaired_node_name When the impaired node shows Waiting for giveback press Ctrl C and then respond y Option 3 Controller is in a two node MetroCluster To shut down the impaired n...

Page 349: ...is successful If the healing is vetoed you have the option of reissuing the metrocluster heal command with the override vetoes parameter If you use this optional parameter the system overrides any sof...

Page 350: ...ed controller module disconnect the power supplies Step 2 Open the controller module To access components inside the controller you must first remove the controller module from the system and then rem...

Page 351: ...ng unwritten data in the nonvolatile memory NVMEM The LED is located on the back of the controller module Look for the following icon 3 If the NVMEM LED is not flashing there is no content in the NVME...

Page 352: ...rom the socket c Wait a few seconds and then plug the battery back into the socket 5 Return to step 2 of this procedure to recheck the NVMEM LED 6 Locate the DIMMs on your controller module Each syste...

Page 353: ...location of system DIMMs 9 Remove the replacement DIMM from the antistatic shipping bag hold the DIMM by the corners and align it to the slot The notch among the pins on the DIMM should line up with t...

Page 354: ...verters QSFPs or SFPs remember to reinstall them if you are using fiber optic cables 4 Complete the reinstallation of the controller module The controller module begins to boot as soon as it is fully...

Page 355: ...gs During the boot process you can safely respond y to the prompts until the Maintenance mode prompt appears 3 Run diagnostics on the system memory sldiag device run dev mem 4 Verify that no hardware...

Page 356: ...plies turned on to provide power to the other controller module If you have one controller module in the chassis turn off the power supplies and unplug them from the power sources c Verify that you ha...

Page 357: ...d enabled heal roots completed cluster_B controller_B_1 configured enabled waiting for switchback recovery 2 entries were displayed 2 Verify that resynchronization is complete on all SVMs metrocluster...

Page 358: ...th the replacement procedure Swap out a fan AFF A300 To swap out a fan module without interrupting service you must perform a specific sequence of tasks You must replace the fan module within two minu...

Page 359: ...sliding it into the chassis 8 Push firmly on the fan module cam handle so that it is seated all the way into the chassis The cam handle raises slightly when the fan module is completely seated 9 Swin...

Page 360: ...s to serve data from the impaired node storage About this task If you have a cluster with more than two nodes it must be in quorum If the cluster is not in quorum or a healthy node shows false for eli...

Page 361: ...gibility and health you must correct the issue before shutting down the impaired node see the Administration overview with the CLI If you have a MetroCluster configuration you must have confirmed that...

Page 362: ...the CLI You must leave the power supplies turned on at the end of this procedure to provide power to the healthy node Steps 1 Check the MetroCluster status to determine whether the impaired node has a...

Page 363: ...ck the state of the aggregates by using the storage aggregate show command controller_A_1 storage aggregate show Aggregate Size Available Used State Vols Nodes RAID Status aggr_b2 227 1GB 227 1GB 0 on...

Page 364: ...ller module 1 If you are not already grounded properly ground yourself 2 Loosen the hook and loop strap binding the cables to the cable management device and then unplug the system cables and SFPs if...

Page 365: ...r system is in an HA configuration go to the next step If your system is in a stand alone configuration cleanly shut down the controller module and then check the NVRAM LED identified by the NV icon T...

Page 366: ...s on the battery holder with the notches in the controller module side and then gently push down on the battery housing until the battery housing clicks into place 7 Close the CPU air duct Make sure t...

Page 367: ...on the cam handle on back of the controller module c If you have not already done so reinstall the cable management device d Bind the cables to the cable management device with the hook and loop stra...

Page 368: ...l diagnostics tests Then Were completed without any failures a Clear the status logs sldiag device clearstatus b Verify that the log was cleared sldiag device status The following default response is...

Page 369: ...e boot by pressing Ctrl C when prompted to get to the Boot menu If you have two controller modules in the chassis fully seat the controller module you are servicing in the chassis The controller modul...

Page 370: ...hback command from any node in the surviving cluster 5 Verify that the switchback operation has completed metrocluster show The switchback operation is still running when a cluster is in the waiting f...

Page 371: ...u must determine the status of the node and if necessary take over the node so that the healthy node continues to serve data from the impaired node storage About this task If you have a cluster with m...

Page 372: ...gibility and health you must correct the issue before shutting down the impaired node see the Administration overview with the CLI If you have a MetroCluster configuration you must have confirmed that...

Page 373: ...the CLI You must leave the power supplies turned on at the end of this procedure to provide power to the healthy node Steps 1 Check the MetroCluster status to determine whether the impaired node has a...

Page 374: ...ck the state of the aggregates by using the storage aggregate show command controller_A_1 storage aggregate show Aggregate Size Available Used State Vols Nodes RAID Status aggr_b2 227 1GB 227 1GB 0 on...

Page 375: ...ller module 1 If you are not already grounded properly ground yourself 2 Loosen the hook and loop strap binding the cables to the cable management device and then unplug the system cables and SFPs if...

Page 376: ...ller module as you slide it out of the chassis Step 3 Replace a PCIe card To replace a PCIe card locate it within the controller and follow the specific sequence of steps 1 If you are not already grou...

Page 377: ...controller module halfway into the system Do not completely insert the controller module in the chassis until instructed to do so 3 Recable the system as needed If you removed the media converters QSF...

Page 378: ...luster interconnect and data connections on 40 GbE NICs or onboard ports convert these ports to 10 GbE connections by using the nicadmin convert command from Maintenance mode Be sure to exit Maintenan...

Page 379: ...cessfully metrocluster check lif show 4 Perform the switchback by using the metrocluster switchback command from any node in the surviving cluster 5 Verify that the switchback operation has completed...

Page 380: ...undant and hot swappable This procedure is written for replacing one power supply at a time It is a best practice to replace the power supply within two minutes of removing it from the chassis The sys...

Page 381: ...Power supply Cam handle release latch Power and Fault LEDs Cam handle 378...

Page 382: ...able retainer Once power is restored to the power supply the status LED should be green 1 Turn on the power to the new power supply and then verify the operation of the power supply activity LEDs The...

Page 383: ...ailover modify node local auto giveback false 3 Take the impaired node to the LOADER prompt If the impaired node is displaying Then The LOADER prompt Go to the next step Waiting for giveback Press Ctr...

Page 384: ...rd prompt enter system password Take over or halt the impaired node For an HA pair take over the impaired node from the healthy node storage failover takeover ofnode impaired_node_name When the impair...

Page 385: ...b succeeded Heal Aggregates is successful If the healing is vetoed you have the option of reissuing the metrocluster heal command with the override vetoes parameter If you use this optional parameter...

Page 386: ...ed controller module disconnect the power supplies Step 2 Open the controller module To access components inside the controller you must first remove the controller module from the system and then rem...

Page 387: ...e sure that you support the bottom of the controller module as you slide it out of the chassis Step 3 Replace the RTC Battery To replace the RTC battery locate them inside the controller and follow th...

Page 388: ...pping bag 5 Locate the empty battery holder in the controller module 6 Note the polarity of the RTC battery and then insert it into the holder by tilting the battery at an angle and pushing down 7 Vis...

Page 389: ...he hook and loop strap d Reconnect the power cables to the power supplies and to the power sources and then turn on the power to start the boot process e Halt the controller at the LOADER prompt 6 Res...

Page 390: ...ing performed by the healing operations were completed successfully metrocluster check lif show 4 Perform the switchback by using the metrocluster switchback command from any node in the surviving clu...

Page 391: ...or SnapVault configurations Step 6 Return the failed part to NetApp After you replace the part you can return the failed part to NetApp as described in the RMA instructions shipped with the kit Conta...

Page 392: ...ing through initial system bring up Use this guide if you are familiar with installing NetApp systems Access the Installation and Setup Instructions PDF poster AFF A320 Systems Installation and Setup...

Page 393: ...out this system NetApp Hardware Universe Find the Release Notes for your version of ONTAP 9 You need to provide the following at your site Rack space for the storage system Phillips 2 screwdriver Addi...

Page 394: ...00326 2m X66250 5 112 00328 5m X66250 30 112 00331 30m Ethernet cable order dependent Optical cables SR X6553 R6 112 00188 2m X6554 R6 112 00189 15m X6537 R6 112 00091 30m LR X66250 3 112 00342 2m X66...

Page 395: ...e system Cable controllers to your network You can cable the controllers to your network by using the two node switchless cluster method or by using the cluster interconnect network Option 1 Cable a t...

Page 396: ...t turn it around and try again 1 You can used the illustration or the step by step instructions to complete the cabling between the controllers and to the switches Step Perform on each controller modu...

Page 397: ...your onboard ports for a data network connection connect the 100GbE or 40Gbe cables to the appropriate data network switches e0g and e0h If you are using your NIC cards for Ethernet or FC connections...

Page 398: ...erconnect HA ports are cabled on to the cluster HA switch You must have contacted your network administrator for information about connecting the system to the switches Be sure to check the illustrati...

Page 399: ...er HA ports to the cluster HA switch with the 100 GbE QSFP28 cable e0a on both controllers to the cluster HA switch e0d on both controllers to the cluster HA switch If you are using your onboard ports...

Page 400: ...to the appropriate switches Cable the e0M ports to the management network switches with the RJ45 cables DO NOT plug in the power cords at this point 2 Cable your storage Cabling controllers to drive s...

Page 401: ...sure to check the illustration arrow for the proper cable connector pull tab orientation As you insert the connector you should feel it click into place if you do not feel it click remove it turn it...

Page 402: ...the shelf Cable controller B to the shelf 2 To complete setting up your system see Completing system setup and configuration Option 2 Cable the controllers to two drive shelves You must cable each co...

Page 403: ...or pull tab orientation As you insert the connector you should feel it click into place if you do not feel it click remove it turn it around and try again 1 You can use the following illustration or t...

Page 404: ...complete the system setup and configuration using cluster discovery with only a connection to the switch and laptop or by connecting directly to a controller in the system and then connecting to the m...

Page 405: ...discover a Open File Explorer b Click network in the left pane c Right click and select refresh d Double click either ONTAP icon and accept any certificates displayed on your screen XXXXX is the syst...

Page 406: ...sole cable that came with your system and then connect the laptop to the management switch on the management subnet c Assign a TCP IP address to the laptop or console using one that is on the manageme...

Page 407: ...TAP Maintain Boot media Replace the boot media AFF A320 The boot media stores a primary and secondary set of system boot image files that the system uses when it boots Depending on your network config...

Page 408: ...invoke node type all message MAINT number_of_hours_downh The following AutoSupport message suppresses automatic case creation for two hours cluster1 system node autosupport invoke node type all messa...

Page 409: ...Enter the command to display the key management information security key manager onboard show backup c Copy the contents of the backup information to a separate file or your log file You ll need it in...

Page 410: ...o complete some additional steps If the Key Manager type displays external and the Restored column displays anything other than yes you need to complete some additional steps 2 If the Key Manager type...

Page 411: ...aster scenarios where you might need to manually recover OKM g Return to admin mode set priv admin h You can safely shutdown the node Shut down the node AFF A320 Option 1 Most systems After completing...

Page 412: ...y invoking an AutoSupport message system node autosupport invoke node type all message MAINT number_of_hours_downh The following AutoSupport message suppresses automatic case creation for two hours cl...

Page 413: ...ou reinstall the cable management device the cables are organized 4 Remove and set aside the cable management devices from the left and right sides of the controller module 5 Remove the controller mod...

Page 414: ...s seated squarely and completely in the socket If necessary remove the boot media and reseat it into the socket 3 Lock the boot media in place a Rotate the boot media down toward the motherboard b Pla...

Page 415: ...er to the top directory on the USB flash drive The USB flash drive should have the efi folder and the same Service Image BIOS version of what the impaired controller is running d Remove the USB flash...

Page 416: ...arg name command and correct any errors using the setenv variable name value command a Check the boot environment variables bootarg init boot_clustered partner sysid bootarg init flash_optimized for A...

Page 417: ...successful press y on the impaired node when prompted to use the restored copy 15 Press y when you see confirm backup procedure was successful and then press y when prompted to reboot the node 16 Veri...

Page 418: ...k command c After the giveback operation is complete confirm that the HA pair is healthy and that takeover is possible by using the storage failover show command d Restore automatic giveback if you di...

Page 419: ...ress impaired_node_IP_address d Return the node to admin level set privilege admin e Press y when prompted to use the restored configuration f Press y when prompted to reboot the node No network conne...

Page 420: ...e is changed to Connected for the target iSCSI target type dr_auxiliary address ip address date and time node name iscsi session stateChanged notice iSCSI session state is changed to Connected for the...

Page 421: ...estore automatic giveback if you disabled it by using the storage failover modify node local auto giveback true command Restore OKM NSE and NVE as needed AFF A320 Once environment variables are checke...

Page 422: ...security key manager onboard show backup command Example of backup data BEGIN BACKUP TmV0QXBwIEtleSBCbG9iAAEAAAAEAAAAcAEAAAAAAADuD byAAAAACEAAAAAAAAA QAAAAAAAAABvOlH0AAAAAMh7qDLRyH1DBz12piVdy9ATSFMT0...

Page 423: ...security key manager onboard sync b Run the security key manager onboard sync command and then enter the passphrase when prompted c Enter the security key manager key query command to see a detailed v...

Page 424: ...P SnapMirror or SnapVault process disable the process See the appropriate Documentation Center for more information 5 Wait 3 minutes and check the failover status with the storage failover show comman...

Page 425: ...ssis Replace the chassis AFF A320 To replace the chassis you must move the fans and controller modules from the impaired chassis to the new chassis of the same model as the impaired chassis All other...

Page 426: ...To ensure continuity of service use the storage failover takeover command Are you sure you want to halt node node_name y n You must perform a clean system shutdown before replacing the chassis to avo...

Page 427: ...dules to the replacement chassis when replacing the chassis you must perform a specific sequence of tasks 1 If you are not already grounded properly ground yourself 2 Remove the bezel if necessary wit...

Page 428: ...install the controller modules into the new chassis you need to boot it to a state where you can run the diagnostic test For HA pairs with two controller modules in the same chassis the sequence in w...

Page 429: ...atch your system configuration a Set the HA state for the chassis ha config modify chassis HA state The value for HA state can be one of the following ha mcc mccip non ha b Confirm that the setting ha...

Page 430: ...in a MetroCluster configuration you must review the section Choosing the correct recovery procedure to determine whether you should use this procedure If this is the procedure you should use note that...

Page 431: ...he Administration overview with the CLI Steps 1 If AutoSupport is enabled suppress automatic case creation by invoking an AutoSupport message system node autosupport invoke node type all message MAINT...

Page 432: ...port invoke node type all message MAINT number_of_hours_downh The following AutoSupport message suppresses automatic case creation for two hours cluster1 system node autosupport invoke node type all m...

Page 433: ...and loop strap binding the cables to the cable management device and then unplug the system cables and SFPs if needed from the controller module keeping track of where the cables were connected Leave...

Page 434: ...om the controller module and injure you 2 Move the power supply to the new controller module and then install it 3 Using both hands support and align the edges of the power supply with the opening in...

Page 435: ...nt controller module 5 Align the battery module with the opening for the battery and then gently push the battery into slot until it locks into place Do not plug the battery cable back into the mother...

Page 436: ...edia and reseat it into the socket 5 Lock the boot media in place a Rotate the boot media down toward the motherboard b Placing a finger at the end of the boot media by the blue button push down on th...

Page 437: ...1 Locate the DIMMs on your controller module 434...

Page 438: ...he components on the DIMM circuit board b Locate the corresponding DIMM slot on the replacement controller module c Make sure that the DIMM ejector tabs on the DIMM socket are in the open position and...

Page 439: ...oller module a Remove a riser from the impaired controller module and move it to the replacement controller module b Lower the riser straight into the bay so that it is square with the bay and the pin...

Page 440: ...connect the rest of the cables to the controller module later in this procedure 4 Complete the reinstallation of the controller module a Make sure the latch arms are locked in the extended position b...

Page 441: ...2 On the healthy node check the system time show date The date and time are given in GMT 3 At the LOADER prompt check the date and time on the replacement node show date The date and time are given i...

Page 442: ...ed menu to enable running the diagnostics tests 4 Select Test system from the displayed menu to run diagnostics tests 5 Select the test or series of tests from the various sub menus 6 Proceed based on...

Page 443: ...MAINT number_of_hours_downh The following AutoSupport message suppresses automatic case creation for two hours cluster1 system node autosupport invoke node type all message MAINT 2h 2 Disable automat...

Page 444: ...h 2 Disable automatic giveback from the console of the healthy node storage failover modify node local auto giveback false 3 Take the impaired node to the LOADER prompt If the impaired node is display...

Page 445: ...pin on the chassis The latching mechanism hook should be nearly vertical and should be clear of the chassis pin c Gently pull the controller module a few inches toward you so that you can grasp the co...

Page 446: ...MM ejector tabs on either side of the DIMM and then slide the DIMM out of the socket Carefully hold the DIMM by the edges to avoid pressure on the components on the DIMM circuit board 5 Remove the rep...

Page 447: ...hen gently push the controller module halfway into the system Do not completely insert the controller module in the chassis until instructed to do so 3 Cable the management and console ports only so t...

Page 448: ...test 6 Proceed based on the result of the preceding step If the test failed correct the failure and then rerun the test If the test reported no failures select Reboot from the menu to reboot the syst...

Page 449: ...m the chassis 5 Pull the fan module straight out from the chassis making sure that you support it with your free hand so that it does not swing out of the chassis The fan modules are short Always supp...

Page 450: ...ry take over the node so that the healthy node continues to serve data from the impaired node storage About this task If you have a cluster with more than two nodes it must be in quorum If the cluster...

Page 451: ...gibility and health you must correct the issue before shutting down the impaired node see the Administration overview with the CLI If you have a MetroCluster configuration you must have confirmed that...

Page 452: ...module from the chassis 1 If you are not already grounded properly ground yourself 2 Unplug the controller module power supply from the power source 3 Loosen the hook and loop strap binding the cables...

Page 453: ...oth hands gently pull the controller module out of the chassis and set it on a flat stable surface Step 3 Replace the NVDIMM To replace the NVDIMM you must locate it in the controller module using the...

Page 454: ...to place over the notches at the ends of the NVDIMM 8 Close the air duct Step 4 Install the controller module After you have replaced the component in the controller module you must re install the con...

Page 455: ...t access the special drivers specifically designed for system level diagnostics to function properly boot_diags 3 Select Scan System from the displayed menu to enable running the diagnostics tests 4 S...

Page 456: ...st determine the status of the node and if necessary take over the node so that the healthy node continues to serve data from the impaired node storage About this task If you have a cluster with more...

Page 457: ...gibility and health you must correct the issue before shutting down the impaired node see the Administration overview with the CLI If you have a MetroCluster configuration you must have confirmed that...

Page 458: ...module from the chassis 1 If you are not already grounded properly ground yourself 2 Unplug the controller module power supply from the power source 3 Loosen the hook and loop strap binding the cables...

Page 459: ...ical and should be clear of the chassis pin a Gently pull the controller module a few inches toward you so that you can grasp the controller module sides b Using both hands gently pull the controller...

Page 460: ...r duct at the rear of the controller module and reinstall the cover over the PCIe cards 2 Align the end of the controller module with the opening in the chassis and then gently push the controller mod...

Page 461: ...enu to run diagnostics tests 5 Proceed based on the result of the preceding step If the scan show problems correct the issue and then rerun the scan If the scan reported no failures select Reboot from...

Page 462: ...ontinues to serve data from the impaired node storage About this task If you have a cluster with more than two nodes it must be in quorum If the cluster is not in quorum or a healthy node shows false...

Page 463: ...gibility and health you must correct the issue before shutting down the impaired node see the Administration overview with the CLI If you have a MetroCluster configuration you must have confirmed that...

Page 464: ...module from the chassis 1 If you are not already grounded properly ground yourself 2 Unplug the controller module power supply from the power source 3 Loosen the hook and loop strap binding the cables...

Page 465: ...is pin a Gently pull the controller module a few inches toward you so that you can grasp the controller module sides b Using both hands gently pull the controller module out of the chassis and set it...

Page 466: ...f the PCIe card on either side of the socket and then gently push up to release the card from the socket c Slide the card out of the riser and set it aside d Align the replacement card bezel with the...

Page 467: ...s the system to perform the tasks in the following sections You will connect the rest of the cables to the controller module later in this procedure 4 Complete the reinstallation of the controller mod...

Page 468: ...shipped with the kit Contact technical support at NetApp Support 888 463 8277 North America 00 800 44 638277 Europe or 800 800 80 800 Asia Pacific if you need the RMA number or additional help with th...

Page 469: ...sh the power supply into the controller module until the locking tab clicks into place The power supplies will only properly engage with the internal connector and lock in place one way To avoid damag...

Page 470: ...om the impaired node storage About this task If you have a cluster with more than two nodes it must be in quorum If the cluster is not in quorum or a healthy node shows false for eligibility and healt...

Page 471: ...gibility and health you must correct the issue before shutting down the impaired node see the Administration overview with the CLI If you have a MetroCluster configuration you must have confirmed that...

Page 472: ...components inside the controller module you must remove the controller module from the chassis 1 If you are not already grounded properly ground yourself 2 Unplug the controller module power supply fr...

Page 473: ...e latching pin on the chassis The latching mechanism hook should be nearly vertical and should be clear of the chassis pin a Gently pull the controller module a few inches toward you so that you can g...

Page 474: ...the controller module and setting time date after RTC battery replacement After you replace a component within the controller module you must reinstall the controller module in the system chassis res...

Page 475: ...date mm dd yyyy command d If necessary set the time in GMT using the set time hh mm ss command e Confirm the date and time on the target node 7 At the LOADER prompt enter bye to reinitialize the PCIe...

Page 476: ...llation of your system from racking and cabling through initial system bring up Use this guide if you are familiar with installing NetApp systems Access the Installation and Setup Instructions PDF pos...

Page 477: ...s additional information on your configured system You might also want to have access to the Release Notes for your version of ONTAP for more information about this system NetApp Hardware Universe Fin...

Page 478: ...112 00437 2m X66033A 112 00438 3m mini SAS HD to mini SAS HD cables order dependent Optical cables X66250 2 N C 112 00342 16 Gb FC or 25GbE cables for mezzanine cards order dependent RJ 45 order depe...

Page 479: ...de switchless cluster method or by using the cluster interconnect network Option 1 Cable a two node switchless cluster The optional data ports optional NIC cards and management ports on the controller...

Page 480: ...ling instructions Option 2 Cable a switched cluster The optional data ports optional NIC cards mezzanine cards and management ports on the controller modules are connected to switches The cluster inte...

Page 481: ...abling 2 Go to Step 4 Cable controllers to drive shelves for drive shelf cabling instructions Step 4 Cable controllers to drive shelves You can cable either NSS224 or SAS shelves to you system Option...

Page 482: ...ive shelf Cabling the controllers to one NS224 drive shelf 2 Go to Step 5 Complete system setup and configuration to complete system setup and configuration Option 2 Cable the controllers to two drive...

Page 483: ...shelves Cabling controllers to two NS224 drive shelves 2 Go to Step 5 Complete system setup and configuration to complete system setup and configuration Option 3 Cable the controllers to SAS drive sh...

Page 484: ...hould feel it click into place if you do not feel it click remove it turn it around and try again Steps 1 Use the following illustration to cable your controllers to two drive shelves Cabling the cont...

Page 485: ...discovery 1 Use the following animation to set one or more drive shelf IDs If your system has NS224 drive shelves the shelves are pre set to shelf ID 00 and 01 If you want to change the shelf IDs you...

Page 486: ...features in ONTAP Option 2 Completing system setup and configuration if network discovery is not enabled If network discovery is not enabled on your laptop you must complete the configuration and setu...

Page 487: ...prompted by the script 3 Using System Manager on your laptop or console configure your cluster a Point your browser to the node management IP address The format for the address is https x x x x b Conf...

Page 488: ...e steps on the correct node The impaired node is the node on which you are performing maintenance The healthy node is the HA partner of the impaired node Check onboard encryption keys as needed AFF A4...

Page 489: ...any volumes are listed in the output NVE is configured and you need to verify the NVE configuration If no volumes are listed check whether NSE is configured 2 Verify whether NSE is configured storage...

Page 490: ...the customer s onboard key management passphrase at the prompt If the passphrase cannot be provided contact NetApp Support mysupport netapp com b Verify the Restored column shows yes for all authentic...

Page 491: ...y key manager external sync If the command fails contact NetApp Support mysupport netapp com b Verify that the Restored column equals yes for all authentication keys security key manager key query c Y...

Page 492: ...te the shutdown of the impaired node Do not use this procedure if your system is in a two node MetroCluster configuration To shut down the impaired node you must determine the status of the node and i...

Page 493: ...t down the impaired node you must determine the status of the node and if necessary switch over the node so that the healthy node continues to serve data from the impaired node storage About this task...

Page 494: ...verride vetoes parameter If you use this optional parameter the system overrides any soft vetoes that prevent the healing operation 4 Verify that the operation has been completed by using the metroclu...

Page 495: ...ve Step 1 Remove the controller module To access components inside the controller module you must remove the controller module from the chassis You can use the following animation illustration or the...

Page 496: ...controller module and then follow the directions to replace it Before you begin Although the contents of the boot media is encrypted it is a best practice to erase the contents of the boot media befor...

Page 497: ...s the locking tabs on the sides of the air duct in toward the middle of the controller module b Slide the air duct toward the back of the controller module and then rotate it upward to its completely...

Page 498: ...gently push it into the socket 4 Check the boot media to make sure that it is seated squarely and completely in the socket If necessary remove the boot media and reseat it into the socket 5 Lock the...

Page 499: ...ash drive a Download the service image to your work space on your laptop b Unzip the service image If you are extracting the contents using Windows do not use WinZip to extract the netboot image Use a...

Page 500: ...s Ctrl C select the option to boot to Maintenance mode and then halt the node to boot to LOADER 9 Although the environment variables and bootargs are retained you should check that all required boot e...

Page 501: ...om the USB drive restore the file system and verify the environmental variables This procedure applies to systems that are not in a two node MetroCluster configuration Steps 1 From the LOADER prompt b...

Page 502: ...store OKM NSE and NVE as needed If your system does not have onboard keymanager NSE or NVE configured complete the steps in this section 6 From the LOADER prompt enter the boot_ontap command If you se...

Page 503: ...Press Ctrl C for Boot Menu message and when the Boot Menu is displayed select option 6 5 Verify that the environmental variables are set as expected a Take the node to the LOADER prompt b Check the e...

Page 504: ...urviving cluster 5 Verify that the switchback operation has completed metrocluster show The switchback operation is still running when a cluster is in the waiting for switchback state cluster_B metroc...

Page 505: ...target node 2 Use the boot_ontap command at the LOADER prompt to boot the node 3 Check the console output If the console displays Then The LOADER prompt Boot the node to the boot menu boot_ontap menu...

Page 506: ...with the storage failover show command 10 Giveback only the CFO aggregates with the storage failover giveback fromnode local only cfo aggregates true command If the command fails because of a failed...

Page 507: ...the net int revert command 17 Move the console cable to the target node and run the version v command to check the ONTAP versions 18 Restore automatic giveback if you disabled it by using the storage...

Page 508: ...he key management servers If the Restored column yes true you are done and can proceed to complete the replacement process If the Key Manager type external and the Restored column anything other than...

Page 509: ...cluster is not in quorum or a healthy node shows false for eligibility and health you must correct the issue before shutting down the impaired node see the Administration overview with the CLI If Aut...

Page 510: ...the node so that the healthy node continues to serve data from the impaired node storage About this task If you are using NetApp Storage Encryption you must have reset the MSID using the instructions...

Page 511: ...5 56 Errors 5 Check the state of the aggregates by using the storage aggregate show command controller_A_1 storage aggregate show Aggregate Size Available Used State Vols Nodes RAID Status aggr_b2 227...

Page 512: ...right sides of the controller module 5 Press down on both of the locking latches and then rotate both latches downward at the same time The controller module moves slightly out of the chassis 6 Slide...

Page 513: ...crews from the chassis mount points 2 With two people slide the old chassis off the rack rails in a system cabinet or equipment rack and then set it aside 3 If you are not already grounded properly gr...

Page 514: ...cable management device e Interrupt the normal boot process and boot to LOADER by pressing Ctrl C If your system stops at the boot menu select the option to boot to LOADER f At the LOADER prompt enter...

Page 515: ...erly boot_diags 3 Select Scan System from the displayed menu to enable running the diagnostics tests 4 Select Test system from the displayed menu to run diagnostics tests 5 Select the test or series o...

Page 516: ...urviving cluster 5 Verify that the switchback operation has completed metrocluster show The switchback operation is still running when a cluster is in the waiting for switchback state cluster_B metroc...

Page 517: ...disruptive operation during the replacement You must replace the failed component with a replacement FRU component you received from your provider You must be replacing a controller module with a cont...

Page 518: ...or password prompt enter system password Take over or halt the impaired node storage failover takeover ofnode impaired_node_name When the impaired node shows Waiting for giveback press Ctrl C and then...

Page 519: ...red node you must determine the status of the node and if necessary switch over the node so that the healthy node continues to serve data from the impaired node storage About this task If you are usin...

Page 520: ...verride vetoes parameter If you use this optional parameter the system overrides any soft vetoes that prevent the healing operation 4 Verify that the operation has been completed by using the metroclu...

Page 521: ...o Maintenance mode Step 1 Remove the controller module To access components inside the controller module you must remove the controller module from the chassis You can use the following illustration o...

Page 522: ...slide it out of the chassis 7 Place the controller module on a stable flat surface 8 On the replacement controller module open the air duct and remove the empty risers from the controller module usin...

Page 523: ...1 up and toward air duct lift the riser up and then set it aside d Repeat the previous step for the remaining risers Step 2 Move the power supplies You must move the power supply from the impaired con...

Page 524: ...until the locking tab clicks into place The power supplies will only properly engage with the internal connector and lock in place one way To avoid damaging the internal connector do not use excessiv...

Page 525: ...the battery cable from the socket 4 Grasp the battery and press the blue locking tab marked PUSH and then lift the battery out of the holder and controller module 5 Move the battery to the replacement...

Page 526: ...of the socket 2 Move the boot media to the new controller module align the edges of the boot media with the socket housing and then gently push it into the socket 3 Check the boot media to make sure...

Page 527: ...ser 3 right riser Moving the mezzanine card and riser 3 1 Move PCIe risers one and two from the impaired controller module to the replacement controller module a Remove any SFP or QSFP modules that mi...

Page 528: ...the replacement controller module e Install the mezzanine in the replacement controller and secure it with the thumbscrews f Install the third riser in the replacement controller module Step 6 Move t...

Page 529: ...oller module 4 Move the DIMMs from the impaired controller module to the replacement controller module Make sure that you install the each DIMM into the same slot it occupied in the impaired controlle...

Page 530: ...er module After all of the components have been moved from the impaired controller module to the replacement controller module you must install the replacement controller module into the chassis and t...

Page 531: ...your system stops at the boot menu select the option to boot to LOADER f At the LOADER prompt enter bye to reinitialize the PCIe cards and other components g Interrupt the boot process and boot to th...

Page 532: ...In Maintenance mode from the new controller module verify that all components display the same HA state ha config show The HA state should be the same for all components 2 If the displayed system sta...

Page 533: ...must ensure that the healthy node remains down You can safely respond y to these prompts Recable the system and reassign disks AFF A400 Continue the replacement procedure by recabling the storage and...

Page 534: ...e Partner Possible State Description node1 node2 false System ID changed on partner Old 151759755 New 151759706 In takeover node2 node1 Waiting for giveback HA mailboxes 4 From the healthy node verify...

Page 535: ...MetroCluster configuration monitor the status of the node metrocluster node show The MetroCluster configuration takes a few minutes after the replacement to return to a normal state at which time each...

Page 536: ...available to the replacement node However if the impaired node was the only node in the cluster with a license for the feature no configuration changes to the feature are allowed Also using unlicensed...

Page 537: ...ould verify that the LIFs are on their home ports and register the serial number of the replacement node if AutoSupport is enabled and reset automatic giveback 1 Verify that the logical interfaces are...

Page 538: ...hback command from any node in the surviving cluster 5 Verify that the switchback operation has completed metrocluster show The switchback operation is still running when a cluster is in the waiting f...

Page 539: ...fferent procedures depending on the storage system hardware configuration Option 1 Most configurations To shut down the impaired node you must determine the status of the node and if necessary take ov...

Page 540: ...s not in quorum or a healthy node shows false for eligibility and health you must correct the issue before shutting down the impaired node see the Administration overview with the CLI If you have a Me...

Page 541: ...the CLI You must leave the power supplies turned on at the end of this procedure to provide power to the healthy node Steps 1 Check the MetroCluster status to determine whether the impaired node has a...

Page 542: ...ck the state of the aggregates by using the storage aggregate show command controller_A_1 storage aggregate show Aggregate Size Available Used State Vols Nodes RAID Status aggr_b2 227 1GB 227 1GB 0 on...

Page 543: ...ation or the written steps to remove the controller module from the chassis Removing the controller module 1 If you are not already grounded properly ground yourself 2 Release the power cable retainer...

Page 544: ...out of the chassis 7 Place the controller module on a stable flat surface Step 3 Replace system DIMMs Replacing a system DIMM involves identifying the target DIMM through the associated error message...

Page 545: ...n rotate it upward to its completely open position 2 Locate the DIMMs on your controller module 3 Note the orientation of the DIMM in the socket so that you can insert the replacement DIMM in the prop...

Page 546: ...nap into place over the notches at the ends of the DIMM 8 Close the air duct Step 4 Install the controller module After you have replaced the component in the controller module you must re install the...

Page 547: ...anagement device e Interrupt the normal boot process and boot to LOADER by pressing Ctrl C If your system stops at the boot menu select the option to boot to LOADER f At the LOADER prompt enter bye to...

Page 548: ...ame 3 If automatic giveback was disabled reenable it storage failover modify node local auto giveback true Step 7 Switch back aggregates in a two node MetroCluster configuration After you have complet...

Page 549: ...cluster_B configured normal Remote cluster_A configured normal If a switchback is taking a long time to finish you can check on the status of in progress baselines by using the metrocluster config re...

Page 550: ...ng at the Attention LED on each fan module 4 Press down the release latch on the fan module cam handle and then rotate the cam handle downward The fan module moves a little bit away from the chassis 5...

Page 551: ...oning properly if not you must contact technical support Step 1 Shut down the impaired controller You can shut down or take over the impaired controller using different procedures depending on the sto...

Page 552: ...s not in quorum or a healthy node shows false for eligibility and health you must correct the issue before shutting down the impaired node see the Administration overview with the CLI If you have a Me...

Page 553: ...the CLI You must leave the power supplies turned on at the end of this procedure to provide power to the healthy node Steps 1 Check the MetroCluster status to determine whether the impaired node has a...

Page 554: ...ck the state of the aggregates by using the storage aggregate show command controller_A_1 storage aggregate show Aggregate Size Available Used State Vols Nodes RAID Status aggr_b2 227 1GB 227 1GB 0 on...

Page 555: ...ration or the written steps to remove the controller module from the chassis Removing the controller module 1 If you are not already grounded properly ground yourself 2 Release the power cable retaine...

Page 556: ...assis 7 Place the controller module on a stable flat surface Step 3 Replace the NVDIMM battery To replace the NVDIMM battery you must remove the failed battery from the controller module and install t...

Page 557: ...ign the battery module with the opening for the battery and then gently push the battery into slot until it locks into place 7 Plug the battery plug back into the controller module and then close the...

Page 558: ...ot already done so reinstall the cable management device e Interrupt the normal boot process and boot to LOADER by pressing Ctrl C If your system stops at the boot menu select the option to boot to LO...

Page 559: ...modify node local auto giveback true Step 7 Switch back aggregates in a two node MetroCluster configuration After you have completed the FRU replacement in a two node MetroCluster configuration you ca...

Page 560: ...finish you can check on the status of in progress baselines by using the metrocluster config replication resync status show command 6 Reestablish any SnapMirror or SnapVault configurations Step 8 Retu...

Page 561: ...message MAINT number_of_hours_downh The following AutoSupport message suppresses automatic case creation for two hours cluster1 system node autosupport invoke node type all message MAINT 2h 2 Disable...

Page 562: ...console of the healthy node storage failover modify node local auto giveback false 3 Take the impaired node to the LOADER prompt If the impaired node is displaying Then The LOADER prompt Go to the nex...

Page 563: ...If you are unable to resolve the issue contact technical support 3 Resynchronize the data aggregates by running the metrocluster heal phase aggregates command from the surviving cluster controller_A_...

Page 564: ...meter the system overrides any soft vetoes that prevent the healing operation 7 Verify that the heal operation is complete by using the metrocluster operation show command on the destination cluster m...

Page 565: ...h latches downward at the same time The controller module moves slightly out of the chassis 6 Slide the controller module out of the chassis Make sure that you support the bottom of the controller mod...

Page 566: ...tion illustration or the written steps to replace the NVDIMM The animation shows empty slots for sockets without DIMMs These empty sockets are populated with blanks Replacing the NVDIMM 1 Open the air...

Page 567: ...VDIMM squarely into the slot The NVDIMM fits tightly in the slot but should go in easily If not realign the NVDIMM with the slot and reinsert it Visually inspect the NVDIMM to verify that it is evenly...

Page 568: ...by rotating the locking latches upward tilting them so that they clear the locking pins gently push the controller all the way in and then lower the locking latches into the locked position The contro...

Page 569: ...le and then reenable automatic giveback 1 Recable the system as needed If you removed the media converters QSFPs or SFPs remember to reinstall them if you are using fiber optic cables 2 Return the nod...

Page 570: ...urviving cluster 5 Verify that the switchback operation has completed metrocluster show The switchback operation is still running when a cluster is in the waiting for switchback state cluster_B metroc...

Page 571: ...ge system hardware configuration Option 1 Most configurations To shut down the impaired node you must determine the status of the node and if necessary take over the node so that the healthy node cont...

Page 572: ...a healthy node shows false for eligibility and health you must correct the issue before shutting down the impaired node see the Administration overview with the CLI If you have a MetroCluster configur...

Page 573: ...the CLI You must leave the power supplies turned on at the end of this procedure to provide power to the healthy node Steps 1 Check the MetroCluster status to determine whether the impaired node has a...

Page 574: ...ck the state of the aggregates by using the storage aggregate show command controller_A_1 storage aggregate show Aggregate Size Available Used State Vols Nodes RAID Status aggr_b2 227 1GB 227 1GB 0 on...

Page 575: ...ration or the written steps to remove the controller module from the chassis Removing the controller module 1 If you are not already grounded properly ground yourself 2 Release the power cable retaine...

Page 576: ...rd you must locate the failed PCIe card remove the riser that contains the card from the controller module replace the card and then reinstall the PCIe riser in the controller module You can use the f...

Page 577: ...seating it in the socket The PCIe card must be fully and evenly seated in the slot If you are installing a card in the bottom slot and cannot see the card socket well remove the top card so that you...

Page 578: ...r module d Lift the riser up and then set it aside on a stable flat surface 2 Replace the mezzanine card a Remove any QSFP or SFP modules from the card b Loosen the thumbscrews on the mezzanine card a...

Page 579: ...opening in the chassis and then gently push the controller module halfway into the system Do not completely insert the controller module in the chassis until instructed to do so 3 Recable the system...

Page 580: ...d reenable it storage failover modify node local auto giveback true Step 6 Restore the controller module to operation To restore the controller you must recable the system give back the controller mod...

Page 581: ...urviving cluster 5 Verify that the switchback operation has completed metrocluster show The switchback operation is still running when a cluster is in the waiting for switchback state cluster_B metroc...

Page 582: ...unplugging the power cable removing the old PSU and installing the replacement PSU and then reconnecting the replacement PSU to the power source The power supplies are redundant and hot swappable Thi...

Page 583: ...wer supply cabling a Reconnect the power cable to the power supply and the power source b Secure the power cable to the power supply using the power cable retainer Once power is restored to the power...

Page 584: ...to the next step Waiting for giveback Press Ctrl C and then respond y when prompted System prompt or password prompt enter system password Take over or halt the impaired node For an HA pair take over...

Page 585: ...failover takeover ofnode impaired_node_name When the impaired node shows Waiting for giveback press Ctrl C and then respond y Option 3 Controller is in a two node MetroCluster To shut down the impaire...

Page 586: ...is successful If the healing is vetoed you have the option of reissuing the metrocluster heal command with the override vetoes parameter If you use this optional parameter the system overrides any sof...

Page 587: ...using the metrocluster operation show command on the destination cluster mcc1A metrocluster operation show Operation heal root aggregates State successful Start Time 7 29 2016 20 54 41 End Time 7 29 2...

Page 588: ...oller module and set it aside 5 Press down on both of the locking latches and then rotate both latches downward at the same time The controller module moves slightly out of the chassis 6 Slide the con...

Page 589: ...ery away from the holder rotate it away from the holder and then lift it out of the holder Note the polarity of the battery as you remove it from the holder The battery is marked with a plus sign and...

Page 590: ...ing in the chassis and then gently push the controller module halfway into the system Do not completely insert the controller module in the chassis until instructed to do so 3 Recable the system as ne...

Page 591: ...m dd yyyy command d If necessary set the time in GMT using the set time hh mm ss command e Confirm the date and time on the target node 7 At the LOADER prompt enter bye to reinitialize the PCIe cards...

Page 592: ...urviving cluster 5 Verify that the switchback operation has completed metrocluster show The switchback operation is still running when a cluster is in the waiting for switchback state cluster_B metroc...

Page 593: ...failed part to NetApp as described in the RMA instructions shipped with the kit Contact technical support at NetApp Support 888 463 8277 North America 00 800 44 638277 Europe or 800 800 80 800 Asia Pa...

Page 594: ...ps AFF A700 and FAS9000 This guide gives graphic instructions for a typical installation of your system from racking and cabling through initial system bring up Use this guide if you are familiar with...

Page 595: ...in You need to have access to the Hardware Universe for information about site requirements as well as additional information on your configured system You might also want to have access to the Releas...

Page 596: ...etwork cables order dependent X6553 R6 112 00188 2m X6536 R6 112 00090 5m FC host network Cat 6 RJ 45 order dependent Part numbers X6585 R6 112 00291 3m X6562 R6 112 00196 5m Management network and Et...

Page 597: ...ntrollers to your network You can cable the controllers to your network by using the two node switchless cluster method or by using the cluster interconnect network Option 1 Two node switchless cluste...

Page 598: ...drive shelves for drive shelf cabling instructions Option 2 Switched cluster Management network data network and management ports on the controllers are connected to switches The cluster interconnect...

Page 599: ...abling instructions Step 4 Cable controllers to drive shelves You can cable your new system to DS212C DS224C or NS224 shelves depending on if it is an AFF or FAS system Option 1 Cable the controllers...

Page 600: ...able your drive shelves to your controllers The examples use DS224C shelves Cabling is similar with other supported SAS drive shelves Cabling SAS shelves in FAS9000 AFF A700 and ASA AFF A700 ONTAP 9 7...

Page 601: ...Cabling SAS shelves in FAS9000 AFF A700 and ASA AFF A700 ONTAP 9 8 and later Cabling SAS storage ONTAP 9 8 and later 598...

Page 602: ...If you have more than one drive shelf stack see the Installation and Cabling Guide for your drive shelf type Install and cable shelves for a new system installation shelves with IOM12 modules 599...

Page 603: ...rs to a single NS224 drive shelf in AFF A700 and ASA AFF A700 systems running ONTAP 9 8 and later only You must cable each controller to the NSM modules on the NS224 drive shelf on an AFF A700 or ASA...

Page 604: ...storage modules are up while the pull tabs on the shelves are down As you insert the connector you should feel it click into place if you do not feel it click remove it turn it around and try again St...

Page 605: ...602...

Page 606: ...the NSM modules on the NS224 drive shelves on an AFF A700 or ASA AFF A700 running system ONTAP 9 8 or later This task applies to AFF A700 and ASA AFF A700 running ONTAP 9 8 or later only The systems m...

Page 607: ...it click into place if you do not feel it click remove it turn it around and try again Steps 1 Use the following animation or illustrations to cable your controllers to two NS224 drive shelves Cablin...

Page 608: ...ing cluster discovery with only a connection to the switch and laptop or by connecting directly to a controller in the system and then connecting to the management switch Option 1 Completing system se...

Page 609: ...rollers Initial booting may take up to eight minutes 4 Make sure that your laptop has network discovery enabled See your laptop s online help for more information 5 Use the following animation to conn...

Page 610: ...TAP Option 2 Completing system setup and configuration if network discovery is not enabled If network discovery is not enabled on your laptop you must complete the configuration and setup using this t...

Page 611: ...a Open a console session using PuTTY a terminal server or the equivalent for your environment Check your laptop or console s online help if you do not know how to configure PuTTY b Enter the manageme...

Page 612: ...requires two reboots You must replace the failed component with a replacement FRU component you received from your provider It is important that you apply the commands in these steps on the correct n...

Page 613: ...on systems running ONTAP 9 5 and earlier Before shutting down the impaired node you need to check whether the system has either NetApp Volume Encryption NVE or NetApp Storage Encryption NSE enabled If...

Page 614: ...n to a separate file or your log file You ll need it in disaster scenarios where you might need to manually recover OKM Return to admin mode set priv admin Shut down the impaired node b If the Restore...

Page 615: ...anager key show detail a If the Restored column displays yes manually backup the onboard key management information Go to advanced privilege mode and enter y when prompted to continue set priv advance...

Page 616: ...ion 1 Display the key IDs of the authentication keys that are stored on the key management servers security key manager query If the Key Manager type displays external and the Restored column displays...

Page 617: ...ment backup information security key manager onboard show backup f Copy the contents of the backup information to a separate file or your log file You ll need it in disaster scenarios where you might...

Page 618: ...ty key manager sync command security key manager onboard sync Enter the customer s onboard key management passphrase at the prompt If the passphrase cannot be provided contact NetApp Support mysupport...

Page 619: ...if necessary take over the node so that the healthy node continues to serve data from the impaired node storage If you have a cluster with more than two nodes it must be in quorum If the cluster is no...

Page 620: ...If you have a cluster with more than two nodes it must be in quorum If the cluster is not in quorum or a healthy node shows false for eligibility and health you must correct the issue before shutting...

Page 621: ...nd transfer the boot image to the boot media AFF A700 and FAS9000 To replace the boot media you must remove the impaired controller module install the replacement boot media and transfer the boot imag...

Page 622: ...oller module out of the chassis Make sure that you support the bottom of the controller module as you slide it out of the chassis 5 Place the controller module lid side up on a stable flat surface pre...

Page 623: ...Controller module cover locking button Step 2 Replace the boot media Locate the boot media using the following illustration or the FRU map on the controller module 1 2 620...

Page 624: ...lled on it However you must restore the var file system during this procedure You must have a USB flash drive formatted to FAT32 with at least 4GB capacity A copy of the same image version of ONTAP as...

Page 625: ...init boot_clustered partner sysid bootarg init flash_optimized for AFF C190 AFF A220 All Flash FAS bootarg init san_optimized for AFF A220 and All SAN Array bootarg init switchless_cluster enable b I...

Page 626: ...configuration a Boot to Maintenance mode boot_ontap maint b Set the MetroCluster ports as initiators ucadmin modify m fc t initiator adapter_name c Halt to return to Maintenance mode halt The changes...

Page 627: ...ress impaired_node_IP_address d Return the node to admin level set privilege admin e Press y when prompted to use the restored configuration f Press y when prompted to reboot the node No network conne...

Page 628: ...ssion state is changed to Connected for the target iSCSI target type dr_auxiliary address ip address date and time node name iscsi session stateChanged notice iSCSI session state is changed to Connect...

Page 629: ...ilover modify node local auto giveback true command Option 2 Boot the recovery image in a two node MetroCluster configuration You must boot the ONTAP image from the USB drive and verify the environmen...

Page 630: ...y applies to two node MetroCluster configurations Steps 1 Verify that all nodes are in the enabled state metrocluster node show cluster_B metrocluster node show DR Configuration DR Group Cluster Node...

Page 631: ...specific to systems that have Onboard Key Manager OKM NetApp Storage Encryption NSE or NetApp Volume Encryption NVE enabled Determine which section you should use to restore your OKM NSE or NVE config...

Page 632: ...security key manager onboard show backup command Example of backup data BEGIN BACKUP TmV0QXBwIEtleSBCbG9iAAEAAAAEAAAAcAEAAAAAAADuD byAAAAACEAAAAAAAAA QAAAAAAAAABvOlH0AAAAAMh7qDLRyH1DBz12piVdy9ATSFMT0...

Page 633: ...d a Start the wizard using the security key manager setup nodenodename command and then enter the passphrase for onboard key management when prompted b Enter the key manager key show detail command to...

Page 634: ...tner node and give back the target node storage using the storage failover giveback fromnode local only cfo aggregates true local command If the command fails because of a failed disk physically dis e...

Page 635: ...anagers report in an available state 11 If the Onboard Key Management is enabled a Use the security key manager key show detail to see a detailed view of all keys stored in the onboard key manager b U...

Page 636: ...logical interfaces that are not on their home node and port If any interfaces are listed as false revert those interfaces back to their home port using the net int revert command 7 Move the console ca...

Page 637: ...lling NS224 drive shelves in an AFF A700 system Before you begin You must replace the failed component with a replacement FRU component you received from your provider For instructions about hot swapp...

Page 638: ...espond y Option 2 Controller is in a MetroCluster Do not use this procedure if your system is in a two node MetroCluster configuration To shut down the impaired node you must determine the status of t...

Page 639: ...status of the node and if necessary switch over the node so that the healthy node continues to serve data from the impaired node storage About this task If you are using NetApp Storage Encryption you...

Page 640: ...verride vetoes parameter If you use this optional parameter the system overrides any soft vetoes that prevent the healing operation 4 Verify that the operation has been completed by using the metroclu...

Page 641: ...ocate it on the rear of the system on slot 6 and then follow the specific sequence of steps to replace it Before you begin Your storage system must meet certain criteria depending on your situation It...

Page 642: ...m handle straight toward you to remove the caching module from the NVRAM10 module Be sure to support the caching module as you remove it from the NVRAM10 module 4 Install the caching module a Align th...

Page 643: ...before adding or replacing the code dump module You must have received two X9170 core dump modules one for each controller All other components in the storage system must be functioning properly if n...

Page 644: ...VRAM10 module c Gently push the core dump module into the bay until the cam handle engages d Rotate the cam handle until it locks into place Step 4 Reboot the controller after FRU replacement After yo...

Page 645: ...urviving cluster 5 Verify that the switchback operation has completed metrocluster show The switchback operation is still running when a cluster is in the waiting for switchback state cluster_B metroc...

Page 646: ...for the caching module you are installing It must support the caching capacity The replacement caching module must have the same capacity as the failed caching module but can be from a different suppo...

Page 647: ...system node run local sysconfig av 6 ii In admin privilege level prepare the target NVMe slot for removal responding y when prompted whether to continue system controller slot module remove node node...

Page 648: ...handle straight toward you to remove the caching module from the NVRAM10 module Be sure to support the caching module as you remove it from the NVRAM10 module 5 Install the caching module a Align the...

Page 649: ...pped with the kit Contact technical support at NetApp Support 888 463 8277 North America 00 800 44 638277 Europe or 800 800 80 800 Asia Pacific if you need the RMA number or additional help with the r...

Page 650: ...ss failure To ensure continuity of service use the storage failover takeover command Are you sure you want to halt node node_name y n You must perform a clean system shutdown before replacing the chas...

Page 651: ...d the switchover was vetoed Review the veto messages and if possible resolve the issue and try again If you are unable to resolve the issue contact technical support 3 Resynchronize the data aggregate...

Page 652: ...on the destination cluster mcc1A metrocluster operation show Operation heal root aggregates State successful Start Time 7 29 2016 20 54 41 End Time 7 29 2016 20 54 42 Errors 8 On the impaired control...

Page 653: ...e bezel if necessary with two hands by grasping the openings on each side of the bezel and then pulling it toward you until the bezel releases from the ball studs on the chassis frame 2 Press the oran...

Page 654: ...p 3 Remove the controller module To replace the chassis you must remove the controller module or modules from the old chassis Steps 1 Unplug the cables from the impaired controller module and keep tra...

Page 655: ...upport the bottom of the controller module as you slide it out of the chassis 4 Set the controller module aside in a safe place and repeat these steps if you have another controller module in the chas...

Page 656: ...chassis b Rotate the cam latch down until it is in a horizontal position The I O module disengages from the chassis and moves about 1 2 inch out of the I O slot c Remove the I O module from the chass...

Page 657: ...t Steps You must remove the existing chassis from the equipment rack or system cabinet before you can install the replacement chassis 1 Remove the screws from the chassis mount points If the system is...

Page 658: ...push the module all the way into the chassis until it clicks into place Step 8 Install the de stage controller power module when replacing the chassis Steps Once the replacement chassis is installed i...

Page 659: ...he power supplies into the replacement chassis and connecting to the power source 1 Using both hands support and align the edges of the power supply with the opening in the system chassis and then gen...

Page 660: ...when you see the message Press Ctrl C for Boot Menu If you miss the prompt and the controller modules boot to ONTAP enter halt and then at the LOADER prompt enter boot_ontap press Ctrl C when prompted...

Page 661: ...ation Both controllers must be in Maintenance mode to run the interconnect test 3 At the LOADER prompt access the special drivers specifically designed for system level diagnostics to function properl...

Page 662: ...following command on both controllers at the LOADER prompt bye e Return the node to normal operation With two nodes in the cluster Issue these commands node cluster ha modify configured true node sto...

Page 663: ...roCluster configuration you can perform the MetroCluster switchback operation This returns the configuration to its normal operating state with the sync source storage virtual machines SVMs on the for...

Page 664: ...rocluster config replication resync status show command 6 Reestablish any SnapMirror or SnapVault configurations Step 4 Return the failed part to NetApp After you replace the part you can return the f...

Page 665: ...hat is being replaced The replacement node is the new node that is replacing the impaired node The healthy node is the surviving node You must always capture the node s console output to a text file T...

Page 666: ...luster with more than two nodes it must be in quorum If the cluster is not in quorum or a healthy node shows false for eligibility and health you must correct the issue before shutting down the impair...

Page 667: ...of Administration overview with the CLI You must leave the power supplies turned on at the end of this procedure to provide power to the healthy node Steps 1 Check the MetroCluster status to determin...

Page 668: ...ck the state of the aggregates by using the storage aggregate show command controller_A_1 storage aggregate show Aggregate Size Available Used State Vols Nodes RAID Status aggr_b2 227 1GB 227 1GB 0 on...

Page 669: ...o the replacement controller module install the replacement controller module in the chassis and then boot the system to Maintenance mode Step 1 Open the controller module To access components inside...

Page 670: ...oller module out of the chassis Make sure that you support the bottom of the controller module as you slide it out of the chassis 2 Place the controller module lid side up on a stable flat surface pre...

Page 671: ...boot media and follow the directions to remove it from the old controller and insert it in the new controller Steps 1 Lift the black air duct at the back of the controller module and then locate the b...

Page 672: ...f the boot media with the socket housing and then gently push it into the socket 4 Check the boot media to make sure that it is seated squarely and completely in the socket If necessary remove the boo...

Page 673: ...slowly pushing apart the two DIMM ejector tabs on either side of the DIMM and then slide the DIMM out of the slot Carefully hold the DIMM by the edges to avoid pressure on the components on the DIMM...

Page 674: ...s Do not abort this process The procedure requires you to interrupt the boot process which you can typically do at any time after prompted to do so However if the system updates the system firmware wh...

Page 675: ...o not match you must reset them on the replacement controller module to prevent possible outages on clients due to time differences About this task It is important that you apply the commands in the s...

Page 676: ...2 At the LOADER prompt access the special drivers specifically designed for system level diagnostics to function properly boot_diags During the boot process you can safely respond y to the prompts unt...

Page 677: ...sts that you want to run sldiag device modify dev dev_name selection only selection only disables all other tests that you do not want to run for the device d Run the selected tests sldiag device run...

Page 678: ...nt to run for the device d Verify that the tests were modified sldiag device show e Repeat these substeps for each device that you want to run concurrently f Run diagnostics on all of the devices sldi...

Page 679: ...Boot the node from the LOADER prompt bye e Return the node to normal operation An HA pair Perform a give back storage failover giveback ofnode replacement_node_name If you disabled automatic giveback...

Page 680: ...erly installed in the storage system d Boot the controller module you are servicing interrupting the boot by pressing Ctrl C when prompted to get to the Boot menu If you have two controller modules in...

Page 681: ...mode showing the prompt exit Maintenance mode and go to the LOADER prompt halt 2 From the LOADER prompt on the replacement node boot the node entering y if you are prompted to override the system ID...

Page 682: ...etoes Find the High Availability Configuration Guide for your version of ONTAP 9 b After the giveback has been completed confirm that the HA pair is healthy and that takeover is possible storage failo...

Page 683: ...te node1_siteA metrocluster node show fields configuration state dr group id cluster node configuration state 1 node1_siteA node1mcc 001 configured 1 node1_siteA node1mcc 002 configured 1 node1_siteB...

Page 684: ...on file If you fail to receive the email with the license keys within 30 days you should contact technical support Steps 1 Install each license key system license add license code license key license...

Page 685: ...sync source storage virtual machines SVMs on the formerly impaired site now active and serving data from the local disk pools This task only applies to two node MetroCluster configurations Steps 1 Ve...

Page 686: ...MA number or additional help with the replacement procedure Replace the de stage controller power module containing the NVRAM10 Battery AFF A700 and FAS9000 To hot swap a de stage controller power mod...

Page 687: ...chassis until it clicks into place The module and slot are keyed Do not force the module into the opening If the module does not go in easily realign the module and slide it into the chassis The DCPM...

Page 688: ...storage system hardware configuration Option 1 Most configurations To shut down the impaired node you must determine the status of the node and if necessary take over the node so that the healthy node...

Page 689: ...a healthy node shows false for eligibility and health you must correct the issue before shutting down the impaired node see the Administration overview with the CLI If you have a MetroCluster configur...

Page 690: ...the CLI You must leave the power supplies turned on at the end of this procedure to provide power to the healthy node Steps 1 Check the MetroCluster status to determine whether the impaired node has a...

Page 691: ...ck the state of the aggregates by using the storage aggregate show command controller_A_1 storage aggregate show Aggregate Size Available Used State Vols Nodes RAID Status aggr_b2 227 1GB 227 1GB 0 on...

Page 692: ...n the controller module To access components inside the controller you must first remove the controller module from the system and then remove the cover on the controller module Steps 1 If you are not...

Page 693: ...oller module out of the chassis Make sure that you support the bottom of the controller module as you slide it out of the chassis 5 Place the controller module lid side up on a stable flat surface pre...

Page 694: ...de the controller and follow the specific sequence of steps Steps 1 If you are not already grounded properly ground yourself 2 Locate the DIMMs on your controller module Each system memory DIMM has an...

Page 695: ...slot by slowly pushing apart the two DIMM ejector tabs on either side of the DIMM and then slide the DIMM out of the slot Carefully hold the DIMM by the edges to avoid pressure on the components on t...

Page 696: ...connector are in the open position and then insert the DIMM squarely into the slot The DIMM fits tightly in the slot but should go in easily If not realign the DIMM with the slot and reinsert it Visua...

Page 697: ...on of the controller module a If you have not already done so reinstall the cable management device b Firmly push the controller module into the chassis until it meets the midplane and is fully seated...

Page 698: ...ics on the system memory sldiag device run dev mem 4 Verify that no hardware problems resulted from the replacement of the DIMMs sldiag device status dev mem long state failed System level diagnostics...

Page 699: ...tomatic giveback re enable it with the storage failover modify command A two node MetroCluster configuration Proceed to the next step The MetroCluster switchback procedure is done in the next task in...

Page 700: ...the boot by pressing Ctrl C when prompted to get to the Boot menu If you have two controller modules in the chassis fully seat the controller module you are servicing in the chassis The controller mod...

Page 701: ...hback command from any node in the surviving cluster 5 Verify that the switchback operation has completed metrocluster show The switchback operation is still running when a cluster is in the waiting f...

Page 702: ...isrupted and the controller module or modules shut down after two minutes to avoid overheating Steps 1 If you are not already grounded properly ground yourself 2 Remove the bezel if necessary with two...

Page 703: ...you replace the part you can return the failed part to NetApp as described in the RMA instructions shipped with the kit Contact technical support at NetApp Support 888 463 8277 North America 00 800 44...

Page 704: ...message MAINT number_of_hours_downh The following AutoSupport message suppresses automatic case creation for two hours cluster1 system node autosupport invoke node type all message MAINT 2h 2 Disable...

Page 705: ...console of the healthy node storage failover modify node local auto giveback false 3 Take the impaired node to the LOADER prompt If the impaired node is displaying Then The LOADER prompt Go to the nex...

Page 706: ...If you are unable to resolve the issue contact technical support 3 Resynchronize the data aggregates by running the metrocluster heal phase aggregates command from the surviving cluster controller_A_...

Page 707: ...fy that the heal operation is complete by using the metrocluster operation show command on the destination cluster mcc1A metrocluster operation show Operation heal root aggregates State successful Sta...

Page 708: ...module aside 5 Install the replacement I O module into the chassis by gently sliding the I O module into the slot until the lettered and numbered I O cam latch begins to engage with the I O cam pin an...

Page 709: ...rage failover modify node local auto giveback true Step 4 Switch back aggregates in a two node MetroCluster configuration After you have completed the FRU replacement in a two node MetroCluster config...

Page 710: ...State Mode Local cluster_B configured normal Remote cluster_A configured normal If a switchback is taking a long time to finish you can check on the status of in progress baselines by using the metro...

Page 711: ...t is fully seated flush with the chassis There is an audible click when the module is secure and connected to the midplane Return the failed part to NetApp After you replace the part you can return th...

Page 712: ...with the NVRAM module that is being replaced This procedure uses the following terminology The impaired node is the node on which you are performing maintenance The healthy node is the HA partner of t...

Page 713: ...node autosupport invoke node type all message MAINT 2h 2 Disable automatic giveback from the console of the healthy node storage failover modify node local auto giveback false 3 Take the impaired nod...

Page 714: ...y node local auto giveback false 3 Take the impaired node to the LOADER prompt If the impaired node is displaying Then The LOADER prompt Go to the next step Waiting for giveback Press Ctrl C and then...

Page 715: ...ain If you are unable to resolve the issue contact technical support 3 Resynchronize the data aggregates by running the metrocluster heal phase aggregates command from the surviving cluster controller...

Page 716: ...parameter the system overrides any soft vetoes that prevent the healing operation 7 Verify that the heal operation is complete by using the metrocluster operation show command on the destination clus...

Page 717: ...into the front of the new NVRAM module d Gently push the FlashCache module all the way into the NVRAM module and then swing the cam handle closed until it locks the module in place 3 Remove the target...

Page 718: ...completely unlocked 4 Set the NVRAM module on a stable surface and remove the cover from the NVRAM module by pushing down on the blue locking button on the cover and then while holding down the blue...

Page 719: ...to engage with the I O cam pin and then push the I O cam latch all the way up to lock the module in place Step 3 Replace a NVRAM DIMM To replace NVRAM DIMMs in the NVRAM module you must remove the NVR...

Page 720: ...face Lettered and numbered I O cam latch I O latch completely unlocked 3 Set the NVRAM module on a stable surface and remove the cover from the NVRAM module by pushing down on the blue locking button...

Page 721: ...eplacement NVRAM module into the chassis a Align the module with the edges of the chassis opening in slot 6 b Gently slide the module into the slot until the lettered and numbered I O cam latch begins...

Page 722: ...reassign the disks Select one of the following options for instructions on how to reassign disks to the new controller 719...

Page 723: ...has been automatically assigned storage failover show In the command output you should see a message that the system ID has changed on the impaired node showing the correct old and new IDs In the foll...

Page 724: ...d on partner message 6 Verify that the disks were assigned correctly storage disk show ownership The disks belonging to the replacement node should show the new system ID In the following example the...

Page 725: ...1mcc 004 configured 4 entries were displayed 10 Verify that the expected volumes are present for each node vol show node node name 11 If you disabled automatic takeover on reboot enable it from the he...

Page 726: ...w the new system ID at the Maintenance mode prompt on the impaired node disk show In this example the new system ID is 118065481 Local System ID 118065481 4 Reassign disk ownership for FAS systems or...

Page 727: ...ocal node name partner savecore If the command output indicates that savecore is in progress wait for savecore to complete before issuing the giveback You can monitor the progress of the savecore usin...

Page 728: ...tions in the output to address any issues discovered 12 Simulate a switchover operation a From any node s prompt change to the advanced privilege level set privilege advanced You need to respond with...

Page 729: ...hot swappable This procedure is written for replacing one power supply at a time It is a best practice to replace the power supply within two minutes of removing it from the chassis The system continu...

Page 730: ...s restored to the power supply the status LED should be green 8 Turn on the power to the new power supply and then verify the operation of the power supply activity LEDs The green power LED lights whe...

Page 731: ...ing down the impaired node see the Administration overview with the CLI Steps 1 If AutoSupport is enabled suppress automatic case creation by invoking an AutoSupport message system node autosupport in...

Page 732: ...number_of_hours_downh The following AutoSupport message suppresses automatic case creation for two hours cluster1 system node autosupport invoke node type all message MAINT 2h 2 Disable automatic giv...

Page 733: ...d the switchover was vetoed Review the veto messages and if possible resolve the issue and try again If you are unable to resolve the issue contact technical support 3 Resynchronize the data aggregate...

Page 734: ...peration 7 Verify that the heal operation is complete by using the metrocluster operation show command on the destination cluster mcc1A metrocluster operation show Operation heal root aggregates State...

Page 735: ...oller module out of the chassis Make sure that you support the bottom of the controller module as you slide it out of the chassis 5 Place the controller module lid side up on a stable flat surface pre...

Page 736: ...ery To replace the RTC battery you must locate the failed battery in the controller module remove it from the holder and then install the replacement battery in the holder Steps 1 If you are not alrea...

Page 737: ...ntistatic shipping bag 5 Locate the empty battery holder in the controller module 6 Note the polarity of the RTC battery and then insert it into the holder by tilting the battery at an angle and pushi...

Page 738: ...plies and to the power sources and then turn on the power to start the boot process e Halt the controller at the LOADER prompt 6 Reset the time and date on the controller a Check the date and time on...

Page 739: ...by using the metrocluster switchback command from any node in the surviving cluster 5 Verify that the switchback operation has completed metrocluster show The switchback operation is still running whe...

Page 740: ...er Make sure that all other components are functioning properly Add an X91148A module in an AFF A700 with open slots AFF A700 and FAS9000 You can add an X91148A module into an empty module slot in you...

Page 741: ...ule with the edges of the slot b Slide the X91148A module into the slot until the lettered and numbered I O cam latch begins to engage with the I O cam pin c Push the I O cam latch all the way up to l...

Page 742: ...8A storage module in a system with no open slots AFF A700 and FAS9000 You must remove one more or more existing NIC or storage modules in your system in order to install one or more X91148A storage mo...

Page 743: ...over modify node local auto giveback false b Take over the target node storage failover takeover ofnode target_node_name The console connection shows that the node drops to the LOADER prompt when the...

Page 744: ...t the remove and install steps to replace additional modules for controller A 8 Cable the module or modules to the data switches 9 Reboot controller A boot_ontap 10 Giveback the node from the partner...

Page 745: ...atic giveback storage failover modify node local auto giveback false b Take over the target node storage failover takeover ofnode target_node_name The console connection shows that the node drops to t...

Page 746: ...the way up to lock the module in place d If you are installing a second X91148A module for storage repeat the remove and install steps for the module in slot 7 7 Reboot controller A boot_ontap 8 Give...

Page 747: ...stall and set up your new system The PDF poster provides step by step instructions with live links to additional content AFF A700s Installation and Setup Instructions Installation and setup video AFF...

Page 748: ...of HA configuration log in as admin on the healthy node If the impaired node is in a standalone configuration and at LOADER prompt contact NetApp Support mysupport netapp com 2 If AutoSupport is enab...

Page 749: ...ey managers display available it s safe to shut down the impaired node If the Restored column displays anything other than yes or if any key manager displays unavailable you need to complete some addi...

Page 750: ...scenarios where you might need to manually recover OKM Return to admin mode set priv admin You can safely shutdown the node Verifying NSE configuration Steps 1 Display the key IDs of the authenticati...

Page 751: ...anager key show detail Go to advanced privilege mode and enter y when prompted to continue set priv advanced Enter the command to backup the OKM information security key manager backup show Make sure...

Page 752: ...set priv advanced b Enter the command to display the key management information security key manager onboard show backup c Copy the contents of the backup information to a separate file or your log f...

Page 753: ...ed column displays anything other than yes you need to complete some additional steps If the Key Manager type displays external and the Restored column displays anything other than yes you need to com...

Page 754: ...ion to a separate file or your log file You ll need it in disaster scenarios where you might need to manually recover OKM g Return to admin mode set priv admin h You can safely shutdown the node Shut...

Page 755: ...ables to the cable management device and then unplug the system cables and SFPs if needed from the controller module keeping track of where the cables were connected Leave the cables in the cable mana...

Page 756: ...t toward the fan modules and then rotate it upward to its completely open position Air duct locking tabs Risers Air duct Step 2 Replace the boot media AFF A700s You must locate the failed boot media i...

Page 757: ...ler module a Using a 1 Phillips head screwdriver remove the screw holding down the boot media and set the screw aside in a safe place b Grasping the sides of the boot media gently rotate the boot medi...

Page 758: ...er files to the boot media using backup recovery from the second boot media You can install the system image to the replacement boot media using the image on second boot media installed in the control...

Page 759: ...ule all the way into the system until the controller module locking hooks begin to rise firmly push on the locking hooks to finish seating the controller module and then swing the locking hooks into t...

Page 760: ...lash drive This procedure should only be used if the secondary boot media restore failed or if the image tgz file is not found on the secondary boot media You must have a USB flash drive formatted to...

Page 761: ...e controller module Make sure that you install the USB flash drive in the slot labeled for USB devices and not in the USB console port 7 Gently push the controller module all the way into the system u...

Page 762: ...rg storageencryption support value bootarg keymanager support value bootarg onboard_keymanager value d Save the environment variables you changed with the savenv command e Confirm your changes using t...

Page 763: ...e perform a giveback from the healthy node If your system is in Then An HA pair After the impaired node is displaying the Waiting for giveback message perform a giveback from the healthy node a From t...

Page 764: ...node No network connection a Press n when prompted to restore the backup configuration b Reboot the system when prompted by the system c Select the Update flash from backup config sync flash option f...

Page 765: ...eded AFF A700s Once environment variables are checked you must complete steps specific to systems that have Onboard Key Manager OKM NetApp Storage Encryption NSE or NetApp Volume Encryption NVE enable...

Page 766: ...security key manager onboard show backup command Example of backup data BEGIN BACKUP TmV0QXBwIEtleSBCbG9iAAEAAAAEAAAAcAEAAAAAAADuD byAAAAACEAAAAAAAAA QAAAAAAAAABvOlH0AAAAAMh7qDLRyH1DBz12piVdy9ATSFMT0...

Page 767: ...d a Start the wizard using the security key manager setup nodenodename command and then enter the passphrase for onboard key management when prompted b Enter the key manager key show detail command to...

Page 768: ...tner node and give back the target node storage using the storage failover giveback fromnode local only cfo aggregates true local command If the command fails because of a failed disk physically dis e...

Page 769: ...anagers report in an available state 11 If the Onboard Key Management is enabled a Use the security key manager key show detail to see a detailed view of all keys stored in the onboard key manager b U...

Page 770: ...logical interfaces that are not on their home node and port If any interfaces are listed as false revert those interfaces back to their home port using the net int revert command 7 Move the console ca...

Page 771: ...upport You can use this procedure with all versions of ONTAP supported by your system This procedure is written with the assumption that you are moving the SSDs and controller modules to the new chass...

Page 772: ...f repeated attempts to cleanly shut down the node fail be aware that you might lose any data that was not saved to disk 3 Where applicable halt the second node to avoid a possible quorum error message...

Page 773: ...o the new chassis You need to move the drives from each bay opening in the old chassis to the same bay opening in the new chassis 1 Gently remove the bezel from the front of the system 2 Remove the dr...

Page 774: ...ent chassis into the equipment rack or system cabinet by guiding the chassis onto the rack rails in a system cabinet or equipment rack 5 Slide the chassis all the way into the equipment rack or system...

Page 775: ...g steps to install the second controller into the new chassis Complete the restoration and replacement process AFF A700s Step 1 Verify and set the HA state of the chassis You must verify the HA state...

Page 776: ...he RMA number or additional help with the replacement procedure Controller Replace the controller module AFF A700s You must review the prerequisites for the replacement procedure and select the correc...

Page 777: ...tic case creation by invoking an AutoSupport message system node autosupport invoke node type all message MAINT number_of_hours_downh The following AutoSupport message suppresses automatic case creati...

Page 778: ...f needed from the controller module keeping track of where the cables were connected Leave the cables in the cable management device so that when you reinstall the cable management device the cables a...

Page 779: ...rd from Riser 1 in the impaired controller module and install the card into Riser 1 of the replacement controller module You should only reinstall Riser 1 into the replacement controller module after...

Page 780: ...le that is attached to the NVRAM card c Press the locking bracket on the side of the NVRAM riser and then rotate it to the open position d Remove the NVRAM card from the riser module 3 Remove the NVRA...

Page 781: ...ler module You will install the riser modules into the replacement controller module once the DIMMs have been moved to the replacement controller module 1 Remove the PCIe riser from the controller mod...

Page 782: ...nd squarely seated into the riser socket b Swing the locking latch into place until it clicks into the locked position 5 Repeat the preceding steps for Riser 3 and PCIe cards in slots 4 and 5 in the i...

Page 783: ...then pull the boot media straight out of the socket and set it aside 3 Move the boot media to the new controller module and install it Install the boot media into the same socket in the replacement co...

Page 784: ...de of the fan module and then lifting the fan module straight out of the controller module Fan locking tabs Fan module 2 Move the fan module to the replacement controller module and then install the f...

Page 785: ...slot Carefully hold the DIMM by the edges to avoid pressure on the components on the DIMM circuit board 4 Locate the slot where you are installing the DIMM 5 Make sure that the DIMM ejector tabs on th...

Page 786: ...he riser and the riser sits squarely in the controller module d Reinsert any SFP modules that were removed from the PCIe cards Step 8 Move the NVRAM battery When replacing the controller module you mu...

Page 787: ...ller module and then lower the riser into the controller module c Swing the locking latch down and click it into the locked position When locked the locking latch is flush with the top of the riser an...

Page 788: ...e system 5 Remove the PSU blanking panel from the impaired controller module and then install it in the replacement controller module Step 11 Install the controller module After all the components hav...

Page 789: ...the cables to the controller module later in this procedure 5 Plug the power cord into the power supply reinstall the power cable locking collar and then connect the power supply to the power source...

Page 790: ...e time server in a stand alone configuration If the time and date do not match you must reset them on the replacement controller module to prevent possible outages on clients due to time differences A...

Page 791: ...l commands in the diagnostic procedures are issued from the node where the component is being replaced 1 If the node to be serviced is not at the LOADER prompt reboot the node system node halt node no...

Page 792: ...put from Config Advisor Step 2 Reassign disks If the storage system is in an HA pair the system ID of the new controller module is automatically assigned to the disks when the giveback occurs at the e...

Page 793: ...level set privilege admin 5 Give back the node a From the healthy node give back the replaced node s storage storage failover giveback ofnode replacement_node_name the replacement node takes back its...

Page 794: ...are allowed Also using unlicensed features on the node might put you out of compliance with your license agreement so you should install the replacement license key or keys on the replacement node as...

Page 795: ...l number of the replacement node if AutoSupport is enabled and reset automatic giveback 1 Verify that the logical interfaces are reporting to their home server and ports network interface show is home...

Page 796: ...he impaired node to the LOADER prompt If the impaired node is displaying Then The LOADER prompt Go to the next step Waiting for giveback Press Ctrl C and then respond y System prompt or password promp...

Page 797: ...h Locking pin 6 Slide the controller module out of the chassis Make sure that you support the bottom of the controller module as you slide it out of the chassis 7 Place the controller module on a stab...

Page 798: ...it in the controller module using the DIMM map on the inside of the controller module or locating it using the LED next to the DIMM and then replace it following the specific sequence of steps 1 If y...

Page 799: ...Note the orientation of the DIMM in the socket so that you can insert the replacement DIMM in the proper orientation 4 Eject the DIMM from its slot by slowly pushing apart the two DIMM ejector tabs on...

Page 800: ...nd yourself 2 Align the end of the controller module with the opening in the chassis and then gently push the controller module halfway into the system Do not completely insert the controller module i...

Page 801: ...layed menu 5 Proceed based on the result of the preceding step If the test failed correct the failure and then rerun the test If the test reported no failures select Reboot from the menu to reboot the...

Page 802: ...impaired_node_name When the impaired node shows Waiting for giveback press Ctrl C and then respond y Remove the controller module AFF A700s You must remove the controller module from the chassis when...

Page 803: ...module as you slide it out of the chassis 7 Place the controller module on a stable flat surface and then open the air duct a Press in the locking tabs on the sides of the air duct toward the middle...

Page 804: ...re not already grounded properly ground yourself 2 Identify the fan module that you must replace by checking the console error messages or by locating the lit LED for the fan module on the motherboard...

Page 805: ...ter you replace a component within the controller module you must reinstall the controller module in the system chassis and boot it 1 If you are not already grounded properly ground yourself 2 If you...

Page 806: ...cord into the power supply reinstall the power cable locking collar and then connect the power supply to the power source 6 Complete the reinstallation of the controller module a If you have not alrea...

Page 807: ...tery AFF A700s To replace an NVRAM battery in the system you must remove the controller module from the system remove the battery replace the battery and then reinstall the controller module All other...

Page 808: ...ntroller module or replace a component inside the controller module 1 If you are not already grounded properly ground yourself 2 Unplug the controller module power supply from the source and then unpl...

Page 809: ...Set the controller module aside in a safe place Replace the NVRAM battery To replace the NVRAM battery you must remove the failed NVRAM battery from the controller module and install the replacement N...

Page 810: ...the side wall hook into the slots on the battery pack and the battery pack latch engages and locks into place 7 Plug the battery plug into the riser socket and make sure that the plug locks into plac...

Page 811: ...cord into the power supply reinstall the power cable locking collar and then connect the power supply to the power source 6 Complete the reinstallation of the controller module a If you have not alrea...

Page 812: ...DIMMs AFF A700s To replace a failed NVRAM card you must remove the NVRAM riser Riser 1 from the controller module remove the failed card from the riser install the new NVRAM card in the riser and the...

Page 813: ...er modify node local auto giveback false 3 Take the impaired node to the LOADER prompt If the impaired node is displaying Then The LOADER prompt Go to the next step Waiting for giveback Press Ctrl C a...

Page 814: ...side 5 Press down on both of the locking latches and then rotate both latches downward at the same time The controller module moves slightly out of the chassis Locking latch Locking pin 6 Slide the co...

Page 815: ...le 1 If you are not already grounded properly ground yourself 2 Remove the NVRAM riser Riser 1 from the controller module a Rotate the riser locking latch on the left side of the riser up and toward t...

Page 816: ...NVRAM card c Press the locking bracket on the side of the NVRAM riser and then rotate it to the open position d Remove the NVRAM card from the riser module 4 Install the NVRAM card into the NVRAM rise...

Page 817: ...controller module with the opening in the chassis and then gently push the controller module halfway into the system Do not completely insert the controller module in the chassis until instructed to...

Page 818: ...nd output you should see a message that the system ID has changed on the impaired node showing the correct old and new IDs In the following example node2 has undergone replacement and has a new system...

Page 819: ...e should show the new system ID In the following example the disks owned by node1 now show the new system ID 1873775277 node1 storage disk show ownership Disk Aggregate Home Owner DR Home Home ID Owne...

Page 820: ...ted by your system All other components in the system must be functioning properly if not you must contact technical support Step 1 Shut down the impaired controller To shut down the impaired node you...

Page 821: ...onent inside the controller module 1 If you are not already grounded properly ground yourself 2 Loosen the hook and loop strap binding the cables to the cable management device and then unplug the sys...

Page 822: ...module as you slide it out of the chassis 7 Place the controller module on a stable flat surface and then open the air duct a Press in the locking tabs on the sides of the air duct toward the middle...

Page 823: ...grounded properly ground yourself 2 Remove the PCIe riser from the controller module a Remove any SFP modules that might be in the PCIe cards b Rotate the module locking latch on the left side of the...

Page 824: ...the same slot in PCIe riser a Align the card with the card guide on the riser and the card socket in the riser and then slide it squarely into the socket in the riser Make sure that the card is compl...

Page 825: ...tall the controller module in the system chassis and boot it 1 If you are not already grounded properly ground yourself 2 If you have not already done so close the air duct a Swing the air duct all th...

Page 826: ...f your system is configured to support 10 GbE cluster interconnect and data connections on 40 GbE NICs or onboard ports convert these ports to 10 GbE connections by using the nicadmin convert command...

Page 827: ...d yourself 2 Identify the power supply you want to replace based on console error messages or through the LEDs on the power supplies 3 Disconnect the power supply a Open the power cable retainer and t...

Page 828: ...AFF A700s You replace the real time clock RTC battery in the controller module so that your system s services and applications that depend on accurate time synchronization continue to function You can...

Page 829: ...ntroller module or replace a component inside the controller module 1 If you are not already grounded properly ground yourself 2 Loosen the hook and loop strap binding the cables to the cable manageme...

Page 830: ...module as you slide it out of the chassis 7 Place the controller module on a stable flat surface and then open the air duct a Press in the locking tabs on the sides of the air duct toward the middle...

Page 831: ...ers Air duct Replace the RTC battery To replace the RTC battery locate it inside the controller and follow the specific sequence of steps 1 If you are not already grounded properly ground yourself 2 L...

Page 832: ...nd pushing down 6 Visually inspect the battery to make sure that it is completely installed into the holder and that the polarity is correct Reinstall the controller module and setting time date after...

Page 833: ...te command b At the LOADER prompt on the target node check the time and date c If necessary modify the date with the set date mm dd yyyy command d If necessary set the time in GMT using the set time h...

Page 834: ...rom racking and cabling through initial system bring up Use this guide if you are familiar with installing NetApp systems Access the Installation and Setup Instructions PDF poster AFF A800 Systems Ins...

Page 835: ...this system NetApp Hardware Universe Find the Release Notes for your version of ONTAP 9 You need to provide the following at your site Rack space for the storage system Phillips 2 screwdriver Addition...

Page 836: ...nagement Fibre Channel X66250 2 112 00342 2m X66250 5 112 00344 5m X66250 15 112 00346 15m X66250 30 112 00347 30m Micro USB console cable Not applicable Console connection during software setup Power...

Page 837: ...s cabling is not exclusive you can have cable to a host network and storage Required cabling Cable controllers to a cluster Cable the controllers to a cluster by using the two node switchless cluster...

Page 838: ...y again 1 Use the animation or the step by step instructions to complete the cabling between the controllers and to the switches Cabling a two node switchless cluster Step Perform on each controller m...

Page 839: ...d configuration Option 2 Cable a switched cluster Cluster interconnect and management network ports on the controllers are connected to switches while the HA interconnect ports are cabled on both cont...

Page 840: ...a switched cluster Step Perform on each controller module Cable the HA interconnect ports e0b to e0b e1b to e1b Cable the cluster interconnect ports to the 100 GbE cluster interconnect switches e0a e...

Page 841: ...mpleting system setup and configuration Optional cabling Cable configuration dependent options You have configuration dependent optional cabling to the Fibre Channel or iSCSI host networks or direct a...

Page 842: ...rect attached NS224 drive shelves 3 To complete setting up your system see Step4 Completing system setup and configuration Option 2 Cable to a 10GbE host network 10GbE ports on the controllers are con...

Page 843: ...tem setup and configuration Option 3 Cable the controllers to a single drive shelf You must cable each controller to the NSM modules on the NS224 drive shelf Be sure to check the illustration arrow fo...

Page 844: ...omplete setting up your system see Step4 Completing system setup and configuration Option 4 Cable the controllers to two drive shelves You must cable each controller to the NSM modules on both NS224 d...

Page 845: ...ot feel it click remove it turn it around and try again 1 Use the following animation or the written steps to cable your controllers to two drive shelves Cabling the controllers to two drive shelves S...

Page 846: ...and configuration if network discovery is enabled If you have network discovery enabled on your laptop you can complete system setup and configuration using automatic cluster discovery 1 Plug the powe...

Page 847: ...ial configuration go to the ONTAP ONTAP System Manager Documentation Resources page for information about configuring additional features in ONTAP Option 2 Complete system setup and configuration if n...

Page 848: ...take up to eight minutes 3 Assign an initial node management IP address to one of the nodes If the management network has DHCP Then Configured Record the IP address assigned to the new controllers No...

Page 849: ...king the status of the onboard encryption keys you must check the status of the impaired node disable automatic giveback and check what version of ONTAP the system is running If you have a cluster wit...

Page 850: ...the impaired node 2 Check whether NVE is configured for any volumes in the cluster volume show is encrypted true If any volumes are listed in the output NVE is configured and you need to verify the N...

Page 851: ...han yes Run the key manager setup wizard security key manager setup node target impaired node name Enter the customer s onboard key management passphrase at the prompt If the passphrase cannot be prov...

Page 852: ...kup information security key manager backup show Copy the contents of the backup information to a separate file or your log file You ll need it in disaster scenarios where you might need to manually r...

Page 853: ...s yes it s safe to shut down the impaired node If the Key Manager type displays onboard and the Restored column displays yes you need to complete some additional steps If the Key Manager type displays...

Page 854: ...o admin mode set priv admin h You can safely shutdown the node Verify NSE configuration 1 Display the key IDs of the authentication keys that are stored on the key management servers security key mana...

Page 855: ...mysupport netapp com b Verify the Restored column shows yes for all authentication keys security key manager key query c Verify that the Key Manager type shows onboard manually backup the OKM informa...

Page 856: ...ata from the impaired node storage If you have a cluster with more than two nodes it must be in quorum If the cluster is not in quorum or a healthy node shows false for eligibility and health you must...

Page 857: ...ller module from the chassis when you replace the controller module or replace a component inside the controller module 1 If you are not already grounded properly ground yourself 2 Unplug the controll...

Page 858: ...module as you slide it out of the chassis 8 Place the controller module on a stable flat surface and then open the air duct a Press in the locking tabs on the sides of the air duct toward the middle...

Page 859: ...Step 2 Replace the boot media You locate the failed boot media in the controller module by removing Riser 3 on the controller module before you can replace the boot media You need a Phillips head scr...

Page 860: ...boot media up and then pull the boot media straight out of the socket and set it aside 3 Install the replacement boot media into the controller module a Align the edges of the boot media with the sock...

Page 861: ...nd alone system you do not need a network connection but you must perform an additional reboot when restoring the var file system Steps 1 Download and copy the appropriate service image from the NetAp...

Page 862: ...all the way into the system until the controller module locking hooks begin to rise firmly push on the locking hooks to finish seating the controller module and then swing the locking hooks into the...

Page 863: ...targ values listed in the kenv ASUP output bootarg storageencryption support value bootarg keymanager support value bootarg onboard_keymanager value d Save the environment variables you changed with t...

Page 864: ...ress impaired_node_IP_address d Return the node to admin level set privilege admin e Press y when prompted to use the restored configuration f Press y when prompted to reboot the node No network conne...

Page 865: ...ssion state is changed to Connected for the target iSCSI target type dr_auxiliary address ip address date and time node name iscsi session stateChanged notice iSCSI session state is changed to Connect...

Page 866: ...he storage failover modify node local auto giveback true command Restore OKM NSE and NVE as needed AFF A800 Once environment variables are checked you must complete steps specific to systems that have...

Page 867: ...om either security key manager backup show or security key manager onboard show backup command Example of backup data BEGIN BACKUP TmV0QXBwIEtleSBCbG9iAAEAAAAEAAAAcAEAAAAAAADuD byAAAAACEAAAAAAAAA QAAA...

Page 868: ...run the key manager setup wizard a Start the wizard using the security key manager setup nodenodename command and then enter the passphrase for onboard key management when prompted b Enter the key ma...

Page 869: ...tner node and give back the target node storage using the storage failover giveback fromnode local only cfo aggregates true local command If the command fails because of a failed disk physically dis e...

Page 870: ...anagers report in an available state 11 If the Onboard Key Management is enabled a Use the security key manager key show detail to see a detailed view of all keys stored in the onboard key manager b U...

Page 871: ...logical interfaces that are not on their home node and port If any interfaces are listed as false revert those interfaces back to their home port using the net int revert command 7 Move the console ca...

Page 872: ...you must contact technical support You can use this procedure with all versions of ONTAP supported by your system This procedure is written with the assumption that you are moving the bezel NVMe driv...

Page 873: ...node and start from the beginning of this procedure If repeated attempts to cleanly shut down the node fail be aware that you might lose any data that was not saved to disk 3 Where applicable halt the...

Page 874: ...o the new chassis You need to move the drives from each bay opening in the old chassis to the same bay opening in the new chassis 1 Gently remove the bezel from the front of the system 2 Remove the dr...

Page 875: ...ck or system cabinet by guiding the chassis onto the rack rails in a system cabinet or equipment rack 5 Slide the chassis all the way into the equipment rack or system cabinet 6 Secure the front of th...

Page 876: ...e HA state of the chassis and if necessary update the state to match your system configuration 1 In Maintenance mode from either controller module display the HA state of the local controller module a...

Page 877: ...ule AFF A800 You must review the prerequisites for the replacement procedure and select the correct one for your version of the ONTAP operating system All drive shelves must be working properly The he...

Page 878: ...e so that the healthy node continues to serve data from the impaired node storage About this task If you have a cluster with more than two nodes it must be in quorum If the cluster is not in quorum or...

Page 879: ...gibility and health you must correct the issue before shutting down the impaired node see the Administration overview with the CLI If you have a MetroCluster configuration you must have confirmed that...

Page 880: ...ou replace the controller module or replace a component inside the controller module 1 If you are not already grounded properly ground yourself 2 Unplug the controller module power supplies from the s...

Page 881: ...module as you slide it out of the chassis 8 Place the controller module on a stable flat surface and then open the air duct a Press in the locking tabs on the sides of the air duct toward the middle...

Page 882: ...e replacement controller module when you replace a controller module 1 Rotate the cam handle such that it can be used to pull power supply out of the controller module while pressing the locking tab C...

Page 883: ...place The power supplies will only properly engage with the internal connector and lock in place one way To avoid damaging the internal connector do not use excessive force when sliding the power supp...

Page 884: ...sliding the fan module into the controller module until the locking latches click into place 3 Repeat these steps for the remaining fan modules Step 4 Move the NVDIMM battery When replacing the contr...

Page 885: ...y plug to release the plug from the socket and then unplug the battery cable from the socket 3 Grasp the battery and lift the battery out of the air duct and controller module 4 Move the battery pack...

Page 886: ...es The riser raises up slightly from the controller module c Lift the riser up shift it toward the fans so that the sheet metal lip on the riser clears the edge of the controller module lift the riser...

Page 887: ...Insert the DIMM squarely into the slot The DIMM fits tightly in the slot but should go in easily If not realign the DIMM with the slot and reinsert it Visually inspect the DIMM to verify that it is ev...

Page 888: ...g the NVDIMM 5 Insert the NVDIMM squarely into the slot The NVDIMM fits tightly in the slot but should go in easily If not realign the NVDIMM with the slot and reinsert it Visually inspect the NVDIMM...

Page 889: ...edia gently rotate the boot media up and then pull the boot media straight out of the socket and set it aside 3 Move the boot media to the new controller module and install it a Align the edges of the...

Page 890: ...and the riser sits squarely in the controller module d Reinsert any SFP or QSFP modules that were removed from the PCIe cards 2 Repeat the preceding step for the remaining PCIe risers Step 10 Install...

Page 891: ...controller module begins to boot as soon as it is fully seated in the chassis Be prepared to interrupt the boot process b Rotate the locking latches upward tilting them so that they clear the locking...

Page 892: ...le verify that all components display the same HA state ha config show The HA state should be the same for all components 2 If the displayed system state of the controller module does not match your s...

Page 893: ...AFF A800 Continue the replacement procedure by recabling the storage and confirming disk reassignment Step 1 Recable the system After running diagnostics you must recable the controller module s stor...

Page 894: ...hanged on partner Old 151759755 New 151759706 In takeover node2 node1 Waiting for giveback HA mailboxes 4 From the healthy node verify that any coredumps are saved a Change to the advanced privilege l...

Page 895: ...or the status of the node metrocluster node show The MetroCluster configuration takes a few minutes after the replacement to return to a normal state at which time each node will show a configured sta...

Page 896: ...available to the replacement node However if the impaired node was the only node in the cluster with a license for the feature no configuration changes to the feature are allowed Also using unlicensed...

Page 897: ...should verify that the LIFs are on their home ports and register the serial number of the replacement node if AutoSupport is enabled and reset automatic giveback 1 Verify that the logical interfaces a...

Page 898: ...visor Option 2 Controller is in a MetroCluster Do not use this procedure if your system is in a two node MetroCluster configuration To shut down the impaired node you must determine the status of the...

Page 899: ...module 1 If you are not already grounded properly ground yourself 2 Unplug the controller module power supplies from the source 3 Release the power cable retainers and then unplug the cables from the...

Page 900: ...module as you slide it out of the chassis 8 Place the controller module on a stable flat surface and then open the air duct a Press in the locking tabs on the sides of the air duct toward the middle...

Page 901: ...replace a DIMM you must locate it in the controller module using the DIMM map label on top of the air duct or locating it using the LED next to the DIMM and then replace it following the specific seq...

Page 902: ...4 are left empty Do not attempt to install DIMMs into these slots 2 Note the orientation of the DIMM in the socket so that you can insert the replacement DIMM in the proper orientation 3 Eject the DIM...

Page 903: ...d and fully inserted into the slot 6 Push carefully but firmly on the top edge of the DIMM until the ejector tabs snap into place over the notches at the ends of the DIMM 7 Reinstall any risers that y...

Page 904: ...is to avoid damaging the connectors The controller module begins to boot as soon as it is fully seated in the chassis Be prepared to interrupt the boot process b Rotate the locking latches upward tilt...

Page 905: ...using different procedures depending on the storage system hardware configuration Option 1 Most configurations To shut down the impaired node you must determine the status of the node and if necessary...

Page 906: ...s not in quorum or a healthy node shows false for eligibility and health you must correct the issue before shutting down the impaired node see the Administration overview with the CLI If you have a Me...

Page 907: ...2 Unplug the controller module power supplies from the source 3 Release the power cable retainers and then unplug the cables from the power supplies 4 Loosen the hook and loop strap binding the cables...

Page 908: ...lace Step 3 Replace a fan To replace a fan remove the failed fan module and replace it with a new fan module 1 Identify the fan module that you must replace by checking the console error messages or b...

Page 909: ...ently push the controller module halfway into the system Do not completely insert the controller module in the chassis until instructed to do so 2 Recable the system as needed 3 Plug the power cables...

Page 910: ...nic All other components in the system must be functioning properly if not you must contact technical support You must replace the failed component with a replacement FRU component you received from y...

Page 911: ...e healthy node continues to serve data from the impaired node storage If you have a cluster with more than two nodes it must be in quorum If the cluster is not in quorum or a healthy node shows false...

Page 912: ...module 1 If you are not already grounded properly ground yourself 2 Unplug the controller module power supplies from the source 3 Release the power cable retainers and then unplug the cables from the...

Page 913: ...module as you slide it out of the chassis 8 Place the controller module on a stable flat surface and then open the air duct a Press in the locking tabs on the sides of the air duct toward the middle...

Page 914: ...he NVDIMM map label on top of the air duct or locating it using the LED next to the NVDIMM and then replace it following the specific sequence of steps The NVDIMM LEDs blinks while destaging contents...

Page 915: ...part the two NVDIMM ejector tabs on either side of the NVDIMM and then slide the NVDIMM out of the socket and set it aside Carefully hold the NVDIMM by the edges to avoid pressure on the components on...

Page 916: ...place over the notches at the ends of the NVDIMM 8 Reinstall any risers that you removed from the controller module 9 Close the air duct Step 4 Reinstall the controller module and booting the system...

Page 917: ...t as soon as it is fully seated in the chassis Be prepared to interrupt the boot process b Rotate the locking latches upward tilting them so that they clear the locking pins and then lower them into t...

Page 918: ...u can shut down or take over the impaired controller using different procedures depending on the storage system hardware configuration Option 1 Most configurations To shut down the impaired node you m...

Page 919: ...s not in quorum or a healthy node shows false for eligibility and health you must correct the issue before shutting down the impaired node see the Administration overview with the CLI If you have a Me...

Page 920: ...cable retainers and then unplug the cables from the power supplies 4 Loosen the hook and loop strap binding the cables to the cable management device and then unplug the system cables and SFP and QSFP...

Page 921: ...ou slide it out of the chassis 8 Set the controller module aside in a safe place Step 3 Replace the NVDIMM battery To replace the NVDIMM battery you must remove the failed battery from the controller...

Page 922: ...clip on the face of the battery plug to release the plug from the socket and then unplug the battery cable from the socket 3 Grasp the battery and lift the battery out of the air duct and controller...

Page 923: ...controller module a Firmly push the controller module into the chassis until it meets the midplane and is fully seated The locking latches rise when the controller module is fully seated Do not use ex...

Page 924: ...remove the SFP and QSFP modules from the cards before removing the riser reinstall the riser and then reinstall the SFP and QSFP modules before cabling the cards You can use this procedure with all v...

Page 925: ...determine the status of the node and if necessary take over the node so that the healthy node continues to serve data from the impaired node storage If you have a cluster with more than two nodes it m...

Page 926: ...module 1 If you are not already grounded properly ground yourself 2 Unplug the controller module power supplies from the source 3 Release the power cable retainers and then unplug the cables from the...

Page 927: ...module as you slide it out of the chassis 8 Place the controller module on a stable flat surface and then open the air duct a Press in the locking tabs on the sides of the air duct toward the middle...

Page 928: ...r 1 or if it is from Riser 2 or 3 If you are replacing the 100GbE PCIe card in Riser 1 use Steps 2 3 and Steps 6 7 If you are replacing a PCIe card from Riser 2 or 3 use Steps 4 through 7 2 Remove Ris...

Page 929: ...e card from the riser 4 Remove the PCIe riser from the controller module a Remove any SFP or QSFP modules that might be in the PCIe cards b Rotate the riser locking latch on the left side of the riser...

Page 930: ...socket in the riser and then slide it squarely into the socket in the riser Make sure that the card is completely and squarely seated into the riser socket b For Riser 2 or 3 close the side panel c Sw...

Page 931: ...air duct toward the risers until the locking tabs click into place c Inspect the air duct to make sure that it is properly seated and locked into place Locking tabs Slide plunger 2 Align the end of th...

Page 932: ...44 638277 Europe or 800 800 80 800 Asia Pacific if you need the RMA number or additional help with the replacement procedure Replace a power supply AFF A800 Replacing a power supply involves disconne...

Page 933: ...lock in place one way To avoid damaging the internal connector do not use excessive force when sliding the power supply into the system 6 Reconnect the power supply cabling a Reconnect the power cabl...

Page 934: ...data from the impaired node storage About this task If you have a cluster with more than two nodes it must be in quorum If the cluster is not in quorum or a healthy node shows false for eligibility an...

Page 935: ...gibility and health you must correct the issue before shutting down the impaired node see the Administration overview with the CLI If you have a MetroCluster configuration you must have confirmed that...

Page 936: ...und yourself 2 Unplug the controller module power supplies from the source 3 Release the power cable retainers and then unplug the cables from the power supplies 4 Loosen the hook and loop strap bindi...

Page 937: ...module as you slide it out of the chassis 2 Place the controller module on a stable flat surface and then open the air duct a Press in the locking tabs on the sides of the air duct toward the middle...

Page 938: ...rom the controller module a Remove any SFP or QSFP modules that might be in the PCIe cards b Rotate the riser locking latch on the left side of the riser up and toward the fan modules The riser raises...

Page 939: ...Riser 2 middle riser locking latch Step 4 Replace the RTC battery To replace the RTC battery locate it inside the controller and follow the specific sequence of steps 1 Locate the RTC battery under Ri...

Page 940: ...c shipping bag 4 Note the polarity of the RTC battery and then insert it into the holder by tilting the battery at an angle and pushing down 5 Visually inspect the battery to make sure that it is comp...

Page 941: ...re unplugged plug them back in and reinstall the power cable retainers 5 Complete the reinstallation of the controller module a Firmly push the controller module into the chassis until it meets the mi...

Page 942: ...e local auto giveback true Step 7 Return the failed part to NetApp After you replace the part you can return the failed part to NetApp as described in the RMA instructions shipped with the kit Contact...

Page 943: ...ing up Use this guide if you are familiar with installing NetApp systems Access the Installation and Setup Instructions PDF poster AFF C190 Systems Installation and Setup Instructions Videos AFF C190...

Page 944: ...to provide the following at your site Rack space for the storage system Phillips 2 screwdriver Additional networking cables to connect your system to your network switch and laptop or console with a W...

Page 945: ...host and management network Micro USB console cable Not applicable Console connection during software setup on non Windows or Mac laptop console Power cables Not applicable Powering up the system 6 D...

Page 946: ...nect ports are cabled on both controller modules Contact your network administrator for information about connecting the system to the switches Be sure to check the illustration arrow for the proper c...

Page 947: ...each other with the cluster interconnect cable e0a to e0a e0b to e0b Use one of the following cable types to cable the e0c 0c and e0d 0d or e0e 0e and e0f 0f data ports to your host network Cable the...

Page 948: ...erconnect switches Contact your network administrator for information about connecting the system to the switches Be sure to check the illustration arrow for the proper cable connector pull tab orient...

Page 949: ...tches with the cluster interconnect cable Use one of the following cable types to cable the e0c 0c and e0d 0d or e0e 0e and e0f 0f data ports to your host network Cable the e0M ports to the management...

Page 950: ...information about connecting the system to the switches Be sure to check the illustration arrow for the proper cable connector pull tab orientation As you insert the connector you should feel it clic...

Page 951: ...Cable a switched cluster Ethernet configuration RJ45 ports and management ports on the controller modules are connected to switches The cluster interconnect ports are cabled to the cluster interconnec...

Page 952: ...the cabling between the controllers and the switches Step Perform on each controller module Cable e0a and e0b to the cluster interconnect switches with the cluster interconnect cable Use the Cat 6 RJ4...

Page 953: ...tem and then connecting to the management switch Option 1 Complete system setup and configuration if network discovery is enabled If you have network discovery enabled on your laptop you can complete...

Page 954: ...health of your system by running Config Advisor 8 After you have completed the initial configuration go to the ONTAP ONTAP System Manager Documentation Resources page for information about configuring...

Page 955: ...ment subnet d Assign a TCP IP address to the laptop or console using one that is on the management subnet 2 Plug the power cords into the controller power supplies and then connect them to power sourc...

Page 956: ...ified configuration systems is CNA mode if connecting to an FC host network you have to modify the ports for FC mode Maintain Boot media Replace the boot media AFF C190 The boot media stores a primary...

Page 957: ...de type all message MAINT number_of_hours_downh The following AutoSupport message suppresses automatic case creation for two hours cluster1 system node autosupport invoke node type all message MAINT 2...

Page 958: ...additional steps 2 If the Key Manager type displays onboard and the Restored column displays yes manually backup the OKM information a Go to advanced privilege mode and enter y when prompted to conti...

Page 959: ...impaired node If the Key Manager type displays onboard and the Restored column displays yes you need to complete some additional steps If the Key Manager type displays external and the Restored column...

Page 960: ...ement backup information security key manager onboard show backup f Copy the contents of the backup information to a separate file or your log file You ll need it in disaster scenarios where you might...

Page 961: ...dule Steps 1 If you are not already grounded properly ground yourself 2 Loosen the hook and loop strap binding the cables to the cable management device and then unplug the system cables and SFPs if n...

Page 962: ...t stable surface 6 Open the cover by sliding in the blue tabs to release the cover and then swing the cover up and open Step 2 Replace the boot media You must locate the boot media in the controller m...

Page 963: ...e impaired controller was running You can download the appropriate image from the Downloads section on the NetApp Support Site If NVE is enabled download the image with NetApp Volume Encryption as ind...

Page 964: ...uster enable b If External Key Manager is enabled check the bootarg values listed in the kenv ASUP output bootarg storageencryption support value bootarg keymanager support value kmip init interface v...

Page 965: ...tion a Press n when prompted to restore the backup configuration b Reboot the system when prompted by the system c Select the Update flash from backup config sync flash option from the displayed menu...

Page 966: ...itor the progress of the giveback operation by using the storage failover show giveback command c After the giveback operation is complete confirm that the HA pair is healthy and that takeover is poss...

Page 967: ...p config sync flash option from the displayed menu If you are prompted to continue with the update press y 4 Ensure that the environmental variables are set as expected a Take the node to the LOADER p...

Page 968: ...s needed AFF C190 Once environment variables are checked you must complete steps specific to systems that have Onboard Key Manager OKM NetApp Storage Encryption NSE or NetApp Volume Encryption NVE ena...

Page 969: ...AEAAAAAAADuD byAAAAACEAAAAAAAAA QAAAAAAAAABvOlH0AAAAAMh7qDLRyH1DBz12piVdy9ATSFMT0C0TlYFss4PDjTaV dzRYkLd1PhQLxAWJwOIyqSr8qY1SEBgm1IWgE5DLRqkiAAAAAAAAACgAAAAAAAAA 3WTh7gAAAAAAAAAAAAAAAAIAAAAAAAgAZJEIWv...

Page 970: ...and then enter the passphrase when prompted c Enter the security key manager key query command to see a detailed view of all keys stored in the onboard key manager and verify that the Restored column...

Page 971: ...P SnapMirror or SnapVault process disable the process See the appropriate Documentation Center for more information 5 Wait 3 minutes and check the failover status with the storage failover show comman...

Page 972: ...C190 To replace the chassis you must move the power supplies hard drives and controller module or modules from the impaired chassis to the new chassis and swap out the impaired chassis from the equip...

Page 973: ...bled cluster may result in client disruption or data access failure To ensure continuity of service use the storage failover takeover command Are you sure you want to halt node node_name y n You must...

Page 974: ...ing the power supply into the system You can damage the connector 7 Close the cam handle so that the latch clicks into the locked position and the power supply is fully seated 8 Reconnect the power ca...

Page 975: ...ide the drive out of the chassis The drive should disengage from the chassis allowing it to slide free of the chassis When removing a drive always use two hands to support its weight Drives are fragil...

Page 976: ...two controller modules in the same chassis the sequence in which you install the controller module is especially important because it attempts to reboot as soon as you completely seat it in the chass...

Page 977: ...model type You cannot upgrade your system by just replacing the controller module You cannot change any drives or drive shelves as part of this procedure In this procedure the boot device is moved fro...

Page 978: ...an HA pair take over the impaired node from the healthy node storage failover takeover ofnode impaired_node_name When the impaired node shows Waiting for giveback press Ctrl C and then respond y Move...

Page 979: ...ontroller module 5 Squeeze the latch on the cam handle until it releases open the cam handle fully to release the controller module from the midplane and then using two hands pull the controller modul...

Page 980: ...locate the boot media and follow the directions to remove it from the old controller module and insert it in the new controller module 1 Locate the boot media using the following illustration or the F...

Page 981: ...ove the NVMEM battery To move the NVMEM battery from the old controller module to the new controller module you must perform a specific sequence of steps 1 Check the NVMEM LED If your system is in an...

Page 982: ...s on the side wall hook into the slots on the battery pack and the battery pack latch engages and clicks into the opening on the side wall Step 4 Move the DIMMs To move the DIMMs you must follow the d...

Page 983: ...nsert the DIMM squarely into the slot The DIMM fits tightly in the slot but should go in easily If not realign the DIMM with the slot and reinsert it Visually inspect the DIMM to verify that it is eve...

Page 984: ...ed in the chassis Be prepared to interrupt the boot process a With the cam handle in the open position firmly push the controller module in until it meets the midplane and is fully seated and then clo...

Page 985: ...ue to time differences About this task It is important that you apply the commands in the steps on the correct systems The replacement node is the new node that replaced the impaired node as part of t...

Page 986: ...rocedures are issued from the node where the component is being replaced 1 If the node to be serviced is not at the LOADER prompt reboot the node halt After you issue the command you should wait until...

Page 987: ...devices identified in the preceding step c Examine the output and if applicable select only the tests that you want to run sldiag device modify dev dev_name selection only selection only disables all...

Page 988: ...nt to run for the device d Verify that the tests were modified sldiag device show e Repeat these substeps for each device that you want to run concurrently f Run diagnostics on all of the devices sldi...

Page 989: ...halt b Perform a clean shutdown and then disconnect the power supplies c Verify that you have observed all of the considerations identified for running system level diagnostics that cables are securel...

Page 990: ...dure applies only to systems running ONTAP in an HA pair 1 If the replacement node is in Maintenance mode showing the prompt exit Maintenance mode and go to the LOADER prompt halt 2 From the LOADER pr...

Page 991: ...ofnode replacement_node_name the replacement node takes back its storage and completes booting If you are prompted to override the system ID due to a system ID mismatch you should enter y If the give...

Page 992: ...ster should have its own key for the feature About this task Until you install license keys features requiring standard licenses continue to be available to the replacement node However if the impaire...

Page 993: ...hether you are using onboard or external key management Restoring onboard key management encryption keys Restoring external key management encryption keys Step 3 Verifying LIFs and registering the ser...

Page 994: ...out this task If you have a cluster with more than two nodes it must be in quorum If the cluster is not in quorum or a healthy node shows false for eligibility and health you must correct the issue be...

Page 995: ...1 If you are not already grounded properly ground yourself 2 Loosen the hook and loop strap binding the cables to the cable management device and then unplug the system cables and SFPs if needed from...

Page 996: ...e surface 6 Open the cover by sliding in the blue tabs to release the cover and then swing the cover up and open Step 3 Replace the DIMMs To replace the DIMMs you need to locate them inside the contro...

Page 997: ...ollowing steps and proceed to the next task in this procedure 3 If the NVMEM LED is flashing there is data in the NVMEM and you must disconnect the battery to clear the memory a Locate the battery pre...

Page 998: ...he corners and align it to the slot The notch among the pins on the DIMM should line up with the tab in the socket 9 Make sure that the DIMM ejector tabs on the connector are in the open position and...

Page 999: ...he cam handle to the locked position Do not use excessive force when sliding the controller module into the chassis to avoid damaging the connectors The controller begins to boot as soon as it is seat...

Page 1000: ...eplacement of the DIMMs sldiag device status dev mem long state failed System level diagnostics returns you to the prompt if there are no test failures or lists the full status of failures resulting f...

Page 1001: ...ces c Verify that you have observed all the considerations identified for running system level diagnostics that cables are securely connected and that hardware components are properly installed in the...

Page 1002: ...node so that the healthy node continues to serve data from the impaired node storage About this task If you have a cluster with more than two nodes it must be in quorum If the cluster is not in quoru...

Page 1003: ...1 If you are not already grounded properly ground yourself 2 Loosen the hook and loop strap binding the cables to the cable management device and then unplug the system cables and SFPs if needed from...

Page 1004: ...n the cover by sliding in the blue tabs to release the cover and then swing the cover up and open Step 3 Replace the NVMEM battery To replace the NVMEM battery in your system you must remove the faile...

Page 1005: ...til the destage is complete and then the LED turns off If the LED is on and power is on unwritten data is stored on NVMEM This typically occurs during an uncontrolled shutdown after ONTAP has successf...

Page 1006: ...tion of the controller module The controller module begins to boot as soon as it is fully seated in the chassis Be prepared to interrupt the boot process a With the cam handle in the open position fir...

Page 1007: ...ing the boot process you can safely respond y to the prompts until the Maintenance mode prompt appears 3 Run diagnostics on the NVMEM memory sldiag device run dev nvmem 4 Verify that no hardware probl...

Page 1008: ...ne controller module in the chassis turn off the power supplies and unplug them from the power sources c Verify that you have observed all the considerations identified for running system level diagno...

Page 1009: ...power supply so you must replace the power supply within two minutes of removal to prevent overheating due to reduced airflow Because the chassis provides a shared cooling configuration for the two H...

Page 1010: ...one way Do not use excessive force when sliding the power supply into the system You can damage the connector 8 Close the cam handle so that the latch clicks into the locked position and the power su...

Page 1011: ...d if necessary take over the node so that the healthy node continues to serve data from the impaired node storage About this task If you have a cluster with more than two nodes it must be in quorum If...

Page 1012: ...1 If you are not already grounded properly ground yourself 2 Loosen the hook and loop strap binding the cables to the cable management device and then unplug the system cables and SFPs if needed from...

Page 1013: ...ace 6 Open the cover by sliding in the blue tabs to release the cover and then swing the cover up and open Step 3 Replace the RTC battery To replace the RTC battery you need to locate it inside the co...

Page 1014: ...e air duct or controller module cover 2 Align the end of the controller module with the opening in the chassis and then gently push the controller module halfway into the system Do not completely inse...

Page 1015: ...e to normal operation by giving back its storage storage failover giveback ofnode impaired_node_name 9 If automatic giveback was disabled reenable it storage failover modify node local auto giveback t...

Page 1016: ...tallation and setup PDF poster FAS2600 You can use the PDF poster to install and set up your new system The PDF poster provides step by step instructions with live links to additional content AFF FAS2...

Page 1017: ...must correct the issue before shutting down the impaired node see the NetApp Encryption overview with the CLI Steps 1 Check the status of the impaired node If the impaired node is at the login prompt...

Page 1018: ...ed it s safe to shut down the impaired node Verifying NVE configuration Steps 1 Display the key IDs of the authentication keys that are stored on the key management servers security key manager query...

Page 1019: ...e set priv advanced Enter the command to display the OKM backup information security key manager backup show Copy the contents of the backup information to a separate file or your log file You ll need...

Page 1020: ...at the prompt If the passphrase cannot be provided contact mysupport netapp com Verify that the Restored column shows yes for all authentication keys security key manager key show detail Go to advanc...

Page 1021: ...additional steps 2 If the Key Manager type displays onboard and the Restored column displays yes manually backup the OKM information a Go to advanced privilege mode and enter y when prompted to conti...

Page 1022: ...mpaired node If the Key Manager type displays onboard and the Restored column displays yes you need to complete some additional steps If the Key Manager type displays external and the Restored column...

Page 1023: ...ement backup information security key manager onboard show backup f Copy the contents of the backup information to a separate file or your log file You ll need it in disaster scenarios where you might...

Page 1024: ...module 1 If you are not already grounded properly ground yourself 2 Loosen the hook and loop strap binding the cables to the cable management device and then unplug the system cables and SFPs if neede...

Page 1025: ...cover by sliding in the blue tabs to release the cover and then swing the cover up and open Step 2 Replace the boot media 1 If you are not already grounded properly ground yourself 2 Locate the boot m...

Page 1026: ...g 7 Close the controller module cover Step 3 Transfer the boot image to the boot media You can install the system image to the replacement boot media using a USB flash drive with the image installed o...

Page 1027: ...rrupt the boot process to stop at the LOADER prompt by pressing Ctrl C when you see Starting AUTOBOOT press Ctrl C to abort If you miss this message press Ctrl C select the option to boot to Maintenan...

Page 1028: ...sk is the network mask of the management network that is connected to the HA partner gateway is the gateway for the network dns_addr is the IP address of a name server on your network dns_domain is th...

Page 1029: ...update press y 4 Ensure that the environmental variables are set as expected a Take the node to the LOADER prompt b Check the environment variable settings with the printenv command c If an environmen...

Page 1030: ...e enabled along with Onboard Key Manager you must restore settings you captured at the beginning of this procedure If NSE or NVE are enabled and Onboard Key Manager is enabled go to Option 1 Restore N...

Page 1031: ...B4jc4A7cvWEFY6lLG6hc6tbKLAHZuvfQ4rIbYAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA H4nPQM0nrDRYRa9...

Page 1032: ...oard sync a Run the security key manager onboard sync command and then enter the passphrase when prompted b Enter the security key manager key query command to see a detailed view of all keys stored i...

Page 1033: ...synchronize If the command fails because of an NDMP SnapMirror or SnapVault process disable the process See the appropriate Documentation Center for more information 5 Wait 3 minutes and check the fai...

Page 1034: ...Restored column yes for all authentication keys 12 Connect the console cable to the partner node 13 Give back the node using the storage failover giveback fromnode local command 14 Restore automatic...

Page 1035: ...on the key management servers If the Restored column yes true you are done and can proceed to complete the replacement process If the Key Manager type external and the Restored column anything other t...

Page 1036: ...issue before shutting down the impaired node ONTAP 9 System Administration Reference You might want to erase the contents of your caching module before replacing it 1 Although data on the caching modu...

Page 1037: ...must first remove the controller module from the system and then remove the cover on the controller module 1 If you are not already grounded properly ground yourself 2 Loosen the hook and loop strap b...

Page 1038: ...sliding in the blue tabs to release the cover and then swing the cover up and open Step 3 Replace a caching module To replace a caching module referred to as the M 2 PCIe card on the label on your con...

Page 1039: ...of the controller module and remove it a Press the release tab b Remove the heatsink 1 Gently pull the caching module straight out of the housing 2 Align the edges of the caching module with the sock...

Page 1040: ...fully seated in the chassis Be prepared to interrupt the boot process a With the cam handle in the open position firmly push the controller module in until it meets the midplane and is fully seated an...

Page 1041: ...nter boot_ontap press Ctrl C when prompted and then boot to Maintenance mode e From the boot menu select the option for Maintenance mode Step 5 Run system level diagnostics After installing a new cach...

Page 1042: ...failures a Clear the status logs sldiag device clearstatus b Verify that the log was cleared sldiag device status The following default response is displayed SLDIAG No log messages are present c Exit...

Page 1043: ...controller module you are servicing interrupting the boot by pressing Ctrl C when prompted to get to the Boot menu If you have two controller modules in the chassis fully seat the controller module yo...

Page 1044: ...chassis prior to moving them to the new chassis About this task If you have a cluster with more than two nodes it must be in quorum If the cluster is not in quorum or a healthy node shows false for el...

Page 1045: ...ling and connecting it on the replacement chassis 1 If you are not already grounded properly ground yourself 2 Turn off the power supply and disconnect the power cables a Turn off the power switch on...

Page 1046: ...nt device so that when you reinstall the cable management device the cables are organized 2 Remove and set aside the cable management devices from the left and right sides of the controller module 3 S...

Page 1047: ...drives in the system Step 4 Replace a chassis from within the equipment rack or system cabinet Remove the existing chassis from the equipment rack or system cabinet before you can install the replacem...

Page 1048: ...ule into the chassis to avoid damaging the connectors b If you have not already done so reinstall the cable management device c Bind the cables to the cable management device with the hook and loop st...

Page 1049: ...guration a Set the HA state for the chassis ha config modify chassis HA state The value for HA state can be one of the following ha non ha b Confirm that the setting has changed ha config show 3 If yo...

Page 1050: ...respond y to the prompts until the Maintenance mode prompt appears 4 Enable the interconnect diagnostics tests from the Maintenance mode prompt sldiag device modify dev interconnect sel enable The int...

Page 1051: ...both controllers before proceeding any further d Enter the following command on both controllers at the LOADER prompt bye e Return the node to normal operation If your system is running ONTAP Then Wi...

Page 1052: ...e the controller module FAS2600 You must review the prerequisites for the replacement procedure and select the correct one for your version of the ONTAP operating system All drive shelves must be work...

Page 1053: ...st correct the issue before shutting down the impaired node see the Administration overview with the CLI Steps 1 If AutoSupport is enabled suppress automatic case creation by invoking an AutoSupport m...

Page 1054: ...not already grounded properly ground yourself 2 Loosen the hook and loop strap binding the cables to the cable management device and then unplug the system cables and SFPs if needed from the controlle...

Page 1055: ...pen the cover by sliding in the blue tabs to release the cover and then swing the cover up and open Step 2 Move the boot media You must locate the boot media and follow the directions to remove it fro...

Page 1056: ...then gently push it into the socket 4 Check the boot media to make sure that it is seated squarely and completely in the socket If necessary remove the boot media and reseat it into the socket 5 Push...

Page 1057: ...face of the battery plug to release the plug from the socket and then unplug the battery cable from the socket 4 Grasp the battery and press the blue locking tab marked PUSH and then lift the battery...

Page 1058: ...wly pushing apart the two DIMM ejector tabs on either side of the DIMM and then slide the DIMM out of the slot Carefully hold the DIMM by the edges to avoid pressure on the components on the DIMM circ...

Page 1059: ...rred to as the M 2 PCIe card on the label on your controller locate and move it from the old controller into the replacement controller and follow the specific sequence of steps You must have the new...

Page 1060: ...because it attempts to reboot as soon as you completely seat it in the chassis The system might update system firmware when it boots Do not abort this process The procedure requires you to interrupt...

Page 1061: ...nto the chassis to avoid damaging the connectors The controller begins to boot as soon as it is seated in the chassis b If you have not already done so reinstall the cable management device c Bind the...

Page 1062: ...select the option for Maintenance mode Important During the boot process you might see the following prompts A prompt warning of a system ID mismatch and asking to override the system ID A prompt war...

Page 1063: ...ssary update the state to match your system configuration 1 In Maintenance mode from the new controller module verify that all components display the same HA state ha config show The HA state should b...

Page 1064: ...sldiag device show dev mb The controller module devices and ports displayed can be any one or more of the following bootmedia is the system booting device cna is a Converged Network Adapter or interfa...

Page 1065: ...ts that you want to run sldiag device modify dev dev_name selection only selection only disables all other tests that you do not want to run for the device d Run the selected tests sldiag device run d...

Page 1066: ...nt to run for the device d Verify that the tests were modified sldiag device show e Repeat these substeps for each device that you want to run concurrently f Run diagnostics on all of the devices sldi...

Page 1067: ...l of the considerations identified for running system level diagnostics that cables are securely connected and that hardware components are properly installed in the storage system d Reconnect the pow...

Page 1068: ...e prompt exit Maintenance mode and go to the LOADER prompt halt 2 From the LOADER prompt on the replacement node boot the node entering y if you are prompted to override the system ID due to a system...

Page 1069: ...on of ONTAP 9 b After the giveback has been completed confirm that the HA pair is healthy and that takeover is possible storage failover show The output from the storage failover show command should n...

Page 1070: ...65481 DISK OWNER POOL SERIAL NUMBER HOME disk_name system 1 118073209 Pool0 J8XJE9LC system 1 118073209 disk_name system 1 118073209 Pool0 J8Y478RC system 1 118073209 5 Boot the node boot_ontap Comple...

Page 1071: ...a storage system that you previously configured to use Storage or Volume Encryption you must perform additional steps to provide uninterrupted Encryption functionality You can skip this task on stora...

Page 1072: ...DIMM replacement video Step 1 Shut down the impaired controller Shut down or take over the impaired controller using different procedures depending on the storage system hardware configuration To shut...

Page 1073: ...de the controller you must first remove the controller module from the system and then remove the cover on the controller module 1 If you are not already grounded properly ground yourself 2 Loosen the...

Page 1074: ...flat stable surface 6 Open the cover by sliding in the blue tabs to release the cover and then swing the cover up and open Step 3 Replace the DIMMs To replace the DIMMs locate them inside the control...

Page 1075: ...the NVMEM you can skip the following steps and proceed to the next task in this procedure 3 If the NVMEM LED is flashing there is data in the NVMEM and you must disconnect the battery to clear the mem...

Page 1076: ...e corners and align it to the slot The notch among the pins on the DIMM should line up with the tab in the socket 9 Make sure that the DIMM ejector tabs on the connector are in the open position and t...

Page 1077: ...as soon as it is fully seated in the chassis Be prepared to interrupt the boot process a With the cam handle in the open position firmly push the controller module in until it meets the midplane and...

Page 1078: ...boot_ontap press Ctrl C when prompted and then boot to Maintenance mode e From the boot menu select the option for Maintenance mode Step 5 Run system level diagnostics After installing a new DIMM you...

Page 1079: ...level diagnostics tests Then Were completed without any failures a Clear the status logs sldiag device clearstatus b Verify that the log was cleared sldiag device status The following default response...

Page 1080: ...sing Ctrl C when prompted to get to the Boot menu If you have two controller modules in the chassis fully seat the controller module you are servicing in the chassis The controller module boots up whe...

Page 1081: ...AutoSupport is enabled suppress automatic case creation by invoking an AutoSupport message system node autosupport invoke node type all message MAINT number_of_hours_downh The following AutoSupport m...

Page 1082: ...were connected Leave the cables in the cable management device so that when you reinstall the cable management device the cables are organized 3 Remove and set aside the cable management devices from...

Page 1083: ...r module and then check the NVRAM LED identified by the NV icon The NVRAM LED blinks while destaging contents to the flash memory when you halt the system After the destage is complete the LED turns o...

Page 1084: ...the side wall hook into the slots on the battery pack and the battery pack latch engages and clicks into the opening on the side wall 9 Plug the battery plug back into the controller module Step 4 Rei...

Page 1085: ...ding the controller module into the chassis to avoid damaging the connectors The controller begins to boot as soon as it is seated in the chassis b If you have not already done so reinstall the cable...

Page 1086: ...ontap press Ctrl C when prompted and then boot to Maintenance mode e From the boot menu select the option for Maintenance mode Step 5 Run system level diagnostics After installing a new NVMEM battery...

Page 1087: ...stem level diagnostics tests Then Were completed without any failures a Clear the status logs sldiag device clearstatus b Verify that the log was cleared sldiag device status The following default res...

Page 1088: ...essing Ctrl C when prompted to get to the Boot menu If you have two controller modules in the chassis fully seat the controller module you are servicing in the chassis The controller module boots up w...

Page 1089: ...oth controller modules do shut down make sure that both power supplies are inserted turn both off for 30 seconds and then turn both on The number of power supplies in the system depends on the model P...

Page 1090: ...lled one way Do not use excessive force when sliding the power supply into the system You can damage the connector 8 Close the cam handle so that the latch clicks into the locked position and the powe...

Page 1091: ...status of the node and if necessary take over the node so that the healthy node continues to serve data from the impaired node storage About this task If you have a cluster with more than two nodes it...

Page 1092: ...r module from the system and then remove the cover on the controller module 1 If you are not already grounded properly ground yourself 2 Loosen the hook and loop strap binding the cables to the cable...

Page 1093: ...stable surface 6 Open the cover by sliding in the blue tabs to release the cover and then swing the cover up and open Step 3 Replace the RTC battery To replace the RTC battery locate it inside the co...

Page 1094: ...RTC battery and then insert it into the holder by tilting the battery at an angle and pushing down 6 Visually inspect the battery to make sure that it is completely installed into the holder and that...

Page 1095: ...art the boot process e Halt the controller at the LOADER prompt 6 Reset the time and date on the controller a Check the date and time on the healthy node with the show date command b At the LOADER pro...

Page 1096: ...rough initial system bring up Use this guide if you are familiar with installing NetApp systems Access the Installation and Setup Instructions PDF poster English FAS500f Installation and Setup Instruc...

Page 1097: ...version of ONTAP for more information about this system NetApp Hardware Universe Find the Release Notes for your version of ONTAP 9 You need to provide the following at your site Rack space for the s...

Page 1098: ...6250 15 112 00346 15m X66250 30 112 00347 30m Micro USB console cable Not applicable Console connection during software setup Power cables Not applicable Powering up the system 5 Review the NetApp ONT...

Page 1099: ...e switchless cluster method or by using the cluster interconnect network Option 1 Cable a two node switchless cluster The management Fibre Channel and data or host network ports on the controller modu...

Page 1100: ...ng system setup and configuration Option 2 Cable a switched cluster All ports on the controllers are connected to switches cluster interconnect management Fibre Channel and data or host network switch...

Page 1101: ...int 2 To complete setting up your system see Step4 Completing system setup and configuration Optional cabling Cable configuration dependent options You have configuration dependent optional cabling to...

Page 1102: ...nal cabling choose from Option 2 Cable to a 25GbE data or host network Option 3 Cable the controllers to a single drive shelf 3 To complete setting up your system see Step4 Completing system setup and...

Page 1103: ...complete setting up your system see Step4 Completing system setup and configuration Option 3 Cable the controllers to a single drive shelf You must cable each controller to the NSM modules on the NS2...

Page 1104: ...ller in the system and then connecting to the management switch Option 1 Complete system setup and configuration if network discovery is enabled If you have network discovery enabled on your laptop yo...

Page 1105: ...health of your system by running Config Advisor 7 After you have completed the initial configuration go to the ONTAP ONTAP System Manager Documentation Resources page for information about configurin...

Page 1106: ...re PuTTY b Enter the management IP address when prompted by the script 4 Using System Manager on your laptop or console configure your cluster a Point your browser to the node management IP address Th...

Page 1107: ...onfiguration log in as admin on the healthy node If the impaired node is in a standalone configuration and at LOADER prompt contact NetApp Support mysupport netapp com 2 If AutoSupport is enabled supp...

Page 1108: ...ey Manager type displays external and the Restored column displays anything other than yes you need to complete some additional steps If the Key Manager type displays onboard and the Restored column d...

Page 1109: ...t servers security key manager query If the Key Manager type displays external and the Restored column displays yes it s safe to shut down the impaired node If the Key Manager type displays onboard an...

Page 1110: ...query c Verify that the Key Manager type shows onboard manually backup the OKM information d Go to advanced privilege mode and enter y when prompted to continue set priv advanced e Enter the command...

Page 1111: ...data from the impaired node storage If you have a cluster with more than two nodes it must be in quorum If the cluster is not in quorum or a healthy node shows false for eligibility and health you mu...

Page 1112: ...d transfer the boot image to a USB flash drive Step 1 Remove the controller module You must remove the controller module from the chassis when you replace a component inside the controller module Make...

Page 1113: ...oth hands grasp the controller module sides and gently pull it out of the chassis and set it on a flat stable surface 6 Turn the thumbscrew on the front of the controller module anti clockwise and ope...

Page 1114: ...edia You need a 1 magnetic Phillips head screw driver to remove the screw that holds the boot media in place Due to the space constraints within the controller module you should also have a magnet to...

Page 1115: ...the controller module d Using the 1 magnetic screw driver insert and tighten the screw on the boot media Do not apply force when tightening the screw on the boot media you might crack it Step 3 Transf...

Page 1116: ...service image from the NetApp Support Site to the USB flash drive a Download the service image to your work space on your laptop b Unzip the service image If you are extracting the contents using Win...

Page 1117: ...3 Close the controller module cover and tighten the thumbscrew 1114...

Page 1118: ...into place The controller module begins to boot as soon as it is fully seated in the chassis Be prepared to interrupt the boot process The controller module should be fully inserted and flush with th...

Page 1119: ...e the brackets on your screen 3 Restore the var file system If your system has Then A network connection a Press y when prompted to restore the backup configuration b Set the healthy node to advanced...

Page 1120: ...sion state is changed to Connected for the target iSCSI target type dr_auxiliary address ip address date and time node name iscsi session stateChanged notice iSCSI session state is changed to Connecte...

Page 1121: ...estore automatic giveback if you disabled it by using the storage failover modify node local auto giveback true command Restore OKM NSE and NVE as needed FAS500f Once environment variables are checked...

Page 1122: ...security key manager onboard show backup command Example of backup data BEGIN BACKUP TmV0QXBwIEtleSBCbG9iAAEAAAAEAAAAcAEAAAAAAADuD byAAAAACEAAAAAAAAA QAAAAAAAAABvOlH0AAAAAMh7qDLRyH1DBz12piVdy9ATSFMT0C...

Page 1123: ...ecurity key manager onboard sync b Run the security key manager onboard sync command and then enter the passphrase when prompted c Enter the security key manager key query command to see a detailed vi...

Page 1124: ...P SnapMirror or SnapVault process disable the process See the appropriate Documentation Center for more information 5 Wait 3 minutes and check the failover status with the storage failover show comman...

Page 1125: ...FAS500f To replace the chassis you must move the bezel controller modules and NVMe drives from the impaired chassis to the replacement chassis and then remove the impaired chassis from the equipment...

Page 1126: ...may result in client disruption or data access failure To ensure continuity of service use the storage failover takeover command Are you sure you want to halt node node_name y n You must perform a cl...

Page 1127: ...anism 5 Using both hands grasp the controller module sides and gently pull it out of the chassis and set it on a flat stable surface 6 Set the controller module aside in a safe place and repeat these...

Page 1128: ...ady grounded properly ground yourself 4 Using two people install the replacement chassis into the equipment rack or system cabinet by guiding the chassis onto the rack rails in a system cabinet or equ...

Page 1129: ...eat the preceding steps to install the second controller into the new chassis Complete the restoration and replacement process FAS500f Step 1 Verify and set the HA state of the chassis You must verify...

Page 1130: ...800 800 80 800 Asia Pacific if you need the RMA number or additional help with the replacement procedure Controller Replace the controller module FAS500f You must review the prerequisites for the rep...

Page 1131: ...ost configurations To shut down the impaired node you must determine the status of the node and if necessary take over the node so that the healthy node continues to serve data from the impaired node...

Page 1132: ...gibility and health you must correct the issue before shutting down the impaired node see the Administration overview with the CLI If you have a MetroCluster configuration you must have confirmed that...

Page 1133: ...You must remove the controller module from the chassis when you replace a component inside the controller module Make sure that you label the cables so that you know where they came from You can use t...

Page 1134: ...oth hands grasp the controller module sides and gently pull it out of the chassis and set it on a flat stable surface 6 Turn the thumbscrew on the front of the controller module anti clockwise and ope...

Page 1135: ...a Open the power cable retainer and then unplug the power cable from the power supply b Unplug the power cable from the power source 2 Rotate the cam handle such that it can be used to pull power sup...

Page 1136: ...icks into place The power supplies will only properly engage with the internal connector and lock in place one way To avoid damaging the internal connector do not use excessive force when sliding the...

Page 1137: ...FF A250 under the air duct in the controller module You must move it from the impaired controller module to the replacement controller module You need a 1 magnetic Phillips head screw driver to remove...

Page 1138: ...ut of the socket and align it into place in the replacement controller module c Using the 1 magnetic screw driver insert and tighten the screw on the boot media Do not apply force when tightening the...

Page 1139: ...open position and then insert the DIMM squarely into the socket The DIMMs fit tightly in the socket If not reinsert the DIMM to realign it with the socket d Visually inspect the DIMM to verify that it...

Page 1140: ...impaired controller module and from the mezzanine card and set them aside safely on the magnet d Gently lift the mezzanine card out of the socket and move it to the same position in the replacement co...

Page 1141: ...er module to the replacement controller module Squeeze the clip on the face of the battery plug Unplug the battery cable from the socket Grasp the battery and press the blue locking tab marked PUSH Li...

Page 1142: ...wall f Press firmly down on the battery pack to make sure that it is locked into place Step 8 Install the controller module After all of the components have been moved from the impaired controller mo...

Page 1143: ...llowing sections You will connect the rest of the cables to the controller module later in this procedure 5 Insert the controller module into the chassis a Ensure the latching mechanism arms are locke...

Page 1144: ...systems The replacement node is the new node that replaced the impaired node as part of this procedure The healthy node is the HA partner of the replacement node Steps 1 If the replacement node is not...

Page 1145: ...e node system node halt node node_name After you issue the command you should wait until the system stops at the LOADER prompt 2 At the LOADER prompt access the special drivers specifically designed f...

Page 1146: ...replacement node and then verify that the change was implemented This procedure applies only to systems running ONTAP in an HA pair 1 If the replacement node is in Maintenance mode showing the prompt...

Page 1147: ...rage storage failover giveback ofnode replacement_node_name the replacement node takes back its storage and completes booting If you are prompted to override the system ID due to a system ID mismatch...

Page 1148: ...fields node systemid command output displays the old system ID until the MetroCluster configuration returns to a normal state 8 If the node is in a MetroCluster configuration depending on the MetroCl...

Page 1149: ...vailable to the replacement node However if the impaired node was the only node in the cluster with a license for the feature no configuration changes to the feature are allowed Also using unlicensed...

Page 1150: ...should verify that the LIFs are on their home ports and register the serial number of the replacement node if AutoSupport is enabled and reset automatic giveback 1 Verify that the logical interfaces a...

Page 1151: ...f you have a cluster with more than two nodes it must be in quorum If the cluster is not in quorum or a healthy node shows false for eligibility and health you must correct the issue before shutting d...

Page 1152: ...gibility and health you must correct the issue before shutting down the impaired node see the Administration overview with the CLI If you have a MetroCluster configuration you must have confirmed that...

Page 1153: ...controller module Make sure that you label the cables so that you know where they came from 1 If you are not already grounded properly ground yourself 2 Unplug the controller module power supplies fr...

Page 1154: ...nd gently pull it out of the chassis and set it on a flat stable surface 6 Turn the thumbscrew on the front of the controller module anti clockwise and open the controller module cover Thumbscrew Cont...

Page 1155: ...it following the specific sequence of steps You can use the following video or the tabulated steps to replace a DIMM Replacing a DIMM 1 Replace the impaired DIMM on your controller module The DIMMs ar...

Page 1156: ...components on the DIMM circuit board e Insert the replacement DIMM squarely into the slot The DIMMs fit tightly in the socket If not reinsert the DIMM to realign it with the socket f Visually inspect...

Page 1157: ...2 Close the controller module cover and tighten the thumbscrew 1154...

Page 1158: ...cess the system to perform the tasks in the following sections You will connect the rest of the cables to the controller module later in this procedure Step 5 Run diagnostics After you have replaced a...

Page 1159: ...tinues to serve data from the impaired node storage About this task If you have a cluster with more than two nodes it must be in quorum If the cluster is not in quorum or a healthy node shows false fo...

Page 1160: ...gibility and health you must correct the issue before shutting down the impaired node see the Administration overview with the CLI If you have a MetroCluster configuration you must have confirmed that...

Page 1161: ...dule Make sure that you label the cables so that you know where they came from 1 If you are not already grounded properly ground yourself 2 Unplug the controller module power supplies from the source...

Page 1162: ...3 Replace a fan To replace a fan remove the failed fan module and replace it with a new fan module You can use the following video or the tabulated steps to replace a fan Replacing a fan 1 Identify t...

Page 1163: ...then slide the replacement fan module into the controller module Step 4 Reinstall the controller module After you replace a component within the controller module you must reinstall the controller mod...

Page 1164: ...the orange tabs on top of the latching mechanism and gently push the controller module over the stop e Release your thumbs from the top of the latching mechanisms and continue pushing until the latch...

Page 1165: ...the impaired controller You can shut down or take over the impaired controller using different procedures depending on the storage system hardware configuration Option 1 Most configurations To shut d...

Page 1166: ...not in quorum or a healthy node shows false for eligibility and health you must correct the issue before shutting down the impaired node see the Administration overview with the CLI If you have a Met...

Page 1167: ...controller module Make sure that you label the cables so that you know where they came from 1 If you are not already grounded properly ground yourself 2 Unplug the controller module power supplies fr...

Page 1168: ...er module cover Step 3 Replace or install a mezzanine card To replace a mezzanine card you must remove the impaired card and install the replacement card to install a mezzanine card you must remove th...

Page 1169: ...remove the screws from the face of the controller module and set them aside safely on the magnet d Using the 1 magnetic screw driver loosen the screw on the impaired mezzanine card e Gently lift the...

Page 1170: ...t them aside safely on the magnet b Remove the mezzanine card from the antistatic shipping bag and align it to the inside face of the controller module c Gently align the mezzanine card into place d U...

Page 1171: ...rn the node to normal operation by giving back its storage storage failover giveback ofnode impaired_node_name 5 If automatic giveback was disabled reenable it storage failover modify node local auto...

Page 1172: ...ailover modify node local auto giveback false 3 Take the impaired node to the LOADER prompt If the impaired node is displaying Then The LOADER prompt Go to the next step Waiting for giveback Press Ctr...

Page 1173: ...em prompt or password prompt enter system password Take over or halt the impaired node For an HA pair take over the impaired node from the healthy node storage failover takeover ofnode impaired_node_n...

Page 1174: ...oth hands grasp the controller module sides and gently pull it out of the chassis and set it on a flat stable surface 6 Turn the thumbscrew on the front of the controller module anti clockwise and ope...

Page 1175: ...nto the controller module You can use the following video or the tabulated steps to replace the NVMEM battery Replacing the NVMEM battery 1 Locate and replace the impaired NVMEM battery on your contro...

Page 1176: ...tery plug into the socket e Slide the battery pack down along the sheet metal side wall until the support tabs on the side wall hook into the slots on the battery pack and the battery pack latch engag...

Page 1177: ...mbs down on the orange tabs on top of the latching mechanism and gently push the controller module over the stop e Release your thumbs from the top of the latching mechanisms and continue pushing unti...

Page 1178: ...rerun the scan If the scan reported no failures select Reboot from the menu to reboot the system Step 6 Return the failed part to NetApp After you replace the part you can return the failed part to N...

Page 1179: ...o pull power supply out of the controller module while pressing the locking tab The power supply is short Always use two hands to support it when removing it from the controller module so that it does...

Page 1180: ...he system must be functioning properly if not you must contact technical support Step 1 Shut down the impaired controller You can shut down or take over the impaired controller using different procedu...

Page 1181: ...ore than two nodes it must be in quorum If the cluster is not in quorum or a healthy node shows false for eligibility and health you must correct the issue before shutting down the impaired node see t...

Page 1182: ...sis when you replace a component inside the controller module Make sure that you label the cables so that you know where they came from 1 If you are not already grounded properly ground yourself 2 Unp...

Page 1183: ...e sides and gently pull it out of the chassis and set it on a flat stable surface 6 Turn the thumbscrew on the front of the controller module anti clockwise and open the controller module cover Thumbs...

Page 1184: ...e controller and follow the specific sequence of steps You can use the following video or the tabulated steps to replace the RTC battery Replacing the RTC battery 1 Locate the RTC battery between the...

Page 1185: ...the battery up Make a note of the polarity of the battery The battery should eject out The battery will be ejected out 2 Remove the replacement battery from the antistatic shipping bag 3 Locate the R...

Page 1186: ...Reinstall the controller module and set time date after RTC battery replacement After you replace a component within the controller module you must reinstall the controller module in the system chass...

Page 1187: ...t the LOADER prompt The controller module should be fully inserted and flush with the edges of the chassis 6 Reset the time and date on the controller a Check the date and time on the healthy node wit...

Page 1188: ...either Install MetroCluster IP configuration Install MetroCluster Fabric Attached configuration Installation and setup PDF poster FAS8200 You can use the PDF poster to install and set up your new sys...

Page 1189: ...ystem is running If you have a cluster with more than two nodes it must be in quorum If the cluster is not in quorum or a healthy node shows false for eligibility and health you must correct the issue...

Page 1190: ...ck whether NSE is configured storage encryption disk show If the command output list the drive details with Mode Key ID information NSE is configured and you need to verify the NSE configuration If NV...

Page 1191: ...s yes for all authentication key security key manager key show detail Go to advanced privilege mode and enter y when prompted to continue set priv advanced Enter the command to display the OKM backup...

Page 1192: ...isplays anything other than yes Run the key manager setup wizard security key manager setup node target impaired node name Enter the customer s OKM passphrase at the prompt If the passphrase cannot be...

Page 1193: ...nd the Restored column displays anything other than yes you need to complete some additional steps If the Key Manager type displays onboard and the Restored column displays anything other than yes you...

Page 1194: ...y key manager query If the Key Manager type displays external and the Restored column displays yes it s safe to shut down the impaired node If the Key Manager type displays onboard and the Restored co...

Page 1195: ...er y when prompted to continue set priv advanced e Enter the command to display the key management backup information security key manager onboard show backup f Copy the contents of the backup informa...

Page 1196: ...nfiguration you must have confirmed that the MetroCluster Configuration State is configured and that the nodes are in an enabled and normal state metrocluster node show Steps 1 If AutoSupport is enabl...

Page 1197: ...according to the following table If the impaired node Then Has automatically switched over Proceed to the next step Has not automatically switched over Perform a planned switchover operation from the...

Page 1198: ...d you have the option of reissuing the metrocluster heal command with the override vetoes parameter If you use this optional parameter the system overrides any soft vetoes that prevent the healing ope...

Page 1199: ...lug the system cables and SFPs if needed from the controller module keeping track of where the cables were connected Leave the cables in the cable management device so that when you reinstall the cabl...

Page 1200: ...controller module 3 Press the blue button on the boot media housing to release the boot media from its housing and then gently pull it straight out of the boot media socket Do not twist or pull the b...

Page 1201: ...l the cable management device and recable the system as needed When recabling remember to reinstall the media converters SFPs if they were removed 3 Insert the USB flash drive into the USB slot on the...

Page 1202: ...auto The target port you configure is the target port you use to communicate with the impaired node from the healthy node during var file system restore with a network connection You can also use the...

Page 1203: ...re not in a two node MetroCluster configuration Steps 1 From the LOADER prompt boot the recovery image from the USB flash drive boot_recovery The image is downloaded from the USB flash drive 2 When pr...

Page 1204: ...store OKM NSE and NVE as needed If your system does not have onboard keymanager NSE or NVE configured complete the steps in this section 6 From the LOADER prompt enter the boot_ontap command If you se...

Page 1205: ...Press Ctrl C for Boot Menu message and when the Boot Menu is displayed select option 6 5 Verify that the environmental variables are set as expected a Take the node to the LOADER prompt b Check the e...

Page 1206: ...rviving cluster 5 Verify that the switchback operation has completed metrocluster show The switchback operation is still running when a cluster is in the waiting for switchback state cluster_B metrocl...

Page 1207: ...ard Key Manager is enabled Steps 1 Connect the console cable to the target node 2 Use the boot_ontap command at the LOADER prompt to boot the node 3 Check the console output If the console displays Th...

Page 1208: ...er show command 10 Giveback only the CFO aggregates with the storage failover giveback fromnode local only cfo aggregates true command If the command fails because of a failed disk physically dis enga...

Page 1209: ...ble to the partner node 16 Give back the target node using the storage failover giveback fromnode local command 17 Check the giveback status 3 minutes after it reports complete using the storage failo...

Page 1210: ...that are not on their home node and port If any interfaces are listed as false revert those interfaces back to their home port using the net int revert command 7 Move the console cable to the target n...

Page 1211: ...e console output If the console displays Then The login prompt Go to Step 7 Waiting for giveback a Log into the partner node b Confirm the target node is ready for giveback with the storage failover s...

Page 1212: ...y key manager key query to verify that the Restored column yes true for all authentication keys 11 Connect the console cable to the partner node 12 Give back the node using the storage failover giveba...

Page 1213: ...e a cluster with more than two nodes it must be in quorum If the cluster is not in quorum or a healthy node shows false for eligibility and health you must correct the issue before shutting down the i...

Page 1214: ...gibility and health you must correct the issue before shutting down the impaired node see the Administration overview with the CLI If you have a MetroCluster configuration you must have confirmed that...

Page 1215: ...he CLI You must leave the power supplies turned on at the end of this procedure to provide power to the healthy node Steps 1 Check the MetroCluster status to determine whether the impaired node has au...

Page 1216: ...k the state of the aggregates by using the storage aggregate show command controller_A_1 storage aggregate show Aggregate Size Available Used State Vols Nodes RAID Status aggr_b2 227 1GB 227 1GB 0 onl...

Page 1217: ...ller module 1 If you are not already grounded properly ground yourself 2 Loosen the hook and loop strap binding the cables to the cable management device and then unplug the system cables and SFPs if...

Page 1218: ...ollow the specific sequence of steps Your storage system must meet certain criteria depending on your situation It must have the appropriate operating system for the caching module you are installing...

Page 1219: ...the socket 5 Reseat and push the heatsink down to engage the locking button on the caching module housing 6 Repeat the steps if you have a second caching module Close the controller module cover as n...

Page 1220: ...he boot process when you see the message Press Ctrl C for Boot Menu f Select the option to boot to Maintenance mode from the displayed menu Step 5 Run system level diagnostics After installing a new c...

Page 1221: ...played SLDIAG No log messages are present c Exit Maintenance mode halt The node displays the LOADER prompt d Boot the node from the LOADER prompt bye e Return the node to normal operation If your node...

Page 1222: ...y pressing Ctrl C when prompted to get to the Boot menu If you have two controller modules in the chassis fully seat the controller module you are servicing in the chassis The controller module boots...

Page 1223: ...back command from any node in the surviving cluster 5 Verify that the switchback operation has completed metrocluster show The switchback operation is still running when a cluster is in the waiting fo...

Page 1224: ...that you are moving the controller module or modules to the new chassis and that the chassis is a new component from NetApp This procedure is disruptive For a two node cluster you will have a complete...

Page 1225: ...is procedure If repeated attempts to cleanly shut down the node fail be aware that you might lose any data that was not saved to disk 3 Where applicable halt the second node to avoid a possible quorum...

Page 1226: ...b succeeded Heal Aggregates is successful If the healing is vetoed you have the option of reissuing the metrocluster heal command with the override vetoes parameter If you use this optional parameter...

Page 1227: ...rs 8 On the impaired controller module disconnect the power supplies Move and replace hardware FAS8200 Step 1 Move a power supply Moving out a power supply when replacing a chassis involves turning of...

Page 1228: ...Power supply Cam handle release latch Power and Fault LEDs Cam handle 1225...

Page 1229: ...it all the way into the chassis and then push the cam handle to the closed position making sure that the cam handle release latch clicks into its locked position 8 Reconnect the power cable and secur...

Page 1230: ...g fan modules 6 Insert the fan module into the replacement chassis by aligning it with the opening and then sliding it into the chassis 7 Push firmly on the fan module cam handle so that it is seated...

Page 1231: ...that when you reinstall the cable management device the cables are organized 2 Remove and set aside the cable management devices from the left and right sides of the controller module 3 Loosen the thu...

Page 1232: ...the front of the chassis to the equipment rack or system cabinet using the screws you removed from the old chassis 7 If you have not already done so install the bezel Step 4 Install the controller Af...

Page 1233: ...fully seated and then close the cam handle to the locked position Tighten the thumbscrew on the cam handle on back of the controller module Do not use excessive force when sliding the controller modu...

Page 1234: ...step depends on your system configuration If your system is in Then A stand alone configuration a Exit Maintenance mode halt b Go to Completing the replacement process An HA pair with a second control...

Page 1235: ...the interconnect test from one controller 6 Verify that no hardware problems resulted from the replacement of the chassis sldiag device status dev interconnect long state failed System level diagnosti...

Page 1236: ...sconnect the power supplies c Verify that you have observed all of the considerations identified for running system level diagnostics that cables are securely connected and that hardware components ar...

Page 1237: ...rviving cluster 5 Verify that the switchback operation has completed metrocluster show The switchback operation is still running when a cluster is in the waiting for switchback state cluster_B metrocl...

Page 1238: ...ster configuration is the same as that in an HA pair No MetroCluster specific steps are required because the failure is restricted to an HA pair and storage failover commands can be used to provide no...

Page 1239: ...inistration overview with the CLI Steps 1 If AutoSupport is enabled suppress automatic case creation by invoking an AutoSupport message system node autosupport invoke node type all message MAINT _numb...

Page 1240: ...message MAINT 2h 2 Disable automatic giveback from the console of the healthy node storage failover modify node local auto giveback false 3 Take the impaired node to the LOADER prompt If the impaired...

Page 1241: ...ain If you are unable to resolve the issue contact technical support 3 Resynchronize the data aggregates by running the metrocluster heal phase aggregates command from the surviving cluster controller...

Page 1242: ...er mcc1A metrocluster operation show Operation heal root aggregates State successful Start Time 7 29 2016 20 54 41 End Time 7 29 2016 20 54 42 Errors 8 On the impaired controller module disconnect the...

Page 1243: ...le 5 Loosen the thumbscrew on the cam handle on the controller module Thumbscrew Cam handle 6 Pull the cam handle downward and begin to slide the controller module out of the chassis Make sure that yo...

Page 1244: ...e edges of the boot media with the socket housing and then gently push it into the socket 4 Check the boot media to make sure that it is seated squarely and completely in the socket If necessary remov...

Page 1245: ...ng contents to the flash memory when you halt the system After the destage is complete the LED turns off If power is lost without a clean shutdown the NVMEM LED flashes until the destage is complete a...

Page 1246: ...teps 1 Locate the DIMMs on your controller module 2 Note the orientation of the DIMM in the socket so that you can insert the DIMM in the replacement controller module in the proper orientation 3 Ejec...

Page 1247: ...ps for the remaining DIMMs 7 Move the NVMEM battery to the replacement controller module 8 Align the tab or tabs on the battery holder with the notches in the controller module side and then gently pu...

Page 1248: ...at the preceding step for the remaining PCIe cards in the old controller module 5 Open the new controller module side panel if necessary slide off the PCIe card filler plate as needed and carefully in...

Page 1249: ...e heatsink The storage system comes with two slots available for the caching module and only one slot is occupied by default 2 Move the caching module to the new controller module and then align the e...

Page 1250: ...the boot process which you can typically do at any time after prompted to do so However if the system updates the system firmware when it boots you must wait until after the update is complete before...

Page 1251: ...when sliding the controller module into the chassis to avoid damaging the connectors The controller begins to boot as soon as it is seated in the chassis b If you have not already done so reinstall t...

Page 1252: ...ss Ctrl C when prompted and then boot to Maintenance mode e From the boot menu select the option for Maintenance mode Important During the boot process you might see the following prompts A prompt war...

Page 1253: ...te and time on the replacement node show date The date and time are given in GMT Step 2 Verify and set the HA state of the controller module You must verify the HA state of the controller module and i...

Page 1254: ...gs During the boot process you can safely respond y to the prompts until the Maintenance mode prompt appears 3 Display and note the available devices on the controller module sldiag device show dev mb...

Page 1255: ...ts that you want to run sldiag device modify dev dev_name selection only selection only disables all other tests that you do not want to run for the device d Run the selected tests sldiag device run d...

Page 1256: ...nt to run for the device d Verify that the tests were modified sldiag device show e Repeat these substeps for each device that you want to run concurrently f Run diagnostics on all of the devices sldi...

Page 1257: ...l of the considerations identified for running system level diagnostics that cables are securely connected and that hardware components are properly installed in the storage system d Reconnect the pow...

Page 1258: ...go to the LOADER prompt halt 2 From the LOADER prompt on the replacement node boot the node entering y if you are prompted to override the system ID due to a system ID mismatch boot_ontap 3 Wait until...

Page 1259: ...ration Guide for your version of ONTAP 9 b After the giveback has been completed confirm that the HA pair is healthy and that takeover is possible storage failover show The output from the storage fai...

Page 1260: ...st enter Y when prompted to override the system ID due to a system ID mismatch 2 View the old system IDs from the healthy node metrocluster node show fields node systemid dr partner systemid In this e...

Page 1261: ...n prompted to continue into advanced mode The advanced mode prompt appears b Verify that the coredumps are saved system node run node local node name partner savecore If the command output indicates t...

Page 1262: ...on a From any node s prompt change to the advanced privilege level set privilege advanced You need to respond with y when prompted to continue into advanced mode and see the advanced mode prompt b Per...

Page 1263: ...lity After replacing the controller module or NVRAM module for a storage system that you previously configured to use Storage or Volume Encryption you must perform additional steps to provide uninterr...

Page 1264: ...applies to two node MetroCluster configurations Steps 1 Verify that all nodes are in the enabled state metrocluster node show cluster_B metrocluster node show DR Configuration DR Group Cluster Node St...

Page 1265: ...support at NetApp Support 888 463 8277 North America 00 800 44 638277 Europe or 800 800 80 800 Asia Pacific if you need the RMA number or additional help with the replacement procedure Replace a DIMM...

Page 1266: ...l C and then respond y when prompted System prompt or password prompt enter system password Take over or halt the impaired node For an HA pair take over the impaired node from the healthy node storage...

Page 1267: ...lover takeover ofnode impaired_node_name When the impaired node shows Waiting for giveback press Ctrl C and then respond y Option 3 Controller is in a two node MetroCluster To shut down the impaired n...

Page 1268: ...s successful If the healing is vetoed you have the option of reissuing the metrocluster heal command with the override vetoes parameter If you use this optional parameter the system overrides any soft...

Page 1269: ...ed controller module disconnect the power supplies Step 2 Open the controller module To access components inside the controller you must first remove the controller module from the system and then rem...

Page 1270: ...is located on the back of the controller module Look for the following icon 2 If the NVMEM LED is not flashing there is no content in the NVMEM you can skip the following steps and proceed to the nex...

Page 1271: ...e NVMEM LED on the controller module 5 Locate the DIMMs on your controller module Each system memory DIMM has an LED located on the board next to each DIMM slot The LED for the faulty blinks every two...

Page 1272: ...he notch among the pins on the DIMM should line up with the tab in the socket 9 Make sure that the DIMM ejector tabs on the connector are in the open position and then insert the DIMM squarely into th...

Page 1273: ...fully seated in the chassis Be prepared to interrupt the boot process a With the cam handle in the open position firmly push the controller module in until it meets the midplane and is fully seated an...

Page 1274: ...ware problems resulted from the replacement of the DIMMs sldiag device status dev mem long state failed System level diagnostics returns you to the prompt if there are no test failures or lists the fu...

Page 1275: ...ified for running system level diagnostics that cables are securely connected and that hardware components are properly installed in the storage system d Boot the controller module you are servicing i...

Page 1276: ...hronization is complete on all SVMs metrocluster vserver show 3 Verify that any automatic LIF migrations being performed by the healing operations were completed successfully metrocluster check lif sh...

Page 1277: ...th the replacement procedure Swap out a fan FAS8200 To swap out a fan module without interrupting service you must perform a specific sequence of tasks You must replace the fan module within two minut...

Page 1278: ...ule aside 7 Insert the replacement fan module into the chassis by aligning it with the opening and then sliding it into the chassis 8 Push firmly on the fan module cam handle so that it is seated all...

Page 1279: ...determine the status of the node and if necessary take over the node so that the healthy node continues to serve data from the impaired node storage About this task If you have a cluster with more tha...

Page 1280: ...gibility and health you must correct the issue before shutting down the impaired node see the Administration overview with the CLI If you have a MetroCluster configuration you must have confirmed that...

Page 1281: ...he CLI You must leave the power supplies turned on at the end of this procedure to provide power to the healthy node Steps 1 Check the MetroCluster status to determine whether the impaired node has au...

Page 1282: ...k the state of the aggregates by using the storage aggregate show command controller_A_1 storage aggregate show Aggregate Size Available Used State Vols Nodes RAID Status aggr_b2 227 1GB 227 1GB 0 onl...

Page 1283: ...ller module 1 If you are not already grounded properly ground yourself 2 Loosen the hook and loop strap binding the cables to the cable management device and then unplug the system cables and SFPs if...

Page 1284: ...tion go to the next step If your system is in a stand alone configuration cleanly shut down the controller module and then check the NVRAM LED identified by the NV icon The NVRAM LED blinks while dest...

Page 1285: ...s on the battery holder with the notches in the controller module side and then gently push down on the battery housing until the battery housing clicks into place 6 Close the CPU air duct Make sure t...

Page 1286: ...so reinstall the cable management device d Bind the cables to the cable management device with the hook and loop strap e As each node starts the booting press Ctrl C to interrupt the boot process whe...

Page 1287: ...ailures a Clear the status logs sldiag device clearstatus b Verify that the log was cleared sldiag device status The following default response is displayed SLDIAG No log messages are present c Exit M...

Page 1288: ...y pressing Ctrl C when prompted to get to the Boot menu If you have two controller modules in the chassis fully seat the controller module you are servicing in the chassis The controller module boots...

Page 1289: ...back command from any node in the surviving cluster 5 Verify that the switchback operation has completed metrocluster show The switchback operation is still running when a cluster is in the waiting fo...

Page 1290: ...must determine the status of the node and if necessary take over the node so that the healthy node continues to serve data from the impaired node storage About this task If you have a cluster with mo...

Page 1291: ...gibility and health you must correct the issue before shutting down the impaired node see the Administration overview with the CLI If you have a MetroCluster configuration you must have confirmed that...

Page 1292: ...he CLI You must leave the power supplies turned on at the end of this procedure to provide power to the healthy node Steps 1 Check the MetroCluster status to determine whether the impaired node has au...

Page 1293: ...k the state of the aggregates by using the storage aggregate show command controller_A_1 storage aggregate show Aggregate Size Available Used State Vols Nodes RAID Status aggr_b2 227 1GB 227 1GB 0 onl...

Page 1294: ...ller module 1 If you are not already grounded properly ground yourself 2 Loosen the hook and loop strap binding the cables to the cable management device and then unplug the system cables and SFPs if...

Page 1295: ...port the bottom of the controller module as you slide it out of the chassis Step 3 Replace a PCIe card To replace a PCIe card locate it within the controller and follow the specific sequence of steps...

Page 1296: ...the system Do not completely insert the controller module in the chassis until instructed to do so 2 Recable the system as needed If you removed the media converters QSFPs or SFPs remember to reinsta...

Page 1297: ...s convert these ports to 10 GbE connections by using the nicadmin convert command from Maintenance mode Be sure to exit Maintenance mode after completing the conversion 5 Return the node to normal ope...

Page 1298: ...rviving cluster 5 Verify that the switchback operation has completed metrocluster show The switchback operation is still running when a cluster is in the waiting for switchback state cluster_B metrocl...

Page 1299: ...ing one power supply at a time It is a best practice to replace the power supply within two minutes of removing it from the chassis The system continues to function but ONTAP sends messages to the con...

Page 1300: ...Power supply Cam handle release latch Power and Fault LEDs Cam handle 1297...

Page 1301: ...able retainer Once power is restored to the power supply the status LED should be green 1 Turn on the power to the new power supply and then verify the operation of the power supply activity LEDs The...

Page 1302: ...ailover modify node local auto giveback false 3 Take the impaired node to the LOADER prompt If the impaired node is displaying Then The LOADER prompt Go to the next step Waiting for giveback Press Ctr...

Page 1303: ...rd prompt enter system password Take over or halt the impaired node For an HA pair take over the impaired node from the healthy node storage failover takeover ofnode impaired_node_name When the impair...

Page 1304: ...b succeeded Heal Aggregates is successful If the healing is vetoed you have the option of reissuing the metrocluster heal command with the override vetoes parameter If you use this optional parameter...

Page 1305: ...ed controller module disconnect the power supplies Step 2 Open the controller module To access components inside the controller you must first remove the controller module from the system and then rem...

Page 1306: ...sure that you support the bottom of the controller module as you slide it out of the chassis Step 3 Replace the RTC Battery To replace the RTC battery locate them inside the controller and follow the...

Page 1307: ...pping bag 5 Locate the empty battery holder in the controller module 6 Note the polarity of the RTC battery and then insert it into the holder by tilting the battery at an angle and pushing down 7 Vis...

Page 1308: ...he hook and loop strap d Reconnect the power cables to the power supplies and to the power sources and then turn on the power to start the boot process e Halt the controller at the LOADER prompt 6 Res...

Page 1309: ...ing performed by the healing operations were completed successfully metrocluster check lif show 4 Perform the switchback by using the metrocluster switchback command from any node in the surviving clu...

Page 1310: ...or SnapVault configurations Step 6 Return the failed part to NetApp After you replace the part you can return the failed part to NetApp as described in the RMA instructions shipped with the kit Contac...

Page 1311: ...a typical installation of your system from racking and cabling through initial system bring up Use this guide if you are familiar with installing NetApp systems Access the Installation and Setup Instr...

Page 1312: ...of ONTAP for more information about this system NetApp Hardware Universe Find the Release Notes for your version of ONTAP 9 You need to provide the following at your site Rack space for the storage s...

Page 1313: ...dependent X6585 R6 112 00291 3m X6562 R6 112 00196 5m Management network Micro USB console cable Not applicable Console connection used during software setup if laptop or console does not support net...

Page 1314: ...itchless cluster The optional data ports optional NIC cards and management ports on the controller modules are connected to switches The cluster interconnect and HA ports are cabled on both controller...

Page 1315: ...ing instructions Option 2 Cable a switched cluster The optional data ports optional NIC cards mezzanine cards and management ports on the controller modules are connected to switches The cluster inter...

Page 1316: ...s to drive shelves for drive shelf cabling instructions Step 4 Cable controllers to drive shelves Option 1 Cable the controllers to SAS drive shelves You must cable each controller to the IOM modules...

Page 1317: ...Complete system setup and configuration to complete system setup and configuration Step 5 Complete system setup and configuration You can complete the system setup and configuration using cluster disc...

Page 1318: ...op has network discovery enabled See your laptop s online help for more information 4 Use the following animation to connect your laptop to the Management switch Connecting your laptop to the Manageme...

Page 1319: ...your laptop or console a Set the console port on the laptop or console to 115 200 baud with N 8 1 See your laptop or console s online help for how to configure the console port b Connect the console c...

Page 1320: ...Log in to your existing account or create an account NetApp Support Registration b Register your system NetApp Product Registration c Download Active IQ Config Advisor NetApp Downloads Config Advisor...

Page 1321: ...ligibility and health you must correct the issue before shutting down the impaired node see the NetApp Encryption overview with the CLI Steps 1 Check the status of the impaired node If the impaired no...

Page 1322: ...s external and the Restored column displays yes it s safe to shut down the impaired node If the Key Manager type displays onboard and the Restored column displays yes you need to complete some additio...

Page 1323: ...t need to manually recover OKM g Return to admin mode set priv admin h You can safely shutdown the node Verify NSE configuration 1 Display the key IDs of the authentication keys that are stored on the...

Page 1324: ...port mysupport netapp com b Verify the Restored column shows yes for all authentication keys security key manager key query c Verify that the Key Manager type shows onboard manually backup the OKM inf...

Page 1325: ...data from the impaired node storage If you have a cluster with more than two nodes it must be in quorum If the cluster is not in quorum or a healthy node shows false for eligibility and health you mu...

Page 1326: ...the Returning SEDs to unprotected mode section of Administration overview with the CLI You must leave the power supplies turned on at the end of this procedure to provide power to the healthy node Ste...

Page 1327: ...k the state of the aggregates by using the storage aggregate show command controller_A_1 storage aggregate show Aggregate Size Available Used State Vols Nodes RAID Status aggr_b2 227 1GB 227 1GB 0 onl...

Page 1328: ...nimation illustration or the written steps to remove the controller module from the chassis Removing the controller module Steps 1 If you are not already grounded properly ground yourself 2 Release th...

Page 1329: ...ontroller module and then follow the directions to replace it Before you begin Although the contents of the boot media is encrypted it is a best practice to erase the contents of the boot media before...

Page 1330: ...the locking tabs on the sides of the air duct in toward the middle of the controller module b Slide the air duct toward the back of the controller module and then rotate it upward to its completely o...

Page 1331: ...gently push it into the socket 4 Check the boot media to make sure that it is seated squarely and completely in the socket If necessary remove the boot media and reseat it into the socket 5 Lock the b...

Page 1332: ...drive a Download the service image to your work space on your laptop b Unzip the service image If you are extracting the contents using Windows do not use WinZip to extract the netboot image Use anot...

Page 1333: ...Ctrl C select the option to boot to Maintenance mode and then halt the node to boot to LOADER 9 Although the environment variables and bootargs are retained you should check that all required boot en...

Page 1334: ...mage from the USB drive restore the file system and verify the environmental variables This procedure applies to systems that are not in a two node MetroCluster configuration Steps 1 From the LOADER p...

Page 1335: ...store OKM NSE and NVE as needed If your system does not have onboard keymanager NSE or NVE configured complete the steps in this section 6 From the LOADER prompt enter the boot_ontap command If you se...

Page 1336: ...trl C for Boot Menu message and when the Boot Menu is displayed select option 6 5 Verify that the environmental variables are set as expected a Take the node to the LOADER prompt b Check the environme...

Page 1337: ...rviving cluster 5 Verify that the switchback operation has completed metrocluster show The switchback operation is still running when a cluster is in the waiting for switchback state cluster_B metrocl...

Page 1338: ...to the target node 2 Use the boot_ontap command at the LOADER prompt to boot the node 3 Check the console output If the console displays Then The LOADER prompt Boot the node to the boot menu boot_onta...

Page 1339: ...with the storage failover show command 10 Giveback only the CFO aggregates with the storage failover giveback fromnode local only cfo aggregates true command If the command fails because of a failed...

Page 1340: ...the net int revert command 17 Move the console cable to the target node and run the version v command to check the ONTAP versions 18 Restore automatic giveback if you disabled it by using the storage...

Page 1341: ...anagement servers If the Restored column yes true you are done and can proceed to complete the replacement process If the Key Manager type external and the Restored column anything other than yes true...

Page 1342: ...issue before shutting down the impaired node ONTAP 9 System Administration Reference You might want to erase the contents of your caching module before replacing it Steps 1 Although data on the cachin...

Page 1343: ...false for eligibility and health you must correct the issue before shutting down the impaired node see the Administration overview with the CLI If you have a MetroCluster configuration you must have c...

Page 1344: ...he CLI You must leave the power supplies turned on at the end of this procedure to provide power to the healthy node Steps 1 Check the MetroCluster status to determine whether the impaired node has au...

Page 1345: ...k the state of the aggregates by using the storage aggregate show command controller_A_1 storage aggregate show Aggregate Size Available Used State Vols Nodes RAID Status aggr_b2 227 1GB 227 1GB 0 onl...

Page 1346: ...on or the written steps to remove the controller module from the chassis Removing the controller module Steps 1 If you are not already grounded properly ground yourself 2 Release the power cable retai...

Page 1347: ...he FRU map on the controller module for the location of the Flash Cache Your storage system must meet certain criteria depending on your situation It must have the appropriate operating system for the...

Page 1348: ...led caching module s LED is lit a Press the blue release tab The caching module end rises clear of the release tab b Rotate the caching module up and slide it out of the socket 4 Install the replaceme...

Page 1349: ...e in the chassis until instructed to do so 3 Cable the management and console ports only so that you can access the system to perform the tasks in the following sections You will connect the rest of t...

Page 1350: ...art diagnostics All commands in the diagnostic procedures are issued from the node where the component is being replaced Steps 1 If the node to be serviced is not at the LOADER prompt reboot the node...

Page 1351: ...local disk pools This task only applies to two node MetroCluster configurations Steps 1 Verify that all nodes are in the enabled state metrocluster node show cluster_B metrocluster node show DR Config...

Page 1352: ...u can return the failed part to NetApp as described in the RMA instructions shipped with the kit Contact technical support at NetApp Support 888 463 8277 North America 00 800 44 638277 Europe or 800 8...

Page 1353: ...rm the halt system node halt node node_name The confirmation message looks like the following Warning Rebooting or halting node node_name in an HA enabled cluster may result in client disruption or da...

Page 1354: ...er you attempted switchover with the metrocluster switchover command and the switchover was vetoed Review the veto messages and if possible resolve the issue and try again If you are unable to resolve...

Page 1355: ...nation cluster mcc1A metrocluster operation show Operation heal root aggregates State successful Start Time 7 29 2016 20 54 41 End Time 7 29 2016 20 54 42 Errors 8 On the impaired controller module di...

Page 1356: ...ard The fan module moves a little bit away from the chassis 4 Pull the fan module straight out from the chassis making sure that you support it with your free hand so that it does not swing out of the...

Page 1357: ...e with the opening in the chassis and then gently push the controller module halfway into the system Do not completely insert the controller module in the chassis until instructed to do so 2 Recable t...

Page 1358: ...state should be the same for all components 2 If the displayed system state for the chassis does not match your system configuration a Set the HA state for the chassis ha config modify chassis HA sta...

Page 1359: ...ync source storage virtual machines SVMs on the formerly impaired site now active and serving data from the local disk pools This task only applies to two node MetroCluster configurations Steps 1 Veri...

Page 1360: ...r or additional help with the replacement procedure Controller Replace the controller module FAS8300 and FAS8700 You must review the prerequisites for the replacement procedure and select the correct...

Page 1361: ...down the impaired node you must determine the status of the node and if necessary take over the node so that the healthy node continues to serve data from the impaired node storage If you have a clus...

Page 1362: ...st have confirmed that the MetroCluster Configuration State is configured and that the nodes are in an enabled and normal state metrocluster node show Steps 1 If AutoSupport is enabled suppress automa...

Page 1363: ...d node Then Has automatically switched over Proceed to the next step Has not automatically switched over Perform a planned switchover operation from the healthy node metrocluster switchover Has not au...

Page 1364: ...the healing is vetoed you have the option of reissuing the metrocluster heal command with the override vetoes parameter If you use this optional parameter the system overrides any soft vetoes that pre...

Page 1365: ...g the cables to the cable management device and then unplug the system cables and SFPs if needed from the controller module keeping track of where the cables were connected Leave the cables in the cab...

Page 1366: ...ler module and then rotate it upward to its completely open position c Rotate the riser locking latch on the left side of riser 1 up and toward air duct lift the riser up and then set it aside d Repea...

Page 1367: ...ule until the locking tab clicks into place The power supplies will only properly engage with the internal connector and lock in place one way To avoid damaging the internal connector do not use exces...

Page 1368: ...e blue locking tab marked PUSH and then lift the battery out of the holder and controller module 3 Move the battery to the replacement controller module 4 Align the battery module with the opening for...

Page 1369: ...sing and then gently push it into the socket 3 Check the boot media to make sure that it is seated squarely and completely in the socket If necessary remove the boot media and reseat it into the socke...

Page 1370: ...ns illustrations or the written steps to move the PCIe risers and mezzanine card from the impaired controller module to the replacement controller module Moving PCIe riser 1 and 2 left and middle rise...

Page 1371: ...er squarely into the socket on the motherboard and then rotate the latch down flush with the sheet metal on the riser e Repeat this step for riser number 2 2 Remove riser number 3 remove the mezzanine...

Page 1372: ...les to the new controller module Moving the caching modules 1 If you are not already grounded properly ground yourself 2 Move the caching modules from the impaired controller module to the replacement...

Page 1373: ...ed controller module to the replacement controller module You must have the new controller module ready so that you can move the DIMMs directly from the impaired controller module to the corresponding...

Page 1374: ...e c Make sure that the DIMM ejector tabs on the DIMM socket are in the open position and then insert the DIMM squarely into the socket The DIMMs fit tightly in the socket but should go in easily If no...

Page 1375: ...e power supply to the power source b Using the locking latches firmly push the controller module into the chassis until the locking latches begin to rise Do not use excessive force when sliding the co...

Page 1376: ...It is important that you apply the commands in the steps on the correct systems The replacement node is the new node that replaced the impaired node as part of this procedure The healthy node is the...

Page 1377: ...e to be serviced is not at the LOADER prompt reboot the node system node halt node node_name After you issue the command you should wait until the system stops at the LOADER prompt 2 At the LOADER pro...

Page 1378: ...the end of the procedure In a stand alone system you must manually reassign the ID to the disks You must use the correct procedure for your configuration Controller redundancy Then use this procedure...

Page 1379: ...re issuing the giveback You can enter the following command to monitor the progress of the savecore command system node run node local node name partner savecore s d Return to the admin privilege leve...

Page 1380: ...t this task This procedure applies only to systems in a two node MetroCluster configuration running ONTAP You must be sure to issue the commands in this procedure on the correct node The impaired node...

Page 1381: ...reassign s old system ID In the case of the preceding example the command is disk reassign s 118073209 You can respond Y when prompted to continue 5 Verify that the disks or FlexArray LUNs were assign...

Page 1382: ...e show fields configuration state node1_siteA metrocluster node show fields configuration state dr group id cluster node configuration state 1 node1_siteA node1mcc 001 configured 1 node1_siteA node1mc...

Page 1383: ...e licenses keys must be in the 28 character format You have a 90 day grace period in which to install the license keys After the grace period all old licenses are invalidated After a valid license key...

Page 1384: ...d as false revert them to their home ports network interface revert 2 Register the system serial number with NetApp Support If AutoSupport is enabled send an AutoSupport message to register the serial...

Page 1385: ...rviving cluster 5 Verify that the switchback operation has completed metrocluster show The switchback operation is still running when a cluster is in the waiting for switchback state cluster_B metrocl...

Page 1386: ...ng different procedures depending on the storage system hardware configuration Option 1 Most configurations To shut down the impaired node you must determine the status of the node and if necessary ta...

Page 1387: ...not in quorum or a healthy node shows false for eligibility and health you must correct the issue before shutting down the impaired node see the Administration overview with the CLI If you have a Met...

Page 1388: ...he CLI You must leave the power supplies turned on at the end of this procedure to provide power to the healthy node Steps 1 Check the MetroCluster status to determine whether the impaired node has au...

Page 1389: ...k the state of the aggregates by using the storage aggregate show command controller_A_1 storage aggregate show Aggregate Size Available Used State Vols Nodes RAID Status aggr_b2 227 1GB 227 1GB 0 onl...

Page 1390: ...on or the written steps to remove the controller module from the chassis Removing the controller module Steps 1 If you are not already grounded properly ground yourself 2 Release the power cable retai...

Page 1391: ...ut of the chassis 7 Place the controller module on a stable flat surface Step 3 Replace system DIMMs Replacing a system DIMM involves identifying the target DIMM through the associated error message l...

Page 1392: ...n slots 2 4 7 9 13 15 18 and 20 The NVDIMM is located in slot 11 Steps 1 Open the air duct a Press the locking tabs on the sides of the air duct in toward the middle of the controller module b Slide t...

Page 1393: ...e DIMM squarely into the slot The DIMM fits tightly in the slot but should go in easily If not realign the DIMM with the slot and reinsert it Visually inspect the DIMM to verify that it is evenly alig...

Page 1394: ...tating the locking latches upward tilting them so that they clear the locking pins gently push the controller all the way in and then lower the locking latches into the locked position The controller...

Page 1395: ...r module and then reenable automatic giveback Steps 1 Recable the system as needed If you removed the media converters QSFPs or SFPs remember to reinstall them if you are using fiber optic cables 2 Re...

Page 1396: ...rviving cluster 5 Verify that the switchback operation has completed metrocluster show The switchback operation is still running when a cluster is in the waiting for switchback state cluster_B metrocl...

Page 1397: ...ber or additional help with the replacement procedure Hot swap a fan module FAS8300 and FAS8700 To swap out a fan module without interrupting service you must perform a specific sequence of tasks You...

Page 1398: ...n the fan module is completely seated 9 Swing the cam handle up to its closed position making sure that the cam handle release latch clicks into the locked position The Attention LED should not be lit...

Page 1399: ...ailover modify node local auto giveback false 3 Take the impaired node to the LOADER prompt If the impaired node is displaying Then The LOADER prompt Go to the next step Waiting for giveback Press Ctr...

Page 1400: ...rd prompt enter system password Take over or halt the impaired node For an HA pair take over the impaired node from the healthy node storage failover takeover ofnode impaired_node_name When the impair...

Page 1401: ...b succeeded Heal Aggregates is successful If the healing is vetoed you have the option of reissuing the metrocluster heal command with the override vetoes parameter If you use this optional parameter...

Page 1402: ...e by using the metrocluster operation show command on the destination cluster mcc1A metrocluster operation show Operation heal root aggregates State successful Start Time 7 29 2016 20 54 41 End Time 7...

Page 1403: ...rt the bottom of the controller module as you slide it out of the chassis 7 Place the controller module on a stable flat surface Step 3 Replace the NVDIMM To replace the NVDIMM you must locate it in t...

Page 1404: ...M ejector tabs on either side of the NVDIMM and then slide the NVDIMM out of the socket and set it aside Carefully hold the NVDIMM by the edges to avoid pressure on the components on the NVDIMM circui...

Page 1405: ...have replaced the component in the controller module you must re install the controller module into the chassis and then boot it to Maintenance mode You can use the following animation illustration or...

Page 1406: ...mal boot process and boot to LOADER by pressing Ctrl C If your system stops at the boot menu select the option to boot to LOADER f At the LOADER prompt enter bye to reinitialize the PCIe cards and oth...

Page 1407: ...as disabled reenable it storage failover modify node local auto giveback true Step 7 Switch back aggregates in a two node MetroCluster configuration After you have completed the FRU replacement in a t...

Page 1408: ...e Mode Local cluster_B configured normal Remote cluster_A configured normal If a switchback is taking a long time to finish you can check on the status of in progress baselines by using the metroclust...

Page 1409: ...message MAINT number_of_hours_downh The following AutoSupport message suppresses automatic case creation for two hours cluster1 system node autosupport invoke node type all message MAINT 2h 2 Disable...

Page 1410: ...console of the healthy node storage failover modify node local auto giveback false 3 Take the impaired node to the LOADER prompt If the impaired node is displaying Then The LOADER prompt Go to the nex...

Page 1411: ...If you are unable to resolve the issue contact technical support 3 Resynchronize the data aggregates by running the metrocluster heal phase aggregates command from the surviving cluster controller_A_...

Page 1412: ...meter the system overrides any soft vetoes that prevent the healing operation 7 Verify that the heal operation is complete by using the metrocluster operation show command on the destination cluster m...

Page 1413: ...set it aside 5 Press down on both of the locking latches and then rotate both latches downward at the same time The controller module moves slightly out of the chassis 6 Slide the controller module o...

Page 1414: ...battery in the controller module 3 Locate the battery plug and squeeze the clip on the face of the battery plug to release the plug from the socket and then unplug the battery cable from the socket 4...

Page 1415: ...e in the chassis until instructed to do so 3 Cable the management and console ports only so that you can access the system to perform the tasks in the following sections You will connect the rest of t...

Page 1416: ...nostic procedures are issued from the node where the component is being replaced Steps 1 If the node to be serviced is not at the LOADER prompt reboot the node system node halt node node_name After yo...

Page 1417: ...oCluster configurations Steps 1 Verify that all nodes are in the enabled state metrocluster node show cluster_B metrocluster node show DR Configuration DR Group Cluster Node State Mirroring Mode 1 clu...

Page 1418: ...pp Support 888 463 8277 North America 00 800 44 638277 Europe or 800 800 80 800 Asia Pacific if you need the RMA number or additional help with the replacement procedure Replace a PCIe or mezzanine ca...

Page 1419: ...sword Take over or halt the impaired node For an HA pair take over the impaired node from the healthy node storage failover takeover ofnode impaired_node_name When the impaired node shows Waiting for...

Page 1420: ...ng for giveback press Ctrl C and then respond y Option 3 Controller is in a two node MetroCluster To shut down the impaired node you must determine the status of the node and if necessary switch over...

Page 1421: ...s successful If the healing is vetoed you have the option of reissuing the metrocluster heal command with the override vetoes parameter If you use this optional parameter the system overrides any soft...

Page 1422: ...using the metrocluster operation show command on the destination cluster mcc1A metrocluster operation show Operation heal root aggregates State successful Start Time 7 29 2016 20 54 41 End Time 7 29 2...

Page 1423: ...ntroller module and set it aside 5 Press down on both of the locking latches and then rotate both latches downward at the same time The controller module moves slightly out of the chassis 6 Slide the...

Page 1424: ...locking bracket on the side of the PCIe riser and then rotate it to the open position c For risers 2 and 3 only swing the side panel up d Remove the PCIe card from the riser by gently pushing up on t...

Page 1425: ...access the mezzanine card replace the mezzanine card and then reinstall riser number 3 See the FRU map on the controller module for more information You can use the following animation illustration o...

Page 1426: ...3 Reinstall the riser a Align the riser with the pins to the side of the riser socket lower the riser down on the pins b Push the riser squarely into the socket on the motherboard c Rotate the latch d...

Page 1427: ...ting them so that they clear the locking pins gently push the controller all the way in and then lower the locking latches into the locked position d If you have not already done so reinstall the cabl...

Page 1428: ...back command from any node in the surviving cluster 5 Verify that the switchback operation has completed metrocluster show The switchback operation is still running when a cluster is in the waiting fo...

Page 1429: ...cal support at NetApp Support 888 463 8277 North America 00 800 44 638277 Europe or 800 800 80 800 Asia Pacific if you need the RMA number or additional help with the replacement procedure Replace a p...

Page 1430: ...r supply from the chassis c Using both hands pull the power supply out of the chassis and then set it aside 5 Using both hands support and align the edges of the power supply with the opening in the c...

Page 1431: ...ired controller using different procedures depending on the storage system hardware configuration Option 1 Most configurations To shut down the impaired node you must determine the status of the node...

Page 1432: ...healthy node shows false for eligibility and health you must correct the issue before shutting down the impaired node see the Administration overview with the CLI If you have a MetroCluster configura...

Page 1433: ...he CLI You must leave the power supplies turned on at the end of this procedure to provide power to the healthy node Steps 1 Check the MetroCluster status to determine whether the impaired node has au...

Page 1434: ...k the state of the aggregates by using the storage aggregate show command controller_A_1 storage aggregate show Aggregate Size Available Used State Vols Nodes RAID Status aggr_b2 227 1GB 227 1GB 0 onl...

Page 1435: ...on or the written steps to remove the controller module from the chassis Removing the controller module Steps 1 If you are not already grounded properly ground yourself 2 Release the power cable retai...

Page 1436: ...he controller module as you slide it out of the chassis 7 Place the controller module on a stable flat surface Step 3 Replace the RTC battery You need to locate the RTC battery inside the controller m...

Page 1437: ...ign near the holder tells you how the battery should be positioned c Remove the replacement battery from the antistatic shipping bag d Note the polarity of the RTC battery and then insert it into the...

Page 1438: ...repared to interrupt the boot process b Fully seat the controller module in the chassis by rotating the locking latches upward tilting them so that they clear the locking pins gently push the controll...

Page 1439: ...figured enabled heal roots completed cluster_B controller_B_1 configured enabled waiting for switchback recovery 2 entries were displayed 2 Verify that resynchronization is complete on all SVMs metroc...

Page 1440: ...lication resync status show command 6 Reestablish any SnapMirror or SnapVault configurations Step 6 Return the failed part to NetApp After you replace the part you can return the failed part to NetApp...

Page 1441: ...e applicable field replaceable unit FRU flyer This guide does not provide detailed definitions of specific commands subcommands tests or conditions Once the command is entered the tests run in the bac...

Page 1442: ...together due to an internal switch connection In systems with e0M and e0P ports the most efficient pairings are e0M with e0a and e0P with e0b If there are a number of network interface ports on the s...

Page 1443: ...s used in syntax help are as follows keyword Specifies the name of a command or an option that must be entered as shown less than greater than symbols Specify that you must replace the variable identi...

Page 1444: ...system level diagnostics 3 View the version of system level diagnostics present on your storage system by entering the following command sldiag version show The version is displayed in the format Syst...

Page 1445: ...s Your storage system provides the following output while the tests are still running There are still test s being processed After all the tests are complete the following response appears by default...

Page 1446: ...35309 Started adapter interrupt test Adapter interrupt test OK Started adapter reset test Adapter reset OK Started Adapter Get Connection State Test Connection State 5 Loop on FC Adapter 0b is OPEN St...

Page 1447: ...down and disconnect the power supplies c Verify that you have observed all the considerations identified for running system level diagnostics that cables are securely connected and that hardware compo...

Page 1448: ...s of the failures is displayed in a test run without the appropriate hardware sldiag device status long state failed TEST START DEVTYPE nvram_ib NAME external loopback test START DATE Sat Jan 3 23 10...

Page 1449: ...on State 5 Loop on FC Adapter 0b is OPEN Started adapter Retry LIP test Adapter Retry LIP OK ERROR failed to init adaptor port for IOCTL call ioctl_status class_type 0x1 ioctl_status subclass 0x3 ioct...

Page 1450: ...he power supplies c Verify that you have observed all the considerations identified for running system level diagnostics that cables are securely connected and that hardware components are properly in...

Page 1451: ...atus of the failures is displayed in a test run without the appropriate hardware sldiag device status long state failed TEST START DEVTYPE nvram_ib NAME external loopback test START DATE Sat Jan 3 23...

Page 1452: ...on State 5 Loop on FC Adapter 0b is OPEN Started adapter Retry LIP test Adapter Retry LIP OK ERROR failed to init adaptor port for IOCTL call ioctl_status class_type 0x1 ioctl_status subclass 0x3 ioct...

Page 1453: ...d halt d Enter the following command at the Loader prompt to boot the storage system boot_ontap You have completed system level diagnostics Resulted in some test failures Determine the cause of the pr...

Page 1454: ...ng substeps 1 and 2 e Repeat Steps 1 through 5 of Running slow system response diagnostics If the failures persist after repeating the steps you need to replace the hardware Run hardware installation...

Page 1455: ...ifies that all the motherboard devices are to be tested slot slotnum specifies that a device in a specific slot number is to be tested name device specifies a given device class and type 4 View the st...

Page 1456: ...d adapter interrupt test Adapter interrupt test OK Started adapter reset test Adapter reset OK Started Adapter Get Connection State Test Connection State 5 Loop on FC Adapter 0b is OPEN Started adapte...

Page 1457: ...cause of the problem a Exit Maintenance mode by entering the following command halt b Perform a clean shutdown and disconnect the power supplies c Verify that you have observed all the considerations...

Page 1458: ...annel Virtual Interface not connected to a Fibre Channel network interconnect or nvram ib is the high availability interface mem is system memory nic is a Network Interface Card not connected to a net...

Page 1459: ...adapter info Adapter get adapter info OK Adapter fc_data_link_rate 1Gib Adapter name QLogic 2532 Adapter firmware rev 4 5 2 Adapter hardware rev 2 Started adapter get WWN string test Adapter get WWN...

Page 1460: ...e same test failures Technical support might recommend modifying the default settings on some of the tests to help identify the problem a Modify the selection state of a specific device or type of dev...

Page 1461: ...lt response is displayed SLDIAG No log messages are present c Exit Maintenance mode by entering the following command halt d Enter the following command at the Loader prompt to boot the storage system...

Page 1462: ...Installing SuperRail to round hole four post rack 1459...

Page 1463: ...kit installation instructions AFF A700 and FAS9000 There are two two post support rail kits that can be used with the FAS9000 and AFF A700 systems One kit allows you to flush mount your system in the...

Page 1464: ...the other kit allows you to mid mount your system in the two post rack Install the two post mid mount rail kit Install the two post flush mount rail kit 1461...

Page 1465: ...to install cabinet System cabinet features The system cabinet consists of side panels front and rear doors an optional bolt down kit an optional interconnect kit PDUs for your equipment and an integr...

Page 1466: ...f the rear door and the frame Cable management Cable management hook and loop strapping is attached to the frame of the system cabinet at equal intervals Support rails The number of support rails you...

Page 1467: ...l kit from other system cabinets because they are not designed for use in the 42U 1280 mm system cabinet A left and right support rail Two screws per rail for securing the rail to the system cabinet f...

Page 1468: ...d to unpack and install your system cabinet Dimensions U S Metric Shipping ramp length 80 in 203 2 cm Clearance beyond the ramp for cabinet mobility 72 in 182 9 cm Shipping pallet depth 59 in 149 9 cm...

Page 1469: ...system cabinet The following illustrations show top and bottom views of the system cabinet and identify the openings through which you can run cable bundles from the floor of your data center into th...

Page 1470: ...EMA or IEC The most current information for PDUs supported in your system cabinet is listed in the Hardware Universe hwu netapp com Unpack the system cabinet You must remove the packing material that...

Page 1471: ...system cabinets can be connected together by using the optional interconnect kit and they can be anchored to the data center floor by using the optional bolt down kit Install the cabinet interconnect...

Page 1472: ...s recommended reinstall the side panels that were removed during unpacking a Lift the side panel tilting it about 15 degrees away from the system cabinet bottom and then hang it over the lip at the to...

Page 1473: ...illustration for reference to unplug the power to the illuminated bezel Illuminated bezel circuit board and cable Back panel and thumbscrews c Use the following illustration for reference to remove t...

Page 1474: ...he rear door whose hinges are on the edge where the cabinets meet a Unlock and open the rear door that you are removing b Lift the top hinge pin until it clears the bottom of the hinge c Gently tip th...

Page 1475: ...four leveling feet at the bottom of the system cabinets 6 Install the interconnect brackets Use the following illustration for reference if you are installing the interconnect brackets with the syste...

Page 1476: ...bracket Use the following illustration for reference if you are installing the interconnect brackets with the system cabinet side panels off 7 Repeat the process for any remaining system cabinets 8 T...

Page 1477: ...floor anchor point on the bracket 2 Mark the anchoring points where the rear bolt down brackets will be anchored to the floor and then drill the holes for the brackets Be sure to use the appropriate...

Page 1478: ...s task applies to all controller and disk shelves except the DS212C and the DE212C disk shelves Use the instructions in the rail kit flyer applicable to those two disk shelves Installing a DE212C or D...

Page 1479: ...ipment The storage controllers should be in the middle of the system cabinet The disk shelves should be above and below the storage controllers Any switches should be at the very top of the system cab...

Page 1480: ...ower cables through an opening in the system cabinet Use one of the following openings The top of the system cabinet Between the rear door bottom and frame of the system cabinet Through the floor open...

Page 1481: ...unting screws from the old PDU 7 Secure the bottom of the PDU to the system cabinet frame and then tighten all of the mounting screws 8 Verify that all of the power switches or circuit breakers are in...

Page 1482: ...system cabinet door Use the following illustration along with the following steps 1 Unlock and open the system cabinet front door 2 Loosen the captive screws on the badge back panel on the inside of t...

Page 1483: ...de 6 Unscrew the grounding lug assembly from the system cabinet door and set it aside 7 Lift the top hinge pin until it clears the bottom of the hinge 8 Gently tip the top of the door away from the sy...

Page 1484: ...ite side of the system cabinet a Locate the two screw holes next to each other on the cabinet frame and then attach the top of the power supply housing to the bottom most of the two screw holes You mi...

Page 1485: ...e retainer on the cabinet upright 180 to the right remove it from the system cabinet frame and then gently pull the cable out of the system cabinet b Move the cable to the other side of the cabinet an...

Page 1486: ...urce Reverse the door hinge and lock catch When reversing the system cabinet door you must move the system cabinet door hinge and lock catch to the opposite front side system cabinet upright You need...

Page 1487: ...e spade Grounding wire Frame grounding wire lug Top front door hinge with hinge pin held by retaining clip Lock catch 3 Reverse the hinge pin from the top hinge a Lift the hinge pin and expose the ret...

Page 1488: ...s and then secure it to the system cabinet upright Reinstall the door and illuminated badge After you move the power supply and components to the other side of the system cabinet and moved the hinges...

Page 1489: ...the front door 1 Using the following illustration for reference reinstall the illuminated badge on the front door of the system cabinet 2 Close and lock the front door Swap out internal disk drive Vid...

Page 1490: ...ng on the drive type and capacity it can take up to several hours for the drive to appear in the list of failed drives Best practice The best practice is to have the current version of the Disk Qualif...

Page 1491: ...t the drive is fully seated into the mid plane and the handle clicks into place Be sure to close the cam handle slowly so that it aligns correctly with the face of the drive 7 Verify that the drive s...

Page 1492: ...ructions in the ONTAP documentation describe additional steps you must perform before and after replacing an SED ONTAP 9 NetApp Encryption Power Guide When replacing several disk drives you must wait...

Page 1493: ...ands remove the disk drive from the disk shelf 8 With the cam handle in the open position insert the replacement disk drive into the drive bay firmly pushing until the disk drive stops Wait a minimum...

Page 1494: ...shipped with the kit Contact technical support at NetApp Support 888 463 8277 North America 00 800 44 638277 Europe or 800 800 80 800 Asia Pacific if you need the RMA number or additional help with t...

Page 1495: ...ported by your platform model If your HA pair does not have enough available RoCE capable ports and your platform model supports the use of RoCE capable PCIe cards or I O modules you must have install...

Page 1496: ...ing because drives are not recognized The DQP also notifies you of noncurrent drive firmware NetApp Downloads Disk Qualification Package Best practice The best practice is to run Active IQ Config Advi...

Page 1497: ...e ports are configured for storage use If you determine that the non dedicated RoCE capable ports in your HA pair are not configured for storage use it is a nondisruptive procedure to configure them I...

Page 1498: ...storage ONTAP 9 7 or 9 6 storage port enable node node name port port name 4 If your HA pair is running ONTAP 9 6 reboot the controller module so that the port changes take effect system node reboot...

Page 1499: ...port connections is a nondisruptive procedure when your shelf has multipath HA connectivity You recable the first shelf across both sets of ports on each controller so that when you hot add the second...

Page 1500: ...SA A400HA pair a On controller A move the cable from port e0d to slot 5 Port 2 e5b b Repeat the same cable move on controller B 2 Verify that the recabled shelf is cabled correctly If any cabling erro...

Page 1501: ...rackets and rack or cabinet by using the installation flyer A fully loaded NS224 shelf can weigh up to 66 78 lbs 30 29 kg and requires two people to lift or use of a hydraulic lift Avoid removing shel...

Page 1502: ...e shelf for a hot add You cable each NS224 drive shelf you are hot adding so that each shelf has two connections to each controller module in the HA pair Depending on the number of shelves you are hot...

Page 1503: ...red them on and set the shelf IDs Install a drive shelf for a hot add About this task When viewed from the rear of the platform chassis the RoCE capable card port on the left is port a e1a and the por...

Page 1504: ...assignment if needed Otherwise you are done with this procedure Complete the hot add Cable a hot add shelf for an AFF A700 or ASA A700HA pair How you cable an NS224 drive shelf in an AFF A700 or ASA A...

Page 1505: ...eps Otherwise go to the next step This step assumes that you installed the RoCE capable I O module in slot 3 instead of slot 7 on each controller module a Cable shelf NSM A port e0a to controller A sl...

Page 1506: ...slot 3 port a d Cable NSM B port e0b to controller A slot 7 port b e If you are hot adding a second shelf complete the Shelf 2 substeps otherwise go to step 3 Shelf 2 These substeps assume that you ar...

Page 1507: ...ssign drive ownership and then reenable automatic drive assignment if needed Otherwise you are done with this procedure Complete the hot add Cable a hot add shelf for an AFF A800 or ASA A800HA pair Ho...

Page 1508: ...le and this is the only NS224 shelf in your HA pair complete the following substeps Otherwise go to the next step This step assumes you installed the RoCE capable PCIe card in slot 5 a Cable shelf NSM...

Page 1509: ...3 port b c Cable NSM B port e0a to controller B slot 5 port a d Cable NSM B port e0b to controller A slot 3 port b e If you are hot adding a second shelf complete the Shelf 2 substeps otherwise go to...

Page 1510: ...assignment if needed Otherwise you are done with this procedure Complete the hot add Cable a hot add shelf for an AFF A400 or ASA A400HA pair How you cable an NS224 drive shelf in an AFF A400 or ASA A...

Page 1511: ...e next step a Cable shelf NSM A port e0a to controller A port e0c b Cable shelf NSM A port e0b to controller B port e0d c Cable shelf NSM B port e0a to controller B port e0c d Cable shelf NSM B port e...

Page 1512: ...bsteps otherwise go to step 3 Shelf 2 a Cable NSM A port e0a to controller A slot 5 port a b Cable NSM A port e0b to controller B port e0d c Cable NSM B port e0a to controller B slot 5 port a d Cable...

Page 1513: ...for a hot add You must have completed the applicable preparation procedures Prepare for a hot add You must have installed the shelves powered them on and set the shelf IDs Install a drive shelf for a...

Page 1514: ...c drive assignment if needed Otherwise you are done with this procedure Complete the hot add Complete the hot add If you disabled automatic drive assignment as part of the preparation for the NS224 dr...

Page 1515: ...e s You can verify the state of the drives by using the storage disk show shelf shelf_number command Output in the Container Type column should display spare or broken if it is a failed drive Addition...

Page 1516: ...h the desired number from 0 to 9 The second number continues to blink 5 Lock in the desired number and exit the programming mode by pressing and holding the button until the second number stops blinki...

Page 1517: ...isruptively while the drive shelf is powered on and I O is in progress Before you begin Your HA pair must already be running ONTAP 9 7 or later which has the minimum supported version of NSM firmware...

Page 1518: ...has three location LEDs one on the operator display panel and one on each NSM module Location LEDs remain illuminated for 30 minutes You can turn them off by entering the same command but using the of...

Page 1519: ...t to the boot media slot is illuminated The LED remains illuminated for 10 minutes after you remove the NSM module from the shelf 6 Replace the boot media a Using the Phillips 1 screwdriver carefully...

Page 1520: ...echanisms snap into place The NSM module should be fully inserted into the shelf and flush with the edges of the shelf 9 Reconnect the cabling to the NSM module a Reconnect the storage cabling to the...

Page 1521: ...re If needed you can turn on the shelf s location blue LEDs to aid in physically locating the affected shelf storage shelf location led modify shelf name shelf_name led status on If you do not know th...

Page 1522: ...sm arms extend from the NSM module and lock in their fully extended position 4 Loosen the NSM module cover thumb screw and open the cover The FRU label on the NSM module cover shows the location of th...

Page 1523: ...fingers through the finger holes from the inside by crossing your arms e With your thumbs press down and hold the orange tabs on top of the latching mechanisms f Gently push forward to get the latches...

Page 1524: ...led drive appears in the list of failed drives If it does not you should wait and then run the command again Depending on the drive type and capacity it can take up to several hours for the drive to a...

Page 1525: ...ific The following video provides an overview of the physical removal and insertion portions of the drive hot swap procedure Hot swapping a drive in an NS224 drive shelf Steps 1 If you want to manuall...

Page 1526: ...ace of the drive 7 Verify that the drive s activity green LED is illuminated When the drive s activity LED is solid it means that the drive has power When the drive s activity LED is blinking it means...

Page 1527: ..._name of the affected shelf run the storage shelf show command A shelf has three location LEDs one on the operator display panel and one on each NSM module Location LEDs remain illuminated for 30 minu...

Page 1528: ...gs a warning message to the system console indicating which fan failed Additionally the fan attention amber LED located on the board near the fan slot illuminates The LED for the failed fan remains il...

Page 1529: ...ates green Additionally both NSM module port LNK green LEDs illuminate If a LNK LED does not illuminate reseat the cable 10 Verify that the attention amber LEDs on the NSM module containing the failed...

Page 1530: ...not know the shelf_name of the affected shelf run the storage shelf show command A shelf has three location LEDs one on the operator display panel and one on each NSM module Location LEDs remain illum...

Page 1531: ...SD NVM spare 3 Physically locate the shelf you are removing 4 Disconnect the cabling from the shelf you are removing a Disconnect the power cord from the power supply by opening the power cord retaine...

Page 1532: ...7 or 9 6 the non dedicated ports which display false in the Is Dedicated column also display enabled in the State column b Complete the set of steps applicable to the version of ONTAP your HA pair is...

Page 1533: ...hanges c Verify that the non dedicated ports of both controller modules are reconfigured for networking use storage port show You can enter the command on either controller module If your HA pair is r...

Page 1534: ...f s location blue LEDs to aid in physically locating the affected shelf storage shelf location led modify shelf name shelf_name led status on If you do not know the shelf_name of the affected shelf ru...

Page 1535: ...ds to support its weight and then place it on a flat stable surface When you begin pulling the latching mechanism arms extend from the NSM module and lock in their fully extended position 5 Unpack the...

Page 1536: ...Gently push the power supply into the NSM module until the locking mechanism clicks into place Do not use excessive force or you might damage the internal connector f Rotate the cam handle to the clo...

Page 1537: ...ly NS224 shelves You can replace a failed power supply nondisruptively in an NS224 drive shelf that is powered on and while I O is in progress About this task If you are replacing more than one power...

Page 1538: ...es red 3 Disconnect the power cord from the power supply by opening the power cord retainer and then unplug the power cord from the power supply Power supplies do not have a power switch 4 Remove the...

Page 1539: ...lf_name of the affected shelf run the storage shelf show command A shelf has three location LEDs one on the operator display panel and one on each NSM module Location LEDs remain illuminated for 30 mi...

Page 1540: ...d RTC battery The RTC battery attention amber LED located on the board next to the battery slot illuminates The LED for the failed RTC battery remains illuminated for 10 minutes after you remove the N...

Page 1541: ...e cabling to the same two NSM module ports Cables are inserted with the connector pull tab facing up When a cable is inserted correctly it clicks into place b Reconnect the power cord to the power sup...

Page 1542: ...n AFF and FAS System Documentation Disk shelves and controllers must not be powered on at this time If you are using mini SAS HD SAS optical cables you must have met the rules in Mini SAS HD SAS optic...

Page 1543: ...A pair or single controller configuration If any SAS cabling or duplicate shelf ID errors are generated follow the corrective actions provided You need network access to download Config Advisor NetApp...

Page 1544: ...led by pushing up until they click into place As you slide the disk shelf onto the rails detach handles using the thumb latch It is recommended that you use a mechanical hoist or lift if you are movin...

Page 1545: ...o installing your disk shelf into the rack b Open the top drawer of the shelf c Raise the cam handle on the drive to vertical d Align the two raised buttons on each side of the drive carrier with the...

Page 1546: ...then rotate the cam handle down until the drive snaps into place under the orange release latch f Repeat the previous substeps for each drive in the drawer You must be sure that slots 0 3 6 and 9 in e...

Page 1547: ...ns shelf to shelf as applicable and controller to shelf to establish storage connectivity for the system Before you begin You must have met the requirements in Requirements for installing and cabling...

Page 1548: ...logical first shelf in the stack connect IOM A port 4 to the next shelf s IOM A port 2 until each IOM A in the stack is connected c Repeat substeps a and b for IOM B d Repeat substeps a through c for...

Page 1549: ...g them in place with the power cord retainer and then connect the power cords to different power sources for resiliency b Turn on the power supplies for each disk shelf and wait for the disk drives to...

Page 1550: ...menu select option 5 for Maintenance mode e Automatically assign shelf IDs sasadmin expander_set_shelf_id a f Exit Maintenance mode halt g Bring up the system by entering the following command at the...

Page 1551: ...es with IOM12 modules directly to a SAS HBA or an onboard SAS port on the controller About this task You cannot use this procedure to mix a stack hot add a shelf with IOM12 modules to a stack of shelv...

Page 1552: ...ions in the stack and the controller to stack connections so that the stack meets the rules in Mini SAS HD SAS optical cable rules This means that you must have ordered the appropriate number of mini...

Page 1553: ...k shelf provides a snapshot of the SAS connectivity verifies disk shelf IOM firmware versions and allows you to verify shelf IDs already in use on your system Running Config Advisor after hot adding a...

Page 1554: ...allation flyer that came with the kit If you are installing multiple disk shelves you should install them from the bottom to the top of the rack for the best stability Do not flange mount the disk she...

Page 1555: ...isk shelf In a shelf with 30 drives the remaining ten drives are distributed evenly throughout the shelf in slots 1 and 10 of each drawer The following illustration shows how the drives are numbered f...

Page 1556: ...t side of the drive carrier e Lower the drive straight down and then rotate the cam handle down until the drive snaps into place under the orange release latch f Repeat the previous substeps for each...

Page 1557: ...t is unique within the HA pair or single controller configuration If you have a system with an internal disk shelf shelf IDs must be unique across the internal disk shelf and externally attached disk...

Page 1558: ...your configuration it is automatically enabled on the hot added disk shelves Firmware updates can take up to 30 minutes Steps 1 If you want to manually assign disk ownership for the disk shelves you...

Page 1559: ...ler to stack cabling worksheets and cabling examples to see whether a completed worksheet exists for your configuration Controller to stack cabling worksheets and cabling examples for common AFF A200...

Page 1560: ...t adding to the end of the stack that does not have controller to stack connections a Cable the shelf to shelf connection between IOM A of the disk shelf in the stack and IOM A of the disk shelf you a...

Page 1561: ...or 8080 2 0d Errors 7 If you disabled disk ownership automatic assignment in Step 1 manually assign disk ownership and then reenable disk ownership automatic assignment if needed a Display all unowned...

Page 1562: ...ysconfig command at the admin prompt of either controller If the SAS2 SAS3 Mixed Stack Support field does not appear in the output or has a value of none then your system does not support mixed stacks...

Page 1563: ...AS ports are available in the current configuration you should add the IOM12 shelves as a separate stack Use all bridge ports before mixing IOM12 and IOM6 modules in a stack Your system and version of...

Page 1564: ...otects against storage stack access issues if you cabled the hot added shelf to the stack incorrectly After you download the IOM12 shelf firmware to your shelves verify the firmware version is 0260 or...

Page 1565: ...hat shelf IDs are unique within your system NetApp Downloads Config Advisor Best practice The best practice is to have in band ACP IBACP running on your system For systems in which IBAP is running IBA...

Page 1566: ...tallation flyer that came with the kit If you are installing multiple disk shelves you should install them from the bottom to the top of the rack for the best stability Do not flange mount the disk sh...

Page 1567: ...isk shelf In a shelf with 30 drives the remaining ten drives are distributed evenly throughout the shelf in slots 1 and 10 of each drawer The following illustration shows how the drives are numbered f...

Page 1568: ...t side of the drive carrier e Lower the drive straight down and then rotate the cam handle down until the drive snaps into place under the orange release latch f Repeat the previous substeps for each...

Page 1569: ...ower numbers 1 9 and IOM12 shelves use higher numbers 10 and greater If you have a platform model with onboard storage shelf IDs must be unique across the internal shelf and externally attached shelve...

Page 1570: ...ip for a hot add You must have installed the shelves powered them on and set the shelf IDs Install shelves for a hot add About this task You always hot add IOM12 shelves to the logical last shelf in a...

Page 1571: ...iguration you cannot use the IOM B path The initial IOM12 shelf the IOM12 shelf connecting to the logical last IOM6 shelf always connects to the IOM6 shelf circle ports not square ports The SAS cable...

Page 1572: ...You can reference the following illustration for cabling IOM12 shelves to an IOM6 shelf stack in a bridge attached MetroCluster configuration 1569...

Page 1573: ...ections from controller SAS ports B and D or it is the shelf having no connections to any controllers because the controller to stack connectivity is to the logical top of the stack through the contro...

Page 1574: ...to the new IOM12 shelf IOM A port 1 Use a SAS copper QSFP to Mini SAS HD cable c If you are hot adding another IOM12 shelf cable the shelf to shelf connection between the IOM12 shelf IOM A port 3 of t...

Page 1575: ...to Mini SAS HD cable c If you are hot adding another IOM12 shelf cable the shelf to shelf connection between the IOM12 shelf IOM A port 3 of the shelf you just cabled and the next IOM12 shelf IOM A po...

Page 1576: ...ngle path HA with controller connectivity to the logical last shelf or bridge attached connectivity in a MetroCluster configuration a Move the controller to stack cable from the last IOM12 shelf IOM A...

Page 1577: ...l last shelf a Cable the shelf to shelf connection between the last IOM12 shelf IOM A port 3 and the new last IOM12 shelf IOM A port 1 Use a SAS copper Mini SAS HD to Mini SAS HD cable b Repeat the ab...

Page 1578: ...hen hot adding a shelf prior to it being cabled to the system You can also change a shelf ID when ONTAP is up and running controller modules are available to serve data and all drives in the shelf are...

Page 1579: ...ton to advance the number until you reach the desired number from 1 to 9 The second number continues to blink 7 Lock in the desired number and exit the programming mode by pressing and holding the but...

Page 1580: ...ing worksheets and examples Common multipath HA configurations Common AFF A200 AFF A220 FAS2600 and FAS2700 configurations Quad path HA configurations Cabling worksheet templates Multipathed connectiv...

Page 1581: ...s with external disk shelves can be cabled as single path HA configurations to support connectivity to an external SAS tape backup device AFF A200 AFF A220 FAS2600 series and FAS2700HA pair configurat...

Page 1582: ...g the applicable standard or double wide shelf to shelf cabling Your use of standard or double wide shelf to shelf cabling depends on the configuration you have Standard shelf to shelf connectivity St...

Page 1583: ...ard shelf to shelf connectivity using IOM ports 3 and 1 the second cable connection is cabled as double wide shelf to shelf connectivity using IOM ports 4 and 2 From the logical first shelf to the log...

Page 1584: ...s means that disk drive ownership is stored on the disk drive rather than it being determined by the topology of the storage system s physical connections as it is for hardware based disk ownership Sp...

Page 1585: ...stack B and D ports always connect to the logical last disk shelf in a stack B and D ports always connect to disk shelf IOM ports 3 and 4 IOM port 4 is only used for quad path HA and quad path config...

Page 1586: ...in a stack B and D SAS ports connect to the logical last shelf in a stack Port pairs use all SAS ports on each controller in your system You increase system resiliency by incorporating all SAS ports o...

Page 1587: ...irs for your system and you have three stacks to cable as multipath you cable every other port pair in your list When you have more port pairs than you need to cable the stacks in your system the best...

Page 1588: ...t 0b always connects to the logical last disk shelf in a stack Port 0b always connect to disk shelf IOM port 3 Controller 0a port internal HBA port Controller 1 0a port always connects to IOM B domain...

Page 1589: ...ons For quad path HA and quad path configurations if you use multimode breakout cables for the shelf to shelf double wide connections between two disk shelves the best practice is to use identically p...

Page 1590: ...multipathed connectivity Cabling examples show controller to stack cables as solid or dashed to distinguish controller A and C port connections from controller B and D port connections Cables in the...

Page 1591: ...and one single shelf stack The following worksheet and cabling example uses port pair 1a 1d Multipath HA with one quad port SAS HBA and two single shelf stacks The following worksheet and cabling exam...

Page 1592: ...or you can cable every other port pair skip port pairs When you have more port pairs than you need to cable the stacks in your system the best practice is to skip port pairs to optimize the SAS ports...

Page 1593: ...he following worksheet and cabling example shows port pairs being skipped to use every other one in the list 1a 2b and 1c 2d If a third stack is added later you use the port pair that was skipped 1590...

Page 1594: ...SAS ports You can use the completed controller to stack cabling worksheets and cabling examples to cable common multipath HA configurations that have four onboard SAS ports Multipath HA with four onbo...

Page 1595: ...Multipath HA with four onboard SAS ports and two single shelf stacks The following worksheet and cabling example uses port pairs 0a 0d and 0c 0b 1592...

Page 1596: ...worksheet or you can cable every other port pair skip port pairs When you have more port pairs than you need to cable the stacks in your system the best practice is to skip port pairs to optimize the...

Page 1597: ...he following worksheet and cabling example shows port pairs being skipped to use every other one in the list 0a 1b and 0c 1d If a third stack is added later you use the port pair that was skipped 1594...

Page 1598: ...AFF A200 AFF A220 FAS2600 series and FAS2700 configurations If needed you can refer to SAS cabling rules for information about supported configurations shelf to shelf connectivity and controller to sh...

Page 1599: ...connections in two different colors to distinguish connectivity through IOM A domain A and IOM B domain B AFF A200 AFF A220 FAS2600 series and FAS2700 multipath HA configuration with one multi shelf s...

Page 1600: ...eets and cabling examples use port pair 0a 0b In this example the controller is installed in slot A of the chassis When a controller is located in slot A of the chassis its internal storage port 0b is...

Page 1601: ...controller is installed in slot B of the chassis When a controller is located in slot B of the chassis its internal storage port 0b is in domain B IOM B therefore port 0b must connect to domain B IOM...

Page 1602: ...1599...

Page 1603: ...quad pathed connectivity The cabling example shows controller to stack cables as solid or dashed to distinguish controller A and C port connections from controller B and D port connections Cables in...

Page 1604: ...ed with the stack it is cabled to Each port pair designated for quad pathed cabling is encircled by a rectangle that is the color associated with the stack it is cabled to Quad path HA with two quad p...

Page 1605: ...pathed connections for your configuration Before you begin Your HA pair or single controller configuration cannot be an AFF A200 AFF A220 FAS2600 series or FAS2700 system If you have one of these conf...

Page 1606: ...n your system and then all SAS C ports on your system in sequence of slots 0 1 2 3 and so on For example 1a 2a 1c 2c 2 In the gray boxes list all SAS B ports on your system and then all SAS D ports on...

Page 1607: ...acks are hot added later port pair 2a 1d is cabled to stack 3 and port pair 2c 1b is cabled to stack 4 When you have more port pairs than you need to cable the stacks in your system the best practice...

Page 1608: ...t template allows for up to two stacks you need to add more columns if needed Quad pathed connectivity for controller to stack connections consists of two sets of multipathed cabling the first set of...

Page 1609: ...2c 2 In the gray boxes list all SAS B ports on your system and then all SAS D ports on your system in sequence of slots 0 1 2 3 and so on For example 1b 2b 1d 2d 3 In the boxes below the gray boxes re...

Page 1610: ...tack 1 in your HA pair or single controller configuration The following example uses port pair 1c 2d for the multipathed cabling and port pair 2c 1b for the quad pathed cabling to stack 2 6 If you hav...

Page 1611: ...orksheet to cable controller to stack connections The configuration used in this example is a multipath HA configuration with two quad port SAS HBAs eight SAS ports on each controller and two stacks o...

Page 1612: ...Steps 1 Cable port pair 1a 2b on each controller to stack 1 a Cable controller 1 port 1a to stack 1 first shelf IOM A port 1 b Cable controller 2 port 1a to stack 1 first shelf IOM B port 1 1609...

Page 1613: ...guide you through how to read and apply a completed worksheet to cable stacks of disk shelves with IOM12 modules for quad pathed connectivity About this task This procedure references the following wo...

Page 1614: ...d Cable controller 2 port 2b to stack 1 last shelf IOM A port 3 2 Cable port pair 2a 1d on each controller to stack 1 This is the quad pathed cabling for stack 1 Once completed stack 1 has quad pathe...

Page 1615: ...es with IOM12 modules You can hot swap a failed disk drive in a DS224C or DS212C disk shelf Before you begin The disk drive that you are installing must be supported by the DS224C or DS212C disk shelf...

Page 1616: ...e circuitry The best practice is to have the current version of the Disk Qualification Package DQP installed before hot swapping a disk drive Having the current version of the DQP installed allows you...

Page 1617: ...drive assignment is enabled you need to disable it storage disk option modify node node_name autoassign off You need to disable automatic drive assignment on both controllers in an HA pair 2 Properly...

Page 1618: ...h the cam handle in the open position insert the replacement disk drive into the disk shelf firmly pushing until the disk drive stops Wait a minimum of 10 seconds before inserting a new disk drive Thi...

Page 1619: ...ical support at NetApp Support 888 463 8277 North America 00 800 44 638277 Europe or 800 800 80 800 Asia Pacific if you need the RMA number or additional help with the replacement procedure Hot swap a...

Page 1620: ...and cause irreparable damage to the disk drive circuitry The best practice is to have the current version of the Disk Qualification Package DQP installed before hot swapping a disk drive Having the c...

Page 1621: ...on for information about the meaning and location of disk shelf LEDs on the operator display panel and FRU components The DS460C drive shelf consist of five drive drawers drive drawer 1 at the top thr...

Page 1622: ...NetApp requires that all returned disk drives be in a ESD rated bag 4 Identify the failed disk drive from the system console warning message and the illuminated amber attention LED on the drive drawer...

Page 1623: ...Orange release latch b Open the cam handle and lift out the drive slightly c Wait 30 seconds d Use the cam handle to lift the drive from the shelf 1620...

Page 1624: ...way from magnetic fields 7 Insert the replacement drive in the drawer a Raise the cam handle on the new drive to vertical b Align the two raised buttons on each side of the drive carrier with the matc...

Page 1625: ...e the cam handle down until the drive snaps into place under the orange release latch d Carefully push the drive drawer back into the enclosure Possible loss of data access Never slam the drawer shut...

Page 1626: ...manually assign disk ownership and then reenable disk ownership automatic assignment if needed a Display all unowned disks storage disk show container type unassigned b Assign each disk storage disk a...

Page 1627: ...or this procedure Antistatic protection Possible hardware damage To prevent electrostatic discharge damage to the drive shelf use proper antistatic protection when handling drive shelf components Repl...

Page 1628: ...ing shelf components Flashlight About this task Each drive drawer has left and right cable chains The metal ends on the cable chains slide into corresponding vertical and horizontal brackets inside th...

Page 1629: ...y determine which of the five cable chains to disconnect The figure shows the right side of the drive shelf with the fan module removed With the fan module removed you can see the five cable chains an...

Page 1630: ...1627...

Page 1631: ...ottom cable chain is attached to drive drawer 5 4 Use your finger to move the cable chain on the right side to the left 5 Follow these steps to disconnect any of the right cable chains from its corres...

Page 1632: ...Orange ring on the vertical bracket b Disconnect the vertical connector connected to the midplane by gently pressing on the center of the 1629...

Page 1633: ...le chain connector within the vertical bracket 6 Follow these steps to disconnect the other end of the cable chain a Using a flashlight locate the orange ring on the end of the cable chain that is att...

Page 1634: ...Orange ring on horizontal bracket Cable chain 1631...

Page 1635: ...e drive shelf Removing a drive drawer After removing the right and left cable chains you can remove the drive drawer from the drive shelf Removing a drive drawer entails sliding the drawer part of the...

Page 1636: ...location of each drive before removing it 5 Remove the drives from the drive drawer a Gently pull back the orange release latch that is visible on the center front of each drive The following image s...

Page 1637: ...b Raise the drive handle to vertical c Use the handle to lift the drive from the drive drawer 1634...

Page 1638: ...nd cause irreparable damage to the drive circuitry To avoid loss of data access and damage to the drives always keep drives away from magnetic devices 6 Follow these steps to remove the drive drawer a...

Page 1639: ...now where to install each drive You have obtained the following items Replacement drive drawer Flashlight Steps 1 From the front of the drive shelf shine a flashlight into the empty drawer slot and lo...

Page 1640: ...Then reinsert the drawer into the slot and ensure that it slides in and out freely 5 Follow these steps to reinstall the drives in the drive drawer a Unlatch the drive drawer by pulling out on both le...

Page 1641: ...Raised button on the right side of the drive f Lower the drive straight down and then rotate the drive handle down until the drive snaps into place 1638...

Page 1642: ...hing the cable chains The final step in installing a drive drawer is attaching the left and right cable chains to the drive shelf When attaching a cable chain reverse the order you used when disconnec...

Page 1643: ...Callout Cable chain Connector Connects to Left Vertical Midplane Left Horizontal Drive drawer 1640...

Page 1644: ...s on the left cable chain and the corresponding horizontal and vertical brackets inside the enclosure b Align both cable chain connectors with their corresponding brackets c Slide the cable chain s ho...

Page 1645: ...Guide rail 1642...

Page 1646: ...lfunction Make sure to slide the connector underneath the guide rail on the bracket If the connector rests on the top of the guide rail problems might occur when the system runs d Slide the vertical c...

Page 1647: ...ing the failed fan 3 From the back of the disk shelf look at the Attention LEDs to locate the fan module you need to remove You must replace the fan module that has its Attention LED on Item LED name...

Page 1648: ...Tab that you press to release the fan module handle 5 Use the fan module handle to pull the fan module out of the shelf 1645...

Page 1649: ...e failed part to NetApp as described in the RMA instructions shipped with the kit Contact technical support at NetApp Support 888 463 8277 North America 00 800 44 638277 Europe or 800 800 80 800 Asia...

Page 1650: ...nd If you are removing one or more disk shelves from within a stack you must have factored the distance to bypass the disk shelves you are removing therefore if the current cables are not long enough...

Page 1651: ...single path connectivity 2 Verify that the disk drives in the disk shelves you are removing have no aggregates are spares and ownership is removed a Enter the following command from the clustershell...

Page 1652: ...the following substeps otherwise go to the next step a Remove all SAS cables on path A IOM A and path B IOM B This includes controller to shelf cables and shelf to shelf cables for all disk shelves i...

Page 1653: ...helf in the stack The next disk shelf can be above or below the disk shelf you are removing depending on which IOM A ports 1 and 2 or 3 and 4 you removed the cabling from You can refer to the followin...

Page 1654: ...he system to complete discovery The first two lines of output show disk drives with connectivity through both path A and path B The last two lines of output show disk drives with connectivity through...

Page 1655: ...hen you removed ownership from the disk drives as part of the preparation for this procedure you disabled disk ownership automatic assignment reenable it by entering the following command otherwise go...

Page 1656: ...a system that is powered on and serving data I O is in progress For FAS2600 series single path configurations you must halt your system to replace an IOM12 module If you attempt to hot swap an IOM12 m...

Page 1657: ...odule from the system console warning message and the illuminated attention amber LED on the failed IOM12 module 4 Perform one of the following actions based on the type of configuration you have If y...

Page 1658: ...e until it meets the mid plane Do not use excessive force when sliding the IOM12 module into the disk shelf you might damage the connectors 10 Close the cam handle so that the latch clicks into the lo...

Page 1659: ...more than one power supply you must do so one at a time so that the disk shelf maintains power You must replace a power supply within two minutes of removal to minimize disruption to the disk shelf s...

Page 1660: ...le to fully release the power supply from the mid plane The following illustration is for a power supply used in a DS224C or DS212C disk shelf however the latch operates the same way for power supplie...

Page 1661: ...instructions shipped with the kit Contact technical support at NetApp Support 888 463 8277 North America 00 800 44 638277 Europe or 800 800 80 800 Asia Pacific if you need the RMA number or additiona...

Page 1662: ...t Location Solid blue The system administrator activated this LED function to aid in physically locating the disk shelf requiring service The location LED on the operator display panel and both IOM12...

Page 1663: ...n the module The IOM12 module is used in DS460C DS224C and DS212C disk shelves LED icon LED name State Description Attention Solid amber IOM12 module function An error occurred with the function of th...

Page 1664: ...r a IOM12 module Power supply LEDs The LEDs on the power supply indicate whether the power supply is functioning normally or there are hardware problems The following table describes the two LEDs on p...

Page 1665: ...icons act as the labels and LEDs meaning the icons themselves illuminate there are no adjacent LEDs The following illustration is for a power supply used in a DS224C or DS212C disk shelf Fan LEDs on...

Page 1666: ...rdware Disk drive LEDs for DS224C and DS212C disk shelves The following table describes the two LEDs on the disk drives used in DS224C and DS212C disk shelves Callout LED name State Description Activi...

Page 1667: ...ally or horizontally in the disk shelf dictating the location of the two LEDs The following illustration is for a disk drive used in a DS224C disk shelf DS224C disk shelves use 2 5 inch disk drives ar...

Page 1668: ...f No drive or other component in the drawer requires attention and no drive in the drawer has an active locate operation Blinking amber A locate drive operation is active for any drive within the draw...

Page 1669: ...Attention LED light on 1666...

Page 1670: ...e shelf models DS2246 disk shelf documentation DS4486 disk shelf documentation DS4246 disk shelf documentation DS4243 disk shelf documentation Cisco and Broadcom supported Cluster Storage and Manageme...

Page 1671: ...etApp Inc Other company and product names may be trademarks of their respective owners http www netapp com us legal netapptmlist aspx Patents A current list of NetApp owned patents can be found at htt...

Page 1672: ...WHETHER IN CONTRACT STRICT LIABILITY OR TORT INCLUDING NEGLIGENCE OR OTHERWISE ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE NetApp reserves the...