NetApp AFF A320, Manual

Page 1: ...A320 systems ONTAP Systems NetApp October 31 2021 This PDF was generated from https docs netapp com us en ontap systems a320 install setup html on October 31 2021 Always check docs netapp com for the latest ...

Page 2: ...Table of Contents AFF A320 System Documentation 1 Install and setup 1 Maintain 16 ...

Page 3: ...ng up Use this guide if you are familiar with installing NetApp systems Access the Installation and Setup Instructions PDF poster AFF A320 Systems Installation and Setup Instructions Videos AFF A320 There are two videos one showing how to rack and cable your system and one showing an example of using the System Manager Guided Setup to perform initial system configuration Video one of two Hardware ...

Page 4: ...about this system NetApp Hardware Universe Find the Release Notes for your version of ONTAP 9 You need to provide the following at your site Rack space for the storage system Phillips 2 screwdriver Additional networking cables to connect your system to your network switch and laptop or console with a Web browser A laptop or console with an RJ 45 connection and access to a Web browser 1 Unpack the ...

Page 5: ...2 00326 2m X66250 5 112 00328 5m X66250 30 112 00331 30m Ethernet cable order dependent Optical cables SR X6553 R6 112 00188 2m X6554 R6 112 00189 15m X6537 R6 112 00091 30m LR X66250 3 112 00342 2m X66260 5 112 00344 5m X66260 30 112 00354 30m FC configurations order dependent RJ 45 order dependent X6585 R6 112 00291 3m X6562 R6 112 00196 5m Management network Micro USB console cable Not applicab...

Page 6: ...the system Cable controllers to your network You can cable the controllers to your network by using the two node switchless cluster method or by using the cluster interconnect network Option 1 Cable a two node switchless cluster The optional data ports optional NIC cards and management ports on the controller modules are connected to switches The cluster interconnect HA ports are cabled on both co...

Page 7: ...ove it turn it around and try again 1 You can used the graphic or the step by step instructions to complete the cabling between the controllers and to the switches Step Perform on each controller module Cable the cluster HA ports to each other with the 100 GbE QSFP28 cable e0a to e0a e0d to e0d 5 ...

Page 8: ...ng your onboard ports for a data network connection connect the 100GbE or 40Gbe cables to the appropriate data network switches e0g and e0h If you are using your NIC cards for Ethernet or FC connections connect the NIC card s to the appropriate switches 6 ...

Page 9: ... interconnect HA ports are cabled on to the cluster HA switch You must have contacted your network administrator for information about connecting the system to the switches Be sure to check the illustration arrow for the proper cable connector pull tab orientation As you insert the connector you should feel it click into place if you do not feel it click remove it turn it around and try again 1 Yo...

Page 10: ...ster HA ports to the cluster HA switch with the 100 GbE QSFP28 cable e0a on both controllers to the cluster HA switch e0d on both controllers to the cluster HA switch If you are using your onboard ports for a data network connection connect the 100GbE or 40Gbe cables to the appropriate data network switches e0g and e0h 8 ...

Page 11: ...s to the appropriate switches Cable the e0M ports to the management network switches with the RJ45 cables DO NOT plug in the power cords at this point 2 Cable your storage Cabling controllers to drive shelves Cable controllers to drive shelves You must cable the controllers to your shelves using the onboard storage ports 9 ...

Page 12: ...f Be sure to check the illustration arrow for the proper cable connector pull tab orientation As you insert the connector you should feel it click into place if you do not feel it click remove it turn it around and try again 1 You can use the graphic or the step by step instructions to cable your controllers to a single shelf 10 ...

Page 13: ...to the shelf Cable controller B to the shelf 2 To complete setting up your system see Completing system setup and configuration Option 2 Cable the controllers to two drive shelves You must cable each controller to the NSM modules on both NS224 drive shelves 11 ...

Page 14: ...nector pull tab orientation As you insert the connector you should feel it click into place if you do not feel it click remove it turn it around and try again 1 You can use the following graphic or the written steps to cable your controllers to two drive shelves 12 ...

Page 15: ... complete the system setup and configuration using cluster discovery with only a connection to the switch and laptop or by connecting directly to a controller in the system and then connecting to the management switch Option 1 Completing system setup and configuration if network discovery is enabled If you have network discovery enabled on your laptop you can complete system setup and configuratio...

Page 16: ... discover a Open File Explorer b Click network in the left pane c Right click and select refresh d Double click either ONTAP icon and accept any certificates displayed on your screen XXXXX is the system serial number for the target node System Manager opens 5 Use System Manager guided setup to configure your system using the data you collected in the NetApp ONTAP Configuration Guide ONTAP Configur...

Page 17: ...et c Assign a TCP IP address to the laptop or console using one that is on the management subnet 2 Use the following graphic to set one or more drive shelf IDs 3 Plug the power cords into the controller power supplies and then connect them to power sources on different circuits The system begins to boot Initial booting may take up to eight minutes 4 Assign an initial node management IP address to ...

Page 18: ... later use in this procedure The nondisruptive and disruptive methods for replacing a boot media both require you to restore the var file system For nondisruptive replacement the HA pair must be connected to a network to restore the var file system For disruptive replacement you do not need a network connection to restore the var file system but the process requires two reboots You must replace th...

Page 19: ...s running ONTAP 9 6 or later go to go to the next section Check NVE or NSE on systems running ONTAP 9 6 and later Before shutting down the impaired node you need to verify whether the system has either NetApp Volume Encryption NVE or NetApp Storage Encryption NSE enabled If so you need to verify the configuration 1 Verify whether NVE is configured for any volumes in the cluster volume show is encr...

Page 20: ...l nodes in the cluster security key manager external restore If the command fails contact NetApp Support mysupport netapp com b Verify that the Restored column equals yes for all authentication keys security key manager key query c Shut down the impaired node 4 If the Key Manager type displays onboard and the Restored column displays anything other than yes a Enter the onboard security key manager...

Page 21: ... show backup c Copy the contents of the backup information to a separate file or your log file You ll need it in disaster scenarios where you might need to manually recover OKM d Return to admin mode set priv admin e You can safely shutdown the node 3 If the Key Manager type displays external and the Restored column displays anything other than yes a Enter the onboard security key manager sync com...

Page 22: ...word Take over or halt the impaired node For an HA pair take over the impaired node from the healthy node storage failover takeover ofnode impaired_node_name When the impaired node shows Waiting for giveback press Ctrl C and then respond y 2 From the LOADER prompt enter printenv to capture all boot environmental variables Save the output to your log file This command may not work if the boot devic...

Page 23: ... of the controller module b Press down on the orange tab on top of the latching mechanism until it clears the latching pin on the chassis The latching mechanism hook should be nearly vertical and should be clear of the chassis pin c Gently pull the controller module a few inches toward you so that you can grasp the controller module sides d Using both hands gently pull the controller module out of...

Page 24: ...cking button to lock the boot media in place 4 Close the air duct Step 3 Transfer the boot image to the boot media using a USB flash drive The replacement boot media that you installed does not have a boot image so you need to transfer a boot image using a USB flash drive You must have a USB flash drive formatted to MBR FAT32 with at least 4GB capacity A copy of the same image version of ONTAP as ...

Page 25: ...ler module halfway into the system 4 Reinstall the cable management device and recable the system as needed When recabling remember to reinstall the media converters SFPs or QSFPs if they were removed 5 Plug the power cable into the power supply and reinstall the power cable retainer 6 Insert the USB flash drive into the USB slot on the controller module Make sure that you install the USB flash dr...

Page 26: ...uster enable b If External Key Manager is enabled check the bootarg values listed in the kenv ASUP output bootarg storageencryption support value bootarg keymanager support value kmip init interface value kmip init ipaddr value kmip init netmask value kmip init gateway value c If Onboard Key Manager is enabled check the bootarg values listed in the kenv ASUP output bootarg storageencryption suppor...

Page 27: ... setenv environment variable name changed value command d Save your changes using the savenev command e Reboot the node 17 With the rebooted impaired node displaying the Waiting for giveback message perform a giveback from the healthy node If your system is in Then An HA pair After the impaired node is displaying the Waiting for giveback message perform a giveback from the healthy node a From the ...

Page 28: ...e target node 2 Use the boot_ontap command at the LOADER prompt to boot the node 3 Check the console output If the console displays Then The LOADER prompt Boot the node to the boot menu boot_ontap menu Waiting for giveback a Enter Ctrl C at the prompt b At the message Do you wish to halt this node rather than wait y n enter y c At the LOADER prompt enter the boot_ontap menu command 4 At the Boot M...

Page 29: ...ck with the storage failover show command 10 Giveback only the CFO aggregates with the storage failover giveback fromnode local only cfo aggregates true command If the command fails because of a failed disk physically dis engage the failed disk but leave the disk in the slot until a replacement is received If the command fails because of an open CIFS sessions check with customer how to close out C...

Page 30: ...ng the net int revert command 17 Move the console cable to the target node and run the version v command to check the ONTAP versions 18 Restore automatic giveback if you disabled it by using the storage failover modify node local auto giveback true command Restore NSE NVE on systems running ONTAP 9 6 and later Steps 1 Connect the console cable to the target node 2 Use the boot_ontap command at the...

Page 31: ...the key management servers If the Restored column yes true you are done and can proceed to complete the replacement process If the Key Manager type external and the Restored column anything other than yes true use the security key manager external restore command to restore the key IDs of the authentication keys If the command fails contact Customer Support If the Key Manager type onboard and the ...

Page 32: ...r with more than two nodes it must be in quorum If the cluster is not in quorum or a healthy node shows false for eligibility and health you must correct the issue before shutting down the impaired node ONTAP 9 System Administration Reference If AutoSupport is enabled suppress automatic case creation by invoking an AutoSupport message system node autosupport invoke node type all message MAINT numb...

Page 33: ...ase the power cable retainers and then unplug the cables from the power supplies 3 Loosen the hook and loop strap binding the cables to the cable management device and then unplug the system cables and SFPs if needed from the controller module keeping track of where the cables were connected Leave the cables in the cable management device so that when you reinstall the cable management device the ...

Page 34: ...is seated all the way into the chassis The cam handle raises slightly when the fan module is completely seated 9 Swing the cam handle up to its closed position making sure that the cam handle release latch clicks into the locked position The fan LED should be green after the fan is seated and has spun up to operational speed 10 Repeat these steps for the remaining fan modules Step 3 Replace a chas...

Page 35: ...and hold the orange tabs on top of the latching mechanism d Gently push the controller module into the chassis bay until it is flush with the edges of the chassis The latching mechanism arms slide into the chassis The controller module begins to boot as soon as it is fully seated in the chassis e Release the latches to lock the controller module into place f Recable the power supply g If you have ...

Page 36: ...cs tests 4 Select Test system from the displayed menu to run diagnostics tests 5 Select the test or series of tests from the various sub menus 6 Proceed based on the result of the preceding step If the test failed correct the failure and then rerun the test If the test reported no failures select Reboot from the menu to reboot the system Step 2 Return the failed part to NetApp After you replace th...

Page 37: ...replacement node will boot up in the same version of ONTAP as the old controller module It is important that you apply the commands in these steps on the correct systems The impaired node is the node that is being replaced The replacement node is the new node that is replacing the impaired node The healthy node is the surviving node You must always capture the node s console output to a text file ...

Page 38: ...vices from the left and right sides of the controller module 5 Remove the controller module from the chassis a Insert your forefinger into the latching mechanism on either side of the controller module b Press down on the orange tab on top of the latching mechanism until it clears the latching pin on the chassis The latching mechanism hook should be nearly vertical and should be clear of the chass...

Page 39: ...le and then gently push the power supply into the controller module until the locking tab clicks into place The power supplies will only properly engage with the internal connector and lock in place one way To avoid damaging the internal connector do not use excessive force when sliding the power supply into the system Step 3 Move the NVDIMM battery To move the NVDIMM battery from the impaired con...

Page 40: ...ove it from the impaired controller module and insert it into the replacement controller module You can use the following animation or the written steps to move the boot media from the impaired controller module to the replacement controller module 1 Open the air duct and locate the boot media using the following illustration or the FRU map on the controller module 2 Locate and remove the boot med...

Page 41: ...lock the boot media in place Step 5 Move the DIMMs You need to locate the DIMMs and then move them from the impaired controller module to the replacement controller module You must have the new controller module ready so that you can move the DIMMs directly from the impaired controller module to the corresponding slots in the replacement controller module You can use the following animation or the...

Page 42: ...controller module 4 Move the DIMMs from the impaired controller module to the replacement controller module Make sure that you install the each DIMM into the same slot it occupied in the impaired controller module a Eject the DIMM from its slot by slowly pushing apart the DIMM ejector tabs on either side of the DIMM and then slide the DIMM out of the slot Carefully hold the DIMM by the edges to av...

Page 43: ...odule Step 6 Move the PCIe risers You must move the PCIe risers with the PCIe cards installed in them from the impaired controller module to the replacement controller module You can use the following animation or the written steps to move the PCIe risers from the impaired controller module to the replacement controller module 1 Remove the cover over the PCIe risers by unscrewing the blue thumbscr...

Page 44: ... for the second riser e Reinstall the cover over the PCIe risers Step 7 Install the controller module After all of the components have been moved from the impaired controller module to the replacement controller module you must install the replacement controller module into the chassis and then boot it to Maintenance mode You can use the following animation or the written steps to install the repl...

Page 45: ...erify the system time after replacing the controller module You should check the time and date on the replacement controller module against the healthy controller module in an HA pair or against a reliable time server in a stand alone configuration If the time and date do not match you must reset them on the replacement controller module to prevent possible outages on clients due to time differenc...

Page 46: ...ged ha config show Step 3 Run diagnostics After you have replaced a component in your system you should run diagnostic tests on that component Your system must be at the LOADER prompt to start diagnostics All commands in the diagnostic procedures are issued from the node where the component is being replaced 1 If the node to be serviced is not at the LOADER prompt reboot the node system node halt ...

Page 47: ...f not you must contact technical support You must replace the failed component with a replacement FRU component you received from your provider Shut down the node To shut down the impaired node you must determine the status of the node and if necessary take over the node so that the healthy node continues to serve data from the impaired node storage About this task If you have a cluster with more ...

Page 48: ... controller module you must remove the controller module from the chassis 1 If you are not already grounded properly ground yourself 2 Unplug the controller module power supply from the power source 3 Loosen the hook and loop strap binding the cables to the cable management device and then unplug the system cables and SFPs if needed from the controller module keeping track of where the cables were...

Page 49: ...ller module a few inches toward you so that you can grasp the controller module sides d Using both hands gently pull the controller module out of the chassis and set it on a flat stable surface Replace system DIMMs Replacing a system DIMM involves identifying the target DIMM through the associated error message locating the target DIMM using the FRU map on the air duct or the lit LED on the mother...

Page 50: ...IMM ejector tabs on either side of the DIMM and then slide the DIMM out of the socket Carefully hold the DIMM by the edges to avoid pressure on the components on the DIMM circuit board 5 Remove the replacement DIMM from the antistatic shipping bag hold the DIMM by the corners and align it to the slot The notch among the pins on the DIMM should line up with the tab in the socket 6 Make sure that th...

Page 51: ...n gently push the controller module halfway into the system Do not completely insert the controller module in the chassis until instructed to do so 3 Cable the management and console ports only so that you can access the system to perform the tasks in the following sections You will connect the rest of the cables to the controller module later in this procedure 4 Complete the reinstallation of the...

Page 52: ...n the test 6 Proceed based on the result of the preceding step If the test failed correct the failure and then rerun the test If the test reported no failures select Reboot from the menu to reboot the system Restore the controller module to operation after running diagnostics After completing diagnostics you must recable the system give back the controller module and then reenable automatic giveba...

Page 53: ...e that you must replace by checking the console error messages and looking at the Attention LED on each fan module 4 Press down the release latch on the fan module cam handle and then rotate the cam handle downward The fan module moves a little bit away from the chassis 5 Pull the fan module straight out from the chassis making sure that you support it with your free hand so that it does not swing...

Page 54: ... FRU component you received from your provider Shut down the impaired controller You can shut down or take over the impaired controller using different procedures depending on the storage system hardware configuration Shut down the node To shut down the impaired node you must determine the status of the node and if necessary take over the node so that the healthy node continues to serve data from ...

Page 55: ... controller module you must remove the controller module from the chassis 1 If you are not already grounded properly ground yourself 2 Unplug the controller module power supply from the power source 3 Loosen the hook and loop strap binding the cables to the cable management device and then unplug the system cables and SFPs if needed from the controller module keeping track of where the cables were...

Page 56: ...inches toward you so that you can grasp the controller module sides b Using both hands gently pull the controller module out of the chassis and set it on a flat stable surface Replace the NVDIMM To replace the NVDIMM you must locate it in the controller module using the NVDIMM map label on top of the air duct or locating it using the LED next to the NVDIMM and then replace it following the specifi...

Page 57: ...he NVDIMM and then slide the NVDIMM out of the socket and set it aside Carefully hold the NVDIMM by the edges to avoid pressure on the components on the NVDIMM circuit board 4 Remove the replacement NVDIMM from the antistatic shipping bag hold the NVDIMM by the corners and then align it to the slot The notch among the pins on the NVDIMM should line up with the tab in the socket 5 Locate the slot w...

Page 58: ...llowing sections You will connect the rest of the cables to the controller module later in this procedure 4 Complete the reinstallation of the controller module a Make sure the latch arms are locked in the extended position b Using the latch arms push the controller module into the chassis bay until it stops c Press down and hold the orange tabs on top of the latching mechanism d Gently push the c...

Page 59: ... converters QSFPs or SFPs remember to reinstall them if you are using fiber optic cables 2 Return the node to normal operation by giving back its storage storage failover giveback ofnode impaired_node_name 3 If automatic giveback was disabled reenable it storage failover modify node local auto giveback true Return the failed part to NetApp After you replace the part you can return the failed part ...

Page 60: ...node to the LOADER prompt If the impaired node is displaying Then The LOADER prompt Go to the next step Waiting for giveback Press Ctrl C and then respond y when prompted System prompt or password prompt enter system password Take over or halt the impaired node For an HA pair take over the impaired node from the healthy node storage failover takeover ofnode impaired_node_name When the impaired nod...

Page 61: ...roller module b Press down on the orange tab on top of the latching mechanism until it clears the latching pin on the chassis The latching mechanism hook should be nearly vertical and should be clear of the chassis pin a Gently pull the controller module a few inches toward you so that you can grasp the controller module sides b Using both hands gently pull the controller module out of the chassis...

Page 62: ...ng for the battery and then gently push the battery into slot until it locks into place 6 Plug the battery plug back into the controller module and then close the air duct Install the controller module After you have replaced the component in the controller module you must re install the controller module into the chassis and then boot it to Maintenance mode 1 If you have not already done so close...

Page 63: ...rms slide into the chassis The controller module begins to boot as soon as it is fully seated in the chassis e Release the latches to lock the controller module into place f Recable the power supply g If you have not already done so reinstall the cable management device h Interrupt the normal boot process by pressing Ctrl C Run diagnostics After you have replaced a component in your system you sho...

Page 64: ...rn the failed part to NetApp After you replace the part you can return the failed part to NetApp as described in the RMA instructions shipped with the kit Contact technical support at NetApp Support 888 463 8277 North America 00 800 44 638277 Europe or 800 800 80 800 Asia Pacific if you need the RMA number or additional help with the replacement procedure Replace a PCIe card AFF A320 To replace a ...

Page 65: ...splaying Then The LOADER prompt Go to the next step Waiting for giveback Press Ctrl C and then respond y when prompted System prompt or password prompt enter system password Take over or halt the impaired node For an HA pair take over the impaired node from the healthy node storage failover takeover ofnode impaired_node_name When the impaired node shows Waiting for giveback press Ctrl C and then r...

Page 66: ...g mechanism until it clears the latching pin on the chassis The latching mechanism hook should be nearly vertical and should be clear of the chassis pin a Gently pull the controller module a few inches toward you so that you can grasp the controller module sides b Using both hands gently pull the controller module out of the chassis and set it on a flat stable surface Replace a PCIe card You must ...

Page 67: ... of the PCIe card on either side of the socket and then gently push up to release the card from the socket c Slide the card out of the riser and set it aside d Align the replacement card bezel with the edge of the riser and the outside edge of the card with the alignment guide on the left side of the riser e Gently slide the card until the card connector aligns with the riser socket and then gentl...

Page 68: ...the system to perform the tasks in the following sections You will connect the rest of the cables to the controller module later in this procedure 4 Complete the reinstallation of the controller module a Make sure the latch arms are locked in the extended position b Using the latch arms push the controller module into the chassis bay until it stops c Press down and hold the orange tabs on top of t...

Page 69: ...ed with the kit Contact technical support at NetApp Support 888 463 8277 North America 00 800 44 638277 Europe or 800 800 80 800 Asia Pacific if you need the RMA number or additional help with the replacement procedure Replace a power supply AFF A320 Replacing a power supply PSU involves disconnecting the target PSU from the power source unplugging the power cable removing the old PSU and installi...

Page 70: ...ush the power supply into the controller module until the locking tab clicks into place The power supplies will only properly engage with the internal connector and lock in place one way To avoid damaging the internal connector do not use excessive force when sliding the power supply into the system 6 Rotate the cam handle so that it is flush against the power supply 7 Reconnect the power supply c...

Page 71: ... before shutting down the impaired node ONTAP 9 System Administration Reference Steps 1 If AutoSupport is enabled suppress automatic case creation by invoking an AutoSupport message system node autosupport invoke node type all message MAINT number_of_hours_downh The following AutoSupport message suppresses automatic case creation for two hours cluster1 system node autosupport invoke node type all ...

Page 72: ... module keeping track of where the cables were connected Leave the cables in the cable management device so that when you reinstall the cable management device the cables are organized 4 Remove and set aside the cable management devices from the left and right sides of the controller module 5 Remove the controller module from the chassis a Insert your forefinger into the latching mechanism on eith...

Page 73: ...Using the FRU map locate the RTC battery on the controller module b Gently push the battery away from the holder rotate it away from the holder and then lift it out of the holder Note the polarity of the battery as you remove it from the holder The battery is marked with a plus sign and must be positioned in the holder correctly A plus sign near the holder tells you how the battery should be posit...

Page 74: ...llation of the controller module a Make sure the latch arms are locked in the extended position b Using the latch arms push the controller module into the chassis bay until it stops Do not push down on the latching mechanism at the top of the latch arms Doing so with raise the locking mechanism and prohibit sliding the controller module into the chassis c Press down and hold the orange tabs on top...

Page 75: ...ack was disabled reenable it storage failover modify node local auto giveback true Return the failed part to NetApp After you replace the part you can return the failed part to NetApp as described in the RMA instructions shipped with the kit Contact technical support at NetApp Support 888 463 8277 North America 00 800 44 638277 Europe or 800 800 80 800 Asia Pacific if you need the RMA number or ad...

Page 76: ...Y WHETHER IN CONTRACT STRICT LIABILITY OR TORT INCLUDING NEGLIGENCE OR OTHERWISE ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE NetApp reserves the right to change any products described herein at any time and without notice NetApp assumes no responsibility or liability arising from the use of products described herein except as expressly agree...