NetApp FAS8300, Manual

Page 1: ...FAS8700 systems ONTAP Systems NetApp November 23 2021 This PDF was generated from https docs netapp com us en ontap systems fas8300 install setup html on November 23 2021 Always check docs netapp com for the latest ...

Page 2: ...Table of Contents FAS8300 and FAS8700 System Documentation 1 Install and setup 1 Maintain 10 ...

Page 3: ...r a typical installation of your system from racking and cabling through initial system bring up Use this guide if you are familiar with installing NetApp systems Access the Installation and Setup Instructions PDF poster FAS8300 and FAS8700 Installation and Setup Instructions Videos FAS8300 and FAS8700 There are two videos one showing how to rack and cable your system and one showing an example of...

Page 4: ...ion of ONTAP for more information about this system NetApp Hardware Universe Find the Release Notes for your version of ONTAP 9 You need to provide the following at your site Rack space for the storage system Phillips 2 screwdriver Additional networking cables to connect your system to your network switch and laptop or console with a Web browser Steps 1 Unpack the contents of all boxes 2 Record th...

Page 5: ...der dependent X6585 R6 112 00291 3m X6562 R6 112 00196 5m Management network Micro USB console cable Not applicable Console connection used during software setup if laptop or console does not support network discovery Power cables Not applicable Powering up the system 4 Review the NetApp ONTAP Confiuration Guide and collect the required information listed in that guide ONTAP Configuration Guide St...

Page 6: ... switchless cluster The optional data ports optional NIC cards and management ports on the controller modules are connected to switches The cluster interconnect and HA ports are cabled on both controller modules You must have contacted your network administrator for information about connecting the system to the switches Be sure to check the direction of the cable pull tabs when inserting the cabl...

Page 7: ...abling instructions Option 2 Cable a switched cluster The optional data ports optional NIC cards mezzanine cards and management ports on the controller modules are connected to switches The cluster interconnect and HA ports are cabled on to the cluster HA switch You must have contacted your network administrator for information about connecting the system to the switches Be sure to check the direc...

Page 8: ...ers to drive shelves for drive shelf cabling instructions Step 4 Cable controllers to drive shelves Option 1 Cable the controllers to SAS drive shelves You must cable each controller to the IOM modules on both SAS drive shelves Be sure to check the illustration arrow for the proper cable connector pull tab orientation The cable pull tab for the DS224 C are down As you insert the connector you shou...

Page 9: ...5 Complete system setup and configuration to complete system setup and configuration Step 5 Complete system setup and configuration You can complete the system setup and configuration using cluster discovery with only a connection to the switch and laptop or by connecting directly to a controller in the system and then connecting to the management switch 7 ...

Page 10: ...ptop has network discovery enabled See your laptop s online help for more information 4 Use the following animation to connect your laptop to the Management switch Connecting your laptop to the Management switch 5 Select an ONTAP icon listed to discover a Open File Explorer b Click network in the left pane c Right click and select refresh d Double click either ONTAP icon and accept any certificate...

Page 11: ...e your laptop or console a Set the console port on the laptop or console to 115 200 baud with N 8 1 See your laptop or console s online help for how to configure the console port b Connect the console cable to the laptop or console using the console cable that came with your system and then connect the laptop to the management switch on the management subnet c Assign a TCP IP address to the laptop...

Page 12: ...a Log in to your existing account or create an account NetApp Support Registration b Register your system NetApp Product Registration c Download Active IQ Config Advisor NetApp Downloads Config Advisor 7 Verify the health of your system by running Config Advisor 8 After you have completed the initial configuration go to the ONTAP ONTAP System Manager Documentation Resources page for information ab...

Page 13: ... eligibility and health you must correct the issue before shutting down the impaired node see the NetApp Encryption overview with the CLI Steps 1 Check the status of the impaired node If the impaired node is at the login prompt log in as admin If the impaired node is at the LOADER prompt and is part of HA configuration log in as admin on the healthy node If the impaired node is in a standalone con...

Page 14: ...ays external and the Restored column displays yes it s safe to shut down the impaired node If the Key Manager type displays onboard and the Restored column displays yes you need to complete some additional steps If the Key Manager type displays external and the Restored column displays anything other than yes you need to complete some additional steps If the Key Manager type displays onboard and t...

Page 15: ...ght need to manually recover OKM g Return to admin mode set priv admin h You can safely shutdown the node Verify NSE configuration 1 Display the key IDs of the authentication keys that are stored on the key management servers security key manager query If the Key Manager type displays external and the Restored column displays yes it s safe to shut down the impaired node If the Key Manager type dis...

Page 16: ...upport mysupport netapp com b Verify the Restored column shows yes for all authentication keys security key manager key query c Verify that the Key Manager type shows onboard manually backup the OKM information d Go to advanced privilege mode and enter y when prompted to continue set priv advanced e Enter the command to display the key management backup information security key manager onboard sho...

Page 17: ...ve data from the impaired node storage If you have a cluster with more than two nodes it must be in quorum If the cluster is not in quorum or a healthy node shows false for eligibility and health you must correct the issue before shutting down the impaired node see the Administration overview with the CLI If you have a MetroCluster configuration you must have confirmed that the MetroCluster Config...

Page 18: ...n the Returning SEDs to unprotected mode section of Administration overview with the CLI You must leave the power supplies turned on at the end of this procedure to provide power to the healthy node Steps 1 Check the MetroCluster status to determine whether the impaired node has automatically switched over to the healthy node metrocluster show 2 Depending on whether an automatic switchover has occ...

Page 19: ...eck the state of the aggregates by using the storage aggregate show command controller_A_1 storage aggregate show Aggregate Size Available Used State Vols Nodes RAID Status aggr_b2 227 1GB 227 1GB 0 online 0 mcc1 a2 raid_dp mirrored normal 6 Heal the root aggregates by using the metrocluster heal phase root aggregates command mcc1A metrocluster heal phase root aggregates Job 137 Job succeeded Heal...

Page 20: ... animation illustration or the written steps to remove the controller module from the chassis Removing the controller module Steps 1 If you are not already grounded properly ground yourself 2 Release the power cable retainers and then unplug the cables from the power supplies 3 Loosen the hook and loop strap binding the cables to the cable management device and then unplug the system cables and SF...

Page 21: ... controller module and then follow the directions to replace it Before you begin Although the contents of the boot media is encrypted it is a best practice to erase the contents of the boot media before replacing it For more information see the Statement of Volatility for your system on the NetApp Support Site You must log into the NetApp Support Site to display the Statement of Volatility for you...

Page 22: ...ss the locking tabs on the sides of the air duct in toward the middle of the controller module b Slide the air duct toward the back of the controller module and then rotate it upward to its completely open position 2 Locate and remove the boot media from the controller module 20 ...

Page 23: ...n gently push it into the socket 4 Check the boot media to make sure that it is seated squarely and completely in the socket If necessary remove the boot media and reseat it into the socket 5 Lock the boot media in place a Rotate the boot media down toward the motherboard b Placing a finger at the end of the boot media by the blue button push down on the boot media end to engage the blue locking b...

Page 24: ...sh drive a Download the service image to your work space on your laptop b Unzip the service image If you are extracting the contents using Windows do not use WinZip to extract the netboot image Use another extraction tool such as 7 Zip or WinRAR There are two folders in the unzipped service image file boot efi c Copy the efi folder to the top directory on the USB flash drive The USB flash drive sh...

Page 25: ...ss Ctrl C select the option to boot to Maintenance mode and then halt the node to boot to LOADER 9 Although the environment variables and bootargs are retained you should check that all required boot environment variables and bootargs are properly set for your system type and configuration using the printenv bootarg name command and correct any errors using the setenv variable name value command a...

Page 26: ... image from the USB drive restore the file system and verify the environmental variables This procedure applies to systems that are not in a two node MetroCluster configuration Steps 1 From the LOADER prompt boot the recovery image from the USB flash drive boot_recovery The image is downloaded from the USB flash drive 2 When prompted either enter the name of the image or accept the default image d...

Page 27: ...Restore OKM NSE and NVE as needed If your system does not have onboard keymanager NSE or NVE configured complete the steps in this section 6 From the LOADER prompt enter the boot_ontap command If you see Then The login prompt Go to the next Step Waiting for giveback a Log into the partner node b Confirm the target node is ready for giveback with the storage failover show command 7 Connect the cons...

Page 28: ... Ctrl C for Boot Menu message and when the Boot Menu is displayed select option 6 5 Verify that the environmental variables are set as expected a Take the node to the LOADER prompt b Check the environment variable settings with the printenv command c If an environment variable is not set as expected modify it with the setenv environment variable name changed value command d Save your changes using...

Page 29: ...surviving cluster 5 Verify that the switchback operation has completed metrocluster show The switchback operation is still running when a cluster is in the waiting for switchback state cluster_B metrocluster show Cluster Configuration State Mode Local cluster_B configured switchover Remote cluster_A configured waiting for switchback The switchback operation is complete when the clusters are in the...

Page 30: ...e to the target node 2 Use the boot_ontap command at the LOADER prompt to boot the node 3 Check the console output If the console displays Then The LOADER prompt Boot the node to the boot menu boot_ontap menu Waiting for giveback a Enter Ctrl C at the prompt b At the message Do you wish to halt this node rather than wait y n enter y c At the LOADER prompt enter the boot_ontap menu command 4 At the...

Page 31: ...ck with the storage failover show command 10 Giveback only the CFO aggregates with the storage failover giveback fromnode local only cfo aggregates true command If the command fails because of a failed disk physically dis engage the failed disk but leave the disk in the slot until a replacement is received If the command fails because of an open CIFS sessions check with customer how to close out C...

Page 32: ...ng the net int revert command 17 Move the console cable to the target node and run the version v command to check the ONTAP versions 18 Restore automatic giveback if you disabled it by using the storage failover modify node local auto giveback true command Restore NSE NVE on systems running ONTAP 9 6 and later Steps 1 Connect the console cable to the target node 2 Use the boot_ontap command at the...

Page 33: ... management servers If the Restored column yes true you are done and can proceed to complete the replacement process If the Key Manager type external and the Restored column anything other than yes true use the security key manager external restore command to restore the key IDs of the authentication keys If the command fails contact Customer Support If the Key Manager type onboard and the Restore...

Page 34: ...e issue before shutting down the impaired node ONTAP 9 System Administration Reference You might want to erase the contents of your caching module before replacing it Steps 1 Although data on the caching module is encrypted you might want to erase any data from the impaired caching module and verify that the caching module has no data a Erase the data on the caching module system controller flash ...

Page 35: ...s false for eligibility and health you must correct the issue before shutting down the impaired node see the Administration overview with the CLI If you have a MetroCluster configuration you must have confirmed that the MetroCluster Configuration State is configured and that the nodes are in an enabled and normal state metrocluster node show Steps 1 If AutoSupport is enabled suppress automatic cas...

Page 36: ... the CLI You must leave the power supplies turned on at the end of this procedure to provide power to the healthy node Steps 1 Check the MetroCluster status to determine whether the impaired node has automatically switched over to the healthy node metrocluster show 2 Depending on whether an automatic switchover has occurred proceed according to the following table If the impaired node Then Has aut...

Page 37: ...eck the state of the aggregates by using the storage aggregate show command controller_A_1 storage aggregate show Aggregate Size Available Used State Vols Nodes RAID Status aggr_b2 227 1GB 227 1GB 0 online 0 mcc1 a2 raid_dp mirrored normal 6 Heal the root aggregates by using the metrocluster heal phase root aggregates command mcc1A metrocluster heal phase root aggregates Job 137 Job succeeded Heal...

Page 38: ...tion or the written steps to remove the controller module from the chassis Removing the controller module Steps 1 If you are not already grounded properly ground yourself 2 Release the power cable retainers and then unplug the cables from the power supplies 3 Loosen the hook and loop strap binding the cables to the cable management device and then unplug the system cables and SFPs if needed from t...

Page 39: ... the FRU map on the controller module for the location of the Flash Cache Your storage system must meet certain criteria depending on your situation It must have the appropriate operating system for the caching module you are installing It must support the caching capacity Although the contents of the caching module is encrypted it is a best practice to erase the contents of the module before repl...

Page 40: ...ailed caching module s LED is lit a Press the blue release tab The caching module end rises clear of the release tab b Rotate the caching module up and slide it out of the socket 4 Install the replacement caching module a Align the edges of the replacement caching module with the socket and gently insert it into the socket b Rotate the caching module downward toward the motherboard c Placing your ...

Page 41: ...ule in the chassis until instructed to do so 3 Cable the management and console ports only so that you can access the system to perform the tasks in the following sections You will connect the rest of the cables to the controller module later in this procedure 4 Complete the installation of the controller module a Plug the power cord into the power supply reinstall the power cable locking collar a...

Page 42: ...start diagnostics All commands in the diagnostic procedures are issued from the node where the component is being replaced Steps 1 If the node to be serviced is not at the LOADER prompt reboot the node system node halt node node_name After you issue the command you should wait until the system stops at the LOADER prompt 2 At the LOADER prompt access the special drivers specifically designed for sy...

Page 43: ...e local disk pools This task only applies to two node MetroCluster configurations Steps 1 Verify that all nodes are in the enabled state metrocluster node show cluster_B metrocluster node show DR Configuration DR Group Cluster Node State Mirroring Mode 1 cluster_A controller_A_1 configured enabled heal roots completed cluster_B controller_B_1 configured enabled waiting for switchback recovery 2 en...

Page 44: ...you can return the failed part to NetApp as described in the RMA instructions shipped with the kit Contact technical support at NetApp Support 888 463 8277 North America 00 800 44 638277 Europe or 800 800 80 800 Asia Pacific if you need the RMA number or additional help with the replacement procedure Chassis Replace the chassis FAS8300 and FAS8700 All other components in the system must be functio...

Page 45: ...firm the halt system node halt node node_name The confirmation message looks like the following Warning Rebooting or halting node node_name in an HA enabled cluster may result in client disruption or data access failure To ensure continuity of service use the storage failover takeover command Are you sure you want to halt node node_name y n You must perform a clean system shutdown before replacing...

Page 46: ...over you attempted switchover with the metrocluster switchover command and the switchover was vetoed Review the veto messages and if possible resolve the issue and try again If you are unable to resolve the issue contact technical support 3 Resynchronize the data aggregates by running the metrocluster heal phase aggregates command from the surviving cluster controller_A_1 metrocluster heal phase a...

Page 47: ...tination cluster mcc1A metrocluster operation show Operation heal root aggregates State successful Start Time 7 29 2016 20 54 41 End Time 7 29 2016 20 54 42 Errors 8 On the impaired controller module disconnect the power supplies Move and replace hardware FAS8300 and FAS8700 Step 1 Remove the controller modules To replace the chassis you must remove the controller modules from the old chassis Step...

Page 48: ...nward The fan module moves a little bit away from the chassis 4 Pull the fan module straight out from the chassis making sure that you support it with your free hand so that it does not swing out of the chassis CAUTION The fan modules are short Always support the bottom of the fan module with your free hand so that it does not suddenly drop free from the chassis and injure you 5 Set the fan module...

Page 49: ...ule with the opening in the chassis and then gently push the controller module halfway into the system Do not completely insert the controller module in the chassis until instructed to do so 2 Recable the console to the controller module and then reconnect the management port 3 Complete the installation of the controller module a Plug the power cord into the power supply reinstall the power cable ...

Page 50: ...HA state should be the same for all components 2 If the displayed system state for the chassis does not match your system configuration a Set the HA state for the chassis ha config modify chassis HA state The value for HA state can be one of the following ha mcc mcc 2n mccip non ha b Confirm that the setting has changed ha config show 3 If you have not already done so recable the rest of your syst...

Page 51: ... sync source storage virtual machines SVMs on the formerly impaired site now active and serving data from the local disk pools This task only applies to two node MetroCluster configurations Steps 1 Verify that all nodes are in the enabled state metrocluster node show cluster_B metrocluster node show DR Configuration DR Group Cluster Node State Mirroring Mode 1 cluster_A controller_A_1 configured e...

Page 52: ...ber or additional help with the replacement procedure Controller Replace the controller module FAS8300 and FAS8700 You must review the prerequisites for the replacement procedure and select the correct one for your version of the ONTAP operating system All drive shelves must be working properly If your system is in a MetroCluster configuration you must review the section Choosing the correct recov...

Page 53: ...ut down the impaired node you must determine the status of the node and if necessary take over the node so that the healthy node continues to serve data from the impaired node storage If you have a cluster with more than two nodes it must be in quorum If the cluster is not in quorum or a healthy node shows false for eligibility and health you must correct the issue before shutting down the impaire...

Page 54: ...must have confirmed that the MetroCluster Configuration State is configured and that the nodes are in an enabled and normal state metrocluster node show Steps 1 If AutoSupport is enabled suppress automatic case creation by invoking an AutoSupport message system node autosupport invoke node type all message MAINT number_of_hours_downh The following AutoSupport message suppresses automatic case crea...

Page 55: ...red node Then Has automatically switched over Proceed to the next step Has not automatically switched over Perform a planned switchover operation from the healthy node metrocluster switchover Has not automatically switched over you attempted switchover with the metrocluster switchover command and the switchover was vetoed Review the veto messages and if possible resolve the issue and try again If ...

Page 56: ...f the healing is vetoed you have the option of reissuing the metrocluster heal command with the override vetoes parameter If you use this optional parameter the system overrides any soft vetoes that prevent the healing operation 7 Verify that the heal operation is complete by using the metrocluster operation show command on the destination cluster mcc1A metrocluster operation show Operation heal r...

Page 57: ...ing the cables to the cable management device and then unplug the system cables and SFPs if needed from the controller module keeping track of where the cables were connected Leave the cables in the cable management device so that when you reinstall the cable management device the cables are organized 4 Remove the cable management device from the controller module and set it aside 5 Press down on ...

Page 58: ...oller module and then rotate it upward to its completely open position c Rotate the riser locking latch on the left side of riser 1 up and toward air duct lift the riser up and then set it aside d Repeat the previous step for the remaining risers Step 2 Move the power supplies You must move the power supply from the impaired controller module to the replacement controller module when you replace a...

Page 59: ...odule until the locking tab clicks into place The power supplies will only properly engage with the internal connector and lock in place one way To avoid damaging the internal connector do not use excessive force when sliding the power supply into the system 4 Repeat the preceding steps for any remaining power supplies Step 3 Move the NVDIMM battery To move the NVDIMM battery from the impaired con...

Page 60: ...the blue locking tab marked PUSH and then lift the battery out of the holder and controller module 3 Move the battery to the replacement controller module 4 Align the battery module with the opening for the battery and then gently push the battery into slot until it locks into place Do not plug the battery cable back into the motherboard until instructed to do so Step 4 Move the boot media You mus...

Page 61: ...ousing and then gently push it into the socket 3 Check the boot media to make sure that it is seated squarely and completely in the socket If necessary remove the boot media and reseat it into the socket 4 Lock the boot media in place a Rotate the boot media down toward the motherboard b Press the blue locking button so that it is in the open position c Placing your fingers at the end of the boot ...

Page 62: ...ions illustrations or the written steps to move the PCIe risers and mezzanine card from the impaired controller module to the replacement controller module Moving PCIe riser 1 and 2 left and middle risers Moving PCI risers 1 and 2 Moving the mezzanine card and riser 3 right riser Moving the mezzanine card and riser 3 60 ...

Page 63: ...iser squarely into the socket on the motherboard and then rotate the latch down flush with the sheet metal on the riser e Repeat this step for riser number 2 2 Remove riser number 3 remove the mezzanine card and install both into the replacement controller module a Remove any SFP or QSFP modules that might be in the PCIe cards b Rotate the riser locking latch on the left side of the riser up and t...

Page 64: ...dules to the new controller module Moving the caching modules 1 If you are not already grounded properly ground yourself 2 Move the caching modules from the impaired controller module to the replacement controller module a Press the blue release tab at the end of the caching module rotate the module up and then remove the module from the socket b Move the caching module to the same socket on the r...

Page 65: ...ired controller module to the replacement controller module You must have the new controller module ready so that you can move the DIMMs directly from the impaired controller module to the corresponding slots in the replacement controller module You can use the following animation illustration or the written steps to move the DIMMs from the impaired controller module to the replacement controller ...

Page 66: ...ule c Make sure that the DIMM ejector tabs on the DIMM socket are in the open position and then insert the DIMM squarely into the socket The DIMMs fit tightly in the socket but should go in easily If not realign the DIMM with the socket and reinsert it d Visually inspect the DIMM to verify that it is evenly aligned and fully inserted into the socket e Repeat these substeps for the remaining DIMMs ...

Page 67: ...the power supply to the power source b Using the locking latches firmly push the controller module into the chassis until the locking latches begin to rise Do not use excessive force when sliding the controller module into the chassis to avoid damaging the connectors c Fully seat the controller module in the chassis by rotating the locking latches upward tilting them so that they clear the locking...

Page 68: ...sk It is important that you apply the commands in the steps on the correct systems The replacement node is the new node that replaced the impaired node as part of this procedure The healthy node is the HA partner of the replacement node Steps 1 If the replacement node is not at the LOADER prompt halt the system to the LOADER prompt 2 On the healthy node check the system time show date The date and...

Page 69: ...ode to be serviced is not at the LOADER prompt reboot the node system node halt node node_name After you issue the command you should wait until the system stops at the LOADER prompt 2 At the LOADER prompt access the special drivers specifically designed for system level diagnostics to function properly boot_diags 3 Select Scan System from the displayed menu to enable running the diagnostics tests...

Page 70: ...at the end of the procedure In a stand alone system you must manually reassign the ID to the disks You must use the correct procedure for your configuration Controller redundancy Then use this procedure HA pair Option 1 Verify the system ID change on an HA system Two node MetroCluster configuration Option 2 Manually reassign the system ID on systems in a two node MetroCluster configuration Option ...

Page 71: ...fore issuing the giveback You can enter the following command to monitor the progress of the savecore command system node run node local node name partner savecore s d Return to the admin privilege level set privilege admin 5 Give back the node a From the healthy node give back the replaced node s storage storage failover giveback ofnode replacement_node_name the replacement node takes back its st...

Page 72: ...out this task This procedure applies only to systems in a two node MetroCluster configuration running ONTAP You must be sure to issue the commands in this procedure on the correct node The impaired node is the node on which you are performing maintenance The replacement node is the new node that replaced the impaired node as part of this procedure The healthy node is the DR partner of the impaired...

Page 73: ...k reassign s old system ID In the case of the preceding example the command is disk reassign s 118073209 You can respond Y when prompted to continue 5 Verify that the disks or FlexArray LUNs were assigned correctly disk show a Verify that the disks belonging to the replacement node show the new system ID for the replacement node In the following example the disks owned by system 1 now show the new...

Page 74: ...ode show fields configuration state node1_siteA metrocluster node show fields configuration state dr group id cluster node configuration state 1 node1_siteA node1mcc 001 configured 1 node1_siteA node1mcc 002 configured 1 node1_siteB node1mcc 003 configured 1 node1_siteB node1mcc 004 configured 4 entries were displayed 11 Verify the operation of the MetroCluster configuration in Data ONTAP a Check ...

Page 75: ...The licenses keys must be in the 28 character format You have a 90 day grace period in which to install the license keys After the grace period all old licenses are invalidated After a valid license key is installed you have 24 hours to install all of the keys before the grace period ends Steps 1 If you need new license keys obtain replacement license keys on the NetApp Support Site in the My Supp...

Page 76: ...ted as false revert them to their home ports network interface revert 2 Register the system serial number with NetApp Support If AutoSupport is enabled send an AutoSupport message to register the serial number If AutoSupport is not enabled call NetApp Support to register the serial number 3 If automatic giveback was disabled reenable it storage failover modify node local auto giveback true Step 4 ...

Page 77: ...surviving cluster 5 Verify that the switchback operation has completed metrocluster show The switchback operation is still running when a cluster is in the waiting for switchback state cluster_B metrocluster show Cluster Configuration State Mode Local cluster_B configured switchover Remote cluster_A configured waiting for switchback The switchback operation is complete when the clusters are in the...

Page 78: ...sing different procedures depending on the storage system hardware configuration Option 1 Most configurations To shut down the impaired node you must determine the status of the node and if necessary take over the node so that the healthy node continues to serve data from the impaired node storage About this task If you have a cluster with more than two nodes it must be in quorum If the cluster is...

Page 79: ...is not in quorum or a healthy node shows false for eligibility and health you must correct the issue before shutting down the impaired node see the Administration overview with the CLI If you have a MetroCluster configuration you must have confirmed that the MetroCluster Configuration State is configured and that the nodes are in an enabled and normal state metrocluster node show Steps 1 If AutoSu...

Page 80: ... the CLI You must leave the power supplies turned on at the end of this procedure to provide power to the healthy node Steps 1 Check the MetroCluster status to determine whether the impaired node has automatically switched over to the healthy node metrocluster show 2 Depending on whether an automatic switchover has occurred proceed according to the following table If the impaired node Then Has aut...

Page 81: ...eck the state of the aggregates by using the storage aggregate show command controller_A_1 storage aggregate show Aggregate Size Available Used State Vols Nodes RAID Status aggr_b2 227 1GB 227 1GB 0 online 0 mcc1 a2 raid_dp mirrored normal 6 Heal the root aggregates by using the metrocluster heal phase root aggregates command mcc1A metrocluster heal phase root aggregates Job 137 Job succeeded Heal...

Page 82: ...tion or the written steps to remove the controller module from the chassis Removing the controller module Steps 1 If you are not already grounded properly ground yourself 2 Release the power cable retainers and then unplug the cables from the power supplies 3 Loosen the hook and loop strap binding the cables to the cable management device and then unplug the system cables and SFPs if needed from t...

Page 83: ... out of the chassis 7 Place the controller module on a stable flat surface Step 3 Replace system DIMMs Replacing a system DIMM involves identifying the target DIMM through the associated error message locating the target DIMM using the FRU map on the air duct or the lit LED on the motherboard and then replacing the DIMM You can use the following animation illustration or the written steps to repla...

Page 84: ... in slots 2 4 7 9 13 15 18 and 20 The NVDIMM is located in slot 11 Steps 1 Open the air duct a Press the locking tabs on the sides of the air duct in toward the middle of the controller module b Slide the air duct toward the back of the controller module and then rotate it upward to its completely open position 2 Locate the DIMMs on your controller module 3 Note the orientation of the DIMM in the ...

Page 85: ...the DIMM squarely into the slot The DIMM fits tightly in the slot but should go in easily If not realign the DIMM with the slot and reinsert it Visually inspect the DIMM to verify that it is evenly aligned and fully inserted into the slot 7 Push carefully but firmly on the top edge of the DIMM until the ejector tabs snap into place over the notches at the ends of the DIMM 8 Close the air duct Step...

Page 86: ...rotating the locking latches upward tilting them so that they clear the locking pins gently push the controller all the way in and then lower the locking latches into the locked position The controller module begins to boot as soon as it is fully seated in the chassis Be prepared to interrupt the boot process d If you have not already done so reinstall the cable management device e Interrupt the n...

Page 87: ...ler module and then reenable automatic giveback Steps 1 Recable the system as needed If you removed the media converters QSFPs or SFPs remember to reinstall them if you are using fiber optic cables 2 Return the node to normal operation by giving back its storage storage failover giveback ofnode impaired_node_name 3 If automatic giveback was disabled reenable it storage failover modify node local a...

Page 88: ...surviving cluster 5 Verify that the switchback operation has completed metrocluster show The switchback operation is still running when a cluster is in the waiting for switchback state cluster_B metrocluster show Cluster Configuration State Mode Local cluster_B configured switchover Remote cluster_A configured waiting for switchback The switchback operation is complete when the clusters are in the...

Page 89: ...umber or additional help with the replacement procedure Hot swap a fan module FAS8300 and FAS8700 To swap out a fan module without interrupting service you must perform a specific sequence of tasks You must replace the fan module within two minutes of removing it from the chassis System airflow is disrupted and the controller module or modules shut down after two minutes to avoid overheating You c...

Page 90: ...hen the fan module is completely seated 9 Swing the cam handle up to its closed position making sure that the cam handle release latch clicks into the locked position The Attention LED should not be lit after the fan is seated and has spun up to operational speed 10 Align the bezel with the ball studs and then gently push the bezel onto the ball studs 11 After you replace the part you can return t...

Page 91: ... failover modify node local auto giveback false 3 Take the impaired node to the LOADER prompt If the impaired node is displaying Then The LOADER prompt Go to the next step Waiting for giveback Press Ctrl C and then respond y when prompted System prompt or password prompt enter system password Take over or halt the impaired node For an HA pair take over the impaired node from the healthy node stora...

Page 92: ...word prompt enter system password Take over or halt the impaired node For an HA pair take over the impaired node from the healthy node storage failover takeover ofnode impaired_node_name When the impaired node shows Waiting for giveback press Ctrl C and then respond y Option 3 Controller is in a two node MetroCluster To shut down the impaired node you must determine the status of the node and if n...

Page 93: ...Job succeeded Heal Aggregates is successful If the healing is vetoed you have the option of reissuing the metrocluster heal command with the override vetoes parameter If you use this optional parameter the system overrides any soft vetoes that prevent the healing operation 4 Verify that the operation has been completed by using the metrocluster operation show command controller_A_1 metrocluster op...

Page 94: ...ete by using the metrocluster operation show command on the destination cluster mcc1A metrocluster operation show Operation heal root aggregates State successful Start Time 7 29 2016 20 54 41 End Time 7 29 2016 20 54 42 Errors 8 On the impaired controller module disconnect the power supplies Step 2 Remove the controller module To access components inside the controller module you must remove the c...

Page 95: ...port the bottom of the controller module as you slide it out of the chassis 7 Place the controller module on a stable flat surface Step 3 Replace the NVDIMM To replace the NVDIMM you must locate it in the controller module using the FRU map on top of the air duct or locate the Attention LED using the FRU Map on the top of the slot 1 riser The NVDIMM LED blinks while destaging contents when you hal...

Page 96: ...IMM ejector tabs on either side of the NVDIMM and then slide the NVDIMM out of the socket and set it aside Carefully hold the NVDIMM by the edges to avoid pressure on the components on the NVDIMM circuit board 3 Remove the replacement NVDIMM from the antistatic shipping bag hold the NVDIMM by the corners and then align it to the slot The notch among the pins on the NVDIMM should line up with the t...

Page 97: ...u have replaced the component in the controller module you must re install the controller module into the chassis and then boot it to Maintenance mode You can use the following animation illustration or the written steps to install the controller module in the chassis Installing the controller module Steps 1 If you have not already done so close the air duct 2 Align the end of the controller modul...

Page 98: ...ormal boot process and boot to LOADER by pressing Ctrl C If your system stops at the boot menu select the option to boot to LOADER f At the LOADER prompt enter bye to reinitialize the PCIe cards and other components g Interrupt the boot process and boot to the LOADER prompt by pressing Ctrl C If your system stops at the boot menu select the option to boot to LOADER Step 5 Run diagnostics After you...

Page 99: ... was disabled reenable it storage failover modify node local auto giveback true Step 7 Switch back aggregates in a two node MetroCluster configuration After you have completed the FRU replacement in a two node MetroCluster configuration you can perform the MetroCluster switchback operation This returns the configuration to its normal operating state with the sync source storage virtual machines SV...

Page 100: ...ate Mode Local cluster_B configured normal Remote cluster_A configured normal If a switchback is taking a long time to finish you can check on the status of in progress baselines by using the metrocluster config replication resync status show command 6 Reestablish any SnapMirror or SnapVault configurations Step 8 Return the failed part to NetApp After you replace the part you can return the failed...

Page 101: ...l message MAINT number_of_hours_downh The following AutoSupport message suppresses automatic case creation for two hours cluster1 system node autosupport invoke node type all message MAINT 2h 2 Disable automatic giveback from the console of the healthy node storage failover modify node local auto giveback false 3 Take the impaired node to the LOADER prompt If the impaired node is displaying Then T...

Page 102: ... console of the healthy node storage failover modify node local auto giveback false 3 Take the impaired node to the LOADER prompt If the impaired node is displaying Then The LOADER prompt Go to the next step Waiting for giveback Press Ctrl C and then respond y when prompted System prompt or password prompt enter system password Take over or halt the impaired node For an HA pair take over the impai...

Page 103: ...n If you are unable to resolve the issue contact technical support 3 Resynchronize the data aggregates by running the metrocluster heal phase aggregates command from the surviving cluster controller_A_1 metrocluster heal phase aggregates Job 130 Job succeeded Heal Aggregates is successful If the healing is vetoed you have the option of reissuing the metrocluster heal command with the override veto...

Page 104: ...ameter the system overrides any soft vetoes that prevent the healing operation 7 Verify that the heal operation is complete by using the metrocluster operation show command on the destination cluster mcc1A metrocluster operation show Operation heal root aggregates State successful Start Time 7 29 2016 20 54 41 End Time 7 29 2016 20 54 42 Errors 8 On the impaired controller module disconnect the po...

Page 105: ...nd set it aside 5 Press down on both of the locking latches and then rotate both latches downward at the same time The controller module moves slightly out of the chassis 6 Slide the controller module out of the chassis Make sure that you support the bottom of the controller module as you slide it out of the chassis 7 Place the controller module on a stable flat surface Step 3 Replace the NVDIMM b...

Page 106: ...M battery in the controller module 3 Locate the battery plug and squeeze the clip on the face of the battery plug to release the plug from the socket and then unplug the battery cable from the socket 4 Grasp the battery and press the blue locking tab marked PUSH and then lift the battery out of the holder and controller module 5 Remove the replacement battery from its package 6 Align the battery m...

Page 107: ...le in the chassis until instructed to do so 3 Cable the management and console ports only so that you can access the system to perform the tasks in the following sections You will connect the rest of the cables to the controller module later in this procedure 4 Complete the installation of the controller module a Plug the power cord into the power supply reinstall the power cable locking collar an...

Page 108: ...gnostic procedures are issued from the node where the component is being replaced Steps 1 If the node to be serviced is not at the LOADER prompt reboot the node system node halt node node_name After you issue the command you should wait until the system stops at the LOADER prompt 2 At the LOADER prompt access the special drivers specifically designed for system level diagnostics to function proper...

Page 109: ...roCluster configurations Steps 1 Verify that all nodes are in the enabled state metrocluster node show cluster_B metrocluster node show DR Configuration DR Group Cluster Node State Mirroring Mode 1 cluster_A controller_A_1 configured enabled heal roots completed cluster_B controller_B_1 configured enabled waiting for switchback recovery 2 entries were displayed 2 Verify that resynchronization is c...

Page 110: ...App Support 888 463 8277 North America 00 800 44 638277 Europe or 800 800 80 800 Asia Pacific if you need the RMA number or additional help with the replacement procedure Replace a PCIe or mezzanine card FAS8300 and FAS8700 To replace a PCIe or mezzanine card you must disconnect the cables and any SFP and QSFP modules from the cards replace the failed PCIe or mezzanine card and then recable the ca...

Page 111: ...assword Take over or halt the impaired node For an HA pair take over the impaired node from the healthy node storage failover takeover ofnode impaired_node_name When the impaired node shows Waiting for giveback press Ctrl C and then respond y Option 2 Controller is in a MetroCluster Do not use this procedure if your system is in a two node MetroCluster configuration To shut down the impaired node ...

Page 112: ...ting for giveback press Ctrl C and then respond y Option 3 Controller is in a two node MetroCluster To shut down the impaired node you must determine the status of the node and if necessary switch over the node so that the healthy node continues to serve data from the impaired node storage About this task If you are using NetApp Storage Encryption you must have reset the MSID using the instruction...

Page 113: ... is successful If the healing is vetoed you have the option of reissuing the metrocluster heal command with the override vetoes parameter If you use this optional parameter the system overrides any soft vetoes that prevent the healing operation 4 Verify that the operation has been completed by using the metrocluster operation show command controller_A_1 metrocluster operation show Operation heal a...

Page 114: ... using the metrocluster operation show command on the destination cluster mcc1A metrocluster operation show Operation heal root aggregates State successful Start Time 7 29 2016 20 54 41 End Time 7 29 2016 20 54 42 Errors 8 On the impaired controller module disconnect the power supplies Step 2 Remove the controller module To access components inside the controller module you must remove the control...

Page 115: ...controller module and set it aside 5 Press down on both of the locking latches and then rotate both latches downward at the same time The controller module moves slightly out of the chassis 6 Slide the controller module out of the chassis Make sure that you support the bottom of the controller module as you slide it out of the chassis 7 Place the controller module on a stable flat surface Step 3 R...

Page 116: ...e locking bracket on the side of the PCIe riser and then rotate it to the open position c For risers 2 and 3 only swing the side panel up d Remove the PCIe card from the riser by gently pushing up on the bracket and lift the card straight out of the socket 3 Install the replacement PCIe card in the riser by aligning the card with the socket press the card into the socket and then close the side pa...

Page 117: ...to access the mezzanine card replace the mezzanine card and then reinstall riser number 3 See the FRU map on the controller module for more information You can use the following animation illustration or the written steps to replace the mezzanine card Replacing the mezzanine card Steps 1 Remove riser number 3 slots 4 and 5 a Open the air duct by pressing the locking tabs on the sides of the air du...

Page 118: ...d 3 Reinstall the riser a Align the riser with the pins to the side of the riser socket lower the riser down on the pins b Push the riser squarely into the socket on the motherboard c Rotate the latch down flush with the sheet metal on the riser Step 5 Install the controller module After you have replaced the component in the controller module you must re install the controller module into the cha...

Page 119: ...ilting them so that they clear the locking pins gently push the controller all the way in and then lower the locking latches into the locked position d If you have not already done so reinstall the cable management device e Interrupt the normal boot process and boot to LOADER by pressing Ctrl C If your system stops at the boot menu select the option to boot to LOADER f At the LOADER prompt enter b...

Page 120: ...chback command from any node in the surviving cluster 5 Verify that the switchback operation has completed metrocluster show The switchback operation is still running when a cluster is in the waiting for switchback state cluster_B metrocluster show Cluster Configuration State Mode Local cluster_B configured switchover Remote cluster_A configured waiting for switchback The switchback operation is c...

Page 121: ...ical support at NetApp Support 888 463 8277 North America 00 800 44 638277 Europe or 800 800 80 800 Asia Pacific if you need the RMA number or additional help with the replacement procedure Replace a power supply FAS8300 and FAS8700 Replacing a power supply PSU involves disconnecting the target PSU from the power source unplugging the power cable removing the old PSU and installing the replacement...

Page 122: ...wer supply from the chassis c Using both hands pull the power supply out of the chassis and then set it aside 5 Using both hands support and align the edges of the power supply with the opening in the controller module and then gently push the power supply into the controller module until the locking tab clicks into place The power supplies will only properly engage with the internal connector and...

Page 123: ...paired controller using different procedures depending on the storage system hardware configuration Option 1 Most configurations To shut down the impaired node you must determine the status of the node and if necessary take over the node so that the healthy node continues to serve data from the impaired node storage About this task If you have a cluster with more than two nodes it must be in quoru...

Page 124: ... a healthy node shows false for eligibility and health you must correct the issue before shutting down the impaired node see the Administration overview with the CLI If you have a MetroCluster configuration you must have confirmed that the MetroCluster Configuration State is configured and that the nodes are in an enabled and normal state metrocluster node show Steps 1 If AutoSupport is enabled su...

Page 125: ... the CLI You must leave the power supplies turned on at the end of this procedure to provide power to the healthy node Steps 1 Check the MetroCluster status to determine whether the impaired node has automatically switched over to the healthy node metrocluster show 2 Depending on whether an automatic switchover has occurred proceed according to the following table If the impaired node Then Has aut...

Page 126: ...eck the state of the aggregates by using the storage aggregate show command controller_A_1 storage aggregate show Aggregate Size Available Used State Vols Nodes RAID Status aggr_b2 227 1GB 227 1GB 0 online 0 mcc1 a2 raid_dp mirrored normal 6 Heal the root aggregates by using the metrocluster heal phase root aggregates command mcc1A metrocluster heal phase root aggregates Job 137 Job succeeded Heal...

Page 127: ...ion or the written steps to remove the controller module from the chassis Removing the controller module Steps 1 If you are not already grounded properly ground yourself 2 Release the power cable retainers and then unplug the cables from the power supplies 3 Loosen the hook and loop strap binding the cables to the cable management device and then unplug the system cables and SFPs if needed from th...

Page 128: ... the controller module as you slide it out of the chassis 7 Place the controller module on a stable flat surface Step 3 Replace the RTC battery You need to locate the RTC battery inside the controller module and then follow the specific sequence of steps See the FRU map inside the controller module for the location of the RTC battery You can use the following animation illustration or the written ...

Page 129: ... sign near the holder tells you how the battery should be positioned c Remove the replacement battery from the antistatic shipping bag d Note the polarity of the RTC battery and then insert it into the holder by tilting the battery at an angle and pushing down 4 Visually inspect the battery to make sure that it is completely installed into the holder and that the polarity is correct 5 Close the ai...

Page 130: ... prepared to interrupt the boot process b Fully seat the controller module in the chassis by rotating the locking latches upward tilting them so that they clear the locking pins gently push the controller all the way in and then lower the locking latches into the locked position c If you have not already done so reinstall the cable management device d Interrupt the normal boot process and boot to ...

Page 131: ...onfigured enabled heal roots completed cluster_B controller_B_1 configured enabled waiting for switchback recovery 2 entries were displayed 2 Verify that resynchronization is complete on all SVMs metrocluster vserver show 3 Verify that any automatic LIF migrations being performed by the healing operations were completed successfully metrocluster check lif show 4 Perform the switchback by using the...

Page 132: ...eplication resync status show command 6 Reestablish any SnapMirror or SnapVault configurations Step 6 Return the failed part to NetApp After you replace the part you can return the failed part to NetApp as described in the RMA instructions shipped with the kit Contact technical support at NetApp Support 888 463 8277 North America 00 800 44 638277 Europe or 800 800 80 800 Asia Pacific if you need t...

Page 133: ...Y WHETHER IN CONTRACT STRICT LIABILITY OR TORT INCLUDING NEGLIGENCE OR OTHERWISE ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE NetApp reserves the right to change any products described herein at any time and without notice NetApp assumes no responsibility or liability arising from the use of products described herein except as expressly agree...