Brocade Communications Systems Fabric Watch, Administrator'S Manual

Page 1: ...53 1002752 01 14 December 2012 752 Fabric Watch Administrator s Guide Supporting Fabric OS v7 1 0 ...

Page 2: ...responsibility to any person or entity with respect to any loss cost liability or damages arising from the information contained in this book or the computer programs that accompany it The product described by this document may contain open source software covered by the GNU General Public License or other open source license agreements To find out which open source software is included in Brocade...

Page 3: ...hapter Added support for Brocade 200E Brocade 3014 and Brocade 48000 March 2005 Fabric Watch Administrator s Guide 53 1000047 01 Updates to support Fabric OS v5 1 0 features and Brocade 4900 and 7500 switches November 2005 Fabric Watch Administrator s Guide 53 1000243 01 Updates to support Fabric OS v5 2 0 features and the FC4 16IP and FC4 48 port blades Removed references to Brocade 3014 and 3016...

Page 4: ...ction Removed support for seconds time base Added pause continue feature April 2011 Fabric Watch Administrator s Guide 53 1002153 02 Updated the Copyright section Added support for Brocade 6505 Updates to support Fabric OS v7 0 1 Chapter 1 Added universal temporary license support information Chapter 7 Added port fencing thresholds for state change and link reset areas Chapter 8 Added information ...

Page 5: ...t formatting xvii Notes cautions and warnings xviii Key terms xviii Additional information xix Other industry resources xix Getting technical help xix Document feedback xx Chapter 1 Fabric Watch In this chapter 1 Fabric health 1 Fabric Watch overview 2 Role based access control 2 Fabric Watch licensing 2 Reasons to customize Fabric Watch settings 3 Event behavior configuration 3 Alert configuratio...

Page 6: ...10 RASlog switch event 10 Locked port log 11 Fabric Watch audit messages 11 Data values 11 Fabric Watch support in Access Gateway mode 12 Chapter 2 Fabric Watch Thresholds In this chapter 13 Threshold values 13 In between buffer values 14 Threshold triggers 14 Above event trigger 15 Below event trigger 15 Audit and RASlog messages 15 Time bases 16 Time base set to none 16 Time base set to other th...

Page 7: ...iguration 34 Notification configuration 34 Configuring alarm notifications 34 Chapter 6 Fabric Security SFP and Performance Monitoring In this chapter 37 Fabric monitoring guidelines and default settings 37 Fabric class areas 37 Fabric monitoring setting guidelines 38 Fabric class default settings 39 Security monitoring guidelines and default settings 40 Security class areas 40 Security monitoring...

Page 8: ...Port fencing configuration using BNA 71 Recommended port configuration settings 72 Chapter 8 System Monitoring In this chapter 75 Environment monitoring 75 Environment class area 75 Environment monitoring setting guidelines 76 Environment class default settings 76 Resource class settings 77 Resource class area 77 Resource class setting guidelines 77 Resource class default settings 77 System monito...

Page 9: ...ms for FRUs using Web Tools 92 Configuring alarm filters using Web Tools 92 Fabric Watch alarm information 93 E mail notification using Web Tools 94 Chapter 10 Fabric Watch Reports In this chapter 97 Fabric Watch reports 97 Switch Availability Monitor report 98 Generating a Switch Availability Monitor report 98 Switch Health report 99 Generating a Switch Health report 99 Switch Status Policy repor...

Page 10: ...x Fabric Watch Administrator s Guide 53 1002752 01 ...

Page 11: ...rformance and Security classes 52 Table 15 Port class areas 55 Table 16 Port class default settings 57 Table 17 E_Port class default settings 62 Table 18 FOP_Port and FCU_Port class default settings 66 Table 19 VE_Port class default settings 68 Table 20 Port fencing class and subclass areas 69 Table 21 Recommended port fencing thresholds 71 Table 22 Recommended configuration for the Port class 73 ...

Page 12: ...xii Fabric Watch Administrator s Guide 53 1002752 01 ...

Page 13: ...es Figure 1 In between buffer values 14 Figure 2 Above event trigger with buffer zone 15 Figure 3 Time base set to none 16 Figure 4 Event trigger 17 Figure 5 Configuring Fabric Watch using SNMP 24 Figure 6 Example OID tree 27 Figure 7 Fabric Watch dialog box 88 ...

Page 14: ...xiv Fabric Watch Administrator s Guide 53 1002752 01 ...

Page 15: ...hold settings Chapter 3 Fabric Watch Threshold Components describes the components class area and element associated with every monitored behavior Chapter 4 Fabric Watch Activation describes the Fabric Watch requirements provides an overview of the interfaces and explains the methods of accessing Fabric Watch through each interface Chapter 5 Fabric Watch Configuration provides a comprehensive tabl...

Page 16: ...re and software Although many different software and hardware configurations are tested and supported by Brocade Communications Systems Inc for Fabric OS 7 1 0 documenting all possible configurations and scenarios is beyond the scope of this document Deprecated hardware platform support The following hardware platforms are not supported in the Fabric OS 7 1 0 release These platforms can interopera...

Page 17: ...ormation Updated port fencing section and included moderate aggressive and conservative threshold settings Recommended settings for Port areas using the portThConfig command Buffer settings which now enable the user to configure in between buffer values for thresholds that fall between the below high threshold and the above low threshold boundaries Packet loss monitoring enhancements on the VE_Por...

Page 18: ...der of increasing severity of potential hazards NOTE A note provides a tip guidance or advice emphasizes important information or provides a reference to related information ATTENTION An Attention statement indicates potential damage to hardware or data CAUTION A Caution statement alerts you to situations that can be potentially hazardous to you or cause damage to hardware firmware software or dat...

Page 19: ...chnical Committee T11 website This website provides interface standards for high performance and mass storage applications for Fibre Channel storage management and other applications http www t11 org For information about the Fibre Channel industry visit the Fibre Channel Industry Association website http www fibrechannel org Getting technical help Contact your switch support supplier for hardware...

Page 20: ...e as the serial number except for the Brocade DCX For the Brocade DCX access the numbers on the WWN cards by removing the Brocade logo plate at the top of the nonport side of the chassis Document feedback Quality is our first concern at Brocade and we have made every effort to ensure the accuracy and completeness of this document However if you find an error or an omission or you think that a topi...

Page 21: ...tworked devices One of the more obvious criteria for fabric health is the condition of the network hardware A switch or port failure can prevent data packets from reaching their destination Network traffic can also influence fabric health If the number of packets routed through a port exceeds the port bandwidth it causes network delays and packet loss Receive Rx and Transmit Tx performance areas a...

Page 22: ...Whenever fabric elements exceed these thresholds Fabric Watch automatically provides notification using several methods including e mail messages SNMP traps and log entries Role based access control Role Based Action Control RBAC defines the capabilities that a user account has based on the role the account has been assigned For each role there is a set of predefined permissions on the jobs and ta...

Page 23: ...ssed in the following sections Event behavior configuration You must first use the fwSetToCustom command to switch from default to custom settings and then use the advanced configuration options provided with the portThConfig thConfig and sysMonitor commands to configure event behavior actions and time bases at the port level Alert configuration When Fabric Watch is improperly configured a large n...

Page 24: ...n element port Monitoring Do you want to monitor all class areas or implement the monitoring in incremental stages If you monitor class areas incrementally you should configure Fabric Watch to monitor the classes in the following order 1 Monitor Fabric class areas using the thConfig command Refer to Chapter 6 Fabric Security SFP and Performance Monitoring for details 2 Monitor Port class areas usi...

Page 25: ... between devices such as zone changes fabric segmentation E_Port down fabric reconfiguration domain ID changes and fabric logins A Fabric class alarm alerts you to problems or potential problems with interconnectivity You can customize Fabric class and area parameters using the thConfig command For complete information about fabric monitoring refer to Fabric monitoring guidelines and default setti...

Page 26: ...ngs on page 40 SFP monitoring The SFP class groups areas that monitor the physical aspects of an SFP such as voltage current RXP and TXP in physical ports E_Ports FOP_Ports and FCU_Ports An SFP class alarm alerts you to an SFP fault You can customize SFP class and area parameters using the thConfig command Use the thMonitor command to monitor the Brocade 10 Gbps and 16 Gbps SFP modules and 16 Gbps...

Page 27: ...re exceeded Supported port types include physical ports E_Ports optical F_Ports FOP_Ports copper F_Ports FCU_Ports and Virtual E_Ports VE_Ports NOTE Port fencing is not enabled by default You must manually enable port fencing Refer to Port fencing configuration on page 70 for instructions When a port that has exceeded its user defined thresholds is fenced by the software the port is placed into th...

Page 28: ...s local configuration Fabric Watch supports port movement from one logical switch to another Whenever a port is moved thresholds associated with the port are deleted from which the logical switch from which the port was moved and created for the logical switch to where the port is moved A logical interswitch link LISL is the logical portion of the physical connection that joins base switches You c...

Page 29: ...d default values for specified classes and areas in Fabric Watch You can customize the information reported by Fabric Watch by configuring event behavior types threshold values time bases and event settings These area attributes are used to define and detect events in Fabric Watch Fabric Watch notification types Fabric Watch provides event notifications in several different formats to ensure that ...

Page 30: ...f the threshold that the counter crossed Event type Value of the counter that exceeded the threshold State of the element that triggered the alarm Source of the trap You must configure the software to receive trap information from the network device You must also configure the SNMP agent on the switch to send the trap to the management station You can configure SNMP notifications using the snmpCon...

Page 31: ...pe of management interface used to access the switch NOTE Audit messages are generated for port fencing configuration changes whether port fencing is enabled or disabled You can set up an external host to receive Audit messages so you can easily monitor unexpected changes For information on error messages generated by Fabric Watch see the Fabric OS Message Reference For information on configuring ...

Page 32: ...e bases on page 16 for more information Fabric Watch support in Access Gateway mode Both the Advanced Performance Monitoring APM license and the Fabric Watch license must be installed on the platform configured in Access Gateway AG mode to use the frame monitoring and end to end EE monitoring capabilities The APM license provides the counters and the Fabric Watch license provides the monitoring an...

Page 33: ... trigger for four configuration possibilities A combination of these settings can cause the following actions to occur Above high threshold Fabric Watch takes this action when the current value is above the high threshold Below high threshold Fabric Watch takes this action when the current value is between the high and low threshold This replaces the previous in between action which no longer exis...

Page 34: ...THRESHOLD BUFFER 1 _______________________________________________________________________________ Low action Below high threshold In between Above low threshold Above action ______________________________________________________________________________ LOW THRESHOLD BUFFER 1 ______________________________________________________________________________ Low action Below low threshold FIGURE 1 In b...

Page 35: ...e data value becomes less than the high threshold and buffer value Fabric Watch triggers a second event Event 2 to indicate that it has returned to normal operation The second event will not be triggered until the counter value falls below the high threshold and buffer values FIGURE 2 Above event trigger with buffer zone Below event trigger The Below event trigger generates an event when a data va...

Page 36: ...re exceeds the high threshold it triggers an event FIGURE 3 Time base set to none Time base set to other than none If you specify a time base value other than none minute hour or day Fabric Watch does not use the current data value Instead it calculates the difference between the current data value and the data value as it existed one time base ago It compares this difference to the threshold boun...

Page 37: ...on the tenth sample the counter value changes from 0 to 1 hence calculated rate of change is 1 per minute At the thirteenth sample the rate of change is 2 per minute The rate of change must be at least 3 per minute to exceed the event triggering requirement of 2 which is met on the eighteenth sample FIGURE 4 Event trigger Fabric Watch alarm behavior Fabric Watch alarm behavior depends on the thres...

Page 38: ...18 Fabric Watch Administrator s Guide 53 1002752 01 Fabric Watch alarm behavior 2 ...

Page 39: ...ents of a subclass For example ports connected to another switch can be monitored using both the Port class and E_Port subclass You can configure general port monitoring using the Port class and monitoring specific to a type of port using the E_Port class Ports connected to another switch can trigger events based on either of these configurations Ports that are not connected to another switch are ...

Page 40: ...ments Each area of a subclass with defined thresholds will act in addition to the settings applied to the element through the parent class Assignment of elements to subclasses does not need to be performed by a network administrator These assignments are seamlessly made through automated detection algorithms Table 1 describes the classes into which Fabric Watch groups all switch and fabric element...

Page 41: ...e fabric to another Configure the Port class using the portThConfig command Resource Manages your system s memory or CPU usage Monitors flash memory It calculates the amount of flash space consumed and compares it to a defined threshold Configure the Resource class using the sysMonitor command Security Monitors all attempts to breach your SAN security helping you fine tune your security measures C...

Page 42: ...22 Fabric Watch Administrator s Guide 53 1002752 01 Fabric Watch classes areas and elements 3 ...

Page 43: ...hreshold alerts for Fabric OS switches requires using Web Tools to set up SNMP on the Fabric OS switch See Activating Fabric Watch using SNMP on page 24 for instructions on how to set up SNMP Web Tools Provides a graphical user interface that can be launched from an Internet browser which allows you to launch a Fabric Watch window to configure switch monitoring settings Using Web Tools you can con...

Page 44: ... license key is correct before repeating step 4 6 Enter the fwClassinit command to initialize the Fabric Watch classes Activating Fabric Watch using SNMP You can integrate Fabric Watch with existing enterprise systems management tools such as SNMP The Fabric Watch Management Information Base MIB lets system administrators configure fabric elements receive SNMP traps generated by fabric events and ...

Page 45: ...o SW TRAP yes y no n yes yes swFCPortScn yes y no n no swEventTrap yes y no n no swFabricWatchTrap yes y no n no yes swTrackChangesTrap yes y no n no FA TRAP yes y no n yes connUnitStatusChange yes y no n no connUnitEventTrap yes y no n no connUnitSensorStatusChange yes y no n no connUnitPortStatusChange yes y no n no SW EXTTRAP yes y no n no switch admin 7 Enter the snmpConfig command to configur...

Page 46: ... 0 Read Write true t false f true Access host subnet area in dot notation 0 0 0 0 Read Write true t false f true Access host subnet area in dot notation 0 0 0 0 Read Write true t false f true Access host subnet area in dot notation 0 0 0 0 Read Write true t false f true Access host subnet area in dot notation 0 0 0 0 Read Write true t false f true Access host subnet area in dot notation 0 0 0 0 Re...

Page 47: ...ee 11 Obtain the specific identifier for the element that will be modified To get the identifier click the swFwThresholdTable and swFwThresholdEntry directory and run a get operation on swFwName A list of elements appears in which each element is preceded by an identifier Remember the numeric portion of the identifier which appears before the symbol You can scroll through the list to find the nume...

Page 48: ...and type the IP address of the device in the Address field http 10 77 77 77 or https 10 77 77 77 2 Press Enter A browser window opens to open Web Tools A Login dialog box opens 3 Enter your username and password 4 Select a switch from the Fabric Tree and log in if necessary 5 Select Tasks Manage Fabric Watch For information about how to configure Fabric Watch using Web Tools refer to Chapter 9 Fab...

Page 49: ...23 Set the boundary and alarm level to custom or default Note These command resets all thresholds for all classes and cannot be configured on individual ports fwSetToCustom fwSetToDefault Setting Fabric Watch custom and default values on page 31 Configure Fabric Watch e mail alerts for all classes fwMailCfg E mail notification configuration on page 31 Configure and show alarms filtering for Fabric...

Page 50: ...g the sysMonitor command on page 78 Set and display the switch status policy parameters switchStatusPolicySet switchStatusPolicyShow System Monitoring on page 75 Show the overall switch status switchStatusShow Chapter 8 System Monitoring Configure FRU state and notifications and monitor power supply fan and SFP FRUs fwFruCfg Chapter 8 System Monitoring Display fan status fanShow Chapter 8 System M...

Page 51: ...ications in a Telnet session perform the following steps 1 Enter the fwMailCfg command at the prompt The fwMailcfg menu displays 1 Show Mail Configuration Information 2 Disable Email Alert 3 Enable Email Alert 4 Send Test Mail 5 Set Recipient Mail Address for Email Alert 6 Relay Host IP Configuration 7 Quit Select an item 1 7 7 2 Enter the number corresponding to the task you wish to perform Showi...

Page 52: ...ss for which Fabric Watch should disable e mail alerts The following confirmation message displays Email Alert is disabled The system returns to the fwMailCfg menu Enabling an e mail alert 1 Enter 3 in the fwMailCfg menu to enable e mail alert for a specific class The Config Show menu displays 2 Select a class for which Fabric Watch should enable e mail alerts The following confirmation message di...

Page 53: ...ilCfg menu to specify the recipient to whom Fabric Watch should send the e mail alert for a class The Config Show menu displays 2 Select a class The following prompt displays Mail To NONE 3 Enter the e mail address of the person responsible for the specific class of alerts Fabric Watch uses the default value located between the brackets in the prompt as the current e mail address for the class A v...

Page 54: ...Relay Host configuration 2 Set Relay Host IP 3 Remove Relay Host configuration 4 Quit 2 Enter 3 to remove the configuration Notification configuration Notifications act as a signal or alert that notifies you when a threshold has been crossed When you use alarm notifications error messages are sent to designated locations such as an error log SNMP trap view or e mail With an error log you can log i...

Page 55: ...sent switch admin fwAlarmsFilterSet 0 The 0 option turns the alarm notification off All notifications are suppressed when alarm notifications are turned off except for the Environment class and Resource class 3 Verify or view your current alarm notifications by using the fwAlarmsFilterShow command switch admin fwalarmsfiltershow FW Alarms are enabled ...

Page 56: ...36 Fabric Watch Administrator s Guide 53 1002752 01 Notification configuration 5 ...

Page 57: ...and describes each area Although it is recommended that you leave the entire Fabric class in its default state no alerts you can configure the Fabric class using the thConfig command TABLE 3 Fabric class areas Area Description Domain ID changes DC Monitors forced domain ID changes Forced domain ID changes occur when there is a conflict of domain IDs in a single fabric and the principal switch must...

Page 58: ...ation changes Segmentations only occur in the event of an entire switch failure In this rare case you can gather multiple reports from all the attached E_Ports of the link failures Zoning changes Zone changes are captured through the Audit facility in Fabric OS All zone changes can be configured to be recorded in the RASlog which is the recommended practice Segmentation changes SC Tracks the cumul...

Page 59: ..._Port status Unit Downs Time Base none Low 0 High 0 Buffer 0 Below 0 Above 0 Informative Informative Fabric logins FLOGI Monitors host device fabric logins Unit Logins Time Base none Low 0 High 0 Buffer 0 Below 0 Above 0 Informative Informative Fabric reconfiguration Monitors configuration changes Unit Reconfigs Time Base none Low 0 High 0 Buffer 0 Below 0 Above 0 Informative Informative Segmentat...

Page 60: ...witch from an unauthorized IP address Illegal command IV Commands permitted only to the primary Fibre Channel Switch FCS are executed on another switch Incompatible security DB ISB Secure switches with different version stamps have been detected Login violations LV Login violations which occur when a secure fabric detects a login failure Invalid Certifications IC No FCS NF The switch has lost cont...

Page 61: ... Illegal commands IV Monitors illegal commands Unit Violations Time Base minute Low 1 High 2 Buffer 0 Below 0 Above 3 Informative Out_of_range Incompatible security DB ISB Monitors incompatible security databases Unit Violations Time Base minute Low 1 High 2 Buffer 0 Below 0 Above 3 Informative Out_of_range Login violations LV Monitors login violations Unit Violations Time Base minute Low 1 High 2...

Page 62: ...net violations TV Monitors Telnet violations Unit Violations Time Base minute Low 1 High 2 Buffer 0 Below 0 Above 3 Informative Out_of_range TS out of sync TS Monitors instances in which the timestamp is out of sync Unit Violations Time Base minute Low 1 High 2 Buffer 0 Below 0 Above 3 Informative Out_of_range TABLE 6 Security class area default settings Continued Area Description Default threshol...

Page 63: ...fault state no alerts you can configure the SFP class using the thConfig command NOTE SFPs connected to GbE ports are not monitored TABLE 7 SFP class areas Area Description Temperature Measures the physical temperature of the SFP in degrees Celsius A high temperature indicates that the SFP might be in danger of damage Receive power RXP Measures the amount of incoming laser in µwatts to help determ...

Page 64: ... none Low 0 High 50 Buffer 1 Below 1 Above 1 Out_of_range Out_of_range Receive power RXP Monitors receive power in µWatts Unit µWatts Time Base none Low 0 High 5000 Buffer 25 Below 1 Above 1 Out_of_range Out_of_range Voltage Monitors SFP electrical force in volts Unit mV Time Base none Low 2970 High 3630 Buffer 10 Below 1 Above 1 Out_of_range Out_of_range Temperature Monitors SFP temperature Unit ...

Page 65: ...ines It is recommended that you leave the entire Performance Monitor Class and End to End Performance Monitor Class area settings in their default state no alerts Performance Monitor class default settings Table 10 provides default settings for areas in the Customer Defined Performance Monitor class TABLE 9 Performance Monitor class areas Area Description RXP EE performance monitor The percentage ...

Page 66: ...e following actions Send an SNMP alarm Log a RASlog message Send an e mail alert For complete information about using the thConfig command refer to the Fabric OS Command Reference Manual TABLE 11 End to End Performance Monitor class default settings Area Description Default threshold settings Default alarm settings Threshold state End to end receive performance RX performance Monitors the receivin...

Page 67: ...security IV Illegal command Default or Custom1 Default or Custom2 Use the Security class default settings for areas and alarm configuration There is no reason to alter the default settings SFP TXP Transmit areas RXP Receive areas Current Voltage Temperature PWROnHours Default or Custom1 Default or Custom2 Use the SFP default settings The traits are SFP specific and there is no reason to alter them...

Page 68: ...ert mechanisms for these counters To set the high threshold of the RX area enter the thConfig command using the following parameters switch admin thconfig set ee area RX timebase minute high val 12 Pausing and continuing monitoring To pause the monitoring of a class area and port or index enter the thConfig command using the following parameters NOTE You cannot specify all for all classes but you ...

Page 69: ...or e mail action on the first port and sends a warning to the user that the other ports are affected Logical switch considerations with QSFP NOTE The following information is applicable only to voltage and temperature monitoring of QSFPs Fabric Watch monitors QSFPs in each logical switch Temperature and voltage are monitored on the first available port of the QSFP unit to minimize the display of r...

Page 70: ...nfig apply sfp area TXP sfptype sfptype TABLE 13 16 Gbps and QSFP configurable SFP types SfpType Serial number Area Default Value 16GSWL HA High Low Temperature Centigrade 85 5 Voltage mVoltage 3600 3000 RXP uW 1259 32 TXP uW 1259 126 Current mAmp 12 3 Power on Hours hours 0 0 16GLWL HB Temperature Centigrade 90 5 Voltage mVoltage 3600 3000 RXP uW 1995 10 TXP uW 1995 126 Current mAmp 70 1 QSFP HT ...

Page 71: ...w command using the following parameter switch admin sfpshow health Fabric Watch monitors the SFP s current voltage receiver RXP and transmitter TXP and if any of these parameters crosses the low or high thresholds the state of the SFP is yellow otherwise the state is green The SFP can also be in one of the following states Paused health monitoring is not enabled No license the switch does not hav...

Page 72: ...on Class Area Default Custom Unit Time Base Low Thresh High Thresh Buffer Default Custom Below Above Notes Fabric E_Port downs X Downs None 0 0 0 X Fabric reconfig X Reconfigs None 0 0 0 X Domain ID changes X DID changes None 0 0 0 X Segmentation X Segmentations None 0 0 0 X Zone changes X Zone changes None 0 0 0 X Fabric logins X Logins None 0 0 0 X SFP Temperature X C None 10 85 3 X E E RX power...

Page 73: ...lations Minute 1 2 0 X E S SLAP failures X Violations Minute 1 2 0 X E S TS out of sync X Violations Minute 1 2 0 X E S No FCS X Violations Minute 1 2 0 X E S Incompatible security DB X Violations Minute 1 2 0 X E S Illegal commands X Violations Minute 1 2 0 X E S TABLE 14 Recommended settings for Fabric SFP Performance and Security classes Continued E Error_Log S SNMP_Trap P Port_LOG_LOCK M EMAIL...

Page 74: ...54 Fabric Watch Administrator s Guide 53 1002752 01 Recommended settings for Fabric SFP Performance Security classes 6 ...

Page 75: ...putes to an invalid CRC Invalid CRCs can represent noise on the network Such frames are recoverable by retransmission Invalid CRCs can indicate a potential hardware problem Invalid transmission words ITW The number of times an invalid transmission word error occurs on a port A word did not transmit successfully resulting in encoding errors Invalid word messages usually indicate a hardware problem ...

Page 76: ...ors frequently occur due to a faulty SFP or cable Packet loss VE_Port only The number of packets routed through a port exceeds the port bandwidth Protocol errors PE The number of times a protocol error occurs on a port Invalid state due to LRR on an online link Occasionally these errors occur due to software glitches Persistent errors occur due to hardware problems Received packets RXP The percent...

Page 77: ... alarm settings Threshold state Cyclic redundancy check CRC Monitors the number of CRC errors Unit Errors Time Base minute Low 0 High 1000 Buffer 100 Below 0 Above 0 Informative Out_of_range Invalid transmission words ITW Monitors the number of invalid words transmitted Unit Errors Time Base minute Low 0 High 1000 Buffer 100 Below 0 Above 0 Informative Out_of_range Class 3 discards C3TX_T0 Class 3...

Page 78: ...til you execute portThConfig apply The apply option allows you to toggle between default settings and your own saved custom configuration and to apply actions and thresholds separately You may choose to use default thresholds together with a customized subset of available actions or you may modify some of the thresholds and use the default actions Use the nosave option to save the configuration no...

Page 79: ... Port class to configure an area whose settings are common to one or more of the port subclasses for example configuring all physical ports to monitor invalid CRC counts In most cases the default settings are adequate for the physical port Configuring all physical ports to monitor invalid CRC counts Invalid Cyclic Redundancy Check CRC count errors on a port can represent noise on the network or a ...

Page 80: ...ion raslog snmp buffer 0 switch admin portthconfig set port area itw lowthreshold value 25 trigger above action raslog buffer 0 In this example the alarms are set at two points a high threshold of 40 and a low threshold of 25 The goal is to be notified as the number of invalid transmission words per minute rises above the low boundary and again when it rises above the high boundary Triggers specif...

Page 81: ...ting is set to 0 the default Area Invalid Transmission Words Change the default high boundary from 1000 to 40 per minute and make sure the Buffer setting is set to 0 the default Excessive invalid transmission words on E_ports leads to fabric congestion and possible frame drops if left unchecked therefore set the alarm to fence the port Refer to Port type E_Port FOP_Port or FCU_Port on page 68 for ...

Page 82: ...cing can be enabled or disabled for the following areas for the E_Port class Link Failure Count Loss of Synchronization Count Primitive Sequence Protocol Error Invalid Transmission Word Invalid CRC Count TABLE 17 E_Port class default settings Area Description Default threshold settings Default alarm settings Threshold state Cyclic redundancy check CRC Monitors the number of CRC errors Unit Errors ...

Page 83: ...rrors Time Base minute Low 0 High 5 Buffer 0 Below 0 Above 0 Informative Out_of_range Received packets RXP Monitors the receive rate by percentage Unit Percentage Time Base minute Low 0 High 100 Buffer 0 Below 0 Above 0 Informative Informative State changes ST Monitors state changes Unit Changes Time Base minute Low 0 High 50 Buffer 0 Below 0 Above 0 Informative Out_of_range Transmitted packets TX...

Page 84: ...undary settings are split For Host devices keep the defaults of 1000 per minute and buffer of 100 For storage devices tighten the boundaries substantially change the default high boundary for Invalid Transmission Words to 80 and change the high boundary for Invalid CRC Count to 40 per minute Hosts and HBAs reboot so do not set alerts for these devices Storage devices however should not be rebootin...

Page 85: ... the results and adjust your settings accordingly Area Class 3 C3 Discards Unlike the other areas take a conservative approach for the C3 Discards area Use the default settings and configure the alarms for Above The goal is to locate issues with the device or its infrastructure so monitor the data to help isolate issues Port fencing is one of the recommended solutions for isolating issues Area Tru...

Page 86: ... 3 discards C3TX_TO Class 3 discards frames due to time out or destination unreachable Unit Errors Time Base minute Low 0 High 5 Buffer 0 Below 0 Above 0 Informative Out_of_range Link loss Monitors the number of link failures Unit Errors Time Base minute Low 0 High 500 Buffer 50 Below 0 Above 0 Informative Out_of_range Signal loss Monitors the number of signal loss errors Unit Errors Time Base min...

Page 87: ...formative Trunk utilization E_Port FCU_Port and FOP_Port The percent of utilization for the trunk at the time of the last poll Unit Percentage Time Base minute Low 0 High 100 Buffer 0 Below 0 Above 0 Informative Informative Link reset Monitors the number of link resets sent by a given port LR Out and received on a given port LR In Unit Errors Time Base minute Low 0 High 500 Buffer 50 Below 0 Above...

Page 88: ...d for packet loss for a VE port enter the portThConfig command using the following parameters switch admin portthconfig set ve port area PKTLOSS highthreshold value 0 60 trigger above action snmp Port type E_Port FOP_Port or FCU_Port E_Port FOP_Port and FCU_Port guidelines represent a more aggressive approach in most areas than physical port guidelines Refer to E_Port subclass setting guidelines o...

Page 89: ... the thresholds and configure the ports to report errors for one or more areas using the portThConfig command After the ports are configured you can enable port fencing for specific areas of the physical ports E_Ports FOP_Ports and FCU_Ports using the portFencing command Port fencing is not supported on VE_Ports Table 20 shows the areas that support port fencing for the different physical port cla...

Page 90: ...s Cyclic redundancy check CRC errors and invalid transmission words ITW can occur on normal links They have also been known to occur during certain transitions such as server reboots When these errors occur more frequently they can cause a severe impact While most systems can tolerate infrequent CRC errors or invalid words other environments can be sensitive to even infrequent instances The overal...

Page 91: ...work Advisor BNA Management application supports port fencing Port fencing objects include the SAN Fabrics Directors Switches physical Virtual Switches Ports as well as Port Types E_port F_port and FX_port Use port fencing to directly assign a threshold to these objects When a switch does not support port fencing a No Fencing Changes message displays in the Threshold field in the Ports table If th...

Page 92: ...ssign the thresholds to available objects in the BNA tree Port fencing threshold areas include the following C3 Discard Frames Fabric OS only Invalid CRCs Fabric OS only Invalid Transmission Words Fabric OS only Link Reset Fabric OS only Protocol Errors M EOS and Fabric OS Security M EOS State Changes Fabric OS only Refer to Chapter 5 Device Configuration of the Brocade Network Advisor User Manual...

Page 93: ...Minute 0 100 0 X TX Performance X Percentage Minute 0 100 0 X State Changes X Changes Minute 0 50 0 X Link Reset X Errors Minute 0 500 50 X C3 Discard X Errors Minute 0 5 0 X E_Port Link Loss X Errors Minute 0 0 0 X Sync Loss X Errors Minute 0 45 0 X E S Signal Loss X Errors Minute 0 45 0 X E S Protocol Error X Errors Minute 0 5 0 X Invalid Words X Errors Minute 0 40 0 X E S F pf Invalid CRCs X Er...

Page 94: ...ntage Minute 0 100 0 X FOP_Port and FCU_Port STORAGE Link Loss X Errors Minute 0 15 0 X E S Sync Loss X Errors Minute 0 45 0 X E S Signal Loss X Errors Minute 0 45 0 X E S Protocol Error X Errors Minute 0 5 0 X Invalid Words X Errors Minute 0 80 0 X E S F pf Invalid CRCs X Errors Minute 0 40 0 X E S F pf RX Performance X Percentage Minute 0 85 0 X E TX Performance X Percentage Minute 0 85 0 X E St...

Page 95: ...he switch You can configure the Environment class using the sysMonitor command Environment class area Table 23 lists and describes the Temperature area in the Environment class NOTE Event Manager EM now manages fan monitoring the switch status is calculated based on fan status reported by EM You can use the fanShow command to view the fan status TABLE 23 Environment class area Area Description Tem...

Page 96: ...tch no longer supports fan monitoring Event Manager EM now manages fan monitoring and the switch status is calculated based on the fan status reported by EM TABLE 24 Environment class default settings Area Description Default threshold settings Default alarm settings Threshold state Temperature Monitors switch temperature in Celsius Unit degrees C Time Base none Brocade 200E Low 0 High 60 Buffer 1...

Page 97: ...reas in the Resource class Brocade 8000 Low 0 High 73 Buffer 10 Brocade DCX Low 0 High 70 Buffer 10 Brocade DCX 4S Low 0 High 75 Buffer 10 Below 3 Above 3 Informative Out of range TABLE 24 Environment class default settings Continued Area Description Default threshold settings Default alarm settings Threshold state TABLE 25 Resource class area Area Description Flash Monitors the compact flash spac...

Page 98: ...fied Fabric Watch alerts You can set up the system monitor to poll at certain intervals and specify the number of retries required before Fabric Watch takes action Configuring thresholds for CPU and memory does not follow the transaction model of the typical Fabric Watch command The apply and cancel options are not valid in this context When the system crosses any of the limits SNMP RASlog e mail ...

Page 99: ... env area temp Displaying the threshold of the system areas The temperature area refers to the ambient temperature inside the switch in degrees Celsius Temperature sensors monitor the switch in case the temperature rises to levels at which damage to the switch might occur Enter the sysMonitor command using the following parameters switch admin sysmonitor show env area temp index Example of configu...

Page 100: ...h sends out a RASlog WARNING message When usage returns below the limit Fabric Watch sends a RASlog INFO message Valid values are range between 0 to 80 percent and the default value is different for different systems low_limit Specifies a lower usage limit for memory as percentage of available memory This value must be smaller than the value set by the limit parameter When memory usage exceeds or ...

Page 101: ...t affect its monitors NOTE Based on the configuration of the core blade component of the switch status policy Fabric Watch generates two RASlogs when a core blade is removed either on the Brocade DCX or the Brocade DCX 4S For example if the Down and Marginal configuration is 0 and 1 on the DCX upon removal of the first core blade Fabric Watch generates one RASlog for the switch status policy and t...

Page 102: ...han 256 ports in an 8510 8 chassis NOTE The presence of four or more FS8 18 encryption blades in the DCX Data Center Backbone causes the Fabric Watch switch status policy for power supplies to assume a policy setting of 2 1 Brocade 6505 default policy The default Fabric Watch policy for the Brocade 6505 is one power supply in the left bay with an optional configuration of two power supplies in bot...

Page 103: ...sPolicyShow command displays the following policy parameters that determine the overall switch status NOTE FCoE and VE ports are not considered in marginal port or faulty port calculations Power Supplies The power supply thresholds detect absent or failed power supplies Temperature Temperature thresholds detect faulty temperature sensors Fan Fan thresholds detect faulty fans Flash Flash thresholds...

Page 104: ...onfigure the FRU class using the fwFruCfg command Configuring FRUs The configuration of field replaceable units FRUs is an exception to the procedures described thus far in this chapter FRUs are monitored using state values as opposed to the quantitative values used to monitor the rest of the fabric As a result of the qualitative nature of this monitoring the concept of thresholds does not apply N...

Page 105: ...l 16 Slot Alarm State 0 31 1 Slot Alarm Action 0 17 1 Power Supply Alarm State 0 31 1 Power Supply Alarm Action 0 17 1 Fan Alarm State 0 31 1 Fan Alarm Action 0 17 1 WWN Alarm State 0 31 1 WWN Alarm Action 0 31 1 SFP Alarm State 0 31 1 SFP Alarm Action 0 17 1 Fru configuration left unchanged Specifying triggers for FRU alarms You can specify triggers for any number of alarm states or alarm actions...

Page 106: ...ring 8 Recommended FRU settings Table 30 lists the recommended settings for field replaceable units FRUs TABLE 30 Recommended FRU settings E ERROR_LOG M EMAIL_ALERT Class Area Absent Inserted On Off Faulty Below Above FRU Slot X X Power Supply X X Fan X X WWN X X ...

Page 107: ...e elements and enable the custom limits configure threshold boundaries Configure Fabric Watch to alert you to errant values Configure Fabric Watch to identify unacceptable values threshold traits Opening the Fabric Watch window To open the Fabric Watch window perform the following steps 1 Select a switch from the Fabric Tree and log in if necessary 2 Select Tasks Manage Fabric Watch The Fabric Wat...

Page 108: ...g using Web Tools The Fabric Watch license must be installed to view and modify the System Monitor details Select Monitor System Monitor to display the System Monitor When switch exceeds the configured usage limit an alarm triggers You can configure the alarm with the Alarm Configuration tab The alarm can be configured for SNMP trap RAS log or both There are three Trait and Alarm configurable valu...

Page 109: ...The high threshold for the event setting comparisons Buffer Size The size of the buffer zone used in event setting comparisons NOTE When you are configuring the VE Port Packet Loss area thresholds the packet loss threshold values are a percentage You can configure from 0 01 low boundary to 100 00 high boundary To configure threshold traits perform the following steps 1 Click Fabric Watch in the Ma...

Page 110: ...ion alarm supports all port class types for these options CRC errors Invalid words Protocol errors State change Trunk utilization C3 discards RX performance TX performance Loss of signal Link failures Link resets Packet loss not for E Port Utilization not for E Port To configure threshold alarms perform the following steps 1 From the Fabric Watch dialog box select the Threshold Configuration tab 2...

Page 111: ...ll switches 3 Select the Threshold Configuration tab 4 Under Area Selection select the area with the alarms that you want to enable or disable 5 Select the Element Configuration subtab 6 Select an element from the Element Selection menu 7 In the Status area To disable threshold alarms click Disabled and click Apply The threshold alarms are disabled and you do not need to continue with this procedu...

Page 112: ...e of the selected states an event will occur 6 Select the methods by which you want to be notified about the FRU alarms For FRUs the only options are error log and e mail alert 7 Click Apply to apply the changes to the switch A confirmation dialog box displays asking if you want to apply the changes to the switch 8 Click OK to save the changes to the switch Configuring alarm filters using Web Tool...

Page 113: ...fer to Enabling or disabling threshold alarms for individual elements on page 91 4 Under Area Selection select the alarm area report to be viewed 5 Select the Configuration Report subtab This tab displays a report of the configuration for the selected area Displaying alarms Using the Alarm Notification tab you can view a list of all alarms that occurred for a selected class or area Figure 7 on pag...

Page 114: ...t e mail address on the switch perform the following steps 1 Open the Switch Administration window 2 Select the Switch tab 3 In the DNS Configuration area in the DNS Server 1 field enter the primary Domain Name Server IP address You can enter the IP address in IPv4 or IPv6 format 4 In the DNS Server 2 field enter the secondary Domain Name Server IP address You can enter the IP address in IPv4 or I...

Page 115: ... test e mail so you can verify the e mail notification is working correctly You can send a test e mail only after you have applied your settings Disabling the e mail alert When you disable e mail alerts Fabric Watch does not send e mail notification even if the e mail notification method is assigned to monitored areas To disable an e mail alerts recipient perform the following steps 1 Open the Fab...

Page 116: ...96 Fabric Watch Administrator s Guide 53 1002752 01 Fabric Watch Configuration Using Web Tools 9 ...

Page 117: ...rate reports from the command line using a Telnet session or by using Web Tools The examples in this chapter use the command line interface Table 32 lists the Fabric OS commands to view reports You can generate the following types of reports using Fabric Watch Switch Availability Monitor report Switch Health report Switch Status Policy report Port Detail report TABLE 32 Fabric OS commands to view ...

Page 118: ...throughput or switch performance You can generate reports from the command line using a Telnet session or by using Web Tools The examples in this chapter use the command line interface Generating a Switch Availability Monitor report 1 Connect to the switch and log in as admin 2 Enter the fwSamShow command to generate a SAM report The following is an example of a SAM report Total Total Down Total P...

Page 119: ...out Fabric Watch but for licensed Fabric Watch users the marginal and faulty ports are included in the report The following is an example of a switch health report NOTE Switch health report details do not display the health status of GbE ports Fabric Watch only monitors and reports the status for physical and virtual FC ports Generating a Switch Health report 1 Connect to the switch and log in as ...

Page 120: ...enterprise class platforms such as the DCX Backbone For modular switches the switch status policy report also contains information on the WWN Blade and CP Generating a Switch Status Policy report 1 Connect to the switch and log in as admin 2 Enter the switchStatusPolicyShow command to generate a Switch Status Policy report The current overall switch status policy parameters Down Marginal PowerSupp...

Page 121: ... switch and log in as admin 2 Enter the fwPortDetailShow command to generate a Port Detail report See Table 32 for additional commands to view more port detail information Port Detail Report Report time 04 24 2007 03 40 10 AM Switch Name geo_hi IP address 1080 8 800 200C 417A Port Exception report by All Port Errors SFP Errors Port Type State Dur H M LFA LSY LSI PER INW CRC PSC BLP STM SRX STX SCU...

Page 122: ...riod LSY Sync Loss the number of sync loss occurrences out of range for a specified time period LSI Signal Loss the number of signal loss occurrences out of range for a specified time period PER Protocol Error the number of protocol errors out of range for a specified time period INW Invalid word The number of invalid words out of range for a specified time period CRC Invalid CRC the number of CRC...

Page 123: ...rce class 77 security class 40 SFP class 43 areas 19 audit messages 11 B below event trigger 15 BNA port fencing configuration 71 C class environment 20 fabric 20 FRU 20 Performace Monitor 20 port 21 resource 21 security 21 SFP 21 classes description of 20 command dnsConfig 9 errShow 10 fmConfig 5 fwclassinit 24 fwFruCfg 4 84 fwMailCfg 9 licenseAdd 24 portThConfig 4 6 55 58 snmpConfig 10 switchSta...

Page 124: ...nded settings 52 setting guidelines 38 Fabric Watch activation 23 87 alarm behavior 17 alarms 90 audit messages 11 class areas 19 classes 19 20 components 19 configuration tasks 29 customizing settings 3 description of 1 elements 20 fabric health 1 feature overview 2 interface types 23 interfaces for activating 23 notification types 9 reports 97 role based access control 2 support for virtual fabr...

Page 125: ...34 notification methods 2 e mail 31 e mail alert 9 port log lock 11 notification type e mail alert 9 locked port log 11 RASlog 10 SNMP trap 10 P performance monitor class areas 45 performance monitoring 5 guidelines and settings 45 recommended settings 52 physical port setting guides 57 port class areas 55 default settings 57 guidelines and default settings 56 port configuration 58 invalid CRC are...

Page 126: ...enting 83 viewing 83 switch status policy configuration 30 switch status policy planning 81 switch temperature displaying 30 sysMonitor command 78 command examples 79 system monitoring 7 system monitoring configuration 30 T Telnet using to activate Fabric Watch 23 temperature configuring using sysMonitor command 79 thConfig command configuration options 46 thMonitor command configuration options 6...