background image

DATA CENTER 

 

CONFIGURATION GUIDE 

 

 

 

Configuring an iSCSI SAN Using Brocade FCX Switches 

 

 

I

NTRODUCTION

 

This document describes the steps for configuring the Brocade FCX switch in an iSCSI SAN environment. In 

this document, you will find recommendations and instructions for specific commands to optimize the 

switch for an iSCSI SAN network.   

Internet Small Computer Systems Interface (iSCSI) is an IP-based protocol that links data storage facilities 

by ensuring reliable data transfers over long distances. It allows IT staff to utilize a single underlying 

infrastructure (Ethernet) to meet IT and storage networking needs. The behavior of iSCSI traffic differs from 

regular IP traffic. IP traffic is generally composed of packets ranging in different sizes, requiring various 

amounts of bandwidth from the network. On the other hand, iSCSI traffic encapsulates SCSI traffic (SCSI is 

commonly used in data centers to connect disks and tape drives) and sends large blocks of data in bursts.  

Carrying block SCSI traffic places greater demands on the network compared to regular IP traffic. In order to 

run high-performance SCSI traffic over an IP infrastructure, dedicated iSCSI networks are recommended to 

ensure traffic flows freely and quickly between initiators (clients) and targets (iSCSI arrays) without 

competition from general IP traffic.  

In order to provide reliable operation in a mission-critical iSCSI SAN environment, an ideal switch must offer 

the following switch functionality: 

 

Non-Blocking backplane design.  

A switch should be able to provide the same amount of backplane 

bandwidth required to support full duplex communication on ALL ports simultaneously. The Brocade 

FCX, with its non-blocking line-rate architecture, is an ideal switch for such environments. 

 

Support for Inter-Switch Linking (ISL) or Dedicated Stacking Architecture.  

ISL support is required to 

link all switches in a SAN infrastructure together. For non-stacking switches, the switch should support 

designating one or more (through Link Aggregation Groups) ports for inter-switch links. Brocade FCX 

stand-alone switches provide up to 40Gbps full-duplex bandwidth for ISL. For stacking switches, the 

use of stacking ports for ISL is assumed, and each stacking switch should provide at least 20Mbps full-

duplex bandwidth. The Brocade FCX offers up to 64Gbps of stacking bandwidth. 

 

Support for creating Link Aggregation Groups (LAG).  

For non-stacking switches, the ability to bind 

multiple physical ports into a single logical link for use as an ISL is required. These switches should 

support creating LAGs of at least 8x 1Gbps ports or 1x 10Gbps port. In a non-stacking configuration, a 

Brocade FCX offers 8x 1Gbps ports or 4x 10Gbps for LAG.  

 

Support for active or passive Flow Control (802.3x) on ALL ports.  

Switches must be able to actively 

manage “pause” frames received from hosts, or they must passively pass all “pause” frames through 

to the target arrays. Brocade FCX switches actively respond to “pause” frames received from hosts and 

also generate “pause” frames offering a backpressure mechanism when the receiving port (such as 

initiator) is not able to process data as fast as it is being sent to it. 

 

Support for Rapid Spanning Tree Protocol (R-STP).  

For SAN infrastructures consisting of more than 

two non-stacking switches, R-STP must be enabled on all ports used for ISLs. All non-ISL ports should 

be marked as “edge” ports or they should be set to “fast port-span.”  

 

Support for Jumbo Frames.  

Many storage implementations are able to take advantage of Jumbo 

Frames. Whether or not Jumbo frames are able to provide performance increases depends on the 

application and data characteristics.  

 

Ability to disable Unicast Storm Control.  

In General,

 

iSCSI can send packets in a very “bursty” profile 

that many switches misdiagnose as a viral induced packet storm. Since the SAN should be isolated 

from general Ethernet traffic, the viral possibilities are non-existent. Switches need to always pass 

Ethernet packets regardless of bandwidth utilization. The default behavior of a Brocade FCX is such 

that iSCSI packets sent in bursts will not be diagnosed as a packet storm.  

Summary of Contents for FCX 648S

Page 1: ...DATA CENTER Configuring an iSCSI Storage Area Network Using Brocade FCX Switches A step by step guide describing how to install and configure Brocade FCX Switches in an iSCSI Storage Area Network SAN...

Page 2: ...tack 8 Cabling requirements for redundancy 10 Basic Switch Setup andConfiguration 11 Powering On the System 11 Connecting to a PC or Terminal 11 Using the CLI 12 Configuring IP Addresses 12 Assigning...

Page 3: ...d support designating one or more through Link Aggregation Groups ports for inter switch links Brocade FCX stand alone switches provide up to 40Gbps full duplex bandwidth for ISL For stacking switches...

Page 4: ...one cable is required per switch or one per stack in a Brocade FCX stack The Ethernet cable must be connected to a corporate or data center network that allows the administrator to manage the switch r...

Page 5: ...om an independent circuit breaker As with any equipment a filter or surge suppressor is recommended Rack Installation As noted in the previous section Brocade FCX switches can be installed on a deskto...

Page 6: ...Remove the rack mount kit from the shipping carton The kit contains two L shaped mounting brackets and mounting screws 3 Attach the mounting brackets to the each side of the device using the provided...

Page 7: ...er cable and includes AC and DC status LEDs for easy monitoring and troubleshooting When only one PSU is installed both AC OK and DC OK LEDs on the installed PSU must be green for the Brocade FCX devi...

Page 8: ...the stack link so if one link fails stack communications can be maintained Figure 1 illustrates a ring topology stacking configuration In a redundant iSCSI deployment of stacked Brocade FCX switches...

Page 9: ...of an LC LC MM Fiber cable into one of the top unit s SFP stacking ports 2 Plug the other end of the cable into one of the stacking ports of the next unit 3 Repeat steps 1 and 2 for each unit in the s...

Page 10: ...managed as a logical switch with one active management node Each switch in the stack should have two PSUs and each PSU should be supplied by a separate power source Ensure there are two separate power...

Page 11: ...tlet Connecting to a PC or Terminal To manage the switch connect the console serial port on the switch to a management station such as a PC running a terminal emulation application for example HyperTe...

Page 12: ...r commands or options the CLI understands what you are typing Configuring IP Addresses At least one IP address must be configured using the serial connection to the CLI before you can manage each swit...

Page 13: ...mand to save changes FCX648S Switch config ip address 192 168 1 252 255 255 255 0 FCX648S Switch config write memory Syntax ip address ip address sub net mask 5 Set a default gateway address for the s...

Page 14: ...ecure to avoid allowing access to the SAN from the LAN The management port is an out of band port that customers can use to manage their switches without interfering with the in band ports The managem...

Page 15: ...mands to configure the stack on a Brocade FCX 648 S FCX648S Switch config t FCX648S Switch config stack enable FCX648S Switch config write mem Enter these commands to configure the stack on an Brocade...

Page 16: ...to enter unit ID for the unit in the stack being configured There are two ways to find the unit ID Every Brocade FCX switch has stack indicators in front of the switch as shown below These indicators...

Page 17: ...rnet 1 3 2 FCX648S Switch config if e10000 1 3 2 link aggregate active Syntax interface ethernet stack unit slotnum portnum link aggregate active To configure link aggregation on a Brocade FCX 648 E u...

Page 18: ...02 1w FCX648S Switch config write mem Syntax spanning tree 802 1w BEST PRACTICE For iSCSI deployments Brocade recommends that spanning tree be disabled on all access ports Access ports are the switch...

Page 19: ...unit 1 FCX648S Switch config symmetric flow control enable unit 2 FCX648S Switch config write mem Syntax no symmetric flow control enable unit unit_ID NOTE Refer to the section on stack configuration...

Page 20: ...maximum frame size of 1 500 bytes so most devices use 1 500 as their default MTU Jumbo frames are Ethernet frames with more than 1 500 bytes MTU Conventionally jumbo frames can carry up to 9 000 bytes...

Page 21: ...connection and click View Status The Local Area Connection X Status displays 3 Click Properties 4 Click Configure 5 Click the Advanced tab 6 From the Property list select Jumbo Packet 7 From the Valu...

Page 22: ...ibuting the load across different switches and different switch ports SWITCH CONFIGURATION DUMP This section shows a sample output of the running config from a Brocade FCX stack configured per the ins...

Page 23: ...e ethernet 2 1 15 flow control neg on interface ethernet 2 1 16 flow control neg on interface ethernet 2 2 3 link aggregate active interface ethernet 2 2 4 link aggregate active end telnet STACK1 conf...

Page 24: ...tems Inc All Rights Reserved 06 10 GA CG 285 00 Brocade the B wing symbol BigIron DCFM DCX Fabric OS FastIron IronView NetIron SAN Health ServerIron TurboIron and Wingspan are registered trademarks an...

Reviews: