background image

4–NVM Express over Fibre Channel
Host Setup

106

CU0354604-00  P

Windows OOB driver (Tech Preview):

q23wx64W16Storv9.3.2.20.zip

Fibre Channel firmware version 8.08.204 or later, included in the Multi-Boot 
Image (MBI) version 1.44.33

Linux QLogic management application, QConvergeConsole CLI 
version 2.3.0.11 or later:

QConvergeConsoleCLI-2.3.00-11.x86_64

Windows QLogic management application, QConvergeConsole CLI 
version 2.3.0.11 or later (available from the Dell site):

QConvergeConsoleCLI-2.3.00-11_win_x64.zip

NVMe CLI native application: 

The OS Distribution DVD contains the native 

nvme-cli-x.x-y.y.x86_64.rpm

.

Host Setup

Procedures for setting up the initiator host include the following:

Setting Up the Host

Verifying the Adapter Firmware

Verifying the Availability of FC-NVMe Devices

Setting Up the Host

The following sections provide setup instructions for servers running 
SLES 12 SP4, SLES 15/15 SP1, RHEL 7.6, RHEL 8.0, and Windows 2016/2019:

Linux Host Setup

 

Windows Host Setup

Linux Host Setup

To set up a Linux host:

1.

Install the supported base Linux operating system onto a host system.

2.

Download, untar, and install the Linux driver kit as follows:

a.

Download the appropriate driver kit using the FC-NVMe software as 
indicated in 

“Host Software” on page 105

.

Summary of Contents for MARVELL QLogic QLE2660-DEL

Page 1: ...er Third party information brought to you courtesy of Dell CU0354604 00 P June 12 2019 Cover User s Guide Fibre Channel Adapter QLE2660 DEL QLE2662 DEL QME2662 DEL QLE2690 DEL QLE2690L DEL QLE2692 DEL QLE2692L DEL and QME2692 DEL ...

Page 2: ...s the right to make changes to this document at any time without notice Export Control The user or recipient of this document acknowledges that the information included in this document may be subject to laws including but not limited to U S export control laws and regulations regarding the export re export transfer diversion or release of such information The user or recipient must comply with al...

Page 3: ...irements 1 Safety Precautions 1 Pre Installation Checklist 2 PCIe Bus Slot Considerations 2 Installing the Adapter 3 Connecting to the SAN 4 2 Driver Installation and Configuration Windows Driver Installation and Configuration 6 Running the Dell Update Package in the GUI 6 Running the Dell Update Package from the Command Line 11 Examples 12 Linux Driver Installation and Configuration 12 Installati...

Page 4: ...nvergeConsole VMware vCenter Server Plug in 24 Installing the QLogic Adapter CIM Provider 24 Uninstalling the QLogic Adapter CIM Provider 27 Installing the QConvergeConsole VMware vSphere Web Client Plug in 28 Before You Begin 28 Installing QConvergeConsole VMware vSphere Web Client Plug in 29 Uninstalling the QConvergeConsole VMware vSphere Web Client Plug in 30 Configuring VM ID 30 3 Fibre Chann...

Page 5: ... Boot Devices with Noninteractive QConvergeConsole CLI 46 Configuring Boot Devices with the BIOS 46 Configuring Virtual Ports NPIV 46 Configuring NPIV with QConvergeConsole GUI 47 Configuring NPIV with Interactive QConvergeConsole CLI 47 Configuring NPIV with Noninteractive QConvergeConsole CLI 47 Configuring NPIV Quality of Service 48 Setting QoS by Bandwidth 49 Setting QoS by Priority 52 Configu...

Page 6: ...t LUN with QConvergeConsole GUI 71 Configuring the Adapter and Boot Devices with QConvergeConsole CLI 73 Configuring a Zone in a Brocade Switch 74 Verifying that FA BLD is Operational 75 Adapter Side Restrictions 76 Using a Fabric Assigned Boot LUN 77 Using a Fabric Assigned Boot LUN in QConvergeConsole GUI 77 Using a Fabric Assigned Boot LUN in Interactive QConvergeConsole CLI 77 Using a Fabric A...

Page 7: ...ging the Priority Levels in Windows 89 Changing the Priority Levels in VMware ESXi 91 Configuring FDMI 93 Brocade Switch FOS CLI 94 Fabric Features 95 FDMI Enhancements Support 96 Enabling QLogic Forward Error Correction 98 FEC Process Overview 98 Enabling QLogic FEC 99 Running Extended Link Service Commands 100 Link Cable Beacon Extended Link Service Command 101 Read Diagnostic Parameters Extende...

Page 8: ...witch 122 Verifying D_Port Mode with QConvergeConsole GUI 123 Verifying D_Port Mode with Interactive QConvergeConsole CLI 123 Verifying D_Port Mode with Noninteractive QConvergeConsole CLI 124 Verifying D_Port Mode with QConvergeConsole Plug ins 125 B Specifications Physical Characteristics 126 Power Requirements 127 Standards Specifications 127 Interface Specifications 128 Environmental Specifica...

Page 9: ...xL DEL and QME26x2 DEL ix CU0354604 00 P D Regulatory Information Warranty 136 Regulatory and Compliance Information 136 Laser Safety FDA Notice 136 Agency Certification 137 EMI and EMC Requirements 137 Product Safety Compliance 138 E Adapter LEDs F Revision History ...

Page 10: ...ket QLogic QME2662 DEL dual port mezzanine adapter QLogic QLE2690 DEL single port low profile adapter with a full height bracket QLogic QLE2690L DEL single port low profile adapter with a low profile bracket QLogic QLE2692 DEL dual port low profile adapter with a full height bracket QLogic QLE2692L DEL dual port low profile adapter with a low profile bracket QLogic QME2692 DEL dual port mezzanine ...

Page 11: ... multiboot image Fibre Channel Adapter Function Configuration Utility and instructions for setting Fibre Channel Adapter parameters persistent binding configuring the boot device N_Port ID virtualization NPIV and driver parameters and reassembling out of order frames Chapter 4 NVM Express over Fibre Channel provides information on installing and configuring NVM Express on selected Fibre Channel Ad...

Page 12: ... 00 provides reference material on using the QConvergeConsole VMware vCenter Server Plug in and the QConvergeConsole VMware vSphere Web Client Plug in Documentation Conventions This guide uses the following documentation conventions provides additional information without an alert symbol indicates the presence of a hazard that could cause damage to equipment or loss of data indicates the presence ...

Page 13: ...e UP ARROW key Text in italics indicates terms emphasis variables or document titles For example For a complete listing of license agreements refer to the QLogic Software End User License Agreement What are shortcut keys To enter the date type mm dd yyyy where mm is the month dd is the day and yyyy is the year Topic titles between quotation marks identify related topics either within this manual o...

Page 14: ...wed by c a b c means either a or b c Functionality and Features This section provides the following information Functional Description Key Features Supported Operating Systems Functional Description Functional descriptions for the adapters are as follows QLE2660 DEL A low profile Gen 5 16Gb single port Fibre Channel PCIe adapter QLE2662 DEL A low profile Gen 5 16Gb dual port Fibre Channel PCIe ada...

Page 15: ...aled interrupts MSI X and legacy interrupts INT X NPIV Boot from SAN Several advanced management features for 2600 Series Adapters QConvergeConsole GUI and CLI is available if you are running Windows or Linux QConvergeConsole VMware vCenter Server Plug in is available if you are running VMware ESXi Supported Operating Systems The adapter supports the following operating systems To view the most co...

Page 16: ...RHEL 7 6 RHEL 7 5 SuSE SuSE Linux Enterprise Server SLES 15 SP1 SLES 15 SLES 12 SP3 VMware vSphere VMware ESXi 6 7 U2 vSphere VMware ESXi 6 5 U3 Citrix Citrix XenServer 7 1 CU2 NOTE For the most current versions of the OS and drivers supported by the adapter refer to the release notes file release txt ...

Page 17: ...ner s Manual for your Dell PowerEdge server For QME2662 DEL and QME2692 DEL adapter port and slot assignments refer to the blade and M1000e chassis diagram in the Dell PowerEdge M1000e Systems Configuration Guide Software For information on the supported operating systems firmware versions adapter drivers and utilities refer to the product release notes Safety Precautions For your safety follow th...

Page 18: ...e latest BIOS 3 Check the adapter for visible signs of damage Never attempt to install a damaged adapter PCIe Bus Slot Considerations The size of the PCIe bus slot in which you install the adapter will affect the speed throughput Table 1 1 lists the approximate speed throughput for each bus slot size NOTE If you acquired the adapter software on a disk or from the Dell support Web site http support...

Page 19: ...nsiderations on page 2 4 Pull out the slot cover if any 5 Grasp the adapter by the top edge and seat it firmly into the appropriate slot 6 Refasten the adapter s retaining bracket 7 Close the computer cover 8 Plug the Fibre Channel cable into the adapter 9 Plug in the power cable and turn on the computer For more detailed information refer to the Hardware Owner s Manual for your Dell PowerEdge ser...

Page 20: ...x_Owner 27s 20Manual_en us pdf Connecting to the SAN Follow the instructions for your adapter model number QLE2660 DEL QLE2662 DEL QLE2690 DEL QLE2690L DEL QLE2692 DEL and QLE2692L DEL To connect to the SAN refer to the Hardware Owner s Manual for your Dell PowerEdge server QME2662 DEL and QME2692 DEL To connect to the SAN refer to the Guidelines for Installing I O Modules section of the Dell Powe...

Page 21: ...pdate the Flash Using the Flash Update Wizard topic in the QConvergeConsole Help For QConvergeConsole CLI issue the flashsupport command to update the Flash memory for all cards supported by the specified file For example qaucli pr nic flashsupport i ALL a p3p11179 bin NOTE When you disable the firmware for example during a firmware dump or during a firmware update in Windows or Linux with a QConv...

Page 22: ...ser s Guide Prerequisites and Features for Systems Running Windows section To run the DUP in the GUI 1 Double click the icon representing the DUP file The actual file name of the DUP varies 2 In the Dell Update Package window Figure 2 1 click Install Figure 2 1 Dell Update Package Window NOTE If you are using the 2600 Series Adapters to boot from storage in a Windows Server 2008 R2 SP1 or Windows ...

Page 23: ... Wizard s Welcome window Figure 2 2 click Next Figure 2 2 QLogic InstallShield Wizard Welcome Window 4 In the wizard s License Agreement window Figure 2 3 a Read the QLogic End User Software License Agreement b To continue select I accept the terms in the license agreement c Click Next Figure 2 3 QLogic InstallShield Wizard License Agreement Window ...

Page 24: ...u selected Custom in Step 5 complete the Custom Setup window Figure 2 5 on page 9 as follows a Select the features to install By default all features are selected To change a feature s install setting click the icon next to it and then select one of the following options This feature will be installed on the local hard drive This setting marks the feature for installation without affecting any of ...

Page 25: ...tion and Configuration 9 CU0354604 00 P b Click Next to continue Figure 2 5 InstallShield Wizard Custom Setup Window 7 In the InstallShield Wizard s Ready To Install window Figure 2 6 click Install Figure 2 6 InstallShield Wizard Ready to Install the Program Window ...

Page 26: ...U0354604 00 P The InstallShield Wizard installs the QLogic Adapter drivers and Management Software Installer 8 When the installation is complete the InstallShield Wizard Completed window appears Figure 2 7 Click Finish to dismiss the installer Figure 2 7 InstallShield Wizard Completed Window ...

Page 27: ...e from the Command Line For a list of the CLI options for systems running Windows a description of each option and the command syntax refer to the Dell Update Packages Version xx xx xxx User s Guide Windows CLI Options section Running the DUP from the command line with no options specified results in the same behavior as double clicking the icon representing the DUP To run the DUP from the command...

Page 28: ...g txt Linux Driver Installation and Configuration This section provides the following procedures for installing drivers on a Linux system Installation Overview Installing the Linux Fibre Channel Driver Installation Overview To install and configure the adapter drivers on a Linux system refer to the driver release notes readme and installation instructions included in the package NOTE To install th...

Page 29: ...dules from the source code by executing the build sh script as follows extras build sh install The build sh script does the following Builds the driver ko files Copies the ko files to the appropriate lib modules kernel version extra qlgc qla2xxx directory Add the appropriate directive in the modprobe conf if applicable 3 Optional To manually load the driver issue the insmod or modprobe command To ...

Page 30: ...SP3 and SLES 15 15 SP 1 1 From the directory that contains the source driver file qla2xxx src vx xx xx xx xx x k tar gz issue the following commands tar xzvf qla2xxx src vx xx xx xx xx x k tar gz cd qla2xxx src vx xx xx xx xx x k Where x xx xx xx xx is the applicable version number 2 Build and install the driver modules from the source code by executing the build sh script as follows extras build ...

Page 31: ...e a backup copy of the RAMDISK image by issuing the following commands cd boot cp initramfs kernel version img initramfs kernel version img bak b Create the new RAMDISK by issuing the following command dracut f 5 To load the driver reboot the host VMware Driver Installation and Configuration This section provides the following procedures for installing drivers on a VMware system Installation Overv...

Page 32: ... bundle offline bundle zip to this ESXi host 2 Install the driver bundle offline bundle zip as follows a To create a temporary directory issue the following commands mkdir install cd install b Unzip the driver bundle in the temporary directory install unzip offline bundle zip c Issue the following command esxcli software vib install n qlnativefc d install To use the driver VIB 1 Copy the driver VI...

Page 33: ...ient and HTML5 Client plug ins It is advised to use HTML5 Plug in for ESXi 6 5 and later To use QConvergeConsole VMware vCenter Server Plug in install the following software in this order 1 QConvergeConsole VMware vCenter Server Plug in on the vCenter Server 2 QLogic Adapter CIM Provider on the ESXi server The following sections explain how to install and uninstall the required software Installati...

Page 34: ...ider_vmware_esx65 x x x This file contains the QLogic Adapter CIM Provider installation package for ESXi 6 5 U3 where x x x is the version of the CIM Provider readme txt This file is the Read Me document that covers hardware and software requirements operating system support supported features installation and removal instructions known issues and workarounds and support contact information releas...

Page 35: ...figuration 19 CU0354604 00 P The InstallAnywhere wizard opens as shown in Figure 2 9 Figure 2 9 InstallAnywhere Initial Window 3 In the QLogic Adapter VI Plug in wizard s Introduction window see Figure 2 10 click Next Figure 2 10 QLogic Adapter VI Plug in Wizard Introduction ...

Page 36: ...0 CU0354604 00 P Wait while the wizard configures the plug in see Figure 2 11 Figure 2 11 QLogic Adapter VI Plug in Wizard Configuring the Plug in 4 Select the installation directory and then click Install see Figure 2 12 Figure 2 12 QLogic Adapter VI Plug in Wizard Choose Install Folder ...

Page 37: ...ation and Configuration VMware Driver Installation and Configuration 21 CU0354604 00 P Wait while the wizard performs the installation see Figure 2 13 Figure 2 13 QLogic Adapter VI Plug in Wizard Installing the Plug In ...

Page 38: ...0354604 00 P 5 Type the requested information in the boxes and then click Next see Figure 2 14 Figure 2 14 QLogic Adapter VI Plug in Wizard User Input Wait while the wizard finishes configuring the plug in see Figure 2 15 Figure 2 15 QLogic Adapter VI Plug in Wizard Configuration in Progress ...

Page 39: ...estart the VMware Virtual Center Management Web services If the plug in is installed on a server other than the vCenter Server restart the Apache Tomcat service Plug in Unregistration from a Manual Install If you have performed a manual install of the QConvergeConsole VMware vCenter Server Plug in you must perform a manual uninstall before running the plug in Installation Wizard VMware provides tw...

Page 40: ...nformation Uninstalling the QConvergeConsole VMware vCenter Server Plug in To remove the QConvergeConsole VMware vCenter Server Plug in 1 In the Windows Control Panel select Programs and Features 2 In the Add or Remove Programs dialog box select the QConvergeConsole VMware vCenter Server Plug in and then click Change Remove 3 To remove the plug in follow the instructions in the QConvergeConsole VM...

Page 41: ... c On some platforms FC adapters are not discovered from ESXi 6 7 through vCenter If this happens restart the CIMON by issuing the following commands etc init d sfcbd watchdog stop etc init d sfcbd watchdog restart 2 Copy the following file to the root directory of the ESXi system QLGC ESX 5 5 0 qlogic adapter provider x x xx xxxxxxx offline_bundle xxxxxxx zip This CIM provider is applicable for E...

Page 42: ...tion of the CIM Provider on an ESXi Host 1 Copy the offline bundle zip file to any location on the host where either the vSphere CLI package is installed or vSphere Management Assistant vMA is hosted 2 Navigate to the location of the offline bundle zip file 3 To install the offline bundle issue the vihostupdate command as follows vihostupdate pl conn_options install bundle offline bundle zip nosig...

Page 43: ...following commands To stop the SFCB CIMOM and the QLogic Adapter CIM Provider etc init d sfcbd watchdog stop To start the SFCB CIMOM and the QLogic Adapter CIM Provider etc init d sfcbd watchdog start To restart the SFCB CIMOM and the QLogic Adapter CIM Provider etc init d sfcbd watchdog restart After starting the SFCB CIMOM use a CIM client utility to query the QLogic Adapter CIM Provider for inf...

Page 44: ... Plug in for ESXi 6 5 and later Gather the information necessary for the installation including IP address of the vCenter Server vCenter Server credentials user name and password Where to host the QConvergeConsole VMware vSphere Web Client Plug in on vCenter Server or other server If you are hosting the QConvergeConsole VMware vSphere Web Client Plug in on a non vCenter Server make sure the server...

Page 45: ... Where installer is the file name of the installer d Follow the instructions provided by the installer 2 Restart the Tomcat service If the QConvergeConsole VMware vSphere Web Client Plug in is being hosted on the vCenter Server you must restart the VMware Virtual Center Management Web services In Windows go to the Administrative Tools menu select Services and then restart VMware Virtual Center Man...

Page 46: ...ts user interface or console commands to uninstall the plug in by the root user Configuring VM ID VM storage I O activity automatically generates VM ID tagging in FC frames VM ID tags I O frames with an ID that identifies the virtual machine that sent or received them This ID allows management applications to monitor traffic flows down to the virtual machine level VM ID is disabled by default and ...

Page 47: ...age 46 Configuring Fibre Channel Driver Parameters on page 53 Configuring Selective LUNs on page 54 Configuring OoOFR on page 55 Configuring the UEFI Driver on page 56 Setting Queue Depth on page 63 Setting an FA PWWN on page 65 Configuring and Verifying FA BLD on page 71 Using a Fabric Assigned Boot LUN on page 77 Running Diagnostics Fibre Channel Ping and Trace Route on page 79 Configuring CS_CT...

Page 48: ... Dell Update Packages section To run the firmware DUP by double clicking the executable file 1 Double click the icon representing the firmware DUP file NOTE For information on configuring the Fibre Channel Adapter using VMware vCenter Server refer to the User s Guide QConvergeConsole Plug ins for VMware vSphere part number SN0054677 00 available at www marvell com NOTE If you update the firmware u...

Page 49: ...n the DUP splash screen appears Figure 3 1 click Install to continue Figure 3 1 Dell Update Package Splash Screen 3 Follow the installer instructions If a warning message appears Figure 3 2 click Yes to continue the installation Figure 3 2 Continue Dell Update Package Installation ...

Page 50: ...CU0354604 00 P The installer indicates that it is loading the new firmware Figure 3 3 Figure 3 3 Loading New Firmware 4 When complete the installer indicates the result of the installation Figure 3 4 Click Yes to elect to reboot Figure 3 4 Result of Installation ...

Page 51: ... Figure 3 5 Finish Installation Running the Firmware Update from the Command Line Running the firmware DUP from the command line with no options specified results in the same behavior as double clicking the icon representing the DUP Note that the actual file name of the DUP will vary adapter _Firmware_ release _ OS _ version EXE ...

Page 52: ...vanced users who want to customize the configuration of the adapters and connected devices using Fast UTIL the QLogic Fibre Channel Adapter BIOS utility in a pre OS environment To configure adapters using Fast UTIL 1 During the Host Bus Adapter BIOS initialization press ALT Q or CTRL Q It may take a few seconds for the Fast UTIL menu to appear 2 When the Select Host Adapter window appears select t...

Page 53: ... menu options in Fast UTIL Adapter Settings Selectable Boot Settings Restore Default Settings Raw NVRAM Data Advanced Adapter Settings Adapter Settings Table 3 1 describes the adapter settings CAUTION If the configuration settings are incorrect your 2600 Series Adapter may not function properly Table 3 1 Adapter Settings Setting Values Default Description Host Bus Adapter BIOS Enabled Disabled Dis...

Page 54: ...bled the adapter attempts to use the ID specified in this setting Connection Options 0 1 2 2 This setting defines the type of connection 0 loop only for the 4Gb and 8Gb data rate 1 point to point only for the 4Gb 8Gb and 16Gb data rate 2 loop preferred then point to point for the 4Gb 8Gb and 16Gb data rate Fibre Channel Tape Support Enabled Disabled Enabled This setting enables FCP 2 recovery Data...

Page 55: ...t menu press the DOWN ARROW key 5 To see a list of accessible devices in the Select Fibre Channel Device menu press ENTER 6 Select a drive by pressing the UP ARROW and DOWN ARROW keys or the PAGE UP and PAGE DOWN keys to scroll to the device that you want to put into your Selectable Boot menu list Then press ENTER to select the requested device and load it into the Selectable Boot menu list 7 To s...

Page 56: ...lues Default Description LUNs per Target 0 8 16 32 64 128 256 128 This setting specifies the number of LUNs supported per target if the target does not support the Report LUN com mand Multiple LUN support is typically for redundant array of independent disks RAID boxes that use LUNs to map drives Enable LIP Reset Yes No No This setting determines the type of loop initialization pro cess LIP reset ...

Page 57: ...meout 0 255 seconds 30 seconds This setting specifies the number of seconds the software waits for a link that is down to come up Operation Mode 0 5 6 6 This setting specifies the reduced interrupt operation RIO modes if they are supported by the software driver The RIO modes allow posting multiple command completions in a single interrupt This setting supports the following modes 0 Interrupt for ...

Page 58: ...Exit Fast UTIL option allows you to exit the utility and reboot the system After making changes to the 2600 Series Adapter in Fast UTIL make sure you save the changes before you reboot the system Setting Fibre Channel Adapter Parameters Use QConvergeConsole to set Fibre Channel adapter parameters Setting Fibre Channel Adapter Parameters with QConvergeConsole GUI Setting Fibre Channel Adapter Param...

Page 59: ...figure HBA Parameters option to open the Configure Parameters menu For more information refer to the section about the Fibre Channel interactive commands in the User s Guide QConvergeConsole CLI part number SN0054667 00 Setting Fibre Channel Adapter Parameters with Noninteractive QConvergeConsole CLI For information about how to set Fibre Channel adapter parameters using the noninteractive mode of...

Page 60: ...configuration changes click Save 6 If the Security Check dialog box appears type the password in the Enter Password box and then click OK 7 The system overwrites any previously saved configuration for the current adapter and displays a message box Click OK to close the message box For more information refer to the topic about binding target devices in the QConvergeConsole Help Configuring Persiste...

Page 61: ...le CLI Configuring Boot Devices with Noninteractive QConvergeConsole CLI Configuring Boot Devices with the BIOS Configuring Boot Devices with QConvergeConsole GUI For information about configuring boot devices with QConvergeConsole GUI refer to the topics about HBA parameters viewing or modifying port parameters and boot device selection in the QConvergeConsole Help Configuring Boot Devices with I...

Page 62: ...art number SN0054667 00 Configuring Boot Devices with the BIOS For information about boot device configuration with the Fast UTIL BIOS utility refer to Using Fast UTIL for Custom Configuration on page 36 for information Configuring Virtual Ports NPIV Use QConvergeConsole to configure virtual ports for N_Port ID virtualization and quality of service Configuring NPIV with QConvergeConsole GUI Config...

Page 63: ... the User s Guide QConvergeConsole CLI part number SN0054667 00 To download the guide go to www marvell com Configuring NPIV with Noninteractive QConvergeConsole CLI To create a virtual port with an automatic WWPN using the noninteractive mode of QConvergeConsole CLI issue the following command qaucli vp hba instance hba wwpn create auto num_of_vport Where For more information refer to the section...

Page 64: ...ng the priority method or the bandwidth method but not both The priority method assigns priority levels low medium or high to virtual ports based on the quality of service required for the applications or VMs using the virtual port This method provides for various levels of latency requirements across virtual ports The bandwidth method assigns a bandwidth percentage 0 100 or a bandwidth rate for e...

Page 65: ...h allocates up to 80 percent of the physical port s bandwidth to its virtual ports The remaining 20 percent is reserved to handle non QoS applications and virtual ports Setting QoS by bandwidth guarantees bandwidth for each virtual port and to the application or virtual machine VM associated with that virtual port The proper QoS setting can prevent bottlenecks that occur when VMs contend for port ...

Page 66: ...siness continuity using virtual ports The setting for a specific QoS can resolve bottlenecks that exist when VMs contend for port bandwidth To set the QoS by bandwidth percentage with QConvergeConsole GUI 1 In the QConvergeConsole system tree pane on the left expand a 2600 Series Adapter 2 Select a virtual port 3 In the content pane on the right click the QoS tab 4 In the QoS Type box select Bandw...

Page 67: ...k the QoS tab 4 In the QoS Type box select Bandwidth 5 In the View By box select Bandwidth Speed 6 Move the slider to select the bandwidth speed as shown in Figure 3 9 Figure 3 9 Setting the QoS by Bandwidth Speed 7 Click Save To set the QoS by bandwidth speed with interactive QConvergeConsole CLI 1 On the Fibre Channel Adapter Configuration menu select the QoS option 2 From the port menu select a...

Page 68: ... the content pane on the right click the QoS tab 4 In the QoS Type box select Priority 5 Move the slider to select a low medium or high priority as shown in Figure 3 10 Figure 3 10 Setting the QoS by Priority 6 Click Save To set the QoS by priority with interactive QConvergeConsole CLI 1 From the Fibre Channel Adapter Configuration menu select the QoS option 2 From the port menu select a port to o...

Page 69: ...ameters in the QConvergeConsole Help for information Configuring Fibre Channel Driver Parameters with Interactive QConvergeConsole CLI To configure Fibre Channel driver parameters using interactive QConvergeConsole CLI 1 On the Fibre Channel Adapter Configuration menu select HBA Parameters 2 On the port menu select a port to open the HBA Parameters menu 3 On the HBA Parameters menu select Configur...

Page 70: ...QConvergeConsole plug in see the User s Guide QConvergeConsole Plug ins for VMware vSphere part number SN0054677 00 Configuring Selective LUNs The QConvergeConsole GUI cannot be used for configuring selective LUNs To configure selective LUNs with the interactive QConvergeConsole CLI refer to the section about the Fibre Channel interactive commands in the User s Guide QConvergeConsole CLI part numb...

Page 71: ...OFR with the interactive QConvergeConsole CLI 1 On the Fibre Channel Adapter Configuration menu select HBA Parameters 2 On the port menu select a port to open the HBA Parameters menu 3 On the HBA Parameters menu select Configure HBA Parameters to open the Configure Parameters menu 4 Select 13 Enable Receive Out Of Order Frame Configuring OoOFR with Noninteractive QCC CLI To enable OoOFR in the non...

Page 72: ... configure adapter parameters and boot from SAN settings To configure the UEFI driver for Dell 1 During system boot press the key corresponding to your platform 2 On the Dell System Setup window select Device Settings and then press the ENTER key The Device Settings window opens and lists the devices installed in the system Each listed device supports the HII QLogic devices have one device setting...

Page 73: ...ce appears The Main Configuration Page is the top level menu of the adapter configuration pages Figure 3 12 shows an example of the Main Configuration Page Figure 3 12 Dell System Setup Main Configuration 4 On the Main Configuration Page select Port Configuration Page and press ENTER The Port Configuration Page appears Figure 3 13 shows an example Figure 3 13 Dell System Setup Port Configuration ...

Page 74: ...t 1 to N Figure 3 13 shows port 1 in a two port adapter Port Speed Indicates the data rate of the Fibre Channel adapter port This value can be automatic or specified in GFC The adapters support 4GFC 8GFC and 16GFC Port Connection Mode Indicates the connection mode of the Fibre Channel adapter port The adapters support the following Loop Only Point to Point Loop Preferred Otherwise Point To Point W...

Page 75: ... Information Table 3 5 describes the Firmware and Device Information settings 8 To return to the Main Configuration Page click Back Table 3 5 Firmware and Device Information Settings Setting Description Chip Type Type of intelligent storage peripheral ISP controller used in the adapter PCI Device ID Unique PCI device ID of the adapter Bus Device Function PCI address of the adapter in the Bus Devic...

Page 76: ...I Driver 60 CU0354604 00 P 9 On the Main Configuration Page select Fibre Channel Target Configuration and then press ENTER The Fibre Channel Target Configuration page appears Figure 3 15 shows an example Figure 3 15 Fibre Channel Target Configuration ...

Page 77: ...er initiator behavior for booting the system from the specified Fibre Channel storage target s or fabric discovered target s First FC Target World Wide Port Name Specifies the WWPN of the first Fibre Channel stor age target First FC Target LUN Specifies the LUN of the first Fibre Channel storage target Second FC Target World Wide Port Name Specifies the WWPN of the second Fibre Channel storage tar...

Page 78: ...s on the HBA Configuration Page Table 3 7 HBA Configuration Page Settings Setting Description FC Tape Enable Enables or disables Fibre Channel protocol FCP 2 recovery Loop Reset Delay Specifies the Fibre Channel arbitrated loop reset delay for the port After resetting the loop the adapter firmware refrains from initiating any loop activity for the number of seconds specified The range is 0 to 60 F...

Page 79: ...rget devices This section provides the default values and instructions for modifying the queue depth value configured by the Windows Linux and ESXi drivers Port Login Timeout Specifies the time out in milliseconds that the initiator uses when attempting to log in to the target device port The range is 0 to 255000 Port Down Retry Count Specifies the number of seconds the software retries a command ...

Page 80: ...SYSTEM CurrentControlSet Services Ql2300 Parameters Device 3 Double click DriverParameter REG_SZ qd 32 4 If the string qd does not appear append it to end of the string as qd 32 5 Click OK 6 Exit the Windows Registry Editor and then shutdown and reboot the system Changing the Linux Queue Depth The default queue depth value on Linux is 64 and the range is 1 65535 To change the default value 1 Set t...

Page 81: ... queue depth value 2 Restart the system Setting an FA PWWN This section provides the following information for fabric assigned port world wide FA PWWN name Setting the FA PWWN from the Adapter Setting the FA PWWN from the Brocade Switch Setting the FA PWWN from the Adapter From the adapter side you can set the FA PWWN using the following utilities Setting FA PWWN with QConvergeConsole GUI Setting ...

Page 82: ...tting the FA PWWN in the GUI To set the FA PWWN from the adapter using QConvergeConsole GUI 1 In the QConvergeConsole GUI tree pane on the left select an adapter expand the adapter node and then select a port 2 In the content pane on the right click the Parameters tab 3 On the Parameters page click the Advanced HBA Parameters tab 4 Under Configure Port Advanced Parameters select the Enable Fabric ...

Page 83: ...sole CLI select Main Menu and then click Adapter Configuration 2 Select HBA Parameters 3 Select the appropriate port 4 Select Configuration HBA Parameters 5 Select Enable Fabric Assign WWN 6 On the Enable Fabric Assign WWN Menu select 1 Enable 7 Select the option to Commit Changes The following shows an example of setting the FA PWWN HBA Desc QLE2672 QLogic 2 port 16Gb Fibre Channel Adapter FW Ver...

Page 84: ... Down Timeout seconds 16 Enable Target Reset 17 LUNs per Target 18 Enable Receive Out of Order Frame 19 Enable LR 20 Enable Fabric Assign WWN 21 Commit Changes 22 Abort Changes p or 0 Previous Menu m or 98 Main Menu ex or 99 Quit Please enter selection 20 QConvergeConsole Version 1 1 3 Build 22 Enable Fabric Assign WWN Menu 1 Enable 2 Disable current p or 0 Previous Menu m or 98 Main Menu ex or 99...

Page 85: ...98 Main Menu ex or 99 Quit Please enter selection 2 QConvergeConsole CLI Version 1 1 3 Build 22 Adapter Information HBA Model QLE2672 SN RFE12340H08416 1 Port 1 WWPN 21 00 00 0F 1F 11 4A 30 Link Down 2 Port 2 WWPN 50 00 53 37 63 FA 00 05 Online Setting FA PWWN with QConvergeConsole VMware Plug ins For information about setting a FA PWWN using the QConvergeConsole VMware vCenter Server Plug in or Q...

Page 86: ... FA PWWN from the Switch Figure 3 19 shows the FA PWWN setting from the Brocade switch Figure 3 19 Setting the FA PWWN from the Brocade Switch After refreshing the Brocade switch the Device Port WWN appears in Web Tools as shown in Figure 3 20 Figure 3 20 Device Port WWN for Brocade Switch Setting the Static FA PWWN from the Switch Figure 3 21 shows the static FA PWWN setting from the Brocade swit...

Page 87: ...ions Configuring FA BLD from the Adapter On the adapter side follow these procedures to configure fabric assigned boot LUN discovery FA BLD in the QConvergeConsole GUI and QConvergeConsole CLI Enabling Host Bus Adapter Port BIOS and Fabric assigned Boot LUN with QConvergeConsole GUI To enable the Host Bus Adapter Port BIOS 1 In QConvergeConsole GUI select the Host tab in the left pane 2 In the sys...

Page 88: ...assigned boot LUN 1 In QConvergeConsole GUI select the Host tab in the left pane 2 In the system tree expand the adapter node and then select a port node 3 In the content pane on the right click the Parameters tab 4 On the Parameters page click the Boot Device Selection tab 5 On the Boot Device Selection page select the Enable Fabric Assigned Boot LUN check box 6 Click Save ...

Page 89: ... To configure adapter and boot devices 1 In QConvergeConsole CLI navigate to Adapter Configuration and then select HBA Parameters 2 Enter the port number 3 Select Configure HBA Parameters 4 Select Enable BIOS and set it to Enable 5 In the Adapter Configuration select Boot Device Configuration 6 Enter the port number 7 Select Configure Boot Device s 8 Set the Enable Fabric Assign Boot LUN to Enable...

Page 90: ...switch 1 Create a boot LUN configuration as follows bootluncfg add 50 00 53 37 63 FA 00 05 20 02 00 11 0d 51 5c 01 0000000000000000 2 Create a zone named with the following Device s PWWN Specific information about the target WWN LUN to be booted from 3 Add a zone to the zoneset configuration as follows cfgadd config BFA_5000533763fa0005_BLUN 4 To save the zoneset issue the following command cfgsav...

Page 91: ...xample of a configured zone in a Brocade switch Figure 3 26 Configuring a Zone in a Brocade Switch Verifying that FA BLD is Operational To verify if the FA BLD is operational use either Fast UTIL or the system Figure 3 27 shows Fast UTIL displaying the boot LUN Figure 3 27 Verifying FA BLD with Fast UTIL ...

Page 92: ...rom LUN Figure 3 28 Verifying FA BLD from the System Adapter Side Restrictions The known fabric assigned port world wide name FA PWNN and FA BLD restrictions include the following Cannot be fully enabled from Fast UTIL Do not use Restore Defaults from Fast UTIL QConvergeConsole GUI or QConvergeConsole CLI Doing so causes these capabilities to become disabled ...

Page 93: ...nsole CLI To use a fabric assigned boot LUN with interactive QConvergeConsole CLI 1 From the main menu select the adapter type Fibre Channel Adapter 2 On the Fibre Channel Adapter Configuration menu select Boot Devices Configuration 3 On the Boot Device Settings menu select Configure Boot Device s and then press the ENTER key 4 Select Enable Fabric Assigned Boot LUN and then press ENTER 5 On the E...

Page 94: ...ies Adapter boot device with QConvergeConsole VMware vCenter Server Plug in 1 In the QConvergeConsole VMware vCenter Server Plug in click the QConvergeConsole tab 2 In the tree pane on the left select a 2600 Series Adapter port 3 Click the Boot tab 4 On the Boot Device Selection page select the Enable Fabric Assigned Boot LUN check box Figure 3 29 shows an example Figure 3 29 Fabric Assigned Boot ...

Page 95: ...the Ping Test CT Ping Test and the CT FTR Tests Supported configurations for Fibre Channel ping and trace route include QLogic 2600 Series Adapters and 8200 Series Adapters Brocade Switches with Based Fabric OS FOS v6 0 0a Cisco Switches with NX OS v8 3 1 FC Trace Route not supported Table 3 8 Ping Test CT Ping Test and CT FTR Test Ping Test CT Ping Test CT FTR Test SCSI layer ping CT or Fibre Cha...

Page 96: ...Ping from QConvergeConsole GUI To run a Fibre Channel CT ping test from QConvergeConsole GUI 1 In the QConvergeConsole GUI left pane click the Host tab 2 On the Host page expand the adapter node and then select a port 3 In the content pane on the right click the Diagnostics tab 4 On the Diagnostics page click the General Diagnostics tab 5 On the General Diagnostics page see Figure 3 30 complete th...

Page 97: ... Fibre Channel CT Ping from QConvergeConsole CLI To run a Fibre Channel CT ping test from QConvergeConsole CLI 1 From the QConvergeConsole CLI FC Diagnostics menu select 7 CT Ping Test 2 From the HBA Model list select the port that you want to ping 3 From the CT Ping Test menu select 4 Start Diagnostic Test The following shows example output from the CT ping test Diagnostics Test Configuration Dia...

Page 98: ...ion Diagnostic Tests Fibre Channel Port in the User s Guide QConvergeConsole Plug ins for VMware vSphere part number SN0054677 00 Fibre Channel Trace Route To run a Fibre Channel trace route from QConvergeConsole GUI 1 In the system tree pane on the left click the Host tab 2 In the content pane on the right click the Topology tab 3 Next to Topology select the Physical option 4 In the topology map ...

Page 99: ...oad enters and exits from the appropriate port on each switch as it traverses the path until it reaches the selected target The results appear as a success message output from the following QConvergeConsole GUI QConvergeConsole CLI Diagnostics area For information about using Fibre Channel trace route in QConvergeConsole VMware vCenter Server Plug in or QConvergeConsole VMware vSphere Web Client P...

Page 100: ...he CS_CTL QoS Traffic priority classification for QLogic Gen 5 Fibre Channel SAN QoS at the packet level is realized by using the CS_CTL field which is specified in the FC FS 2 specification QoS allows one to prioritize frames between a host and target depending on the value of the CS_CTL field in the FC Frame header Extending QoS from the fabric to the host Enables QLogic Fibre Channel users to r...

Page 101: ... verify the CS_CTL mode setup for each port Figure 3 34 CS_CTL Mode Setup for Each Port Creating a Virtual Port from the Adapter s Port in QConvergeConsole GUI To create a virtual port in QConvergeConsole GUI 1 In the QConvergeConsole GUI content pane on the left select the Host tab 2 On the Host page expand the adapter node and then select a port 3 In the content pane on the right select the Virt...

Page 102: ...3 Fibre Channel Configuration Configuring CS_CTL QoS 86 CU0354604 00 P Figure 3 35 shows how to create a virtual port from the adapter s port in QConvergeConsole GUI Figure 3 35 Creating a Virtual Port ...

Page 103: ...rol CS_CTL QoS implementation is an end to end solution encompassing the initiator 2600 Series Adapters the switches and the target storage The 2600 Series Adapter stamps the priority value high medium low in the CS_CTL field of the Fibre Channel frame All three entities initiator switch and target honor this priority value at their respective levels NOTE By default the QoS of the physical port is...

Page 104: ...ocade SW6510 switch 1 From the switch issue the following command root configurechassis Configure 2 A list of attributes appear one at a time After either accepting the default or entering a different value the next attribute appears Press ENTER to accept the default for cfgload attributes Custom attributes and system attributes Type y for fos attributes Type 1 for CSCTL QoS Mode For example cfglo...

Page 105: ...ls in Windows and VMware ESXi systems Changing the Priority Levels in Windows To change the vPort priority levels in Windows you must first assign the vPorts and then change the priority levels Both procedures can be accomplished using either QConvergeConsole GUI or interactive QConvergeConsole CLI as described in the following sections For more detailed information see the QConvergeConsole Help a...

Page 106: ...rt menu select Create vPorts 5 On the Create vPorts menu select Generate 6 To create the vPorts select Commit Changing the vPort Priority Level To change the vPort priority level using QConvergeConsole GUI 1 In the QConvergeConsole GUI left pane connect to the host that contains the 2600 Series Adapter whose vPort levels you want to change 2 Expand the host in the left pane by clicking the plus si...

Page 107: ...Selection menu select QoS 3 On the QoS menu select Adapter Port 4 On the Adapter Port menu select QoS Priority 5 On the QoS Priority menu select Modify QoS Settings 6 Choose the priority value for the vPorts 7 Select Apply QoS Changing the Priority Levels in VMware ESXi To change the priority levels using QConvergeConsole VMware vCenter Server Plug in or QConvergeConsole VMware vSphere Web Client ...

Page 108: ...vPort Priority Using QConvergeConsole Plug ins If vPort is not listed under QoS a Under QoS click Add b Set the QoS priority value by moving the corresponding slider c Enter the vPort WWPN d Click Save 7 Click Refresh to see the new QoS settings To remove a vPort priority 1 Under QoS locate the vPort whose priority you want to remove 2 Do one of the following Select the Delete check box of the vPo...

Page 109: ...iguration for FDMI QLogic 2500 and 2600 Series Adapters Brocade 16G switches with Fabric OS FOS v7 3 or later Cisco 16G switches with NX OS v8 3 1 or later This section provides the following information on the FDMI Brocade Switch FOS CLI Fabric Features FDMI Enhancements Support NOTE i Results can be viewed from Switch CLI If the Fibre Channel switch does not support FDMI 2 it falls back to FDMI ...

Page 110: ...3 Fibre Channel Configuration Configuring FDMI 94 CU0354604 00 P Brocade Switch FOS CLI Figure 3 40 shows the FOS CLI of a Brocade switch Figure 3 40 FOS CLI of Brocade Switch ...

Page 111: ...ole GUI QConvergeConsole CLI QConvergeConsole VMware vCenter Server Plug in No default setting Requires configuration on adapter FC Ping Ping a Fibre Channel N_Port or end device QConvergeConsole GUI QConvergeConsole CLI QConvergeConsole VMware vCenter Server Plug in Diagnostic test nothing to configure FC Trace Route Obtains the path infor mation between two F_Ports from the Fabric Configuration ...

Page 112: ...s Table 3 10 Cisco Fibre Channel Fabric Features Default Configuration Feature Description Management Tools Default Configuration D_Port Diagnostics port support N A Diagnostic test run from switch Nothing to config ure on adapter FC Ping Ping a Fibre Channel N_Port or end device QConvergeConsole GUI QConvergeConsole CLI QConvergeConsole VMware vCenter Server Plug in Diagnostic test nothing to con...

Page 113: ...5 33 8f 1a 49 FC4 Active Type 0x000001000000000000000000000000000000000000000000000000000 Port State 0x00000002 Discovered Ports 0x00000000 HBA attributes OS Name and Version Windows Server 2012 R2 Datacenter Evaluation for Intel6 4 Max CT Payload Length 0x00000800 Symbolic Name QLE8362 FW v7 04 00 DVR v9 1 12 20 Alpha 2 Number of Ports 1 Fabric Name 10 00 00 05 33 8f 1a 43 Bios Version 3 26 Vendo...

Page 114: ...ollowing highlights how the FEC process works between the transmitting and receiving device 1 Transmitter Device a Takes the incoming data stream b Inserts a redundant amount of parity bits of information on the data stream c Sends the data stream 2 Receiving Device a Receives the data stream b Checks for missing or corrupt data If there are no corrupt or missing bits of information the receiving ...

Page 115: ...rror Correction part number 83830 514 03 NOTE i Instead of having to request retransmission of the entire data frame the receiving device can recreate or reconstruct the data stream itself This process prevents multiple CRC errors from being triggered and causing application performance issues NOTE FEC can be enabled or disabled manually as long as the adapter is operating at 16Gbps and connected ...

Page 116: ...Adapter Information menu shows a port with an online FEC status Figure 3 41 QConvergeConsole CLI Adapter Information Menu FEC Status Running Extended Link Service Commands Commands for extended link service on the switch include the following Link Cable Beacon Extended Link Service Command Read Diagnostic Parameters Extended Link Service Command ...

Page 117: ...nd The following example shows the read diagnostic parameters extended link service RDP ELS command output for Port 13 on a Brocade 16G switch SW6505 admin sfpshow 13 link force Identifier 3 SFP Connector 7 LC Transceiver 7004404000000000 4 8 16_Gbps M5 sw Short_dist Encoding 6 64B66B Baud Rate 140 units 100 megabaud Length 9u 0 units km Length 9u 0 units 100 meters Length 50u OM2 3 units 10 meter...

Page 118: ...high Temperature 60 Centigrade 5 85 0 75 Current 8 430 mAmps 2 500 12 000 2 000 11 500 Voltage 3322 2 mVolts 3000 0 3600 0 3100 0 3500 0 RX Power 3 1 dBm 495 3uW 31 6 uW 1258 9 uW 31 6 uW 794 3 uW TX Power 3 2 dBm 481 6 uW 125 9 uW 1258 9 uW 251 2 uW 794 3 uW State transitions 5 Port Speed Capabilities 4Gbps 8Gbps 16Gbps PEER Port Gbic Info Laser Type Short Wave Laser SFP Type Optical Port Type Co...

Page 119: ...re Channel Configuration Running Extended Link Service Commands 103 CU0354604 00 P Signal Loss Downstream 20 3 dBm 9 4 uW Port Speed Capabilities 4Gbps 8Gbps 16Gbps Last poll time 03 24 2015 UTC Tue 18 03 14 ...

Page 120: ... installation and configuration of FC NVMe contact Marvell Technical Support at this address https www marvell com support contact cust_support do Hardware and Software Requirements The following sections list the required adapters operating systems and host software Adapters FC NVMe requires one or more of the following adapters including models QLE2690 DEL and QLE2692 DEL Operating Systems The f...

Page 121: ...rver 2019 NVMe over Fibre Channel FC NVMe drivers the Software The Software is not ready for production and is in a pilot state The purpose of providing this Software is to enable your development effort to create leading edge solutions with a significant improvement in time to market Consequently the Software is not warrantied nor fully tested and certain risks are expected You agree that the Sof...

Page 122: ...ation The OS Distribution DVD contains the native nvme cli x x y y x86_64 rpm Host Setup Procedures for setting up the initiator host include the following Setting Up the Host Verifying the Adapter Firmware Verifying the Availability of FC NVMe Devices Setting Up the Host The following sections provide setup instructions for servers running SLES 12 SP4 SLES 15 15 SP1 RHEL 7 6 RHEL 8 0 and Windows ...

Page 123: ...fc connect service ls l usr lib systemd system qla2xxx nvmefc connect service rw r r 1 root root 279 Jan 31 10 54 usr lib systemd system qla2xxx nvmefc connect service 3 If the Linux Out of Box 10 01 00 33 xx y or higher driver does not discover NVMe targets after a system reboot perform the following steps to ensure the service named qla2xxx nvmefc boot connection service is enabled a Open a Linu...

Page 124: ...system and verify NVMe targets are discovered 7 Install the NVMe CLI application version from the base operating system DVD rpm ivh nvme cli x x y y x86_64 rpm 8 In a terminal window verify that the NVMe CLI application version is installed by issuing the following command nvme version 9 Download and install the QConvergeConsole CLI RPM a Download the QConvergeConsole CLI RPM from the URL listed i...

Page 125: ...I nvme gen hostnqn nqn 2014 08 org nvmexpress uuid a0baf242 85fd 41e5 a524 e 253d8531282 d Take the output from the nvme gen hostnqn command and save it to the hostnqn file The edited file in the etc nvme hostnqn directory should appear as follows nqn 2014 08 org nvmexpress uuid a0baf242 85fd 41e5 a524 e 253d8531282 12 Reboot the system and verify that the correct driver and firmware versions are ...

Page 126: ...e Host NQN Verifying the Adapter Firmware The following sections describe how to verify and update adapter firmware Verifying Adapter Firmware Confirm that the adapter is running the minimum required firmware version 8 08 204 or later To verify adapter firmware 1 In QConvergeConsole CLI issue the following command qaucli g HBA Model QLE2692 SN AFD1517Y01945 Port 1 WWPN 21 00 00 24 FF 7B 97 60 HBA ...

Page 127: ...vailability on Linux and Windows systems Verifying in Linux In Linux verify that the target devices are available by issuing either of the following commands lsblk or nvme list Example lsblk Command The following example of a portion of the lsblk output shows the FC NVMe attached targets The system discovered three target controllers nvme0 nvme1 and nvme2 Each of these controllers has one FC NVMe ...

Page 128: ...ng in Windows In Windows verify that the target devices are available by issuing the qaucli t command For example qaucli t 0 HBA instance 0 Using config file C Users Administrator qaucli cfg Installation directory C Users Administrator Working dir C Users Administrator HBA Instance 0 QLE2692Port 1 WWPN 21 00 00 24 FF 8F E3 9A PortID 01 21 00 Link Online FEC Path 0 Target 0 Device ID 0x83 Product V...

Page 129: ... Marvell recommends that you disconnect all FC NVMe devices prior to unloading the driver Refer to the procedure in Unloading and Reloading the Linux Driver Windows Windows FC NVMe does not support point to point also called N2N direct attach to Target LUN configuration It does support fabric configuration through FC Switch fabric NOTE To support formatting of an FC NVMe drive on Windows you may n...

Page 130: ...lowing command ls dev nvme grep E nvme 0 9 The preceding command should list all connected dev nvme x devices For example dev nvme0 dev nvme1 2 Disconnect all of the FC NVMe target devices by issuing the following commands to each of the dev nvme x devices listed in Step 1 nvme disconnect d dev nvme0 nvme disconnect d dev nvme1 3 Unload the current driver by issuing the following command modprobe ...

Page 131: ...tics Using QConvergeConsole GUI QConvergeConsole GUI supports the internal and external loopback read write buffer and beacon on off diagnostic tests for Fibre Channel ports To set the loopback or read write buffer test parameters 1 In the QConvergeConsole system tree select the adapter port 2 In the content pane on the right click the Diagnostics tab and then click the General Diagnostics tab 3 F...

Page 132: ...r Stops the test sequence once an error is encountered Loop on Error Uses the same data pattern and test until the failure is cleared 7 In the Test Increment box type or select the number of passes you want to run before the test stops The valid range is between 1 and 10 000 and must be less than or equal to the value in the Number of Tests box see Step 5 For example if the Number of Tests box con...

Page 133: ...er test or beacon test 1 On the Main Menu select 4 Adapter Diagnostics 2 On the Fibre Channel Diagnostics menu select the test type to run 1 Loopback Test to run the loopback test 2 Read Write Buffer Test to run the read write buffer test 3 Beacon Test to run the beacon test 4 Transceiver Diagnostics Monitoring Interface DMI to view the transceiver diagnostics information For more information refe...

Page 134: ...ibre Channel Troubleshooting Diagram 118 CU0354604 00 P Fibre Channel Troubleshooting Diagram Figure A 1 and Figure A 2 provide a two part troubleshooting flowchart Figure A 1 Fibre Channel Troubleshooting Diagram 1 of 2 ...

Page 135: ...nnel 16G switch and the supported Brocade or Cisco 16G Fibre Channel switch firmware Configure the diagnostic D_Port on the switch to dynamically allow a port to enter D_Port mode when a D_Port is configured on the switch end and then return to operational mode when the test is completed Also configure the switch to start and stop the diagnostic test on the adapter port See the associated switch d...

Page 136: ...ilities Configuring D_Port on a Brocade Fibre Channel 16G Switch Configuring and Running Diagnostics Port on a Cisco Fibre Channel 16 Switch Checking D_Port Results from a Brocade Fibre Channel 16G Switch Verifying D_Port Mode with QConvergeConsole GUI Verifying D_Port Mode with Interactive QConvergeConsole CLI Verifying D_Port Mode with Noninteractive QConvergeConsole CLI Verifying D_Port Mode wi...

Page 137: ...c 1 2 Cisco config if shut Cisco config if switchport link diag Cisco config if no shut Cisco config if diagnostic start interface fc 1 2 test link diag To check the diagnostic test status type the following command Cisco config if show diagnostic result interface fc1 1 test link diag PWWN of peer port 21 00 00 24 ff 8f c9 e0 Status Supported Reflector Reflector loopback capabilities Xcvr optical ...

Page 138: ...The following example output identifies port 17 17 17 011100 id N16 Online FC D Port Loopback Port 17 2 Issue the portdporttest command as follows portdporttest show port_num For example portdporttest show 17 Following is an example output for this command portdporttest show 17 D Port Information Port 17 Remote WWPN 21 00 00 0e 1e 11 4a 31 Mode Automatic No of test frames 1 Million Test frame size...

Page 139: ... the QConvergeConsole left pane click the Host tab 2 On the Host page expand a 2600 Series Adapter to view its port nodes If a port is in D_Port mode the port node specifies Loop Down Diagnostic Mode Figure A 3 shows an example Figure A 3 D_Port Mode in QConvergeConsole GUI Verifying D_Port Mode with Interactive QConvergeConsole CLI To verify D_Port mode in interactive QConvergeConsole CLI 1 From ...

Page 140: ...re A 4 D_Port Mode in Interactive QConvergeConsole CLI Verifying D_Port Mode with Noninteractive QConvergeConsole CLI To verify D_Port mode in noninteractive QConvergeConsole CLI issue the following command quacli pr fc g All the 2600 Series Adapters are listed The affected port shows a status of Loop Down Diagnostic Mo Figure A 5 shows an example Figure A 5 D_Port Mode in Noninteractive QConverge...

Page 141: ...de QConvergeConsole CLI part number SN0054667 00 Verifying D_Port Mode with QConvergeConsole Plug ins For information about verifying D_Port mode using QConvergeConsole VMware vCenter Server Plug in and QConvergeConsole VMware vSphere Web Client Plug in see the Managing Fibre Channel Adapters section in the User s Guide QConvergeConsole Plug ins for VMware vSphere part number SN0054677 00 ...

Page 142: ...d Full height 6 6 inches 2 54 inches QLE2662 DEL Low profile PCIe card Full height 6 6 inches 2 54 inches QME2662 DEL Dell PowerEdge mezzanine adapter Conforms to the Dell mezzanine card form factor QLE2690 DEL Low profile PCIe card Full height 6 6 inches 2 731 inches QLE2690L DEL Low profile PCIe card Low profile 6 6 inches 2 731 inches QLE2692 DEL Low profile PCIe card Full height 6 6 inches 2 7...

Page 143: ... Base Specification rev 3 0 PCI Express Card Electromechanical Specification rev 2 0 PCI Bus Power Management Interface Specification rev 1 2 SCSI 3 Fibre Channel Protocol SCSI FCP SCSI Fibre Channel Protocol 2 FCP 2 Second Generation FC Generic Services FC GS 2 Third Generation FC Generic Services FC GS 3 Table B 2 Power Requirements Adapter Nominal Power Maximum Power QLE2660 DEL 13W 15W QLE2662...

Page 144: ...ntal specifications for the QxE26xx DEL QLE269x DEL and QLE269xL DEL Adapters Table B 3 Interface Specifications Port Type Media 16Gb SFP SFF 8431 Specification for SFP Revision 3 2 Table B 4 Environmental Specifications Characteristic Value Temperature Operational QME2662 DEL All other models 0 C to 65 C 32 F to 149 F 0 C to 55 C 32 F to 131 F Storage All models 20 C to 70 C 4 F to 158 F Humidity...

Page 145: ...n server After QConvergeConsole GUI is launched on the application server you can connect to QConvergeConsole GUI through a browser either locally on the server or remotely from another computer Your browser window becomes the client used to connect to servers that host the QLogic adapters and connected storage devices within the network Use the QConvergeConsole GUI main window to connect to serve...

Page 146: ...dapters on a local or remote host the management agents also called agents used by the host s adapters must already be installed on the host The agent for Fibre Channel is qlremote To connect to a remote host at least one management agent used by any of the host s adapters must be installed and running on the host Only protocols whose agents are installed and running are shown under the host s sys...

Page 147: ...gent Installer To access the QCC Agent Installer within QConvergeConsole GUI 1 Point to the gear icon point to Help and then click Download Agent Installers The QCC Agent Installer Utility opens in a separate window and lists links for the platform that the utility has detected 2 For each agent installer to download click the link 3 In the File Download dialog box click Save Installing QConvergeCo...

Page 148: ...nt a localhost only installation If you do not want a localhost only installation select No 5 In the Pre Installation Summary dialog box verify that the information is correct and then click Install to proceed The installer shows the progress of the installation A message box prompts you to confirm if you want to enable the SSL feature which allows data to be encrypted within a secure layer before...

Page 149: ...e has permission to execute by issuing the ls lt command at the prompt 3 To install QConvergeConsole double click the QConvergeConsole installer bin file A prompt asks if you want to run or view the contents of the bin file 4 Click Run in Terminal The installer extracts the files and installs QConvergeConsole in the following directory opt QLogic_Corporation QConvergeConsole The InstallAnywhere wi...

Page 150: ...ontaining details of the following QConvergeConsole Overview describes the purpose and scope of QConvergeConsole and lists the features supported OSs and supported Web browsers Getting Started shows how to start using QConvergeConsole and the help system It also describes how to initiate automatic e mail notifications and set security on adapters installed for a selected host Managing Host Connect...

Page 151: ...eries Converged Network Adapters Managing Gigabit Ethernet Adapters describes the parameters and configuration options provided on the NIC port management pages for QLE84xx QL41000 and QL45000 Series FastLinQ Intelligent Ethernet Adapters and Converged Network Adapters Managing Ethernet NIC Ports describes the parameters and configuration options provided on the NIC port management pages for 3200 ...

Page 152: ...ned and manufactured according to IEC60825 1 on the safety label of laser product Class 1 Laser Product Caution Class 1 laser radiation when open Do not view directly with optical instruments Appareil laser de classe 1 Attention Radiation laser de classe 1 Ne pas regarder directement avec des instruments optiques Produkt der Laser Klasse 1 Vorsicht Laserstrahlung der Klasse 1 bei geöffneter Abdeck...

Page 153: ...may not cause harmful interference and 2 this device must accept any interference received including interference that may cause undesired operation Industry Canada ICES 003 2004 Class A This Class A digital apparatus complies with Canadian ICES 003 Cet appareil numérique de la classe A est conformé à la norme NMB 003 du Canada CE Mark 2004 108 EC EMC Directive Compliance EN55022 2010 CISPR 22 200...

Page 154: ... with listed ITE or equivalent Complies with 21 CFR 1040 10 and 1040 11 Complies with 21 CFR 1040 10 and 1040 11 For use with UL Listed Servers or equivalent Power off the computer and all attached devices such as monitors printers and external components before installing the accessory card or equivalent 2006 95 EC Low Voltage Directive TUV EN60950 1 2006 A11 A1 A12 2nd Edition TUV IEC 60950 1 20...

Page 155: ...endix describes the LEDs on the 2600 Series Adapters Figure E 1 shows the QLE26xx 16Gb Adapter ports with three LEDs The green LED on the left is 16Gb The green LED in the middle is 8Gb The green LED on the right is 4Gb Figure E 1 QLE26xx 16Gb Adapter LEDs ...

Page 156: ...i zation Power On After Firmware Initiali zation Firmware Fault 4Gbps Link Up and Active 8Gbps Link Up and Active 16Gbps Link Up and Active Beaconing Green LED 16Gbps Off On Flashing Flashing in sequence Off Off On or flashing Flashing Green LED 8Gbps Off On Flashing Flashing in sequence Off On or flashing Off Off Green LED 4Gbps Off On Flashing Flashing in sequence On or flashing Off Off Flashing...

Page 157: ...e Content section User s Guide Content on page xi Updated the list of supported operating sys tems Supported Operating Systems on page xv and all relevant chapters in the guide In Step 1 corrected the name of the source driver file qla2xxx src vx xx xx xx xx x k tar gz In Step 3 corrected the last insmod com mand to insmod qla2xxx ko Building the Driver for RHEL 7 x and 8 x on page 13 In Step 1 co...

Page 158: ...inging and Viewing Trace of Routing Using Topology Map on page 79 Added NVM Express over Fibre Channel chapter NVM Express over Fibre Channel on page 104 In the list of supported FMDI configurations added Cisco switches with NX OS v8 3 1 and later Configuring FDMI on page 93 Added Table 3 10 Cisco Fibre Channel Fab ric Features Default Configuration In Table 3 11 updated the contents of the Dell S...

Page 159: ...Channel Adapter Revision History QLE266x DEL QLE269x DEL QLE269xL DEL and QME26x2 DEL Added a new section describing how to run D_port on a Cisco switch Configuring and Running Diagnostics Port on a Cisco Fibre Channel 16 Switch on page 121 ...

Page 160: ...Marvell Moving Forward Faster Marvell Technology Group http www marvell com Contact Information ...

Reviews: