background image

EF4024

Setup Guide

Document No.: 96-30065-001  

Revision: A0 

Fibre Channel RAID System

 

Summary of Contents for EF4024 FC

Page 1: ...EF4024 Setup Guide Document No 96 30065 001 Revision A0 Fibre Channel RAID System ...

Page 2: ...ty and fitness for a particular purpose of any products or software DataDirect Networks does not warrant guarantee or make any representations regarding the use or the results of the use of any products or software in terms of correctness accuracy reliability or otherwise The entire risk as to the results and performance of the product and software are assumed by you The exclusion of implied warra...

Page 3: ...ge Intended Audience This guide is intended for storage system administrators Prerequisites Prerequisites for installing and using this product include knowledge of Servers and computer networks Network administration Storage system installation and configuration Storage area network SAN management and direct attach storage DAS Fibre Channel FC Serial Attached SCSI SAS and Ethernet protocols Relat...

Page 4: ...ering Off 18 2 3 1 Powering on the System 19 2 3 2 Powering off the System 20 Chapter 3 Connecting Hosts 21 3 1 Host System Requirements 22 3 1 1 Cabling Considerations 22 3 2 Connecting Enclosures to Hosts 22 3 2 1 Dual Controller Configurations 23 3 2 2 Direct Attach Configurations 23 3 2 3 Switch Attach Configurations 24 3 3 Connecting a Management Host on the Network 25 3 4 Updating firmware 2...

Page 5: ... 5 7 3 Cooling Fan Sensors 42 5 7 4 Temperature Sensors 43 5 7 5 Power Supply Module Voltage Sensors 44 Appendix A LED Descriptions 45 A 1 Enclosure Bezels 46 A 1 1 Installing Enclosure Bezel 46 A 1 2 Removing Enclosure Bezel 46 A 2 Enclosure Front Panel LEDs 47 A 3 Disk Drive LEDs 48 A 4 Controller Module 50 A 4 1 Cache Status LED Details 51 A 5 Power and Cooling Module LEDs 52 A 6 LEDs on Expans...

Page 6: ...on Controller Modules 63 D 1 1 USB CLI Port 63 D 1 2 Emulated Serial Port 63 D 1 3 Supported Host Applications 64 D 1 4 Command Line User Interface 64 D 2 Device Driver Special Operation Mode 64 D 2 1 Microsoft Windows 64 D 2 2 Linux 64 D 3 Known Issues on Windows 65 Appendix E SFP Option for CNC Ports 66 E 1 Locate the SFP transceivers 67 E 2 Install an SFP transceiver 67 E 3 Verify Component Ope...

Page 7: ...Cord Connector on Power Supply Modules 19 Figure 12 Connect Power Cords to Rack Power Source 19 Figure 13 Connecting Hosts Direct Attach One Server One HBA Dual Path 24 Figure 14 Connecting Hosts Direct Attach Two Servers One HBA Dual Path 24 Figure 15 Connecting Hosts Switch Attach Two Servers Two Switches 24 Figure 16 Connecting USB Cable to CLI Port on Controller Module 26 Figure 17 Enclosure B...

Page 8: ... 47 Table 5 Disk Module LED Description 48 Table 6 Disk Module LED Behavior 49 Table 7 Vdisk LED Behavior 49 Table 8 Controller Module LED Descriptions 50 Table 9 Power and Cooling Module LED Descriptions 52 Table 10 Expansion Enclosure I O Module LED Descriptions 53 Table 11 Power Requirements AC Input 55 Table 12 Rackmount Controller Enclosure Weights 58 Table 13 Supported Terminal Emulator Appl...

Page 9: ...96 30065 001 Rev A0 DataDirect Networks EF4024 FC RAID System Setup Guide 9 Chapter 1 1 0System Components ...

Page 10: ... The enclosure status LEDs and enclosure ID LED are visible through the front bezel There are 24 disk bays at the front of the enclosure Figure 2 illustrates the LEDs on the front panel Refer to Appendix A for LED descriptions 1 1 1 Disk Drives EF4024 enclosures support SFF Midline SAS and SFF Enterprise SAS disks For information about creating vdisks and adding spares using different disk drive t...

Page 11: ...ing either 8Gb or 16Gb FC connections Refer to the EF4024 RAIDar User Guide Configuring Host Ports for information on CNC port configuration 1 2 2 Power and Cooling Module Power redundancy is achieved through two independent load sharing power supplies In the event of a power supply failure or the failure of the power source the storage system can operate continuously on a single power supply Grea...

Page 12: ...through caching The controller writes user data into the cache memory in the controller module rather than directly to the disks Later when the storage system is either idle or aging and continuing to receive new I O data the controller writes the data to the disks Read ahead caching The controller detects sequential data access reads ahead into the next sequence of data based upon settings and st...

Page 13: ... is used installed in a different enclosure data loss data corruption will occur Contact DDN Support for guidance on replacement procedure IMPORTANT In dual controller configurations featuring one healthy partner controller there is no need to transport failed controller cache to a replacement controller because the cache is duplicated between the controllers subject to volume write optimization s...

Page 14: ...96 30065 001 Rev A0 DataDirect Networks EF4024 FC RAID System Setup Guide 14 Chapter 2 2 0Installing Enclosures ...

Page 15: ...troller enclosure and optional expansion enclosures Section 2 2 Connecting the Enclosures 3 Connect power cords and power up the system Section 2 3 Powering On and Powering Off 4 Install required host software Section 3 1 Host System Requirements 5 Connect hosts1 1 For more about hosts refer to the EF4024 RAIDar User Guide About hosts Section 3 2 Connecting Enclosures to Hosts 6 Connect remote man...

Page 16: ...ve enclosure fails For example Figure 10 shows reverse cabling wherein controller 0A with enclosure ID 0 controller ID A is connected to expansion module 1A with a chain of connections cascading down blue cable Controller 0B is connected to the lower expansion module B of the last drive enclosure in the chain with connections moving in the opposite direction green cable 2 2 1 Cable Requirements Th...

Page 17: ...abling scheme Using this method if an expansion enclosure fails the enclosures that follow the failed enclosure in the chain are no longer accessible until the failed enclosure is repaired or replaced Figure 8 Connecting One Expansion Enclosure to Controller Enclosure Controller Enclosure 0 Expansion Enclosure 1 Controller Module 0A Controller Module 0B Expansion Expansion In Out In Out Module 1A ...

Page 18: ...o the enclosures as described in Section 2 3 1 Generally when powering up make sure to power up the enclosures and associated data host in the following order Expansion enclosures first This ensures that the disks in the expansion enclosures have enough time to completely spin up before being scanned by the controller modules within the controller enclosure While enclosures power up their LEDs bli...

Page 19: ...he power cords to the power cord connectors on the back of all expansion enclosures Figure 11 Only the power cords supplied with the enclosures should be used 2 Connect the other end of the power cords to the rack power source Figure 12 For redundancy connect the two power supplies to separate power source 3 Allow a couple of minutes for the disks to spin up 4 Similarly connect the power cords bet...

Page 20: ...rs using one of the two methods below Use RAIDar to shut down both controllers as described in the EF4024 RAIDar User Guide Use the command line user interface CLUI to shut down both controllers as described in the EF4024 CLUI Command Reference Guide 3 Turn off the controller enclosure by unplugging the power cords from the rack power source 4 Turn off all expansion enclosures by unplugging the po...

Page 21: ...96 30065 001 Rev A0 DataDirect Networks EF4024 FC RAID System Setup Guide 21 Chapter 3 3 0Connecting Hosts ...

Page 22: ...IO DSM http support microsoft com gp assistsupport http technet microsoft com search for multipath I O overview 3 1 1 Cabling Considerations Common cabling configurations address hosts controller enclosures drive enclosures and switches Host interface ports on EF4024 controller enclosures can connect to respective hosts via direct attach or switch attach Qualified options support cable lengths of ...

Page 23: ...IP Use the RAIDar Configuration Wizard to set FC port speed In the EF4024 RAIDar User Guide see Configuring the system Using the Configuration Wizard Configuring host ports and go to FC port options Use the show host parameters or show ports CLUI commands to view information about host ports 3 2 1 Dual Controller Configurations The EF4024 dual controller configuration improves application availabi...

Page 24: ...er of servers that can be connected to the storage system Each EF4024 controller enclosure supports 64 hosts Figure 15 shows an example of connecting two servers and two switches to an EF4024 controller enclosure Figure 13 Connecting Hosts Direct Attach One Server One HBA Dual Path Controller Module 0A Controller Module 0B Server Figure 14 Connecting Hosts Direct Attach Two Servers One HBA Dual Pa...

Page 25: ...te Firmware panel displays the currently installed firmware versions and allows you to update them Optionally you can update firmware using FTP File Transfer Protocol as described in the EF4024 RAIDar User Guide IMPORTANT See the Updating Firmware topic in the EF4024 RAIDar User Guide before performing a firmware update 3 5 Configuring Network Interfaces You can configure network interface paramet...

Page 26: ...ou are using the mini USB CLI port and cable see Appendix D USB Device Connection Windows users should download and install the device driver as described in Section D 2 1 Linux users should prepare the USB port as described in Section D 2 2 Use the CLUI commands described in the steps below to set the IP address for the network port on each controller module Once the new IP addresses are set you ...

Page 27: ...ter to display the CLI prompt The CLI displays the system version MC version and login prompt Enter the default user name manage Enter the default password manage If the default user name or password or both have been changed for security reasons enter the secure login credentials instead of the defaults shown above 7 At the prompt enter the following command to set the values you obtained in step...

Page 28: ...ystem for at least three minutes after changing the IP address you might need to restart the Management Controller s using the serial CLI When you restart a Management Controller communication with it is temporarily lost until it successfully restarts Enter the following command to restart the Management Controller in both controllers restart mc both 11 When you are done using the CLUI exit the em...

Page 29: ...96 30065 001 Rev A0 DataDirect Networks EF4024 FC RAID System Setup Guide 29 Chapter 4 4 0Basic Operation ...

Page 30: ...nd using RAIDar see the Getting Started section in the EF4024 RAIDar User Guide In addition to summarizing the processes to configure and provision a new system for the first time using the wizards the Getting Started section provides instructions for signing in to RAIDar introduces key system concepts addresses browser setup and provides tips for using the main window and the help window TIP Afte...

Page 31: ...96 30065 001 Rev A0 DataDirect Networks EF4024 FC RAID System Setup Guide 31 Chapter 5 5 0Troubleshooting ...

Page 32: ...vent notification in the EF4024 RAIDar User Guide With event notification configured and enabled you can follow the recommended actions in the notification message to resolve the problem as further discussed in the options presented below 5 2 1 Basic Steps The basic fault isolation steps are listed below Gather fault information including using system LEDs see Section 5 2 3 1 Determine where in th...

Page 33: ... in the log you can do so using either RAIDar or the CLUI Using RAIDar you would view the event log and then click on the event message to see details about that event Using the CLUI you would run the show events detail command with additional parameters to filter the output to see the details of an event 5 2 2 4 View the Enclosure LEDs You can look at the LEDs on the hardware see Appendix A to id...

Page 34: ...oller to shut down Correct the problem immediately Error A failure occurred that may affect data integrity or system stability Correct the problem as soon as possible Warning A problem occurred that may affect system stability but not data integrity Evaluate the problem and correct it if necessary Informational A configuration or state change occurred or a problem occurred that the system correcte...

Page 35: ...ion As an additional data protection precaution it is helpful to conduct regularly scheduled backups of your data IMPORTANT Stopping I O to a vdisk is a host side task and falls outside the scope of this document When on site you can verify that there is no I O activity by briefly monitoring the system LEDs however when accessing the storage system remotely this is not possible Remotely you can us...

Page 36: ...ce Required LED amber Answer Possible reasons Actions No System functioning properly No action required Yes A fault condition exists occurred If installing an I O module FRU the module has gone online and likely failed its self test Check the LEDs on the back of the controller to narrow the fault to a FRU connection or both Check the event log for specific information regarding the fault follow an...

Page 37: ...ivity LED is off The disk drive is offline An event message may have been received for this device Check the event log for specific information regarding the fault Isolate the fault Contact an authorized service provider for assistance Yes and the online activity LED is blinking The disk drive is active but an event message may have been received for this device Check the event log for specific in...

Page 38: ...t Power Source LED off Answer Possible reasons Actions No System functioning properly No action required Yes The power supply is not receiving adequate power Verifythatthepowercordisproperlyconnected andcheck the power source to which it connects Verify that the power supply FRU is firmly locked into position Check the event log for specific information regarding the fault If the above action does...

Page 39: ...k the Cache Status LED to verify that the controller cached data is flushed to the disk drives Solid Cache contains data yet to be written to the disk Blinking Cache data is being written to CompactFlash Flashing at 1 10 second on and 9 10 second off Cache is being refreshed by the supercapacitor Off Cache is clean no unwritten data 4 Remove the SFP and host cable and inspect for damage 5 Reseat t...

Page 40: ... Replace the HBA No It is likely that the controller module needs to be replaced 12 Move the cable and SFP back to its original port Is the host link status link activity LED on No The controller module port has failed Replace the controller module Yes Monitor the connection for a period of time It may be an intermittent problem which can occur with damaged SFPs cables and HBAs 5 6 Isolating a Con...

Page 41: ...od link status This step isolates the problem to the expansion cable or to the controller module s expansion port Is the expansion port status LED on Yes You now know that the expansion cable is good Return the cable to the original port If the expansion port status LED remains off you have isolated the fault to the controller module s expansion port Replace the controller module No Proceed to the...

Page 42: ...ow and can cause the enclosure to overheat 4 Try replacing each power supply one at a time 5 Replace the controller modules one at a time 5 7 1 Sensor Locations The storage system monitors conditions at different points within each enclosure to alert you to problems Power cooling fan temperature and voltage sensors are located at key points in the enclosure In each controller module and expansion ...

Page 43: ...wn Each power supply has one temperature sensor When a temperature fault is reported it must be remedied as quickly as possible to avoid system damage This can be done by warming or cooling the installation location When a power supply sensor goes out of range the Fault ID LED illuminates amber and an event is logged to the event log Fan 1 Power supply 1 4 000 RPM Fan 2 Power supply 1 4 000 RPM Fa...

Page 44: ...e Voltage Sensors Power supply voltage sensors ensure that an enclosure s power supply voltage is within normal ranges There are three voltage sensors per power supply Sensor Event Fault LED condition Power supply 1 voltage 12V 11 00V 13 00V Power supply 1 voltage 5V 4 00V 6 00V Power supply 1 voltage 3 3V 3 00V 3 80V ...

Page 45: ...96 30065 001 Rev A0 DataDirect Networks EF4024 FC RAID System Setup Guide 45 Appendix A A 0 LED Descriptions ...

Page 46: ...e 18 1 Align the clips at each corner on the back of the bezel with the ball studs on the flanges of the chassis 2 Push the bezel in until all four studs engage with the clips A 1 2 Removing Enclosure Bezel To remove the bezel insert the index finger of each hand into the top of the respective left and right pocket openings Figure 18 and insert the middle finger of each hand into the bottom of the...

Page 47: ... normally Both power supplies are off the system is powered off Temperature Fault Enclosure temperature is normal Enclosure temperature is above threshold LED Descriptions 96 30065 001 Rev A0 DataDirect Networks EF4024 FC RAID System Setup Guide 47 A 2 Enclosure Front Panel LEDs Figure 19 shows the enclosure front panel with the bezel removed The drive slots are numbered 0 to 23 from left to right...

Page 48: ...lor Status Power Activity Green On The disk drive module is operating normally Flashes The disk drive is initializing active and processing I O performing a media scan or the vdisk is initializing or reconstructing Off If Fault LED is also OFF the disk is not powered on Fault Amber On The disk has failed experienced a fault is a leftover or the vdisk that it is associated with is down or critical ...

Page 49: ...hes Performing a media scan Green Flashes Disk drive leftover Disk drive is a leftover Amber On Identifying a leftover Amber Flashes Blue1 On Disk drive failed Fault or failure Green1 On Amber On Fault and remove disk drive Green On Amber On Fault and identify disk drive Green On Amber On Fault identify and remove disk drive Green On Amber Flashes Blue On Table 7 Vdisk LED Behavior Description Sta...

Page 50: ...ons LED Color Status FC Link Status Link Activity Green Off No link detected On The port is connected and the link is up Flashes The link has I O or replication activity Network Port Link Status Green Off Link is not established or the link is down On Link is up applies to all negotiated link speeds Network Port Link Speed Amber Off Link is up at 10 100base T negotiated speeds On Link is up and ne...

Page 51: ...essentially four copies of user data are preserved one in controller cache and one in CompactFlash of each controller The Cache Status LED illuminates solid green during the boot up process This behavior indicates the cache is logging all POSTs which will be flushed to the CompactFlash the next time the controller shuts down CAUTION If the Cache Status LED illuminates solid green and you wish to s...

Page 52: ...s normal LED Descriptions 96 30065 001 Rev A0 DataDirect Networks EF4024 FC RAID System Setup Guide 52 A 5 Power and Cooling Module LEDs There are two power and cooling modules on each of the controller enclosure and expansion enclosure Figure 22 shows the LEDs on the module The LEDs are defined in Table 9 Table 9 Power and Cooling Module LED Descriptions Green On Off Amber On Off Figure 22 LEDs o...

Page 53: ...module Fault Service Required Amber On A fault is detected or a service action is required Flashes Hardware controlled power up FRU OK Green On Expansion module is operating normally Off Expansion module is not OK Flashes System is booting SAS In Port Status Green On Port is connected and the link is up Off Port is empty or link is down SAS Out Port Status Green On Port is connected and the link i...

Page 54: ...96 30065 001 Rev A0 DataDirect Networks EF4024 FC RAID System Setup Guide 54 Appendix B B 0 Environmental Requirements Specifications ...

Page 55: ...other applicable government codes and regulations Ensure that the voltage and frequency of your power source match the voltage and frequency inscribed on the equipment s electrical rating label To ensure redundancy provide two separate power sources for the enclosures These power sources must be independent of each other and each must be controlled by a separate circuit breaker at the power distri...

Page 56: ...es work with single phase power systems having an earth ground connection To reduce the risk of electric shock do not plug an enclosure into any other type of power system Contact your facilities manager or a qualified electrician if you are not sure what type of power is supplied to your building Enclosures are shipped with a grounding type three wire power cord To reduce the risk of electric sho...

Page 57: ...ether with sufficient ventilation to allow a free flow of air to all enclosures Figure 24 and Table 12 show enclosure dimensions and weights Enclosure designators are described below Enclosure weights assume the following configurations The chassis is equipped with a disk in each disk bay Two controller modules or two expansion modules per enclosure Two power supply modules per enclosure Figure 24...

Page 58: ...ts Configuration Weight Controller enclosure Chassis only Chassis with FRUs no disks 1 3 Chassis with FRUs including disks 1 4 8 6 kg 19 0lb 17 4 kg 38 4 lb 23 4 kg 51 6 lb Expansion enclosure Chassis only Chassis with FRUs no disks 1 3 Chassis with FRUs including disks 1 4 8 6 kg 19 0 lb 16 2 kg 35 8 lb 22 2 kg 49 0 lb Specification Range Altitude To 3 000 meters 9 843 feet Temperature 5ºC to 40º...

Page 59: ... Power Cable Requirements Each enclosure is shipped with two power cables designed for use with the enclosure power supply module Each power cable connects one of the power supply modules to an independent external power source To ensure power redundancy connect the two power cables to two separate circuits for example to one commercial circuit and one uninterruptible power source UPS B 6 Manageme...

Page 60: ...96 30065 001 Rev A0 DataDirect Networks EF4024 FC RAID System Setup Guide 60 Appendix C C 0 Electrostatic Discharge ...

Page 61: ...c protected area before removing them from their containers Avoid touching pins leads or circuitry Always be properly grounded when touching a static sensitive component or assembly C 2 Grounding Methods Several grounding methods can be used to prevent electrostatic discharge Use one or more of the following methods when handling or installing electrostatic sensitive parts Use a wrist strap connec...

Page 62: ...96 30065 001 Rev A0 DataDirect Networks EF4024 FC RAID System Setup Guide 62 Appendix D D 0 USB Device Connection ...

Page 63: ... or other computer running a Linux or Windows operating system can recognize the controller enclosure as a connected device Without this support the computer might not recognize that a new device is connected or might not be able to communicate with it For Linux computers no new driver files are needed but a Linux configuration file must be created or modified see Section D 2 2 For Windows compute...

Page 64: ...ms require a device driver or special mode of operation Product and vendor identification information required for such setup is provided in Table 14 D 2 1 Microsoft Windows Microsoft Windows operating systems provide a USB serial port driver However the USB driver requires details for connecting to the EF4024 controller enclosures DDN provides a device driver for use in the Windows environment Th...

Page 65: ...nd between the host and controller module for setting network port IP addresses To create a new connection or open an existing connection HyperTerminal 1 From the Windows Control Panel select Device Manager 2 Connect using the USB COM port and Detect Carrier Loss option a Select Connect To Connect using Then select a COM port from the list b Select the Detect Carrier Loss check box The Device Mana...

Page 66: ...96 30065 001 Rev A0 DataDirect Networks EF4024 FC RAID System Setup Guide 66 Appendix E E 0 SFP Option for CNC Ports ...

Page 67: ...ming the steps 1 Orient the SFP as shown and align it for insertion into the target CNC port The SFP should be positioned such that the actuator pivot hinge is on top 2 If the SFP has a plug remove it before installing the transceiver Retain the plug 3 Flip the actuator open as shown in the figure near the left detail view The actuator on your SFP option may look slightly different than the one sh...

Page 68: ...obtain and connect a qualified fibre optic interface cable into the duplex jack at the end of the SFP connector NOTE To remove an SFP module perform the above steps in reverse order E 3 Verify Component Operation View the CNC port Link Status Link Activity LED on the controller module face plate A green LED indicates that the port is connected and the link is up see Appendix A for information abou...

Page 69: ... hosts 22 connecting to remote management hosts 25 customer service contacting 72 D DataDirect Networks contacting 72 DHCP obtaining IP addresses 25 server 25 direct attach configurations 22 disk drive LEDs general 48 E electrostatic discharge grounding methods 61 precautions 61 enclosure cabling 16 IDs correcting 35 initial configuration 15 input frequency requirement 59 input voltage requirement...

Page 70: ...physical requirements 57 power cord requirements 59 power cycle power off 20 power on 19 power supply AC power requirements 55 site wiring requirements 55 R RAIDar web based storage management interface 30 regulatory compliance notices shielded cables 25 59 remote management 25 repair how to return product for 72 requirements cabling 57 clearance 56 host system 22 physical 57 ventilation 56 RFI EM...

Page 71: ...g the CLUI 33 U Unified LUN Presentation 22 USB device connection Command line Interface CLI 64 device driver 64 emulated serial port 63 rear panel USB ports 63 supported host applications 64 vendor and product ID codes 64 V ventilation requirements 56 W warnings temperature 42 voltage 42 ...

Page 72: ...rt Portal https portal ddnsupport com Portal Assistance webportal support ddn com Bulletins Technical Support Bulletins http www ddn com technical support bulletins Bulletin Subscriptions support tsb ddn com Product Shipping Instructions If you are shipping the product to another location always use the original packaging provided with your unit s If you are sending a product to DataDirect Network...

Page 73: ...World Headquarters 9351 Deering Avenue Chatsworth CA 91311 ddn com Phone 1 818 700 7600 Fax 1 818 700 7601 ...

Reviews: