background image

version

 

is

 

05.42.xx.xx

 

for

 

the

 

DS4100

 

storage

 

subsystem

 

and

 

05.41.5x.xx

 

for

 

the

 

DS4500

 

and

 

the

 

DS4300

 

storage

 

subsystems.

 

The

 

associated

 

EXP100

 

ESM

 

firmware

 

must

 

be

 

at

 

version

 

9554.

 

This

 

release

 

has

 

the

 

following

 

characteristics:

 

v

   

The

 

coexistence

 

(intermix)

 

of

 

Fibre

 

Channel

 

drives

 

and

 

SATA

 

drives

 

in

 

a

 

DS4000

 

storage

 

subsystem

 

is

 

still

 

not

 

supported.

 

This

 

requires

 

that

 

the

 

DS4000

 

storage

 

subsystem

 

go

 

through

 

a

 

special

 

controller

 

upgrade

 

process

 

to

 

load

 

the

 

05.41.5x.xx

 

firmware,

 

because

 

the

 

DS4000

 

storage

 

subsystem

 

will

 

not

 

see

 

any

 

EXP100

 

enclosures

 

or

 

SATA

 

drives

 

until

 

the

 

controller

 

firmware

 

version

 

05.41.5x.xx

 

is

 

loaded.

 

Note:

  

The

 

DS4100

 

subsystem

 

is

 

shipped

 

only

 

with

 

the

 

controller

 

firmware

 

version

 

05.42.xx.xx,

 

which

 

supports

 

SATA

 

drives.

 

Therefore,

 

the

 

special

 

controller

 

firmware

 

installing

 

procedure

 

described

 

above

 

is

 

not

 

applicable

 

to

 

the

 

DS4100.

 

v

   

The

 

EXP100

 

ESM

 

now

 

supports

 

Full

 

High

 

Availability

 

(FHA).

 

With

 

this

 

functionality,

 

in

 

the

 

event

 

of

 

ESM

 

or

 

Fibre

 

Channel

 

cabling

 

failure,

 

the

 

drives

 

that

 

belong

 

to

 

the

 

failed

 

ESM

 

will

 

fail-over

 

to

 

the

 

surviving

 

ESM,

 

whether

 

or

 

not

 

the

 

ESM

 

remains

 

inserted

 

in

 

the

 

EXP100

 

drive

 

enclosure

 

chassis.

 

In

 

either

 

case,

 

with

 

FHA,

 

the

 

controller

 

can

 

recognize

 

any

 

of

 

the

 

drives

 

that

 

were

 

managed

 

by

 

the

 

failed

 

ESM.

 

v

   

Upgrading

 

the

 

EXP100

 

ESM

 

firmware

 

from

 

953x

 

to

 

9554

 

requires

 

the

 

controller

 

firmware

 

version

 

05.41.1x.xx.

 

It

 

is

 

not

 

possible

 

to

 

upgrade

 

the

 

EXP100

 

ESM

 

from

 

any

 

pre-9554

 

version

 

to

 

the

 

9554

 

version

 

if

 

the

 

controller

 

firmware

 

of

 

the

 

attached

 

DS4000

 

storage

 

subsystem

 

is

 

version

 

05.41.5x.xx

 

or

 

version

 

05.42.xx.xx.

 

In

 

addition,

 

you

 

should

 

not

 

insert

 

an

 

ESM

 

with

 

firmware

 

version

 

9554

 

into

 

an

 

EXP100

 

that

 

contains

 

an

 

ESM

 

with

 

firmware

 

version

 

953x

 

installed.

 

If

 

you

 

do,

 

the

 

Storage

 

Manager

 

Subsystem

 

Management

 

window

 

will

 

show

 

the

 

EXP100

 

with

 

all

 

slots

 

empty,

 

and

 

will

 

mark

 

the

 

drives

 

in

 

those

 

slots

 

as

 

failed.

Third

 

release:

   

The

 

third

 

release

 

of

 

the

 

DS4000

 

controller

 

firmware/NVSRAM

 

provided

 

SATA

 

support

 

for

 

the

 

DS4100,

 

DS4300,

 

DS4400,

 

DS4500,

 

and

 

DS4800

 

storage

 

subsystems

 

to

 

support

 

the

 

attachment

 

of

 

the

 

EXP100.

 

The

 

latest

 

controller

 

firmware

 

versions

 

for

 

this

 

release

 

is

 

06.12.0x.xx

 

(for

 

the

 

DS4100,

 

DS4300,

 

DS4400

 

and

 

DS4500)

 

and

 

06.15.15.xx

 

(for

 

the

 

DS4800

 

storage

 

subsystem).

 

The

 

associated

 

EXP100

 

ESM

 

firmware

 

version

 

is

 

still

 

9554.

 

This

 

release

 

had

 

the

 

following

 

characteristics:

 

v

   

The

 

coexistence

 

(intermix)

 

of

 

Fibre

 

Channel

 

expansion

 

enclosures

 

and

 

SATA

 

expansion

 

enclosures

 

in

 

a

 

DS4000

 

storage

 

subsystem

 

is

 

now

 

supported,

 

with

 

the

 

purchase

 

and

 

enablement

 

of

 

the

 

DS4000

 

Storage

 

Manager

 

FC/SATA

 

Intermix

 

Premium

 

Feature.

 

If

 

the

 

controller

 

firmware

 

installed

 

in

 

the

 

DS4000

 

storage

 

subsystem

 

is

 

version

 

06.1x.xx.xx,

 

no

 

separate

 

controller

 

firmware

 

or

 

firmware

 

installation

 

procedures

 

are

 

required

 

to

 

support

 

FC/SATA

 

Intermix;

 

Fibre

 

Channel

 

drives

 

only;

 

or

 

SATA

 

drives

 

only.

 

You

 

can

 

follow

 

the

 

documented

 

controller

 

firmware

 

and

 

NVSRAM

 

firmware

 

upgrade

 

procedures

 

in

 

the

 

appropriate

 

IBM

 

TotalStorage

 

DS4000

 

Storage

 

Manager

 

Installation

 

and

 

Support

 

Guide

 

for

 

your

 

host

 

operating

 

system.

 

However,

 

in

 

order

 

to

 

intermix

 

Fibre

 

Channel

 

and

 

SATA

 

expansion

 

enclosures

 

in

 

a

 

DS4000

 

subsystem,

 

you

 

must

 

purchase

 

and

 

enable

 

the

 

DS4000

 

Storage

 

Manager

 

FC/SATA

 

Intermix

 

Premium

 

Feature.

 

Note:

  

If

 

you

 

want

 

to

 

intermix

 

Fibre

 

Channel

 

and

 

SATA

 

expansion

 

enclosures

 

in

 

an

 

existing

 

DS4000

 

configuration

 

with

 

non-06.1x.xx.xx

 

controller

 

firmware

 

installed,

 

that

 

currently

 

supports

 

a

 

single

 

drive

 

technology

 

(either

 

Fibre

 

 

Chapter

 

1.

 

Introduction

 

9

|
|
|

|

|
|
|
|
|
|

|
|
|
|

|
|
|
|
|
|

|
|
|
|
|
|
|
|

|
|
|
|
|
|

|

|
|
|
|
|
|
|
|
|
|
|
|

|
|
|

Summary of Contents for TotalStorage EXP100

Page 1: ...IBM TotalStorage DS4000 EXP100 Storage Expansion Enclosure Installation User s and Maintenance Guide GC26 7694 01 ...

Page 2: ......

Page 3: ...IBM TotalStorage DS4000 EXP100 Storage Expansion Enclosure Installation User s and Maintenance Guide GC26 7694 01 ...

Page 4: ...the general information in Notices on page 141 Second Edition November 2005 Copyright International Business Machines Corporation 2004 2005 All rights reserved US Government Users Restricted Rights Use duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp ...

Page 5: ...des 4 Storage Manager software support for the EXP100 4 Current firmware support for the EXP100 4 EXP100 ESM CRU types firmware and release levels explained 6 EXP100 ESM CRU types 6 EXP100 release levels 7 ESM failover support considerations 11 Determining firmware levels 11 How to receive the latest product updates 12 Inventory checklist 14 EXP100 components 14 EXP100 bays 14 Hot swap drive bays ...

Page 6: ... 53 EXP100 loop redundancy 56 Cabling the power supply 58 Turning the EXP100 on and off 58 Turning on the EXP100 58 Turning off the EXP100 60 Performing an emergency shutdown 61 Restoring power after an emergency 61 Chapter 3 Installing and replacing devices 63 Adding a new EXP100 to an existing and configured drive loop 63 Determining firmware levels of the new and existing EXP100s 63 Adding the ...

Page 7: ...e 113 Problem recovery 113 Appendix B Records 115 Identification numbers 115 Storage subsystem and controller information record 116 Sample information record 117 Installed device records 118 Appendix C Rack mounting template 119 Appendix D Power cords 123 Appendix E Additional DS4000 documentation 125 DS4000 Storage Manager Version 9 library 125 DS4500 Fibre Channel Storage Server library 126 DS4...

Page 8: ... United Kingdom telecommunications safety requirement 143 European Union EMC Directive conformance statement 143 Taiwan Class A warning statement 144 Japanese Voluntary Control Council for Interference VCCI statement 144 Glossary 145 Index 155 vi IBM TotalStorage DS4000 EXP100 Storage Expansion Enclosure Installation User s and Maintenance Guide ...

Page 9: ...s 44 27 Enclosure ID settings 45 28 SFP module and protective cap 48 29 Installing an SFP module into the host port 49 30 Unlocking the SFP module latch plastic variety 49 31 Unlocking the SFP module latch wire variety 50 32 LC LC Fibre Channel cable 51 33 Removing fiber optic cable protective caps 52 34 Inserting an LC LC Fibre Channel cable into an SFP module 52 35 LC LC Fibre Channel cable leve...

Page 10: ...viii IBM TotalStorage DS4000 EXP100 Storage Expansion Enclosure Installation User s and Maintenance Guide ...

Page 11: ...SM incompatibility issues 95 15 Existing EXP100 ESM and new EXP100 ESM firmware compatibility levels 96 16 Symptom to FRU index 100 17 Troubleshooting ESM incompatibility issues 103 18 Parts listing EXP100 storage expansion enclosure 104 19 Required current firmware levels 108 20 Storage subsystem and controller information record 116 21 Sample information record 117 22 Hard disk drive record 118 ...

Page 12: ...x IBM TotalStorage DS4000 EXP100 Storage Expansion Enclosure Installation User s and Maintenance Guide ...

Page 13: ...azardous to you A danger statement is placed just before the description of a potentially lethal or extremely hazardous procedure step or situation v Caution These statements indicate situations that can be potentially hazardous to you A caution statement is placed just before the description of a potentially hazardous procedure step or situation v Attention These notices indicate possible damage ...

Page 14: ...or structural damage v Disconnect the attached power cords telecommunications systems networks and modems before you open the device covers unless instructed otherwise in the installation and configuration procedures v Connect and disconnect cables as described in the following table when installing moving or opening covers on this product or attached devices To Connect To Disconnect 1 Turn everyt...

Page 15: ...or adjustments or performance of procedures other than those specified herein might result in hazardous radiation exposure DANGER Some laser products contain an embedded Class 3A or Class 3B laser diode Note the following Laser radiation when open Do not stare into the beam do not view directly with optical instruments and avoid direct exposure to the beam Class 1 Laser statement Class 1 Laser Pro...

Page 16: ...r switch on the power supply do not turn off the electrical current supplied to the device The device also might have more than one power cord To remove all electrical current from the device ensure that all power cords are disconnected from the power source 1 2 xiv IBM TotalStorage DS4000 EXP100 Storage Expansion Enclosure Installation User s and Maintenance Guide ...

Page 17: ...as the following label attached Hazardous voltage current and energy levels are present inside any component that has this label attached There are no serviceable parts inside these components If you suspect a problem with one of these parts contact a service technician Safety xv ...

Page 18: ...xvi IBM TotalStorage DS4000 EXP100 Storage Expansion Enclosure Installation User s and Maintenance Guide ...

Page 19: ...duct Name Current DS4000 Product Name IBM TotalStorage FAStT Storage Server IBM TotalStorage DS4000 FAStT DS4000 FAStT Family DS4000 Mid range Disk System FAStT Storage Manager vX Y for example v9 10 DS4000 Storage Manager vX Y for example v9 10 FAStT100 DS4100 FAStT600 DS4300 FAStT600 with Turbo Feature DS4300 Turbo FAStT700 DS4400 FAStT900 DS4500 EXP700 DS4000 EXP700 EXP710 DS4000 EXP710 EXP100 ...

Page 20: ...so provides a parts for list for the EXP100 Appendix A Upgrading R1 level firmware DS4300 and DS4500 only on page 107 contains information on how to enable EXP100 R2 full high availability support by upgrading the EXP100 ESM firmware the DS4000 controller firmware and NVSRAM Appendix B Records on page 115 provides a table that you can use to record and update important information about your EXP10...

Page 21: ...anager Installation and Support Guide for Windows 2000 Server 2003 NetWare ESX Server and Linux v DS4100 Storage Server Installation User s and Maintenance Guide v DS4300 Fibre Channel Storage Server Installation and User s Guide v DS4400 Fibre Channel Storage Server Installation and Support Guide v DS4500 Fibre Channel Storage Server Installation and Support Guide v DS4800 Storage Subsystem Insta...

Page 22: ...nd Support Guide v DS4500 Fibre Channel Storage Server Installation and Support Guide v DS4800 Storage Subsystem Installation User s and Maintenance Guide 8 Zone the fabric switch SAN attached only v DS4000 Storage Manager Installation and Support Guide for AIX HP UX Solaris and Linux on POWER v DS4000 Storage Manager Installation and Support Guide for Windows 2000 Server 2003 NetWare ESX Server a...

Page 23: ...s v DS4000 Storage Manager Installation and Support Guide for AIX HP UX Solaris and Linux on POWER v DS4000 Storage Manager Installation and Support Guide for Windows 2000 Server 2003 NetWare ESX Server and Linux v DS4000 Storage Manager online help 17 Configure host partitions 18 Verify host access to DS4000 storage Note The Storage Manager premium copy services FlashCopy VolumeCopy and Enhanced ...

Page 24: ...stem documentation for instructions on how to use the diagnostic programs The troubleshooting information or the diagnostic programs might tell you that you need additional or updated device drivers or other software Web sites IBM maintains pages on the World Wide Web where you can get the latest technical information and download device drivers and updates v For DS4000 information go to the follo...

Page 25: ...owing Web site for support telephone numbers www ibm com planetwide In the U S and Canada hardware service and support is available 24 hours a day 7 days a week In the U K these services are available Monday through Friday from 9 a m to 6 p m Fire suppression systems A fire suppression system is the responsibility of the customer The customer s own insurance underwriter local fire marshal or a loc...

Page 26: ...an IBM representative If the RCF has been removed send your comments to International Business Machines Corporation Information Development Department GZW 9000 South Rita Road Tucson Arizona USA 85744 0001 Be sure to include the name and order number of the document and if applicable the specific location of the text that you are commenting on such as a page number or table number xxiv IBM TotalSt...

Page 27: ...rage subsystems such as the DS4100 DS4300 DS4400 DS4500 and DS4800 This section contains the following information v EXP100 storage expansion enclosure description v Host server operating system support on page 2 v Fibre Channel defined on page 2 v Serial ATA defined on page 3 v New features on page 3 EXP100 storage expansion enclosure description The EXP100 is a rack mountable storage expansion e...

Page 28: ...VSRAM that are associated with the three EXP100 ESM firmware types Before you install and configure your EXP100 read the detailed information about these DS4000 firmware release levels and EXP100 ESM CRU firmware types in Software hardware and firmware compatibility and upgrades on page 4 The information in that section is essential to successfully completing an EXP100 installation Host server ope...

Page 29: ...the following new features v The new 400 GB SATA drive option P N 39M4570 and CRU P N 39M4575 v The new 250 GB SATA drive CRU P N 40K6837 v DS4000 Storage Manager version 9 15 and later Like the previous EXP100 R2 ESM firmware the R3 release features Full High Availability FHA failover capability R3 firmware also enables DS4000 controller firmware and ESM firmware upgrades concurrent with I O acti...

Page 30: ...are to DS4000 Storage Manager version 9 15 or later in the host servers and in the management station You can find the latest DS4000 controller firmware and NVSRAM EXP100 expansion enclosure ESM firmware and Storage Manager software packages at the IBM DS4000 TotalStorage Support Web site www ibm com servers storage support disk The software and firmware are also included on the DS4000 Storage Man...

Page 31: ...x xx or 06 15 xx xx firmware that is required to support EXP100 expansion enclosures However to connect both SATA and Fibre Channel drives in the same DS4000 storage subsystem you need to purchase and install the Fibre Channel SATA Intermix Premium Feature 2 DO NOT install controller versions 5 41 5x xx or 5 41 1x xx in DS4000 storage subsystems The R2 FHA controller firmware version 5 41 5x xx an...

Page 32: ...P100 ESM replacement procedure ESM firmware upgrades and problem troubleshooting please refer to the following sections in this document v Replacing a failed hot swap ESM on page 85 v Upgrading ESM firmware after adding the EXP100 to an existing drive loop on page 68 v Solving problems on page 99 v Troubleshooting on page 95 If you need further assistance please contact IBM technical support your ...

Page 33: ...o four different EXP100 DS4000 firmware release levels that incorporate the various DS4000 controller firmware versions with their associated R1 R2 and R3 EXP100 ESM CRU types Table 5 shows how each release level relates to its EXP100 CRU part number ESM and controller firmware versions and supported DS4000 storage subsystems Detailed explanations of the four release levels follow the table Table ...

Page 34: ...elease The first release of the DS4000 controller firmware and NVSRAM was for DS4300 and DS4500 storage subsystems only to support the attachment of the EXP100 storage expansion enclosure The controller firmware version is 05 41 1x xx and the associated EXP100 ESM firmware version is 953x This release has the following characteristics v The coexistence intermix of Fibre Channel drives and SATA dri...

Page 35: ...n 9554 into an EXP100 that contains an ESM with firmware version 953x installed If you do the Storage Manager Subsystem Management window will show the EXP100 with all slots empty and will mark the drives in those slots as failed Third release The third release of the DS4000 controller firmware NVSRAM provided SATA support for the DS4100 DS4300 DS4400 DS4500 and DS4800 storage subsystems to suppor...

Page 36: ...nt window will show the EXP100 with all slots empty v Upgrading controller firmware from version 05 xx xx xx to version 06 xx xx xx requires that there be no I O activity to the DS4000 storage subsystems You must schedule down time for the upgrade However upgrading controller firmware from one 06 xx xx xx version to a different 06 xx xx xx version does not require that I O activity be stopped Note...

Page 37: ... the EXP100 drives could become inaccessible to the controllers if an ESM fails You can avoid this situation by upgrading your firmware to enable DS4000 EXP100 R3 support Recommendation IBM strongly recommends upgrading firmware to R3 support Important For full ESM failover capability the controller firmware must be either version 5 41 5x xx or version 06 xx xx xx or later and the ESM firmware mus...

Page 38: ...Component Information window opens 2 Click the ESM icon in the left pane The ESM information displays in the right pane of the Drive Enclosure Component Information window 3 Locate the firmware version of each ESM in the storage expansion enclosure To obtain the storage expansion enclosure component firmware version 1 Click the Drive Enclosure Component icon which is the right most icon in the Dri...

Page 39: ...he listing of hardware topics and select Computer Storage Click Go The Computer Storage page opens 3 Scroll down to the Disk Storage Systems category and check the box for either the 1710 or 1724 1Xx where x is an alphanumeric character and the DS4000 series controller that the EXP100 connects to Check boxes for any other DS4000 series products for which you would like to receive information Scrol...

Page 40: ...annel cable Note You must order these options separately EXP100 components The EXP100 has the following removable components These components called customer replaceable units CRUs are accessible from the front or back of the EXP100 v Up to fourteen 1 5 Gbps SATA hard disk drives v Two environmental services modules ESMs v Two power supplies v Two fans EXP100 bays This section shows the location o...

Page 41: ...o not replace one SATA drive with another SATA drive These actions will result in a drive CRU that cannot be recognized by the expansion enclosure ESM 4 The 400 GB SATA drive options and CRU P N 39M4575 and the new 250 GB SATA CRU P N 40K6837 require ESM firmware level 956x or later Recommendation IBM strongly recommends that you check and maintain the DS4000 storage subsystem controller firmware ...

Page 42: ...cy and failover configurations After you remove an ESM wait 70 seconds before reseating or replacing the ESM Failure to do so may cause undesired events The ESMs have locking latches that secure them to the ESM bays You must unlock the latches before you can remove the ESM from the expansion enclosure v Hot swap power supply bays The EXP100 has two hot swap and redundant power supplies The power s...

Page 43: ...ify process is in progress v General system error LED A solid amber LED indicates that the unit has a power supply fan unit or hard disk drive error v Latch Use this multipurpose latch to release or lock the drive CRU in place v Power on LED A solid green LED indicates that the expansion enclosure has dc power v Tray handle Use this multipurpose handle to insert and remove a drive CRU in the bay R...

Page 44: ...he power cables to the ac power connectors that are located on the back of the EXP100 Fan controls and indicators The EXP100 has two hot swappable and redundant fan units as shown in Figure 5 on page 19 The fan units are located at the back of the expansion enclosure One fan will continue to operate if the other fan fails You can remove and replace the fan unit while the EXP100 is powered on and a...

Page 45: ...n of controller firmware version 05 41 5x xx 6 1x xx xx or later and ESM firmware versions 9554 956x or later the EXP100 provides full failover capability If one ESM within the EXP100 expansion enclosure fails the surviving ESM provides data paths to all 14 drives in the EXP100 expansion enclosures Therefore for full failover capability ensure that you have the latest firmware levels Keep in mind ...

Page 46: ...and Output bypass LEDs light This LED also lights if an SFP module is installed and is not connected to another device v Power LED The green Power LED lights when there is power to the ESM v Over temperature LED The amber over temperature LED lights if the expansion enclosure overheats v Enclosure ID switches Two enclosure ID switches are located between the power supplies at the rear of the EXP10...

Page 47: ...y speed setting that is allowed for the EXP100 Attention Do not remove the metal plate that covers the expansion enclosure speed setting Do not adjust the expansion enclosure speed setting EXP100 operating environment This section provides general operating information about the EXP100 X10 X1 exp12038 Figure 7 Enclosure ID Switch Chapter 1 Introduction 21 ...

Page 48: ... system configurations eight hard disk drives installed v Sound power idling 5 9 bel open bay 6 1 bel typical v Sound power operating 5 9 bel open bay 6 2 bel typical v Sound pressure idling 44 dBA open bay 46 dBA typical v Sound pressure operating 44 dBA open bay 47 dBA typical These levels are measured in controlled acoustical environments according to ISO 7779 and are reported in accordance wit...

Page 49: ...uately cooled v Air enters at the front of the rack and leaves at the back To prevent the air that is leaving the rack from entering the intake of another piece of equipment you must position the racks in alternate rows back to back and front to front This arrangement is known as cold aisle hot aisle and is shown in Figure 8 on page 24 v Where racks are in rows each rack must touch the rack that i...

Page 50: ...ed slots 2 4 6 8 10 12 14 Note In contrast to the EXP100 R2 and R3 expansion enclosures which have ESM firmware installed that supports full high availability EXP100 R1 expansion enclosures have low high availability LHA firmware installed Therefore EXP100 R1 units do not provide SATA hard drive failover or fail back support for a loss of connectivity due to bad components in the Fibre Channel dri...

Page 51: ...here are failures in both ESMs or there are failures in the Fibre Channel connections to both ESMs in the EXP100 chassis the controller and ESM firmware work together to ensure that there is no loss of data availability Figure 10 on page 26 shows that if the Fibre Channel connection to the left ESM is bad then the data to drive 1 which is controlled by the left ESM is routed through the right ESM ...

Page 52: ... in another EXP100 To controller drive port or FC port in another EXP100 To controller drive port or FC port in another EXP100 Port Bypass Logic FibreChannel SATA Bridge FC OUT FC IN FibreChannel SATA Bridge right ESM Internal ESM ESM link Port Bypass Logic exp12cfg8 Figure 10 The right ESM and controller firmware recover from a loss of connectivity to the input port of the left ESM 26 IBM TotalSt...

Page 53: ... expansion enclosures and so on up to the maximum number of EXP100s that are supported with a particular storage subsystem eight expansion enclosures for the DS4300 and 16 expansion enclosures for the DS4500 Figure 12 on page 28 and Figure 13 on page 28 show examples of arrays that are orthogonally striped over multiple EXP100 expansion enclosures If an ESM in a EXP100 failed or even if the entire...

Page 54: ... through H2 A B H Array 1 Array 2 Array 3 Array 4 Array 5 Array 7 Possible Hot Spares 1 1 1 2 2 2 3 3 3 4 4 4 5 5 5 6 6 6 7 7 7 8 8 8 9 9 9 10 10 10 11 11 11 12 12 12 13 13 13 14 14 14 Figure 12 Orthogonally striped RAID arrays Option 1 1 14 13 12 7 6 5 4 11 10 9 8 3 2 1 14 13 12 7 6 5 4 11 10 9 8 3 2 1 14 13 12 7 6 5 4 11 10 9 8 3 2 1 14 13 12 7 6 5 4 11 10 9 8 3 2 A B C H Array 1 Array 2 Possibl...

Page 55: ...port rails in the rack See Installing the support rails on page 34 3 If necessary remove the CRUs from the EXP100 See Removing the CRUs on page 37 4 Install the EXP100 See Installing the EXP100 into a rack on page 40 If necessary replace the CRUs in the EXP100 See Replacing the EXP100 CRUs on page 41 5 Set the EXP100 interface options See Setting the interface options on page 44 6 Cable the EXP100...

Page 56: ...inted metal part of the system unit for at least two seconds This drains static electricity from the package and from your body v Remove the device from its package and install it directly into your system unit without setting it down If it is necessary to set the device down place it in its static protective package Do not place the device on your system unit cover or on a metal table v Take addi...

Page 57: ...ed EXP100 and associated systems v Sufficient space to install the EXP100 Weight The EXP100 total weight depends on the number of 1 5 Gbps SATA hard disk drives that are installed A fully configured EXP100 with two fans two power supplies two ESMs and up to 14 SATA hard disk drives installed weighs 40 2 kg 88 4 lbs Continue with Preparing the rack Preparing the rack Important Before you install th...

Page 58: ... easier use use the copies in Appendix C Rack mounting template on page 119 rather than the copies provided in this section Use the following templates Figure 14 on page 33 and Figure 15 on page 34 to identify the proper locations for inserting M6 screws when mounting the support rails and EXP100 to a rack The locations for the M6 screws are highlighted in the templates The EXP100 is 3 U high Alig...

Page 59: ...0 FRONT Rack Mounting Template 2 U 2 U 1 U 1 U 0 U 0 U Rail assembly Front Left Bezel Front Left Bezel Front Right Rail assembly Front Right Figure 14 Front rack mounting template Chapter 2 Installing the EXP100 33 ...

Page 60: ...s to install the support rails Note Refer to Figure 17 on page 36 while performing these steps 1 Ensure that the rack has already been installed 2 Ensure that a stabilizer has been correctly attached to the bottom front of the rack to prevent the rack from tipping forward while the EXP100 is being installed Refer to the installation and service guide or equivalent for the rack as required 3 Locate...

Page 61: ...d unit is three EIA units high Decide accordingly where you are going to install the support rails Attention Use the rack mounting template provided in Figure 14 on page 33 and Figure 15 on page 34 to locate the proper rack mounting holes for installing the support rails into the rack Note the following considerations before you choose where to install the rails v If you are installing the EXP100 ...

Page 62: ...Extend the rear of the support rail until it makes contact with the rear rack rail 8 From the rear of the rack thread and tighten two M6 screws 1 see Figure 15 on page 34 for the location for these screws From the front of the rack finish tightening the front M6 screw 4 When you are the finished the rail should be attached to the cabinet using one M6 screw in the front inserted at the second to lo...

Page 63: ...mes with a rack mounting hardware kit for installing it in a rack It is easier to lift the EXP100 and install it in a rack cabinet if you remove all the CRUs first You will need an antistatic wrist strap and a cart or level surface to hold the CRUs Observe the precautions listed in Handling static sensitive devices on page 30 In the following procedure you will remove the following CRUs from the e...

Page 64: ...the power supply lever and squeeze the latch to release it 2 Pull the lever open 90 and remove the power supply as shown in Figure 19 3 Place the power supply on a level surface 4 Repeat step 1 through step 3 for the second power supply ESM latch Lever Pull ring Figure 18 Removing an ESM Lever Pull ring Figure 19 Removing a power supply 38 IBM TotalStorage DS4000 EXP100 Storage Expansion Enclosure...

Page 65: ...ou remove a drive CRU wait 70 seconds before replacing or reseating the drive CRU to allow the drive to properly spin down Failure to do so may cause undesired events 1 Use Table 22 on page 118 to record the location and identify your SATA hard disk drives You must record this information to be able to replace the hard disk drives in their original order before they were removed 2 Release the latc...

Page 66: ...ou should be able to lift the unit into the cabinet with the help of one other person If you have not removed the CRUs before the installation you should have at least two other people available to help you lift the unit into the rack a Move the EXP100 to the front of the rack mount cabinet b With help from another person place the back of the expansion enclosure on the support rails Slide the uni...

Page 67: ...t of the unit see Figure 14 on page 33 Gently tighten the screws to secure the bezel and the front of the EXP100 to both of the front cabinet rails Attention Do not overtighten If you overtighten these screws you could break the bezel d From the back of the rack insert the two 6 32 in screws 5 in Figure 17 on page 36 one on each side in the holes on the side of the unit Tighten the screws 4 Contin...

Page 68: ...levers lock into place in the expansion enclosure chassis 3 Repeat step 1 and step 2 to replace the second ESM Replacing a power supply Complete the following steps to replace the power supplies that you removed before the installation 1 Slide one power supply into the expansion enclosure Be sure to replace the power supplies so that the lever on each power supply opens toward the interior of the ...

Page 69: ...llation 1 Place the fan in front of the fan bay 2 Ensure that you move the fan latch in the same direction as the arrow before you slide the fan all the way into the bay If the fan does not go into the bay rotate it 180 see Figure 25 3 If the latch does not automatically lock when you have successfully inserted the fan unit into the bay pull back slightly on the fan and then push it in again until...

Page 70: ...0 on a Fibre Channel loop and that assign physical addresses to the drives The enclosure ID switches are located on the back of the expansion enclosure as shown in Figure 26 Fibre Channel loop and ID settings When you install a hard disk drive in the expansion enclosure the drive tray plugs into a printed circuit board called the midplane The midplane sets the Fibre Channel loop ID automatically b...

Page 71: ...oop a unique ones x1 digit ID This setting will enforce hard AL_PAs unchangeable between Fibre Channel Loop Initializations LIPs for the drives and facilitate drive loop problem troubleshooting in the event of an error If the ID is not unique two or more devices will have the same hard AL_PA In such a case the controller will use soft AL_PAs for the devices that have identical hard AL_PAs Use the ...

Page 72: ...ome controllers might have restrictions on the maximum number of disk drives that can be supported on a loop cabling restrictions and other requirements v SFP module ports The EXP100 supports large complex and redundant disk drive loop configurations Each ESM has two SFP module ports Each SFP module has an input and output port A loop is created by connecting one or more EXP100 expansion enclosure...

Page 73: ...ave SFPs and GBICs are not supported for use in the drive ports of storage expansion enclosures Long wave SFPs and GBICs are only supported in the host ports of the DS4000 storage subsystem v The SFP module housing has an integral guide key that is designed to prevent you from inserting the SFP module improperly v Use minimal pressure when inserting an SFP module into an SFP port Forcing the SFP m...

Page 74: ...w directly with optical instruments and avoid direct exposure to the beam Attention When you handle static sensitive devices take precautions to avoid damage from static electricity For details about handling static sensitive devices see Handling static sensitive devices on page 30 1 Remove the SFP module from its static protective package 2 Remove the protective cap from the SFP module as shown i...

Page 75: ...rom the SFP module For more information see Handling fiber optic cables on page 50 2 Unlock the SFP module latch v For SFP modules that contain plastic tabs unlock the SFP module latch by pulling the plastic tab outward 10 as shown in Figure 30 v For SFP modules that contain wire tabs unlock the SFP module latch by pulling the wire latch outward 90 as shown in Figure 31 on page 50 Protective cap P...

Page 76: ...tracted v Route the cable away from places where it can be snagged by other devices in the rack v Do not overtighten the cable straps or bend the cables to a radius of less than 38 mm 1 5 in v Do not put excess weight on the cable at the connection point Be sure that the cable is well supported Using LC LC Fibre Channel cables The LC LC Fibre Channel cable is a fiber optic cable that you use to co...

Page 77: ...those specified herein might result in hazardous radiation exposure DANGER Some laser products contain an embedded Class 3A or Class 3B laser diode Note the following Laser radiation when open Do not stare into the beam do not view directly with optical instruments and avoid direct exposure to the beam 1 Read the information in Handling fiber optic cables on page 50 2 If necessary remove the prote...

Page 78: ...use 6 Connect this end of the LC LC cable to one of the following devices v An SFP module that is installed in a separate EXP100 v An SFP module that is installed in a DS4000 storage subsystem like a DS4300 or DS4500 Removing an LC LC Fibre Channel cable Complete the following steps to remove an LC LC Fibre Channel cable Protective cap Fibre optic cable Figure 33 Removing fiber optic cable protect...

Page 79: ... lever to release the latches as shown in Figure 35 Lever Latches 2 Carefully pull on the connector to remove the cable from the SFP module as shown in Figure 36 3 Replace the protective caps on the cable ends 4 Replace the protective cap on the SFP module Cabling the EXP100 to a DS4000 storage subsystem You can cable the EXP100 to any one of the following storage subsystems v DS4100 v DS4300 v DS...

Page 80: ...oling v The DS4500 supports two redundant drive loops with four drive mini hubs Because each drive mini hub supports only one drive loop you can use only one of the two ports in each of the DS4500 drive mini hubs Do not insert SFPs in the unused mini hub ports Complete the following steps to cable the EXP100 to a DS4000 storage subsystem 1 On the DS4000 storage subsystem install an SFP into a driv...

Page 81: ...e SFP module as shown in Figure 40 on page 56 Mini hub LC LC cable SFP module Drive mini hub ports DS4500 Figure 38 Connecting cables to the installed SFP on a DS4500 exp12039 DS4800 SFP module LC LC cable Dual ported drive channels Figure 39 Connecting cables to the installed SFP on a DS4800 Chapter 2 Installing the EXP100 55 ...

Page 82: ... path to your disk drives Figure 41 on page 57 shows a redundant loop that you might create with a DS4300 storage subsystem and four EXP100s The numbers provided in Figure 41 on page 57 show the order in which cables should be attached 1 Gb s 2 Gb s X10 X1 Tra y Number Co nf lic t EXP100 LC LC cable SPF module Figure 40 Installing an SFP module and connecting an LC LC cable to the EXP100 56 IBM To...

Page 83: ...dant drive loop 5 Make a Fibre Channel connection from the DS4000 drive port to the IN port in the right ESM of the Last expansion enclosure in the redundant drive loop IBM SATA disk drives are dual ported providing individual access from two Fibre Channel loops to the same disk drive When configuring the ESMs configure the second ESM the same way that you configured the first ESM Refer to the Fib...

Page 84: ...on end 2 Attach the power supply nut and tighten it securely 3 Connect the power cable to the power supply 4 Plug the supply power cable into a properly grounded electrical outlet For maximum protection against power loss connect each of the two power supplies to a different power source 5 Continue with Turning the EXP100 on and off for the initial startup of the expansion enclosure Turning the EX...

Page 85: ...f the system components however you should always follow the power up sequence listed in the Turning on the storage subsystem section of the appropriate DS4000 User s Guide during any attended power up procedure v A storage system in an optimal state should recover automatically from an unexpected shutdown and unattended simultaneous restoration of power to system components After power is restore...

Page 86: ...ower supply switches Turning off the EXP100 Use this procedure to turn off the power for the EXP100 Attention Except in an emergency never turn off the power if any Fault LEDs are lit on the EXP100 Correct the fault before you turn off the power using the proper troubleshooting or servicing procedure This ensures that the EXP100 will start correctly later Do not turn off the power for the EXP100 w...

Page 87: ... LEDs are off If any Fault LEDs light drives power supplies or fans correct the problem before you turn off the power Note Be sure to turn off the EXP100 after or at the same time as you turn off the DS4000 storage subsystem 4 Turn off both power supply switches on the back of the EXP100 Performing an emergency shutdown Attention Emergency situations might include fire flood extreme weather condit...

Page 88: ...ause the EXP100 power supply CRUs to intermittently appear as failed and then reappear in an optimal state falsely indicating that the power supply CRUs are bad c In addition consider the following items v The storage subsystem supports simultaneous power up of the system components however you should always follow the power up sequence listed in the Turning on the storage subsystem section of the...

Page 89: ... enclosures in warehouse depots and at resellers that were shipped before the R3 release In the event that your new EXP100s have different ESM firmware versions than the existing EXP100s you must make corrections to match the ESM firmware as soon as background firmware operations such as rebuilds and copybacks have completed Use the options described in Table 13 on page 88 for your particular upgr...

Page 90: ...ontrollers and EXP100 ESMs to the R1 level or upgrade the ESM firmware from the R1 to R3 or R2 level with the controller firmware versions that support the R3 or R2 EXP100 If this is the case contact IBM technical support your IBM reseller or your IBM representative Perform the following steps before you add a new EXP100 expansion enclosure to an existing EXP100 drive loop 1 Use the procedure desc...

Page 91: ...ved an EXP100 with R1 ESMs and your drive loop already contains EXP100s with R2 or R3 ESMs you cannot attach the new EXP100 because you cannot downgrade the R2 or R3 firmware in existing DS4000 controllers and EXP100 ESMs to the R1 level If this is the case contact IBM technical support your IBM reseller or your IBM representative v If you cannot perform the applicable ESM firmware upgrade procedu...

Page 92: ... drive loop After completing the steps in Determining firmware levels of the new and existing EXP100s on page 63 complete the steps in this section to add the new EXP100 to the existing drive loop Figure 42 on page 67 shows an example of a DS4500 configured with four drive loops Drive loops A and B form one redundant Fibre Channel loop Drive loops C and D form the second redundant Fibre Channel lo...

Page 93: ... 42 drive loop B Drive Loop A Drive Loop B Drive Loop D Drive Loop C Input Drive Loop A Fibre Channel interface cables Drive Loop C Fibre Channel interface cables Drive Loop B Fibre Channel interface cables Drive Loop D Fibre Channel interface cables Input Output Output First DS4000 drive enclosure Last DS4000 drive enclosure New DS4000 drive enclosure DS4500 Storage Subsystem ESMs First DS4000 dr...

Page 94: ...indow 8 Repeat step1 on page 67 to step 7 for each EXP100 expansion enclosure that you want to add Note Always add a new EXP100 to the end of a drive loop Always add new expansion enclosures to the existing drive loop one at a time while the DS4400 is running and in an optimal state If the ESM firmware in the new EXP100 does not match the ESM firmware in the EXP100s of the existing drive loop you ...

Page 95: ...xx xx directly without first upgrading to version 05 41 5x xx Note If the EXP100 ESM firmware version is 953x or earlier suspend all host server I O to the DS4000s that use EXP100 storage expansion enclosures while you perform EXP100 ESM firmware or SATA hard drive firmware upgrades Stop clustering services such as Microsoft MSCS if the cluster disks and quorum disks are defined using the disks th...

Page 96: ...l must correct the ESM firmware mismatch as described in the following steps Important Perform this ESM firmware upgrade during periods when you are not using the DS4000 Schedule downtime for the upgrade If you upgrade the ESM firmware with I Os drives might be randomly marked as Failed which will cause the RAID arrays to fail 1 In the Subsystem Management window select Advanced Download Environme...

Page 97: ...el firmware DS4300 and DS4500 only on page 107 to upgrade the EXP100 ESM firmware If you can not perform the upgrade immediately do not proceed with any additional configuration tasks using the new EXP100 expansion enclosure with EXP100 R2 or R3 ESM firmware Disconnect the new EXP100 expansion enclosure with EXP100 R2 ESM firmware from the existing EXP100 drive loop Schedule downtime to upgrade th...

Page 98: ...vironmental ESM card firmware 2 When the Download Environmental ESM card firmware window opens follow the online help to download the ESM firmware to the EXP expansion enclosure with the new ESM Note When you specify the file name of the firmware file to download you might need to select All Files in the Files of Type pull down menu to display the correct file name for the ESM firmware file If you...

Page 99: ...ew drive to find out the minimum controller and ESM firmware versions or any prerequisite tasks for DS4000 controller and EXP100 ESM v Drive CRUs The EXP100 supports IBM 1 5 Gbps SATA hard disk drives only Note Do not use Fibre Channel hard disk drive CRUs in the EXP100 Attention After you remove a drive CRU wait 70 seconds before replacing or reseating the drive CRU to allow the drive to properly...

Page 100: ... is required to install the new drive CRU FRU complete one of the following actions according to the state of your DS4000 storage subsystem 1 DS4000 storage subsystem in Optimal state Upgrade to the latest firmware version that is required to maintain this minimum level for your DS4000 storage subsystem To download the latest firmware go to the IBM DS4000 TotalStorage Support Web site and then cli...

Page 101: ...lit see Solving problems on page 99 3 Determine the bay into which you want to install the drive 4 Remove the blank tray a Release the latch on the drive CRU by pinching together the blue line on the tray latch and the finger hole on the tray handle as shown by the arrow in Figure 43 b Pull the handle on the tray out so that it is in the open position to release the drive CRU and then pull the bla...

Page 102: ...lems include any malfunctions that delay interrupt or prevent successful I O activity between the hosts and the hard disk drives in the expansion enclosure This includes transmission problems between the host controllers the ESMs and the drives This section explains how to replace a failed hard disk drive Note If you want to remove a hard disk drive that is not in a failed or bypass state always u...

Page 103: ...n its associated amber Fault LED is lit and not flashing 2 Remove the drive CRU a Release the latch on the drive CRU by pinching together the blue line on the tray latch and the finger hole on the tray handle as shown by the arrow in Figure 44 on page 76 b Pull the tray handle out into the open position c Lift the drive CRU partially out of the bay Attention After you remove a drive CRU wait 70 se...

Page 104: ...rocedure in Replacing all drives at the same time on page 79 This is the safest way to exchange drives without losing data However this method might take a long time to complete because of the backup reconfiguration and restoration processes In addition other users are not able to use the DS4000 storage subsystem or any expansion enclosures attached to the storage subsystem until you finish the pr...

Page 105: ...drive CRU wait at least 70 seconds before replacing or reseating the drive CRU to allow the drive to properly spin down Failure to do so may cause undesired events v Before you insert the new SATA drive option or drive CRU FRU into the DS4000 configuration you must ensure that the installed DS4000 controller and EXP100 ESM have the minimum controller and ESM firmware versions that are required for...

Page 106: ...ct both power cords Use the procedure in step 7 for the proper shutdown sequence 7 Turn off the power to each device based on the following shutdown sequence a Turn off power to the host before you turn off power to the DS4000 storage subsystem If the host must stay powered on to support an existing network see the operating system documentation for information about disconnecting the DS4000 stora...

Page 107: ...place all the drives one at a time You cannot use this procedure on RAID 0 logical drives use the procedure in Replacing all drives at the same time on page 79 Note If your storage subsystem has hot spares assigned you might want to unassign the hot spares while you perform this procedure If you do not reconstruction might start on the hot spare before you insert the new drive The data on the new ...

Page 108: ...ou want to replace If the array is in degraded state use the recovery procedures to bring the array into the optimal state Make sure that v You fail only one drive v The software status display shows a failed status for the appropriate drive v The amber Drive fault LED on the front bezel below the drive is on Attention Removing the wrong drive can cause data loss Make sure that you remove only the...

Page 109: ... that drive for example from a logical drive Media Scan operation In that case use the host software to determine if the data reconstruction is finished 10 When reconstruction is finished on the new drive repeat step 6 on page 82 through step 9 for each additional drive that you want to install 11 Use the DS4000 Storage Manager software to configure the additional space on the new drives Working w...

Page 110: ...ply Replacing the failed hot swap power supply This section describes the procedure for replacing the failed hot swap power supply Note Before you replace the failed power supply ensure that the new power supply lever is attached to the side of the power supply that faces the middle of the expansion enclosure If it is not remove the lever screw flip the lever over and tighten the screw on the oppo...

Page 111: ...n enclosure see Figure 45 on page 84 b Close the lever until the pull ring latch locks in place Make sure that the lever locks into place in the expansion enclosure chassis 3 Wrap the strain relief clamp around the power cable approximately 20 cm 8 in from the power supply connection end 4 Attach the power supply nut and tighten it securely 5 Connect the power cable to the power supply ac connecto...

Page 112: ...ESM CRU is v Not compatible with the firmware version of the existing ESM module in the DS4000 EXP100 expansion enclosure do not open the ESM CRU box You cannot replace an ESM CRU with firmware that is incompatible with the firmware of the existing ESM module in the DS4000 EXP100 expansion enclosure Contact IBM technical support your IBM reseller or your IBM representative for an EXP100 CRU that i...

Page 113: ...r particular upgrade procedure In certain cases you must schedule down time for the upgrade because there can be no I O activity including background firmware operations to the storage subsystem at the time of the upgrade See EXP100 ESM CRU types firmware and release levels explained on page 6 for more information about the different firmware release levels Also see Determining firmware levels on ...

Page 114: ...irmware upgrade during periods when you are not using the DS4000 storage subsystem Schedule downtime for the upgrade If you upgrade the ESM firmware with I O activity to the storage subsystem including background firmware operations drives might be randomly marked as Failed causing the RAID arrays to fail Note ESM firmware mismatch conditions must be corrected as soon as soon as background firmwar...

Page 115: ...h controller and ESM firmware to the latest R3 level that is posted in the IBM TotalStorage Support Web site to ensure drive and ESM compatibility in the future Use the following procedure to correct the ESM firmware mismatch Important Even though the EXP100 R2 firmware supports concurrent ESM firmware download it is recommended that you download the ESM firmware during a period of low DS4000 stor...

Page 116: ...e window opens follow the online help to download the ESM firmware to the EXP100 enclosure with the new ESM Note When you specify the file name of the firmware file to download you might need to select All Files in the Files of type pull down menu to display the correct file name for the ESM firmware file If you do then a warning window opens Click OK when the warning window opens to continue 3 Wh...

Page 117: ...y All other background firmware operations such as hot spare rebuilds or copybacks must be completed before upgrading the firmware Note ESM firmware mismatch conditions must be corrected as soon as soon as background firmware operations such as rebuilds and copybacks have completed 1 In the Subsystem Management window select Advanced Download Environmental ESM card firmware 2 When the Download Env...

Page 118: ... the firmware file to download you might need to select All Files in the Files of type pull down menu to display the correct file name for the ESM firmware file If you do then a warning window opens Click OK when the warning window opens to continue 3 When the ESM firmware download completes verify that the ESM firmware mismatch error in the Subsystem Management window has been corrected Complete ...

Page 119: ... ESM in the EXP100 expansion enclosure If the firmware versions are not compatible DO NOT proceed further Contact IBM technical support your IBM resellers or IBM representatives for the EXP100 CRU that is compatible with the ESM firmware of the existing ESM module If the firmware versions are compatible continue with step 13 on page 94 Important Do not mix EXP100 R1 ESMs and EXP100 R2 ESMs in the ...

Page 120: ...utput bypass LEDs are lit reconnect the cables and SFP modules 18 Use the DS4000 Storage Manager 9 Client to open a Subsystem Management window to the DS4000 on which the EXP100 ESM was replaced Click on the Recovery Guru or the Environment Status icon of the expansion enclosure on which you replaced the ESM If there is an ESM firmware mismatch proceed to step 19 If there is no ESM firmware mismat...

Page 121: ...e array to be placed in a degraded state The cause could be either an ESM firmware version mismatch or a drive failure Verify that there are no ESM firmware version incompatibilities If the ESM firmware versions are compatible right click the failed drive and select Reconstruct If the drive reconstruction is successful and the drive becomes optimal the drive is OK If the drive is bad it will fail ...

Page 122: ...e this code level contains quality enhancements and Full High Availability EXP100 function CAUTION If you plan to upgrade the ESM firmware to the R3 version you must upgrade the ESM to the intermediate ESM firmware version 9554 first before upgrading to the R3 ESM version 956x or later 9554 R2 ESM or 956x and later R3 ESM 953A or earlier R1 ESM You cannot upgrade the ESM firmware version Contact I...

Page 123: ...er air circulation across the components inside the expansion enclosure Air flows through the expansion enclosure from the front to the back You can hot swap the fans provided that you complete the exchange within 10 minutes This time limit applies only to the total time that a fan is out of the expansion enclosure beginning when you remove the failed unit and ending when you reseat the new one Th...

Page 124: ... lock when you have successfully inserted the fan unit into the bay pull back on the fan slightly and then push it in again until the latch snaps into place 4 Check the LEDs 5 The Fault LEDs are no longer lit after a few seconds if they remain on see Solving problems on page 99 2 Gb s X10 X1 Tray Num ber Con flict 1 Gb s Figure 48 Replacing a hot swap cooling fan 98 IBM TotalStorage DS4000 EXP100 ...

Page 125: ...diagnostics and test information the symptom to FRU index and the connected server HMM to diagnose problems The PD maps found in the IBM TotalStorage DS4000 Problem Determination Guide provide you with additional diagnostic aids Solving problems This section contains information to help you solve some of the problems you might have with your expansion enclosure Table 16 on page 100 contains the pr...

Page 126: ...LEDs on CRUs Fibre Channel connection failure Check that the CRUs are properly installed If none of the amber LEDs are lit on any of the CRUs this indicates an SFP module transmission fault in the expansion enclosure Replace the failed SFP module See your storage manager software documentation for more information ESM ID conflict This expansion enclosure has the same ID as one of the other expansi...

Page 127: ... event logs to isolate the faulty component One or more green LEDs are off Power supply CRUs Power cable is unplugged or switches are turned off Make sure that the power cable is plugged in and that the switches are turned on All drive CRUs Midplane failure Replace the midplane Contact an IBM technical support representative Several CRUs Hardware failure Replace the affected CRUs If this does not ...

Page 128: ...ly when your expansion enclosure is powered off ESM failure Replace one or both ESMs Contact an IBM technical support representative Drive or drives failed Replace failed drive or drives Random errors Subsystem Midplane failure Have the midplane replaced Contact an IBM technical support representative Hard disk drive not visible in RAID management software Several CRUs Drive or drives failed Repla...

Page 129: ...ded that you update the ESM firmware during a period of low DS4000 utilization v 953A or earlier You must schedule down time for the ESM firmware upgrade to 9554 and stop all I Os If there are any I Os during the ESM firmware upgrade drives might randomly be marked failed v The existing ESM is at 9554 or later and the new ESM is 953A or earlier You cannot upgrade the ESM firmware version Contact I...

Page 130: ...y FRU 400 W 19K1289 4 SATA ESM R1 firmware 953A or earlier 24P8814 4 SATA ESM R2 firmware 9554 25R0156 4 SATA ESM R3 firmware 956x or later 39M6004 5 SATA Frame Midplane 24P8815 5 SATA Frame Midplane 1724 model 1Xx only 25R0342 6 bezel ASM FRU 24P8812 SATA tray blank 90P1348 3 8 2 4 1 7 6 5 Figure 49 EXP100 storage expansion enclosure parts list 104 IBM TotalStorage DS4000 EXP100 Storage Expansion...

Page 131: ... miscellaneous hardware kit 24P8813 cable FRU 1M 19K1265 cable FRU 5M 19K1266 cable FRU 25M 19K1267 FRU SFP LC shortwave 19K1280 power cord 2 8M 6952300 power cord jumper 36L8886 Note The drive CRU with P N 40K6837 is a replacement of the drive CRU P N 90P139 These two CRUs are functionally equivalent However the 40K6837 requires the minimum controller and EXP00 ESM firmware as stated in Table 5 o...

Page 132: ...106 IBM TotalStorage DS4000 EXP100 Storage Expansion Enclosure Installation User s and Maintenance Guide ...

Page 133: ...availability support each ESM in the EXP100 expansion enclosure manages only half of the drives in the expansion enclosure The ESM on the left side manages drives at odd numbered slots 1 3 5 7 9 11 13 and the ESM on the right side manages drives at even numbered slots 2 4 6 8 10 12 14 As a result half of the EXP100 drives could become inaccessible to the controllers if an ESM fails You can avoid t...

Page 134: ...you begin the upgrade ensure that the firmware levels listed in Table 19 are currently installed Table 19 Required current firmware levels Model Firmware NVSRAM versions DS4300 Firmware SNAP_05411xxx dlp NVSRAM N1722F600R841V03 dlp DS4500 Firmware FW_05411xxx_yyyyyyyy dlp NVSRAM N1742F900R841V05 dlp EXP100 expansion enclosure ESM firmware 9534 or earlier If you do not have the most current levels ...

Page 135: ... download This can cause the array or arrays to be degraded or failed Use one of the following methods to stop I O from the host server or servers to the logical drives The methods are listed in order from the most desirable to the least desirable option Note If you are using in band management to manage the DS4000 storage subsystem you cannot use method 1 or method 2 1 Shut down all host servers ...

Page 136: ...inutes then check the Performance Monitor window In the Total I O column you should see values of 0 or values less than 10 If there is any I O go back to Stop I O and choose a different method of stopping I O Save the storage subsystem profile Saving a profile is necessary to restore a storage subsystem configuration in the event of a catastrophic failure Save your storage subsystem profile by com...

Page 137: ... Subsystem Management window You could lose data access or data Before you begin To find out the latest versions of the ESM firmware and csb file that you need to download see the IBM EXP100 R1 to R2 ESM firmware upgrade readme file Downloading the ESM firmware Complete the following steps to download the ESM firmware to the EXP100 1 In the Subsystem Management window select Advanced Download Envi...

Page 138: ...ad begins During the download the status field of the Download Environmental ESM Card Firmware window displays the progress of each expansion enclosure When the status field of each expansion enclosure displays Complete the csb file download is complete Click Cancel to close the Download Environmental ESM Card Firmware window and continue to Downloading the controller firmware and NVSRAM Downloadi...

Page 139: ...municate with the controller to verify the download Follow the error recovery procedure that is shown in the Error window If the problem persists contact IBM support During the EXP100 csb or ESM firmware download you see an error window stating that the download to an expansion enclosure failed This expansion enclosure is marked with the word Failed in its status field If there are other expansion...

Page 140: ... in Failed state or drive slots with inserted drives will show as empty slots in the Physical view of the Subsystem Management window Please contact IBM support for instructions to revive the failed array s 114 IBM TotalStorage DS4000 EXP100 Storage Expansion Enclosure Installation User s and Maintenance Guide ...

Page 141: ... Record and retain the following information Product name IBM TotalStorage DS4000 EXP100 Storage Expansion Enclosure Machine type 1710 Model number 10U 10X Serial number OR Product name IBM TotalStorage DS4000 EXP100 Storage Expansion Enclosure Machine type 1724 Model number 1Xx where x is an alphanumeric character Serial number The serial number is located on the bottom inside surface at the rear...

Page 142: ...Domain Name System DNS table The information is also helpful if you add storage subsystems after initial installation Refer to your Storage Manager documentation for detailed instructions about how to obtain the information For a sample information record see Table 21 on page 117 Table 20 Storage subsystem and controller information record Storage subsystem name Management method Controllers Ether...

Page 143: ...ation record Storage subsystem name Management method Controllers Ethernet and IP addresses and host name Host IP address and host name Controller A Controller B Finance Direct Hardware Ethernet address 00a0b8020420 Hardware Ethernet address 00a0b80000d8 IP address 192 168 128 101 IP address 192 168 128 102 Host Denver_a Host Denver_b Engineering Host agent IP address 192 168 2 22 Host Atlanta App...

Page 144: ...nding bay number Attention If you replace a hard disk drive in the wrong drive bay it might cause a loss of data Table 22 Hard disk drive record Bay Number Hard disk drive serial number Replaced hard disk drive serial number 118 IBM TotalStorage DS4000 EXP100 Storage Expansion Enclosure Installation User s and Maintenance Guide ...

Page 145: ...nd Figure 51 on page 121 to identify the proper locations for inserting M6 screws when mounting the support rails and EXP100 to a rack The locations for the M6 screws are highlighted in the templates The EXP100 is 3 U high Align the template with the rack at a U boundary U boundaries are shown as horizontal dashed lines in the rack mounting templates Note The mounting holes that are shown in the f...

Page 146: ...2 U 1 U 1 U 0 U 0 U Rail assembly Front Left Bezel Front Left Bezel Front Right Rail assembly Front Right Figure 50 Front rack mounting template 120 IBM TotalStorage DS4000 EXP100 Storage Expansion Enclosure Installation User s and Maintenance Guide ...

Page 147: ...U 3U 2U 2U 1U 1U 0U 0U Rail assembly Rear Left Rail assembly Rear right Printed in the U S A EXP100 REAR Rack Mounting Template Figure 51 Rear rack mounting template Appendix C Rack mounting template 121 ...

Page 148: ...122 IBM TotalStorage DS4000 EXP100 Storage Expansion Enclosure Installation User s and Maintenance Guide ...

Page 149: ...in which the equipment will be installed IBM power cords for a specific country or region are usually available only in that country or region IBM power cord part number Used in these countries or regions 13F9940 Argentina Australia China PRC New Zealand Papua New Guinea Paraguay Uruguay Western Samoa 13F9979 Afghanistan Algeria Andorra Angola Austria Belgium Benin Bulgaria Burkina Faso Burundi Ca...

Page 150: ...ominican Republic Ecuador El Salvador Guatemala Guyana Haiti Honduras Jamaica Japan Korea South Liberia Mexico Netherlands Antilles Nicaragua Panama Peru Philippines Saudi Arabia Suriname Taiwan Trinidad West Indies United States of America Venezuela 124 IBM TotalStorage DS4000 EXP100 Storage Expansion Enclosure Installation User s and Maintenance Guide ...

Page 151: ...r Version 9 library with its related common user tasks Table 23 TotalStorage DS4000 Storage Manager Version 9 1 titles by user tasks Title User tasks Planning Hardware installation Software installation Configuration Operation and administration Diagnosis and maintenance IBM TotalStorage DS4000 Storage Manager Version 9 Installation and Support Guide for Windows 2000 Server 2003 NetWare ESX Server...

Page 152: ...ng Hardware Installation Software Installation Configuration Operation and Administration Diagnosis and Maintenance IBM TotalStorage DS4500 Installation and Support Guide GC26 7727 U U U IBM TotalStorage DS4500 Fibre Channel Cabling Instructions GC26 7729 U U IBM TotalStorage DS4500 Storage Server User s Guide GC26 7726 U U U IBM TotalStorage DS4500 Rack Mounting Instructions GC26 7728 U U 126 IBM...

Page 153: ...er document titles by user tasks Title User Tasks Planning Hardware Installation Software Installation Configuration Operation and Administration Diagnosis and Maintenance IBM DS4400 Fibre Channel Storage Server User s Guide GC26 7730 U U U U U IBM DS4400 Fibre Channel Storage Server Installation and Support Guide GC26 7731 U U U U IBM DS4400 Fibre Channel Cabling Instructions GC26 7732 U U Append...

Page 154: ...Administration Diagnosis and Maintenance IBM TotalStorage DS4300 Fibre Channel Storage Server Installation and User s Guide GC26 7722 U U U IBM TotalStorage DS4300 Rack Mounting Instructions GC26 7724 U U IBM TotalStorage DS4300 Fibre Channel Cabling Instructions GC26 7725 U U IBM TotalStorage DS4300 SCU Base Upgrade Kit GC26 7740 U U IBM TotalStorage DS4300 SCU Turbo Upgrade Kit GC26 7741 U U IBM...

Page 155: ...torage DS4100 SATA Storage Server document titles by user tasks Title User Tasks Planning Hardware Installation Software Installation Configuration Operation and Administration Diagnosis and Maintenance IBM TotalStorage DS4100 Installation User s and Maintenance Guide GC26 7733 U U U U U IBM TotalStorage DS4100 Cabling Guide 24P8973 U Appendix E Additional DS4000 documentation 129 ...

Page 156: ... user tasks Title User Tasks Planning Hardware Installation Software Installation Configuration Operation and Administration Diagnosis and Maintenance IBM TotalStorage DS4800 Installation User s and Maintenance Guide GC26 7748 U U U U U IBM TotalStorage DS4800 Installation and Cabling Overview 22R4738 U 130 IBM TotalStorage DS4000 EXP100 Storage Expansion Enclosure Installation User s and Maintena...

Page 157: ...000 Hardware Maintenance Manual GC26 7702 U IBM TotalStorage DS4000 Problem Determination Guide GC26 7703 U IBM Fibre Channel Planning and Integration User s Guide and Service Information SC23 4329 U U U U IBM TotalStorage DS4000 FC2 133 Host Bus Adapter Installation and User s Guide GC26 7736 U U IBM TotalStorage DS4000 FC2 133 Dual Port Host Bus Adapter Installation and User s Guide GC26 7737 U ...

Page 158: ...pansion Enclosures Installation User s and Maintenance Guide GC26 7735 U U U U U IBM TotalStorage DS4000 Hard Drive and Storage Expansion Enclosures Installation and Migration Guide GC26 7704 U U IBM DS4000 Management Suite Java User s Guide 32P0081 U U IBM Netfinity Fibre Channel Cabling Instructions 19K0906 U IBM Fibre Channel SAN Configuration Setup Guide 25P2509 U U U U 132 IBM TotalStorage DS...

Page 159: ...The Directive determines the framework for the return and recycling of used appliances as applicable throughout the European Union This label is applied to various products to indicate that the product is not to be thrown away but rather reclaimed upon end of life per this Directive In accordance with the European WEEE Directive electrical and electronic equipment EEE is to be collected separately...

Page 160: ...134 IBM TotalStorage DS4000 EXP100 Storage Expansion Enclosure Installation User s and Maintenance Guide ...

Page 161: ... go to http www ibm com ibm environment products batteryrecycle shtml or contact your local waste disposal facility In the United States IBM has established a return process for reuse recycling or proper disposal of used IBM sealed lead acid nickel cadmium nickel metal hydride and other battery packs from IBM Equipment For information on proper disposal of these batteries contact IBM at 1 800 426 ...

Page 162: ...136 IBM TotalStorage DS4000 EXP100 Storage Expansion Enclosure Installation User s and Maintenance Guide ...

Page 163: ...is product or cords associated with accessories sold with this product will expose you to lead a chemical known to the State of California to cause cancer and birth defects or other reproductive harm Wash hands after handling Copyright IBM Corp 2004 2005 137 ...

Page 164: ...138 IBM TotalStorage DS4000 EXP100 Storage Expansion Enclosure Installation User s and Maintenance Guide ...

Page 165: ...host software components Table 30 defines the keyboard operations that enable you to navigate select or activate user interface components The following terms are used in the table v Navigate means to move the input focus from one user interface component to another v Select means to choose one or more components typically for a subsequent action v Activate means to carry out the action of a parti...

Page 166: ...o select press Ctrl Spacebar to select the drive If you press Spacebar alone when multiple drives are selected then all selections are removed Use the Ctrl Spacebar combination to deselect a drive when multiple drives are selected This behavior is the same for contiguous and non contiguous selection of drives End Page Down Move keyboard focus to the last item in the list Esc Close the current dial...

Page 167: ... KIND EITHER EXPRESS OR IMPLIED INCLUDING BUT NOT LIMITED TO THE IMPLIED WARRANTIES OF NON INFRINGEMENT MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE Some jurisdictions do not allow disclaimer of express or implied warranties in certain transactions therefore this statement may not apply to you This information could include technical inaccuracies or typographical errors Changes are periodic...

Page 168: ...ximum memory may require replacement of the standard memory with an optional memory module IBM makes no representation or warranties regarding non IBM products and services that are ServerProven including but not limited to the implied warranties of merchantability and fitness for a particular purpose These products are offered and warranted solely by third parties IBM makes no representations or ...

Page 169: ... radio interference in which case the user might be required to take adequate measures Industry Canada Class A emission compliance statement This Class A digital apparatus complies with Canadian ICES 003 Avis de conformité à la réglementation d Industrie Canada Cet appareil numérique de la classe A est conforme à la norme NMB 003 du Canada Australia and New Zealand Class A statement Attention This...

Page 170: ...de reasonable protection against interference with licensed communication equipment Attention This is a Class A product In a domestic environment this product may cause radio interference in which case the user may be required to take adequate measures Taiwan Class A warning statement Japanese Voluntary Control Council for Interference VCCI statement 144 IBM TotalStorage DS4000 EXP100 Storage Expa...

Page 171: ...andard for IBM compatibles It extends the XT bus architecture to 16 bits and also allows for bus mastering although only the first 16 MB of main memory are available for direct access agent A server program that receives virtual connections from the network manager the client program in a Simple Network Management Protocol Transmission Control Protocol Internet Protocol SNMP TCP IP network managin...

Page 172: ...omer replaceable unit CRU An assembly or part that a customer can replace in its entirety when any of its components fail Contrast with field replaceable unit FRU cyclic redundancy check CRC 1 A redundancy check in which the check key is generated by a cyclic algorithm 2 An error detection technique performed at both the sending and receiving stations dac See disk array controller dar See disk arr...

Page 173: ...hed to it The fabric is responsible for routing frames between source and destination N_ports using address information in the frame header A fabric can be as simple as a point to point channel between two N ports or as complex as a frame routing switch that provides multiple and redundant internal pathways within the fabric between F_ports fabric port F_port In a fabric an access point for connec...

Page 174: ... partition topology that defines a logical collection of host computers that require shared access to one or more logical drives host port Ports that physically reside on the host adapters and are automatically discovered by the DS4000 Storage Manager software To give a host computer access to a partition its associated host ports must be defined hot swap To replace a hardware component without tu...

Page 175: ...SI bus to distinguish among up to eight devices logical units with the same SCSI ID loop address The unique ID of a node in fibre channel loop topology sometimes referred to as a loop ID loop group A collection of storage area network SAN devices that are interconnected serially in a single loop circuit loop port A node port N_port or fabric port F_port that supports arbitrated loop functions asso...

Page 176: ...of configuring a drive into the kernel ODM See Object Data Manager out of band Transmission of management protocols outside of the fibre channel network typically over Ethernet partitioning See storage partition parity check 1 A test to determine whether the number of ones or zeros in an array of binary digits is odd or even 2 A mathematical operation on the numerical representation of the informa...

Page 177: ...ring See also Global Mirroring Metro Mirroring ROM See read only memory router A computer that determines the path of network traffic flow The path selection is made from several paths based on information obtained from specific protocols algorithms that attempt to identify the shortest or best path and other criteria such as metrics or protocol specific destination addresses RVSD See recoverable ...

Page 178: ...storage products networking products software and services See also fabric Storage Array Identifier SAI or SA Identifier The Storage Array Identifier is the identification value used by the DS4000 Storage Manager host software SMClient to uniquely identify each managed storage server The DS4000 Storage Manager SMClient program maintains Storage Array Identifier records of previously discovered sto...

Page 179: ...eer connectivity functions for both local and wide area networks trap In the Simple Network Management Protocol SNMP a message sent by a managed node agent function to a management station to report an exception condition trap recipient Receiver of a forwarded Simple Network Management Protocol SNMP trap Specifically a trap receiver is defined by an Internet Protocol IP address and port to which t...

Page 180: ...154 IBM TotalStorage DS4000 EXP100 Storage Expansion Enclosure Installation User s and Maintenance Guide ...

Page 181: ...ve 39 removing a power supply 37 38 removing an ESM 37 removing hard disk drives 37 replacing 41 D data sheet 116 devices installing and replacing 63 document organization xviii documentation DS4000 125 DS4000 Storage Manager 125 DS4000 related documents 131 DS4100 SATA Storage Server 129 DS4300 Fibre Channel Storage Server 128 DS4400 Fibre Channel Storage Server 127 DS4500 Fibre Channel Storage S...

Page 182: ...tem 60 80 expansion enclosure speed setting 45 F fan controls and indicators 18 fan CRU bay 16 Fault LED 19 fan CRU continued latch 16 latch and handle 19 fan removal 39 fan unit replacing 43 FAStT DS4000 product renaming xvii Fault LED ESM 20 Fault LED hard disk drive 17 Fault LED power supply 18 FCC Class A notice 142 fiber optic cable handling 50 Fibre Channel loop 46 adding the EXP100 66 Fibre...

Page 183: ... green ESM power 20 green power 18 green power on 17 limited high availability 108 loop redundancy 46 loop redundancy described 56 M Migration Guide 125 multiple drives replacing 78 N notes important 142 notices electronic emission 142 FCC Class A 142 safety and caution xi Notices trademarks 141 NVSRAM downloading 112 O operating environment 21 over temperature LED 20 overview of the product 1 P p...

Page 184: ... description 20 important information about 47 location 20 port location DS4500 55 port location EXP100 55 protective cap 48 removal 49 removing an LC LC cable 52 static protective package 48 software service and support xxiii specifications 22 acoustical noise emission values 22 electrical input 22 environment 22 heat dissipation 22 size 22 weight 22 speed settings setting the 21 45 startup seque...

Page 185: ...information in this book is Very Satisfied Satisfied Neutral Dissatisfied Very Dissatisfied Accurate h h h h h Complete h h h h h Easy to find h h h h h Easy to understand h h h h h Well organized h h h h h Applicable to your tasks h h h h h Please tell us how we can improve this book Thank you for your responses May we contact you h Yes h No When you send comments to IBM you grant IBM a nonexclus...

Page 186: ...opment Department GZW 9000 South Rita Road Tucson Arizona U S A 85744 0001 _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _...

Page 187: ......

Page 188: ... Part Number 39M5947 Printed in USA GC26 7694 01 1P P N 39M5947 ...

Reviews: