Overland Storage SnapSAN S3000, User Manual

Page 1: ...Overland Storage SnapSAN Path Manager Linux User Guide S3000 S5000 April 2013 10400424 002 ...

Page 2: ...l PROPRIETARY NOTICE All information contained in or disclosed by this document is considered proprietary by Overland Storage By accepting this material the recipient agrees that this material and the information contained therein are held in confidence and in trust and will not be used reproduced in whole or in part nor its contents revealed to others except to meet the purpose for which it was d...

Page 3: ...nd network administration terminology and tasks It also assumes you have basic knowledge of Internet SCSI iSCSI Serial attached SCSI SAS Serial ATA SATA Storage Area Network SAN and Redundant Array of Independent Disks RAID technology Product Documentation and Firmware Updates Overland Storage SnapSAN product documentation and additional literature are available online along with the latest releas...

Page 4: ...r key NOTE A Note indicates neutral or positive information that emphasizes or supplements important points of the main text A note supplies information that may apply only in special cases for example memory limitations or details that apply to specific program versions IMPORTANT An Important note is a type of note that provides information essential to the completion of a task or that can impact...

Page 5: ... Cluster Configuration 1 4 Chapter 2 Installation Setup 2 1 Prepare to Install 2 6 Installing PathManager RPM Package 2 7 Installation by Installer 2 7 Manual Installation 2 8 Shifting to a PathManager Environment 2 14 Starting Operation 2 15 Checking the Condition 2 15 RHEL6 2 15 RHEL4 RHEL5 SLES10 2 16 PathManager Uninstallation 2 18 Shifting to a Non PathManager Environment 2 18 Uninstalling Pa...

Page 6: ...ion 3 27 Path Patrol Daemon 3 32 Basic Operation of the Path Patrol Daemon 3 32 Script for Operating the Path Control Daemon 3 32 Arguments of the Path Patrol Daemon Operation Script 3 32 Enable Disable Setting of Path Monitoring 3 33 Messages 3 33 Device Files 3 33 Naming Rules 3 34 Available Maximum number of LUN 3 34 Maximum number of LUN 3 34 Intermittent Error Monitoring Function 3 34 Getting...

Page 7: ...rvers Application Servers X 1 0 to 3 0 SE Ver3 1 D 1 Updating Server1 Server2 D 2 Appendix E LVM Setup Adding Removing PathManager Devices E 1 Adding PathManager Devices to LVM E 1 Removing PathManager Devices from LVM E 4 Appendix F kdump Setup How to Set up kdump F 1 Red Hat Enterprise Linux 5 6 F 1 Setting up kdump with a PathManager Device F 1 Resetting the kdump setting F 2 SUSE Linux Enterpr...

Page 8: ...r or physical path such as a fibre channel cable or switch between a server and a disk array unit system operation cannot be continued only with the redundancy of spindles This is because there is no problem with data in the disk array units but the data cannot be accessed Any disk array unit that is proud of its strong position is helpless against a path fault Handling of Path Faults PathManager ...

Page 9: ...PathManager shall be executed with these commands Path patrol daemon dd_daemon Path patrol daemon automatically monitors the status of each path It issues a monitoring request to each path at the specified intervals Multi Path System Each disk array is recognized as a device file named dev ddX X indicates a unit name a b c by the OS If an unrecoverable fault occurs on the multi path in the HBA NIC...

Page 10: ...ocessing The alternate path is the path to be switched and used as the active path when a fault occurs on the active path System Configuration Examples of basic configurations of systems on which PathManager is installed are shown below Single Server Configuration In this system configuration a server is directly connected to a server This configuration is most typical in comparatively small syste...

Page 11: ... used in a system in which multiple servers for different operations share a comparatively large Overland Exclusive control must be exercised over the logical units used by each server using AccessControl or another component Figure 1 3 Multi Server Configuration Cluster Configuration An example of a cluster system configuration is shown below An FC switch is installed between each server and a Sn...

Page 12: ...10400424 002 04 2013 2013 Overland Storage Inc 1 5 SnapSAN S3000 S5000 Path Manager Linux User Guide Figure 1 4 Cluster Configuration ...

Page 13: ... array unit is redundant 5 In the case you use LVM Logical Volume Manager the distribution and kernel version must be one of shown below Red Hat Enterprise Linux AS ES 4 Kernel 2 6 9 42 EL IA32 EM64T or later Red Hat Enterprise Linux 5 Kernel 2 6 18 53 el5 IA32 EM64T or later Red Hat Enterprise Linux 5 Advanced Platform Kernel 2 6 18 53 el5 IA32 EM64T or later Red Hat Enterprise Linux 6 Kernel 2 6...

Page 14: ...2 6 18 194 el5 IA32 EM64T or later Red Hat Enterprise Linux 6 kernel 2 6 32 131 0 15 el6 IA32 EM64T or later 8 In the case you use SAS connections and FC iSCSI connections concurrently the function version of PathManager must be 5 0 5 or later And the distribution and kernel version must be one of shown below Red Hat Enterprise Linux 5 kernel 2 6 18 274 el5 IA32 EM64T or later Red Hat Enterprise L...

Page 15: ...river E 5 1 6 2 6 32 220 4 2 el6 i686 rpm sps utils 5 1 4 0 el6 i686 rpm EM64T sps driver E 5 1 6 2 6 32 220 4 2 el6 x86_64 rpm sps utils 5 1 4 0 el6 x86_64 rpm SLES10 SP2 SP3 IA32 sps driver E 5 0 3 2 6 16 60 0 57 1 i586 rpm sps kdump E 5 0 3 2 6 16 60 0 57 1 i586 rpm sps utils 5 0 2 0 sles10 i586 rpm EM64T sps driver E 5 0 3 2 6 16 60 0 57 1 x86_64 rpm sps kdump E 5 0 3 2 6 16 60 0 57 1 x86_64 r...

Page 16: ...ater Red Hat Enterprise Linux 6 1 kernel 2 6 32 131 0 15 el6 or later SUSE Linux Enterprise Server SP3 kernel 2 6 16 60 0 54 5 or later Linux RPMS RHEL5 5 3 EM64T sps driver E 4 2 4 2 6 18 128 el5 x86_64 rpm sps mcopt 1 1 0 0 x86_64 rpm 3 sps utils 4 2 2 1 x86_64 rpm 5 6 EM64T sps driver E 5 0 3 2 6 18 238 9 1 el5 x86_64 rpm sps mcopt 1 1 1 0 el5 x86_64 rpm 3 sps utils 5 0 2 1 el5 x86_64 rpm RHEL6...

Page 17: ...iver E 5 1 6 2 6 32 220 4 2 el6 i686 rpm sps utils 5 1 4 0 el6 i686 rpm EM64T sps driver E 5 1 6 2 6 32 220 4 2 el6 x86_64 rpm sps utils 5 1 4 0 el6 x86_64 rpm SLES10 SP2 SP3 IA32 sps driver E 5 0 3 2 6 16 60 0 57 1 i586 rpm sps kdump E 5 0 3 2 6 16 60 0 57 1 i586 rpm sps utils 5 0 2 0 sles10 i586 rpm EM64T sps driver E 5 0 3 2 6 16 60 0 57 1 x86_64 rpm sps kdump E 5 0 3 2 6 16 60 0 57 1 x86_64 rp...

Page 18: ...l 2 6 16 60 0 54 5 or later Prepare to Install Start the OS with the kernel on which you use PathManager and login as root Mount the installation CD as the root authority If the CD is not mounted automatically mount manually as follows Linux RPMS RHEL5 5 3 EM64T sps driver E 4 2 4 2 6 18 128 el5 x86_64 rpm sps mcopt 1 1 0 0 x86_64 rpm 3 sps utils 4 2 2 1 x86_64 rpm 5 6 EM64T sps driver E 5 0 3 2 6...

Page 19: ...RPM Package The PathManager installation procedures depend on the system configuration OS distribution kernel Installation by Installer a Go to the directory mounted to the PathManager Installation CD If the CD is mounted automatically go to the corresponding directory OS Distribution Kernel Version Red Hat Enterprise Linux AS 4 Red Hat Enterprise Linux ES 4 all Red Hat Enterprise Linux 5 Red Hat ...

Page 20: ...SI and you want to reboot automatically specify the both options silent and iscsi If the kernel version is 2 6 18 164 el5 and the system uses FC connection c If the installation is finished normally the message sps Install Completed the shadowed part in above will be displayed If this message is not displayed that installation is failed d If the installation is finished normally the system restart...

Page 21: ... 131 0 15 el6 2 RHEL 5 3 2 6 18 128 el5 or later SLES10 SP2 kernel 2 6 16 60 0 21 or later Execute the following command to install the RPM files corresponding to the kernel version you use Shaded part shows the corresponding kernel Even if the displayed kernel version includes PAE default smp or bigsmp the proper package is the one which doesn t include these words indicates an edition of PathMan...

Page 22: ...ersion you use Shaded part shows the corresponding kernel Even if the displayed kernel version includes PAE smp hugemem or largesmp the proper package is the one which doesn t include these words indicates an edition of PathManager In the case if you use the kernel ver 2 6 18 92 el5 1 If an errata kernel is installed reconfirm PathManager supports the installed kernel Example of errata kernels on ...

Page 23: ...d rc5 d S45dd_daemon 4 etc rc d rc6 d K77dd_daemon 4 etc logrotate d sps sps loglotate 8 opt nec report inf dualpath inf opt nec report table dualpath tbl opt nec sps esm report inf dualpath inf 5 opt nec sps esm report table dualpath tbl 5 opt nec sps esm report inf dualpathE inf 5 opt nec sps esm report table dualpathE tbl 5 opt nec sps bin spslog sh opt nec sps bin sps_setesmtbl sh 5 opt nec sp...

Page 24: ...art when OS starts Additionally if you use iSCSI connection you must also modify the iSCSI initiator startup script etc rc d init d iscsi To modify the OS initialization script apply the patch file as follows If you use both FC SAS and iSCSI connections apply the iSCSI patch The old OS initialization script which is before applying the patch file is left as etc rc d rc sysinit orig And the old iSC...

Page 25: ...13 SnapSAN S3000 S5000 Path Manager Linux User Guide If iSCSI connection follow the procedures shown below Skip this procedure if your system is following Red Hat Enterprise Linux 5 4 or later Red Hat Enterprise Linux 6 SUSE Linux Enterprise Server 10 ...

Page 26: ...set LVM according to Adding PathManager Devices to LVM section If any application or setting file uses the standard SCSI device of storage as dev sdX Shifting to a PathManager Environment If any application or setting file uses the standard SCSI device of SnapSAN Manager as dev sdX follow the procedures below Example to modify etc fstab If you want to use the disk mounted as mnt work with PathMana...

Page 27: ... part above by label name or by device ID the device name in dev disk by id Write it by the PathManager device name dev ddX iv If the system uses the SnapSAN Manager as the standard SCSI device dev sdX in the application or things like that modify those settings in the same way as iii Restart the system The shifting is complete Starting Operation Checking the Condition After installation of PathMa...

Page 28: ...l units exist in a disk array unit and there are two paths For the detail of output items refer to PathManager for Linux User s Manual If the number of paths under the LoadBalance line is only one or Normal is not displayed in LogicalUnit line check the environment such as the connection between the server and disk array unit the condition of FC driver module and the Cross Call settings of disk ar...

Page 29: ...reated on the disk array If partition info is NML the paths are normally multiplexed If nothing is displayed a disk array is not recognized by either path Check the connection between the server and disk array application status of the FC driver Cross Call settings and the other settings of the disk array Check whether dd_daemon is active When dd_daemon is active the following message appears ...

Page 30: ...hange the etc fstab 1 PathManagerCheck the SCSI devices corresponding to the PathManager devices using the spsconfig command A command example is shown below More than one SCSI device corresponding to a PathManager device may be displayed because the paths to the device are multiplexed 2 Modify the description of etc fstab Back up the etc fstab and replace the description of the PathManager device...

Page 31: ...nagerIf your system does not match above environments uninstall manually 3 PathManagerChange directory to opt nec sps installer 4 Execute the uninstall sh A command example is underlined If you use the silent option the installer reboots the server automatically You must reboot before operating the PathManager PathManager If the kernel version is 2 6 18 164 el5 and the system uses FC connection OS...

Page 32: ...ation of PathManager you must restart the system PathManagerIf the message sps Uninstall Completed the shaded part is not displayed that uninstallation is failed PathManager The uninstallation is complete Manual Uninstallation 1 PathManager Use the following command to check that PathManager is installed in the environment you use Confirm and remember the package name of installed PathManager Path...

Page 33: ...hManager from etc modprobe conf a Open the etc modprobe conf by any editor b Delete the sps_mod2 line added in installation 3 Save the data and quit the editor 4 PathManager Unpatch the startup script Skip this procedure if your system is following Red Hat Enterprise Linux 6 1 or later SUSE Linux Enterprise Server 10 connected by FC ...

Page 34: ...n error message appears the unpatching is failed In that case edit etc rc d rc sysinit or etc rc d init d iscsi and delete the all that appropriate lines Refer to the applied patch file regarding which lines should be deleted The lines whose first character is are exactly that 5 Execute the command specifying the PathManager package name checked at Step 1 to uninstall PathManager RHEL 5 3 2 6 18 1...

Page 35: ...s without changing device configuration settings however it is not necessary to execute Step vi Delete the configuration file etc sps conf if there is one It is possible to inherit the current settings by leaving the current configuration file as is PathManager When PathManager uninstalled dev ddX devices become unavailable Therefore stop the application that uses dev ddX devices before updating D...

Page 36: ...athManager is earlier than 5 0 0 the number of paths detected by the OS is 512 Load Distribution Function PathManager has two types of load distribution static and dynamic You can select the load distribution mode by the configuration file And you can also set the path priority by the configuration file In addition PathManager automatically distinguishes the model of Overland and automatically sel...

Page 37: ...Load Distribution Static Load Distribution FailoverOnly The mode of load distribution FailoverOnly Static load Distribution lbstatic Load distribution is performed by assigning different paths to each LUN This load distribution sets the priorities of paths automatically for the best throughput by judging the information from the connected disk array unit The active path is the highest priority pat...

Page 38: ...starts at first after installation And when you execute mkdd command the configuration file is also created if it doesn t exist To change the setting change the configuration file and execute mkdd command When the configuration file is created automatically PathManager driver detects the disk arrays and assigns the device file for each disk array in order of detection And PathManager driver also d...

Page 39: ...ocessing on the faulty unit SACT Time to monitor the path that recovered from a fault Default Value CHK 60sec FLT 180sec SACT 300sec The value of time until 999 hours or less can be specified And the value is sequentially enumerated from the left next to the above items The specified value that attaches ahead of s m h is interpreted respectively as a second and a minute and an hour If no character...

Page 40: ...h a comma LoadBalance Load distribution entry Write the load distribution mode used by the device written as the Device entry path info Path entry Write information of each path connected to the disk array written as a Disk entry The information to be written includes Watch Enable Disable of path monitoring At Watch specify Enable to monitor the path or specify Disable not to monitor The default v...

Page 41: ...of Path Priority Load Distribution Monitoring Interval and Enable Disable of Monitoring at once To change the settings follow the procedures below Execute the procedures in this section without any I O to the paths 1 Cannot change Load Distribution mode 1 Changing the load distribution mode To change the load distribution mode change the LoadBalance entry of the configuration file etc sps conf and...

Page 42: ...on file the shaded part should be changed 2 Use the mkdd command to change the load distribution mode from static load distribution S to dynamic load distribution round robin mode D1 LoadBalance Setting Sign of Displaying Path Status 2 Distribution mode S FailoverOnly Static load distribution D1 RoundRobin Dynamic load distribution round robin mode D2 LeastSectors Dynamic load distribution least I...

Page 43: ...erval 3 To change the path monitoring interval change the configuration file etc sps conf and then execute the mkdd command to reflect the settings Example When the initial status dev dda is as follows 4 Change the Watch entry in the configuration file etc sps conf the shaded part should be changed The following example shows how to change the path monitoring interval from 600 seconds to 900 secon...

Page 44: ...itoring 6 To change the enable disable setting of path monitoring change the configuration file etc sps conf and then execute the mkdd command to reflect the settings Example configuration file format 1 2 1 1 You can change enable disable setting of path monitoring for each device If the initial status dev dda is as follows 7 Change the path monitoring entry in the configuration file etc sps conf ...

Page 45: ...ete LUNs execute the procedures shown below Execute the procedures in this section without any I O to the paths This section refers to the FC connection but the procedures are the same with the iSCSI connection When using iSCSI connection replace HBA by iSCSI software initiator Addition and Deletion of LUN The procedures to add LUNs are different depending on the function version of PathManager If...

Page 46: ... Scanning SCSI subsystem for new devices The scsi rescan command is included in the rpm package named sg3_utils sg3_utils package may not be installed depending on its designation when installing the OS If sg3_utils is not installed get the sg3_utils rpm package from OS installation CD or WEB site of each distribution Then install the rpm package In the case of SLES this command is not included in...

Page 47: ...10400424 002 04 2013 2013 Overland Storage Inc 3 12 SnapSAN S3000 S5000 Path Manager Linux User Guide ...

Page 48: ...10400424 002 04 2013 2013 Overland Storage Inc 3 13 SnapSAN S3000 S5000 Path Manager Linux User Guide ...

Page 49: ... 3 14 SnapSAN S3000 S5000 Path Manager Linux User Guide Initializing Configuration of PathManager For initializing the configuration of PathManager remake the configuration file and make PathManager rediscover the disks Follow the procedures below ...

Page 50: ... order of disks LUNs detected by OS is different from the one when configuration file was created last time Because of a expansion of disk array unit or adding deleting LUNs etc In previous setting the assignment of PathManager devices is changed on purpose after auto configuration Log Information System Log If an event such as a path fault occurs during issuance of an I O request the PathManager ...

Page 51: ...ng A failure occurred on the active path and the active path has been switched Alternate path fault sps Warning Detect HOT path fail dev ddX p host h channel c id s lun l Warning A fault occurred on the alternate path Monitoring path fault sps Warning Failover in inspection dev ddX p host h channel c id s lun l Warning A fault occurred on the monitoring path Too many fault in monitoring dd_daemon ...

Page 52: ...ynamic Load Balancing is not supported sps Warning Dynamic Load Balance D1 D2 is not supported on dev ddX V Warning Dynamic Load Balancing is not supported on this device The path is already used sps Error scsi h channel c id s lun l is already created VI Error Specified path is already used created by another overlapping The disk is already used sps Error vendor v model m serial se lun l is alrea...

Page 53: ...ommand Stop the auto recovering sps Warning Intermittent errors occurred stopped Failback of path p I Warning Count of intermittent error of a path is reached to threshold value default 3 times so the path is gotten off the list of auto recovering Path Status was changed sps Info Asymmetric access state was changed dev ddX Path Disk Message Description p path Path number h host Host number c chann...

Page 54: ...rial number is registered to the Overland It is likely to be configuration failure V This disk array unit does not support the dynamic distribution mode Use it in static load distribution mode VI This error is caused by an invalid entry in the configuration file etc sps conf It may be occurred by modifying the entry which is not allowed to do Check whether there are any mistakes in the configurati...

Page 55: ...on To check the path information of the PathManager driver refer to the proc scsi sps ddX X indicates the unit name such as a b c file Meaning of each entry displayed in 1 is same as proc scsi scsi provided by OS Meaning of each entry displayed in 2 is same as configuration file without device status and path status ...

Page 56: ...tes the alternate path that is normally operating If a fault occurs on the active path during I O processing this alternate path changes to the active path FLT Error Abbreviation for Fault This indicates the path is in the fault status All SCSI commands terminate abnormally In this status recovery from the fault is checked periodically 3 minutes by default SACT Active Monitoring Abbreviation for S...

Page 57: ...10400424 002 04 2013 2013 Overland Storage Inc 3 22 SnapSAN S3000 S5000 Path Manager Linux User Guide Path State Transition ...

Page 58: ...nance command the path changes the status to ACT HOT from RSV You cannot attach the faulty path iii Active path fault If a fault is detected when an I O request is issued the active path changes its status If no SCSI command is found when a fault is detected the active path immediately enters the FLT status iii a iv Alternate path fault If a fault is detected on the alternate path it enters the FL...

Page 59: ...10400424 002 04 2013 2013 Overland Storage Inc 3 24 SnapSAN S3000 S5000 Path Manager Linux User Guide ...

Page 60: ...tility Package X X X Driver Package X X X RHEL 4 RHEL 5 SLES 10 cat proc scsi sps version X X X Path Status Display This section describes the path status display function This function is the most basic function of PathManager For each logical unit this function lists the status of the paths that are managed by PathManager PathManager command spsadmin is available at PathManager function version ...

Page 61: ...and on the terminal An example of execution is shown below If you execute spsadmin lun path list per logical unit is displayed In this example there are two logical units and two paths are recognized per logical unit The meaning of each item in the example above is shown below Position Number Meaning 1 Host number of SCSI address of the PathManager device 2 Channel number of SCSI address of the Pa...

Page 62: ...ager device no sign Redundancy is keeping No Redundant This device has no redundant path 8 Serial number of the Overland 9 LUN Logical Unit Number of the Overland 10 Mode of Load Balancing load distribution FailOverOnly Static Load Distribution mode RoundRobin Round robin mode LeastSectors Least sectors mode 11 Status of optimizing I O performance no sign Condition is enough to deliver the optimiz...

Page 63: ...low dev dda is a case of FC connection dev ddr is a case of iSCSI The meaning of each item in the case of FC SAS connection is shown below Meaning of Each Item in the example v version FC Position Number Meaning 1 Host number of SCSI address of the PathManager device 2 Channel number of SCSI address of the PathManager device ...

Page 64: ...Overland 12 Mode of Load Balancing load distribution FailOverOnly Static Load Distribution mode RoundRobin Round robin mode LeastSectors Least sectors mode 13 Status of optimizing I O performance no sign Condition is enough to deliver the optimized I O performance Unoptimized Condition is inadequate to deliver the optimized I O performance 14 Sequential number given to every path by PathManager Th...

Page 65: ...CSI Position Number Definition 1 Host number of SCSI address of the PathManager device 2 Channel number of SCSI address of the PathManager device 3 SCSI ID of SCSI address of the PathManager device 4 LUN of SCSI address of the PathManager device 5 Device name of PathManager device dev ddX 6 Status of the PathManager device Normal All of the paths corresponding to this device are normal Degraded On...

Page 66: ...mized I O performance 14 Sequential number given to every path by PathManager This number is given in order of detecting by PathManager It may change when the OS restarts 15 Host number of SCSI address of this path 16 Channel number of SCSI address of this path 17 SCSI ID of SCSI address of this path Position Number Definition 18 LUN of SCSI address of this path 19 Device name of a SCSI device of ...

Page 67: ...emon For operation such as starting or stopping the path patrol daemon use the script file etc rc d init d dd_daemon Use this script file to stop monitoring by the path patrol daemon for maintenance purposes and in the other cases Execute the script file specifying an argument string The execution of this script requires the root authority Arguments of the Path Patrol Daemon Operation Script The e...

Page 68: ...ble setting of path monitoring to each path You can change the setting at Watch part of path info entry in the configuration file etc sps conf Settings of all paths is set enable at default Messages When the daemon detects a fault on the path it outputs the following message in the system log sps Warning Detect ACT path fail dev ddX p host h channel c id s lun l When the daemon detects a fault on ...

Page 69: ...s PathManager from continuing to use the intermittent error path Intermittent error means that some failures occurred but I O is succeeded by retrying some times If this function is set enabled PathManager blocks a path which is suspected of being failed and configures the path not to be recovered automatically This prevents the system from decreasing the I O performance If you use this function c...

Page 70: ...the intermittent errors with the parameters Interval of monitoring intermittent error 600 second and Threshold retry count of blocking the path 3 times Enable Disable Setting of the Intermittent Error Monitoring Enabling the Intermittent Error Monitoring To enable the intermittent error monitoring function follow the procedures below Replace the Monitor Mode entry of configuration file etc sps con...

Page 71: ...04 2013 2013 Overland Storage Inc 3 36 SnapSAN S3000 S5000 Path Manager Linux User Guide Disabling the Intermittent Error Monitoring To disable the intermittent error monitoring function follow the procedures below ...

Page 72: ...stem log in addition to a failover message sps Warning Intermittent errors occurred stopped Failback of path p p path number Getting Error History Function This is the function to get the history of errors in the paths The history of errors includes not only the error which causes a failover but also the minor error which does not cause a failover It is not rare that a minor error which does not c...

Page 73: ...does not cause a failover and you will get a chance to handle the error which is hard to detect and this prevents an important failure which may occur in the future Getting Error History Function is available with PathManager function version 4 4 2 or later You can get the history of errors to execute the following command RHEL 6 spsadmin err RHEL 5 SLES 10 spscmd geterr Details of Output This sec...

Page 74: ...10400424 002 04 2013 2013 Overland Storage Inc 3 39 SnapSAN S3000 S5000 Path Manager Linux User Guide ...

Page 75: ...10400424 002 04 2013 2013 Overland Storage Inc 3 40 SnapSAN S3000 S5000 Path Manager Linux User Guide ...

Page 76: ...10400424 002 04 2013 2013 Overland Storage Inc 3 41 SnapSAN S3000 S5000 Path Manager Linux User Guide ...

Page 77: ...automatically You don t have to act anything to restore the path But when the path patrol daemon does not restore the path the fault is not temporary In this case replace the failed module and follow the procedures below Path restoration can be made either by rebooting the system or using operation commands If the system is rebootable restoration by rebooting the system is recommended If the syste...

Page 78: ...24 002 04 2013 2013 Overland Storage Inc 4 2 SnapSAN S3000 S5000 Path Manager Linux User Guide Fault Pattern I 1 If the path info line of the faulty path is displayed as the shaded part Go on to the YES route ...

Page 79: ... 002 04 2013 2013 Overland Storage Inc 4 3 SnapSAN S3000 S5000 Path Manager Linux User Guide Fault Pattern II 2 If the path info line of the faulty path is not displayed as the shaded part Go on to the NO route ...

Page 80: ... rebooted execute step v described in next section Restoration using operation commands to confirm that restoration is successful When you use application servers return the server to the cluster system after executing the above procedures Restoration using Operation Commands Restoration of the Specified Path fault in one or more paths An example of recovery from a path fault using operation comma...

Page 81: ... S3000 S5000 Path Manager Linux User Guide The restored path immediately enters the monitored SACT status The path is monitored for 5 minutes by default If no fault occurs within 5 minutes the path gets out of the monitored status and enters the active status ...

Page 82: ...10400424 002 04 2013 2013 Overland Storage Inc 4 6 SnapSAN S3000 S5000 Path Manager Linux User Guide ...

Page 83: ... Guide To recover from the monitored status the path patrol daemon must be running Restoration of the Specified Path all paths fault An example of recovery from an all path fault using operation commands is shown below Example When the initial status before occurrence of the fault is as follows ...

Page 84: ...age may not be output If you see many messages like this refer to proc dualpath ddX to check the path status SCSI disk error host x channel x id x lun x return code xxxxxx I O error dev xx xx sector xxxxx Execute the spsadmin lun or refer to proc scsi sps dda to check the occurrence of fault If the device status is Dead or ALL dev dda is unavailable I O request is not generally issued to a faulty ...

Page 85: ...ore paths in any order When the command is executed successfully the following message is output to the system log Execute the spsadmin lun or refer to proc scsi sps dda to check that path number 0 has returned to the ACT status and the partition status has returned to FLT This shows that dev dda has been restored and available vi After path number 0 has recovered restore path number 1 next Remove...

Page 86: ...turned to the HOT status and the partition status has returned to NML This shows that dev dda has been restored to the normal status Restoration by Scanning All Paths An example of recovery from a path fault or all path fault using operation commands is shown below If you execute the Rescanning the path and the Restructuring the PathManager devices on the procedures in this section I O performance...

Page 87: ...10400424 002 04 2013 2013 Overland Storage Inc 4 11 SnapSAN S3000 S5000 Path Manager Linux User Guide ...

Page 88: ...10400424 002 04 2013 2013 Overland Storage Inc 4 12 SnapSAN S3000 S5000 Path Manager Linux User Guide The meaning of each message is shown as below ...

Page 89: ... following example you can confirm that the path scsi1 Channel 00 Id 00 Lun 00 is added Message Definition sd scan hostX Rescanning under the hostX dd scan hostX Registering the path which is recognized by rescanning under the hostX sps Info Attached path to dev dda 1 host 1 channel 0 id 0 lun 0 Information about the path which has been recognized by PathManager If the path doesn t exist in the co...

Page 90: ...ser Guide Restoration by iscsiadm Command An example of recovery from a path fault or all path fault using iscsiadm command is shown below This restoration procedures are for iSCSI connection Example If the initial status before the fault is as follows and the fault occurred on the shaded path ...

Page 91: ...10400424 002 04 2013 2013 Overland Storage Inc 4 15 SnapSAN S3000 S5000 Path Manager Linux User Guide ...

Page 92: ...nc 4 16 SnapSAN S3000 S5000 Path Manager Linux User Guide After removing the cause of the fault execute the iscsiadm command as shown below to recover the paths Some error messages may output 1 2 but they don t mean any problems with PathManager ...

Page 93: ...424 002 04 2013 2013 Overland Storage Inc 4 17 SnapSAN S3000 S5000 Path Manager Linux User Guide When the kernel recognizes the path which is ready to use the messages like below are output to the system log ...

Page 94: ...10400424 002 04 2013 2013 Overland Storage Inc 4 18 SnapSAN S3000 S5000 Path Manager Linux User Guide ...

Page 95: ...recover command manually 5 PathManager does not support a path switch during the Diskdump kdump operations Hence if the path failure occurs during Diskdump kdump Diskdump kdump will stop 6 If you use application servers a cluster failover may occur because of a disk monitoring error on a path failback To prevent this you can increase the number of retries of disk monitoring by application servers ...

Page 96: ...se Server 10 Kernel 2 6 16 60 0 21 or later 3 PathManager does not support VxVM Veritas Volume Manager and VxFS Veritas File System But if DMP function of VxVM manages VxFS PathManager supports the concurrent use with VxVM VxFS and PathManager on the following OSes Red Hat Enterprise Linux 5 Kernel 2 6 18 53 el5 or later Red Hat Enterprise Linux 5 Advanced Platform Kernel 2 6 18 53 el5 or later SU...

Page 97: ... 2 6 32 131 0 15 el6 or later If you use it on the OS other than above you can use only one connection type FC iSCSI to a server Manage the Overland to limit the connection to one server by using Overland Storage or modify the system environment 9 PathManager does not support in combination with dm multipath 10 The event of The dd device of no redundant paths was detected SUSE Linux Enterprise Ser...

Page 98: ...s the PathManager driver to start operation of the multi path system If no configuration file is found the PathManager driver attempts to automatically detect the paths You can execute this command to change the setting Options mkdd accepts the following options listed alphabetically mkdd Directs to PathManager driver to start operation mkdd c Only checks the configuration file Does not notify the...

Page 99: ...urns the target path to active state spsadmin err m simple detail counts t number a v target Displays error history of path specified in target If target is omitted spsadmin displays a history for all paths m displays in specified mode simple as normal detail as detail counts as number of errors only t the number of errors to display of each path The default value is ten without using this sub opt...

Page 100: ...ity package 2 Driver package 3 Mcoption package if installed spsadmin suspend target Sets the path specified in target into a reserve RSV state spsadmin resume target Restores the path specified in target from a reserve RSV state spsadmin scan Scans the devices and the paths on the system How to specify target The argument target accepts four types of specifying 1 SCSI address description This typ...

Page 101: ...or a option that affects per path such as active all the paths on the specified logical unit are set into target The following two formats can be accepted in logical disk description D 0003000433204223 3 D 12 34 56 78 90 12 34 55 67 78 23 12 45 67 34 12 Leading character D is the symbol that represents the description is logical disk one In the upper one two items are serial number of storage unit...

Page 102: ... suspend path serial serial hd HD Resume a suspended path old spscmd add path serial HD new spsadmin resume path serial serial hd HD Change the active path old spscmd active path serial HD new spsadmin active path serial serial hd HD Scan to find a path old spscmd scan new spsadmin scan Change to the standby state verifying old spscmd verifystandby path serial HD new spsadmin standby v path serial...

Page 103: ... device appointed by target spsconfig kdump cfg list target Displays the list of configuration of kdump which had been set up spsconfig sanboot cfg add Enables to use a PathManager device as a root device on SAN Boot environment spsconfig sanboot cfg del Cancels the configuration set by sanboot add spsconfig chk target Displays the correspondence between PathManager devices and SCSI devices In the...

Page 104: ...ion of the multi path system If no configuration file is found the PathManager driver attempts to automatically detect the paths You can execute this command to change the setting Syntax mkdd c f filename Argument None Option c Only checks the configuration file Does not notify the PathManager driver f Uses the file specified for filename as the configuration file If you execute the mkdd command I...

Page 105: ...to standby This option does not change the status of paths actually standby Changes the path state to standby 5 Use it to change the state of the target paths to standby avail Rolls back the state of the active paths to the boot 5 Use it to roll back the active paths to the boot if those paths are changed after a boot by using a command and so on Argument path Specify the path number of the target...

Page 106: ... v Displays verbosely Argument MODE Displays all of the retry information simple displays simply detail displays in detail counts displays only the total number of errors NUM Specify the number of error information The maximum value is 1024 path Refer to previous page 1 Controlling Device Path Option serial HD Refer to previous page 1 Controlling Device Path Option spsconfig command Name spsconfig...

Page 107: ...etting to set the character specified in c as a blank character Argument None 1 chk option needs the sg_scan command sg_scan command is included in the rpm package named sg3_utils sg3_utils package may not be installed depending on its designation when installing the OS If sg3_utils is not installed get the sg3_utils rpm package from OS installation CD or WEB site of each distribution Then install...

Page 108: ... collection results In this example information is collected at 17 00 43 on Feb 27 2006 When the command is executed the execution log is displayed on the screen If collection is successfully completed no error is displayed as in the example However if the file to be collected does not exist or if you do not have the copy permission an error is displayed In case that an error is displayed take mea...

Page 109: ... the active path the higher priority one becomes active If Cluster Mode is enabled PathManager always sets a restored path to an alternate HOT with static load distribution LUN except for a total path failure 1 If you use application servers use Cluster Mode How to Enable the Cluster Mode Follow the procedures below to enable the Cluster Mode How to Disable the Cluster Mode Follow the procedures b...

Page 110: ...SnapSAN S3000 S5000 Path Manager Linux User Guide 10400424 002 04 2013 2013 Overland Storage Inc C 2 ...

Page 111: ...ster shutdown Shut down reboot the cluster with WebManager 4 PathManager installation 5 Modifying the cluster configuration Modify the following contents of configuration using the Builder trekking tool a Modifying the device name of disk resource e g sdb2 before modifying dda2 after modifying b Modifying the device name of disk monitor e g sdb1 before modifying dda1 after modifying c Modifying th...

Page 112: ...ready installed Before execution check that no error occurs by moving groups Updating Server1 Server2 Server2 Updating 1 When any group is operating on the server2 move all of the groups starting on the server2 to the server1 using WebManager If you don t use WebManager move groups using clpgrp command on the server2 2 Execute the following command on the server2 to modify the starting configurati...

Page 113: ...normally check by each application Verify steps 1 3 are executed After checking go on to the next procedures Server1 Updating 1 Execute the following command on the server1 to modify the starting configuration of services application servers is configured not to start automatically when OS starts at next time Check that above 1 procedures are executed on the server1 After checking go on to the nex...

Page 114: ... server2 If you don t use application servers execute clpgrp command on server2 to move the groups 2 Check that each resource of moved groups is operating normally by using WebManager If you don t use WebManager check using clpstat command on any server For checking that the applications on the groups are operating normally check by each application The update is complete ...

Page 115: ...sg_scan command and confirm the SCSI disks recognized by the OS If Overland Storage and Model Name are displayed this SCSI disk is Overland shown by the shaded part Product Name is displayed In the following example dev sda and dev sdb are local disks and dev sdc is the Overland The sg_scan command is included in the rpm package named sg3_utils sg3_utils package may not be installed depending on i...

Page 116: ...ome contradictions with accept reject patterns the first one is valid This is because of specification of LVM For example if a reject pattern for all devices like r and some accept ones are written in that order the latter ones are not valid So be sure to write a reject patterns at the end The format of lvm conf is a bit different from Regular Expression For example if you write a dd into filter e...

Page 117: ...c fstab Write the logical volume name which is made by PathManager devices Restart the OS After the OS is restarted confirm that LVM recognizes the PathManager devices by using pvdisplay and lvmdiskscan command In the following example dev dda2 and dev sdb1 are local disks managed by LVM dev dda1 is a PathManager device managed by LVM on the Overland ...

Page 118: ... modify the LVM setting file so that only the PathManager device dev ddX is accepted Alert Message Found duplicate PV 8MScmu8H6OG1Lr0JSOJ9cKPnXltZJHKh using dev sdX1 not dev ddX1 The procedure to add PathManager devices to LVM is complete Removing PathManager Devices from LVM To remove PathManager devices from LVM follow the procedures described below The LVM setting file which was backed up in th...

Page 119: ... 32 131 0 15 el6 or later PathManager does not support the kdump via iSCSI connection Setting up kdump with a PathManager Device To set up kdump with a PathManager device follow the procedures described below Example If you make kdump output to dev dda1 filesystem ext3 Modify the etc kdump conf file Making a backup copy of kdump conf This will be used to reset 1 Make a backup copy of etc kdump con...

Page 120: ...be conf to etc modprobe conf sps 2 Update of modprobe conf Update etc modprobe conf executing the spsconfig command with add option so that dev dda1 is built into the kernel 3 Confirming modprobe conf Open etc modprobe conf and confirm that the shaded part shown below is added Resetting the kdump setting To reset the setting of kdump with a PathManager device follow the procedures The backup copie...

Page 121: ...0 39 3 kernel kdump 2 6 16 60 0 39 3 rpm kdump 0 3 0 8 9 rpm kexec tools 1 101 32 48 rpm PathManager driver package for kdump sps kdump rpm should be installed after setting up kdump with a PathManager Device Do not change the order of setup Do not specify a device of disk array unit connected via iSCSI Setting up kdump with a PathManager device To set up kdump with a PathManager device follow the...

Page 122: ...king a backup copy of etc modprobe conf Make a backup copy of etc modprobe conf as etc modprobe conf sps 2 Updating the etc modprobe conf file Execute the spsconfig command with add option to update the etc modprobe conf file with specifying the device name dev ddc of the destination of kdump 3 Confirming modprobe conf Open etc modprobe conf and confirm that the shaded part shown below is added iv...

Page 123: ...0400424 002 04 2013 2013 Overland Storage Inc F 5 Move to the directory of compatible RPM files in installation CD ROM How to specify the directory is shown below If the kernel version of your system is 2 6 16 60 0 39 3 and its architecture is IA32 smp ...

Page 124: ...00424 002 04 2013 2013 Overland Storage Inc F 6 With that installation of PathManager driver for kdump is complete Resetting the kdump setting To reset the setting of kdump with a PathManager device follow the procedure The backup copies are used to reset ...

Page 125: ...SnapSAN S3000 S5000 Path Manager Linux User Guide 10400424 002 04 2013 2013 Overland Storage Inc F 7 The resetting the kdump setting is complete ...

Page 126: ...on on SuSE PathManager doesn t support iSCSI connection on SuSE ErrCode 1 04 sps mcopt doesn t support on SuSE PathManager doesn t support sps mcopt on SuSE ErrCode 1 05 sps mcopt is only supported on x86_64 architecture PathManager supports sps mcopt only on x86_64 architecture ErrCode 2 01 sps doesn t support this kernel 2 STATUSERR This kernel is not supported by PathManager s installer ErrCode...

Page 127: ...4 01 mcl rens kernel rpm is needed by sps mcopt 4 EXTERNAL mcl rens kernel should be installed before installation of sps mcopt ErrCode 4 02 mcl rens base rpm is needed by sps mcopt mcl rens base should be installed before installation of sps mcopt ErrCode 4 03 kernel kdump rpm is needed by sps kdump kernel kdump should be installed before installation of sps kdump ErrCode 4 04 kdump rpm is needed...

Page 128: ...nd the sps_mod ko ErrCode 6 01 Failed to mkdd 6 MKDD Failed to build the PathManager device ErrCode 6 02 proc scsi sps or sbin mkdd isn t found Couldn t find the files related to mkdd Error Message Handling No refer to Handling List Description ErrCode 7 01 Failed to dd_daemon 7 DDDAEMON Failed to start dd_daemon ErrCode 7 02 sbin dd_daemon or etc init d dd_daemon isn t found Couldn t find the fil...

Page 129: ...ctory in uninstallation ErrCode 9 01 Couldn t find patch for FC Couldn t find the patch file for fibre channel in installation ErrCode 9 02 Couldn t find patch for iSCSI Couldn t find the patch file for iSCSI in installation ErrCode 9 03 Couldn t find patch for FC Couldn t find the patch file for fibre channel in uninstallation ErrCode 9 04 Couldn t find patch for iSCSI Couldn t find the patch fil...

Page 130: ...ment Error Status Error There are some installed RPM packages related to PathManager Uninstall them and try again Failed to read the media Perhaps installer was executed from wrong directory On installation the current directory should be the one where the installer exists in the media Environment Error Check the environment PathManager is supported to work on Red Hat Enterprise Linux and SUSE Lin...

Page 131: ...eck whether the server recognizes the logical disk of SnapSAN Manager If the server does not recognize correctly check the configuration of SnapSAN Manager so that the server recognizes it After that restart the server Then PathManager will work correctly Because the installation was complete 7 DDDAEMON dd_daemon Error Restart the path patrol daemon dd_daemon etc init d dd_daemon restart If same e...

Page 132: ...9 Disabling the Intermittent Error Monitoring 3 36 disk info 3 5 Dynamic Load Distribution 3 2 dynamic load distribution 3 3 3 4 E Enable Disable setting of Intermittent Error Monitoring 3 10 Enable Disable setting of Path Monitoring 3 9 Enable Disable Setting of the Intermittent Error Monitoring 3 35 Enabling the Intermittent Error Monitoring 3 35 F File Format 3 4 FLT 3 4 3 21 3 33 Format 3 3 3 ...

Page 133: ...by Rebooting the System 4 4 restoration by rebooting the system 4 1 Restoration using Operation Commands 4 4 restoration using operation commands 4 1 Restrictions 5 1 Round Robin Mode RoundRobin 3 3 S SACT 3 4 3 21 3 33 Server1 Updating D 3 Server2 Updating D 2 Setting of Monitoring Interval 3 32 Setting up kdump with a PathManager Device F 1 Single Server Configuration 1 3 software update PR iii ...