background image

 

FIBRE-to-SAS/SATA RAID SUBSYSTEM

 

 

104 

User Manual 

 

 

 

NOTE: The maximum capacity of all Logical Volumes on a RAID is 
limited to the capacity of the RAID itself.  If there is not enough 
capacity to expand the Logical Volume, the RAID must be 
expanded first.

  

 

  

3.

 

Click on 

‘Add’

 to create the Logical Volume. 

4.

 

If the Logical Volume is a Private Volume, the NEXT step is to map the 
Logical Volume to Host. See Logical Volume Functions 

Æ

 Host Mapping. 

 

 

 

 
 

 
 

 
 

 
 
 

 
 

 
 

 
 

 
 
 

 
 

 
 

 
 

 
 
 

 
 

 
 

 
 

 
 
 

 
 

 

Summary of Contents for MGD-16FC16A

Page 1: ...FIBRE to SAS SATA RAID SUBSYSTEM User Manual Revision 1 3 ...

Page 2: ... 12 Chapter 2 Physical Components 13 2 1 Controller Module 13 2 1 1 Controller Module Panel 13 2 1 2 Controller Module LEDs 14 2 1 3 Controller Module Installation 15 2 1 4 Controller Board Replacement 16 2 1 5 Upgrading Controller Firmware 16 2 2 Power Supply Fan Module 17 2 2 1 Power Supply Fan Module Panel 17 2 2 2 Power Supply Module LED 18 2 2 3 Power Supply Installation 18 2 3 SCSI Enclosure...

Page 3: ...he Subsystem 53 3 1 Connecting the RAID Subsystem to the Host 53 Chapter 4 RAID Levels 54 Chapter 5 proRAID Manager 57 5 1 Connecting with proRAID Manager 57 5 1 1 Pre setting a Static IP Using Serial Port 57 5 1 2 Connecting with proRAID Manager Using DHCP 58 5 1 3 Connecting with proRAID Manager Using Static IP 59 5 1 4 Connecting with proRAID Manager Using APIPA 59 5 2 Login to proRAID Manager ...

Page 4: ...99 7 1 Viewing Logical Volume Details 100 7 2 Creating a Logical Volume 102 7 3 Modifying Expanding or Deleting a Logical Volume 105 7 4 Host Mapping 109 Chapter 8 Monitoring 112 8 1 Enclosures 112 8 2 Disks 115 8 2 1 Disk Information 115 8 2 2 Disk Errors 117 8 3 Port Statistics 118 8 4 Event Log 120 Chapter 9 Administration 122 9 1 Clear Event Log 122 9 2 Fibre Channel Config 123 9 3 Ethernet Co...

Page 5: ... Set Date and Time 138 9 14 Setup Wizard 139 Chapter 10 Troubleshooting 140 10 1 Alerts 140 10 2 Alert Messages 144 10 2 1 Notifications 144 10 2 2 Warnings 146 Appendix 149 1 How to Upgrade the Controller to Firmware 1 30 from Old Firmware Version 149 ...

Page 6: ...l Copyright No part of this publication may be reproduced stored in a retrieval system or transmitted in any form or by any means electronic mechanical photocopying recording or otherwise without the prior written consent Trademarks All products and trade names used in this document are trademarks or registered trademarks of their respective holders Changes The material in this document is for inf...

Page 7: ... ambient temperature Before plugging in any power cords cables and connectors make sure that the power switches are turned off Disconnect first any power connection if the power supply module is being removed from the enclosure Outlets must be accessible to the equipment All external connections should be made using shielded cables and as much as possible should not be performed by bare hand Using...

Page 8: ... subsystem unit Two 2 power cords One 1 external serial cable One 1 RJ 45 Ethernet cable One 1 RJ 45 crossover Ethernet cable Two 2 external Fibre optical cables Installation Reference Guide Spare screws etc If any of these items are missing or damaged please contact your dealer or sale representative for assistance ...

Page 9: ... 700MB sec The ability to mix SAS and SATA drives allows the RAID subsystem to be used for a range of applications that require different price performance characteristics Cost effective SATA drives can be selected for capacity oriented storage such as disk to disk backup and the storage of reference data Higher specification SAS drives can be employed for I O intensive applications including tran...

Page 10: ...the various parts of the subsystem Each part will be discussed in details in the following sections of this manual 1 1 1 Front View The front section consists of the Drive Carriers and the Smart LCD Panel 1 1 2 Rear View The rear view consists of the Power Supplies the Controller the SES Module and the Optional Battery Module ...

Page 11: ...nt cooling The available slot at the rear is for optional backup battery NOTE The modules of the enclosure are interchangeable with other Epica products 1 3 Technical Specifications RAID Controller 4Gb FC SAS Controller Single Redundant Host Interface 4Gb FC x 2 4 Up to 400 MB s per Channel 512 Command Queue Depth Disk Interface 3 0 Gb SAS SAS SATA II Direct Attached 6 4 TB at 400GB SAS drive 16 T...

Page 12: ... Yes Power Requirements AC 90V 254V Full Range 10A 5A at 110V 220V 50Hz 60Hz 1 3 3 Environmental Relative Humidity 10 85 Non condensing Operating Temperature 10O C 40 O C 50 O F 104 O F Physical Dimension 590 L x 482 W x 131 H mm Weight Without Disk 24 2 25 2 Kg RAID Levels 0 1 10 5 6 Array Group Up to 64 LUNs Up to 1024 Online RAID Expansion Yes Global Local Hot Spares Yes Drive Roaming Yes Immed...

Page 13: ... II Controller Module Some of the functions the 4Gb FC SAS SATA controller supports are as follows 533 MHz RISC AMCC 440SPe processor with an embedded R6 XOR engine The controller supports RAID levels 0 1 5 6 and 10 Up to 1024 LUNs Online expansion online rebuild Global Local Hot Spares Drive Roaming Immediate RAID Availability 2 1 1 Controller Module Panel ...

Page 14: ...Solid when FC Port B is up and no activity Flashes when there is activity on FC Port B FC Host B Activity Red Solid when FC Port B is down or disconnected Fault Red Solid if a fault is detected that activates the alarm Controller Ready Green Solid when the controller is ready Drive Activity Green Flashes when there is activity on any drive in any enclosure Green Solid when connected to a functioni...

Page 15: ...ar of the Controller Module CAUTION Handle the module with care and avoid damaging the connectors Do not install the module if the connectors are damaged b With the Controller handle in the open position carefully insert the module into the enclosure c Manually close the handle to complete the Controller Module installation d Tighten the thumb screws on the handle to secure the Controller Module t...

Page 16: ...ut the controller module 4 Release the memory module lock and remove the memory module 5 Unscrew two hex nut screws at the SAS expansion port 6 Remove six screws at the bottom of the controller module Note that there are six hex jack screws supporting the controller board to the module case 7 Remove the hex nut screws 8 Unscrew four screws that hold the two heat sinks on the side of the controller...

Page 17: ...dule Panel On the back of the Power Supply Fan Module there are three distinct features the Power On Off Switch the AC Inlet Plug and a Power On Fail Indicator showing the Power Status LED indicating ready or fail Each fan within a PSFM is powered independently of the power supply within the same PSFM So if the power supply of a PSFM fails the fan associated with that PSFM will continue to operate...

Page 18: ...EN When the Power On Fail LED is GREEN the PSFM is functioning normally 2 2 3 Power Supply Installation In this section you will be shown how to install the Power Supply a Check for damage especially to the PCB Golden Fingers at the rear of the Power Supply CAUTION Handle the module with care and avoid damaging the Golden Fingers In addition make sure there are no fingerprints on the Golden Finger...

Page 19: ...T To secure the Power Supply to the enclosure tighten the thumb screws d Connect the Power Supply cord from the power source to the AC Power Inlet IMPORTANT For safety reasons make sure the power switches are turned off when you plug in the power cords When removing the power cords ensure that the switch on the back of each power supply fan module are turned off and the power on fail LED are red ...

Page 20: ...protocol used for enclosure environmental control The SES module monitors the following enclosure conditions temperature power supply voltage and fan speed If any of the conditions above are not within specified parameters the SES module will notify the user through email SMS and or an audible alarm 2 3 1 SES Module Panel ...

Page 21: ...for PRO 90 6601 and SES2 for PRO 90 5601 Below are the RS 232 settings Settings Baud Rate 38400 PRO 90 6601 115200 PRO 90 5601 Data Bits 8 Parity None Stop Bits 1 Flow Control None 2 Alarm Mute Button When the audible alarm is sounding press this button to mute the audible alarm 3 Enclosure ID Dial The Enclosure ID Dial is used to indicate the ID number of that particular enclosure Enclosure ID Di...

Page 22: ...teady GREEN light or no GREEN light indicates that there is an error with the SES Module 2 3 3 SES Module LED 2 3 4 SES Module Installation This section describes how to install the SES Module a Check for damage especially to the PCB Golden Fingers at the rear of the SES Module CAUTION Handle the module with care and avoid damaging the Golden Fingers In addition make sure there are no fingerprints...

Page 23: ...dule into the appropriate slot c Use a screwdriver to tighten the 2 screws on either side of the SES Module to secure the SES Module to the enclosure NOTE The Thumbscrew is mainly used as a handle to remove the SES Module from the enclosure NOTE All four DIP switches must be off ...

Page 24: ...2 3 5 SES Board Replacement 1 Remove the SES module from the enclosure NOTE Sometimes the SES module cannot be easily removed Try to use pliers to pull the thumb screw of the SES module 2 Unscrew 6 hex nuts from the SES board 3 Replace the SES board ...

Page 25: ...S version use arrow down key SES2 means Version 2 x of PRO 90 5601 SES board PRO 90 5601 Baud Rate Terminal Setting is 115200 SES means Version 1 x of PRO 90 6601 SES board PRO 90 6601 Baud Rate Terminal Setting is 38400 Another option is to check the SES board version Power off the RAID subsystem and remove the SES module Check the board version from the label marked on the SES board ...

Page 26: ...cable to the RS232 port of SES module 2 Open terminal connection and configure terminal settings as follows Baud Rate 115200 Data Bits 8 Parity None Stop Bits 1 Flow Control None 3 In terminal console type proses reset then immediately press Q 4 Select Transfer then Send File Use Ymodem protocol Select the SES firmware binary file Click Send to start upgrade process ...

Page 27: ... is proceeding 6 Check the message Transfer Completed in terminal console The controller will auto restart to load the update 7 Use LCD panel to verify if the new SES firmware has been updated Use arrow down key SES2 means Version 2 x of PRO 90 5601 V 1 12 is the SES firmware version ...

Page 28: ...per 1 Power off the RAID system Remove the SES Module Insert a jumper in JP8 of SES board PRO 90 6601 2 Insert the SES module into the RAID subsystem Connect RS232 serial cable to the RS232 port of SES module 3 Power on RAID subsystem Configure terminal settings as follows Baud Rate 38400 Data Bits 8 Parity None Stop Bits 1 Flow Control None 4 Open terminal console Type proses upgrade ...

Page 29: ...FIBRE to SAS SATA RAID SUBSYSTEM User Manual 29 5 Select Transfer then Send File 6 Select Xmodem 7 Select SES firmware Click Open ...

Page 30: ...STEM 30 User Manual 8 Click Send to start upgrade process 9 The upgrade process will be shown 10 Check if firmware upgrade is ok 11 Power off RAID subsystem 12 Remove the SES module Remove the jumper in JP8 13 Repeat Steps 2 to 11 ...

Page 31: ...A RAID SUBSYSTEM User Manual 31 14 Power on the RAID subsystem Use LCD panel to check if the new SES firmware has been updated Use arrow down key SES means Version 1 x of PRO 90 6601 V 1 13 is the SES firmware version ...

Page 32: ...er On Error When this light is GREEN the power is on and everything is functioning normally When the Power On Error light is ORANGE then an error has occur that requires the user s attention The other status indicator light is the hard disk drive access light ACCESS LED will light up blue if the SAS HD is installed ACCESS LED will not light up if the SATA HD is installed When the hard disk drive i...

Page 33: ...on describes the physical locations of the hard drives supported by the subsystem and give instructions on installing a hard drive The subsystem supports hot swapping allowing you to install or replace a hard drive while the subsystem is running a The Lock Grooves are located on the carrier open button Press the button and the Drive Carrier handle will flip open b Pull out an empty disk tray Pull ...

Page 34: ...er Manual c Place the hard drive in the disk tray Make sure the holes of the disk tray align with the holes of the hard drive d Install the mounting screws on the bottom part to secure the drive in the disk tray e Slide the tray into a slot ...

Page 35: ...FIBRE to SAS SATA RAID SUBSYSTEM User Manual 35 f Press the lever in until you hear the latch click into place ...

Page 36: ...nel 2 5 1 LCD Display Main Menu RAID Model stands for the model name of the enclosure Chassis ID 01 is the physical enclosure assigned identification number A different chassis ID should be assigned if more than one enclosure is connected 2 5 2 LCD Display Panel LEDs ...

Page 37: ... LED will turn RED and alarm will sound Voltage Warning LED An alarm will sounds if detect voltage in the controller is abnormal and voltage LED will turn RED Access LED This LED will blink blue when the RAID controller is busy active 2 5 3 LCD Front Panel Function Buttons PARTS FUNCTION Up and Down Arrow buttons Use the Up or Down arrow keys to go through the information on the LCD screen This is...

Page 38: ...are version is 1 03 SES ID 00 is the physical enclosure assigned identification number Press or button will go back to the Main Menu Press will bring you to the next menu 2 Disk Status Menu Press button the individual disk information will be displayed This menu displays the disk temperature in each slot and which slots contain disks inserted ...

Page 39: ...mperature of the disk The disk temperature has a threshold value of 55 C if more than that the temp LED will turn RED and buzzer will sound Press button and button to view each 16 disk slots Press button will go back to the Disk Status Menu On the Disk Status Menu press button to proceed to the next menu 3 Power Status Menu Power Status Menu indicates the condition of the dual redundant power supp...

Page 40: ...ratures The FAN speed is linear and it has deviation between 300rpm or 400rpm if the proSES board detects high temperature it will change the speed To view the health of each fan press button Press button to return previous menu Press button will bring you to the next menu FAN Linear Speed Temperature 39 C 39 C 42 C 45 C Fan 1 Fan 3 4000 4500 5000 6000 Fan 2 Fan 4 3100 3400 3700 4000 ...

Page 41: ...EM User Manual 41 5 Voltage Status Menu Voltage status menu display the current voltage information To view the current voltage information press button Press button Valid voltage range 3 3V 2 97V 3 63V 5V 4 5V 5 5V 12V 10 8V 13 2V ...

Page 42: ...l 6 Buzzer Status Menu Buzzer Status menu is used to disable enable the proSES boards alarm By default only the buzzer from the controller will alarm if enclosure has a problem Default is Disabled Pressing the button will bring you to the next menu ...

Page 43: ...s after power on and subsequently refreshed every 15 minutes If the IP address is changed or reconfigured the LCD will show the updated IP address within 15 minutes IMPORTANT ProSES board PRO 90 6601 will not show in the LCD the controller s IP address after upgrading the firmware to the web GUI version controller FW 1 30 expander FW V389 and proSES FW 1 18 If proSES board is PRO 90 5601 the LCD w...

Page 44: ...Rail Box is complete 2 x Rack Rails 2 x Inner Brackets 4 x M5 P0 8 L 25mm Long Screws 8 x M5 0 8 L 8 0mm Round Head Screws 12 x M4 0 7 L 6 0mm Flat Head Screws NOTE To lighten the weight of the RAID system remove the disk trays with disk drives from the chassis 1 Remove one screw lower part from the RAID system ear ...

Page 45: ...Use four M4 flat head screws to attach the inner bracket to one of the side Make sure the holes of the inner bracket are aligned to the holes on the side of the RAID system 4 Repeat Steps 1 to 3 for the other inner bracket on the left side 5 Loosen eight M4 screws on each of the rack rails Make the necessary adjustment on the length of the rack rails to conform to the depth of the rack Then screw ...

Page 46: ... to the rack post Front Right and Rear Right NOTE In the Front Right part of the rack rail the M5 screws must be placed in holes 1 and 3 In the Rear Right part the M5 screws must be placed in holes 1 and 4 7 Repeat Step 6 to fix the left side rack rail to the rack post Front Left and Rear Left Take note of the positioning of the M5 screws in the holes ...

Page 47: ...FIBRE to SAS SATA RAID SUBSYSTEM User Manual 47 8 Carefully insert the RAID system into the cabinet Make sure the inner brackets align with the center opening of the rack rails Front View Rear View ...

Page 48: ...o SAS SATA RAID SUBSYSTEM 48 User Manual 9 Use two M5 long screws on each side front to fix the RAID system onto the cabinet 10 Insert the disk trays with disk drives if they were removed prior to installation ...

Page 49: ...cks are in good condition and cables are well connected 2 Carefully insert the BBU into the appropriate slot of the RAID subsystem 3 Verify in the proRAID Manager GUI Monitoring Enclosures Battery Backup Units if the battery pack s is are detected 4 Check the LEDs of the BBU 1 LED for battery pack 1 2 LED for battery pack 2 Charge Full If LED is Green battery is 100 fully charged If LED is Amber b...

Page 50: ...Replacement 1 Remove the Backup Battery Unit BBU from the RAID subsystem 2 Loosen the screws on the BBU 3 Disconnect the battery cables 4 Replace the battery pack s 5 Insert the new battery pack s into the BBU 6 Connect the battery cables 7 Install BBU into the RAID subsystem ...

Page 51: ...7 96 111 Expansion JBOD 8 Reserved Reserved 9 Reserved Reserved 0 Reserved Reserved 1 Prepare the JBOD expansion enclosure Set the Enclosure ID Dial to the appropriate number 2 Install the expansion enclosure near the RAID subsystem where it will be connected 3 Connect one end of SAS cable to the SAS Disk Expansion port of the RAID subsystem and the other end to the SAS In port of the Expansion En...

Page 52: ...r Manual 2 9 Upgrading Expander Firmware NOTE The Expander firmware upgrade procedure uses the same steps as the controller firmware upgrade except for the upgrade firmware file Please refer to Administration chapter Update Firmware section ...

Page 53: ...m to your host system NOTE For optimum performance use 4Gb FC Host Bus Adapter s in the host computer s 1 Connect the two power cables to the AC Power Inlets 2 Connect the Fibre Cable s to the Fibre Host Channel s 3 Connect the remote management Ethernet cable to the Controller Ethernet port 4 Turn on each power switch of the PSFM 5 Allow the machine a few moments to initialize before using it ...

Page 54: ...ited to mission critical applications such as accounting systems The following is a brief list of the supported RAID levels RAID 0 Striping without Fault Tolerance In a RAID 0 system the data is broken down in to equal blocks and each block is then written to a different disk in the RAID The performance is excellent as the I O load is shared equally between the all disks in the RAID The following ...

Page 55: ... that the effective storage capacity is only half of the total disk capacity because all data gets written twice Ideal for mission critical storage e g accounting systems Suitable for small servers in which only two disks will be used RAID 10 A Stripe of Mirrors A RAID 10 RAID combines both a RAID 0 and a RAID 1 Data is striped across multiple drives and these stripes are then mirrored on identica...

Page 56: ...system s RAID 6 function provides the highest level of data protection by tolerating multiple simultaneous drive failures without downtime or data loss RAID 6 probability of data loss is 1 1 000 three orders of magnitude less that of an equivalent RAID 5 array Where RAID 5 writes one parity block for each stripe across the array RAID 6 saves two parity blocks allowing the RAID controller to contin...

Page 57: ... b Connecting with ProRAID Manager using Static IP c Connecting with ProRAID Manager using APIPA NOTE The RAID controller s IP address can be seen from the LCD display panel Press the button several times until you see the Controller IP menu 5 1 1 Pre setting a Static IP Using Serial Port You can also connect directly to the RAID controller via the RS232 Serial Port on the controller Using a termi...

Page 58: ...o operate in an Internet Protocol IP network By using this protocol system administration workload greatly decreases and devices can be added to the network with minimal or no manual configurations therefore less effort By default DHCP is enabled on the controller s and therefore no further configuration is needed Once the RAID subsystem obtains the dynamic IP address from DHCP server use the IP a...

Page 59: ... which it installed This occurs when the TCP IP protocol is installed set to obtain its IP address automatically from a Dynamic Host Configuration Protocol server and when there is no DHCP server present or the DHCP server is not available The Internet Assigned Numbers Authority IANA has reserved private IP addresses in the range of 169 254 0 0 169 254 255 255 for Automatic Private IP Addressing B...

Page 60: ...ID Manager To connect to the desired RAID subsystem you must enter a valid Username and Password The fixed administrator username is admin and the default administrator password is admin You can change later the administrator password in Administration Change Password ...

Page 61: ...RE to SAS SATA RAID SUBSYSTEM User Manual 61 The System Information screen will be displayed after login NOTE The System Information screen can also be accessed in the Information Î System Information menu ...

Page 62: ...roller 2 Serial number of controller 2 Enclosure ID S N The enclosure ID number and serial number of the enclosure Disks Field Description Status Displays the disk status may be OK critical non critical unrecoverable and unsupported Usage Displays how the disk is used it may be part of a RAID local spare global spare or not used Enclosure The ID of the enclosure that the disk is located in Bay Bay...

Page 63: ...ile Defines the general operating or application environment in which the RAID will be used e g one RAID volume might be optimized for database applications while another might be optimized for file server applications This is configured when the RAID is created State The states available for RAIDs are Good Degraded Rebuilding Initializing Expanding Verifying Inaccessible If the RAID is Rebuilding...

Page 64: ... connected to the SAN Port 1B The current Login status of the host to Port B of Controller 1 If the host is logged in to the controller port then the Address or ALPA will be displayed In fabric and point to point modes this field is referred to as Address In loop mode this field contains the ALPA It represents the ID of the host when connected to the SAN Port 2A The current Login status of the hos...

Page 65: ...gical Volumes Create Logical Volume Modify Delete Volume Logical Volume Functions Host Mapping Enclosures Disks Port Statistics Monitoring Event Log Clear Event Log Fibre Channel Config Ethernet Configuration Email Event Configuration SNMP Configuration Change Password Update Firmware Reset Controller Telnet Enable RAID Manager App Config Save Restore Export Status Set Date and Time Administration...

Page 66: ...ight corner The proRAID Manager logo is displayed in the top left corner There are three options below the proRAID Manager logo open all close all and logout Below the Raid Manager Console are the Main Menus When a Main Menu is selected its sub menus are displayed The Information Configuration screen of the selected sub menu is displayed in the right pane ...

Page 67: ...his array of disks appears as one disk drive to the host computer offering enhanced performance or data reliability or both There are different RAID Levels with each level being suited to a particular application For example RAID Level 1 uses mirroring to hold your data in 2 separate but identical locations If a disk fails the RAID controller will use either the data disk s or the mirror disk s fo...

Page 68: ...n the event of a disk drive in that RAID failing This reduces the risk to your data as the RAID can be rebuilt immediately without installing a new disk to replace a failed disk in the RAID When creating your RAID Set you must consider which Sparing Strategy you want to implement There are 3 possible Sparing Strategies available in ProRAID Manager None Local and Global A Local Spare Drive is a spa...

Page 69: ...s the last block of a previous command the system detects that there is a stream of commands in progress and pre fetches data up to 16 times the size of the original command This increases performance by lowering the latency of subsequent commands in the stream 6 1 2 3 Write Cache Data When write caching is enabled performance is increased in two ways Firstly it lowers command latency to the host ...

Page 70: ...ating shutdown where the cached data is written to the hard disk s before the computer shuts down Certain Host OS platforms require that the target array volume or standalone drive does not support synchronize cache commands The system provides an option where the synchronize cache commands can be enabled or disabled as required By default the synchronize cache command is enabled The synchronize c...

Page 71: ...head On 256 50 Sequential 50 Random 70 Read 30 Write Media Server For video and creative content storage Read Ahead On 256 90 Sequential 10 Random 50 Read 50 Write Database For transaction processing Read On 64 10 Sequential 90 Random 90 Read 10 Write Media Server No init For video and creative content storage Read Ahead On 256 90 Sequential 10 Random 50 Read 50 Write When a RAID is created the pr...

Page 72: ...File Server RAID might be optimized as a File Server that has the primary purpose of providing a location for the shared storage of information such as documents sound files photographs movies images databases etc that can be accessed by the workstations that are attached to the network A File Server is designed primarily to enable the rapid storage and retrieval of data where the heavy computatio...

Page 73: ...ke place 6 1 4 1 Disabled If Auto Rebuild is set to Disabled the RAID will not rebuild unless you manually select Rebuild in the ProRAID Manager RAID Functions Î Rebuild RAID Set screen If a RAID becomes degraded an alert will still be generated even if Auto Rebuild is set to disabled 6 1 4 2 ASAP If Auto Rebuild is set to ASAP the RAID will rebuild as quickly as possible while still allowing read...

Page 74: ...at you want to include in your RAID To include a single disk in a RAID simply tick the check box on the right hand side of the table for the required disk It is also possible to select all disks for a new RAID by pressing the Select All button If user wishes to deselect all disks this can be achieved by pressing the Deselect All button Once disk selection has been completed the user can navigate t...

Page 75: ...n lists to select the relevant parameters that define the RAID Complete the following steps to configure the RAID options 1 The RAID Profile allows the controller to optimise the RAID and cache configuration based on the expected access pattern to the Logical Volumes on the RAID Select the profile that best fits the application environment that the RAID will be used The following are the available...

Page 76: ...D 1 but the RAID capacity is correct 3 Enable Write Cache if you want the controller to respond with Good status when the data is written to the cache but before it is written to disk 4 Enable Read Cache if you want the controller to store the data most recently retrieved in the cache 5 Enable Read Ahead if you want the controller to optimize performance on sequential reads 6 Enable Disk Caching i...

Page 77: ...building a RAID you should not remove the faulty disk until the rebuild is complete If you must remove the disk then the data should be backed up prior to removing the disk 8 Select from the following sparing strategies If local sparing is selected one of the selected disks will be assigned as the local spare If global sparing is selected and no global spare has been assigned or the current global...

Page 78: ...nto the selected power mode as configured by the MAID Level only configurable for MAID Level 1 and higher MAID Level Option mins 1 Idle disk after timeout 10 20 30 45 60 2 Low Speed after timeout 10 20 30 45 60 3 Standby after timeout 20 30 45 60 90 120 180 Refer to Section 6 10 Intelligent Power Management for more information 10 Select Calculate Capacity button to get the RAID Set total capacity...

Page 79: ... RAID Set click the Create RAID button 12 The RAID will initialize If you have free disk drive you can select Open spare selection screen to allocate hot spare drive 13 The NEXT step is to create Logical Volume s See Logical Volume Functions Æ Create Logical Volume ...

Page 80: ...ne RAID volume might be optimized for database applications while another might be optimized for file server applications Configured when the RAID is created State The states available are Good Degraded Rebuilding Initializing Expanding Verifying and Inaccessible If the RAID is rebuilding initializing expanding or verifying the progress of the task will be displayed in brackets e g Initializing 75...

Page 81: ...FIBRE to SAS SATA RAID SUBSYSTEM User Manual 81 The RAID information screen of a selected RAID Set ...

Page 82: ...FIBRE to SAS SATA RAID SUBSYSTEM 82 User Manual The RAID information screen will also show the number of Rows and Columns in a RAID and which Row the disk drives belong to ...

Page 83: ...on the RAID are Change Settings cache size auto rebuild settings etc Delete the RAID Rename the RAID Rebuild the RAID if the RAID is degraded 6 4 1 Change Settings You can change any of the settings for your RAID from the RAID Functions Î Modify Delete RAID Set screen as follows 1 Select the RAID you wish to modify by clicking on the Modify button in the row corresponding to the RAID of interest ...

Page 84: ...t you wish to change and where available choose an option from the drop down menu 3 Click on the Update Settings button to save the settings NOTE All options display a confirmation box before continuing with the operation NOTE The RAID name has a maximum of 31 characters ...

Page 85: ...responding to the RAID of interest 2 Confirm deletion of the RAID by selecting OK to confirm in the confirm dialog box which pops up prior to deletion 3 If the RAID has logical volumes it is not possible to delete the RAID without deleting the logical volumes first NOTE When deleting a RAID clicking on the Delete button will delete the specified RAID without any further warning RAIDs cannot be del...

Page 86: ...he RAID Functions Î Modify Delete RAID Set screen as follows 1 To modify the RAID click on the Modify button in the row of the RAID of interest 2 Enter the new name for the RAID in the Name text box 3 Select Update Settings to save the change and rename the RAID NOTE The RAID name has a maximum of 31 characters ...

Page 87: ...If there is insufficient capacity on the RAID to expand an existing Logical Volume or to create a new Logical Volume the RAID may be expanded to increase the available capacity NOTE At least one spare disk is required to expand the RAID NOTE When selecting disks for RAID expansion never display Missing Faulty or Broken disks regardless of whether they are part of a RAID or spares Use the following...

Page 88: ...uired click Select All button which will select all the available disks 4 To continue click Next button 5 On the following screen select the RAID to be expanded by clicking on the Expand button in the row of the RAID of interest 6 The RAID Set expansion process will start ...

Page 89: ... Set screen as follows NOTE A RAID can only be rebuilt if it is in a degraded state To verify a RAID refer to Section on Verifying a RAID 1 Select the RAID you wish to rebuild by clicking on the Rebuild button in the row of the RAID of interest 2 To stop the rebuild of a RAID select the Stop button in the row of the rebuilding RAID ...

Page 90: ...possible on RAID level 5 or 6 it is not possible to verify RAIDs created using RAID 0 or RAID 1 During a RAID Verify the system reads each stripe and checks for valid parity At the end of the verify process the system sends an Alert if any stripes were found with invalid parity In the Verify RAID Set screen select the Verify button corresponding to the RAID to be verified It is recommended that yo...

Page 91: ...e system that has global sparing strategy selected Local A disk that can only be used by the RAID in which it was added to NOTE A RAID that has a local spare cannot use the global spare None The RAID selected cannot use the global spare and does not have a local spare assigned The RAID cannot be re built automatically 6 8 1 Creating a Hot Spare Select change a sparing strategy from the RAID Functi...

Page 92: ... 5 RAID or a third local spare to a level 6 RAID will replace one of the existing spares with the newly assigned disk 2 Click Select to navigate to the Disk selection screen 3 On the disk selection screen select the disk intended for the sparing strategy by ticking the radio button in the according row of that disk ...

Page 93: ...ed the disk cannot be used for assigning as another spare or creating expanding a RAID 6 8 2 Deleting a Hot Spare To delete a disk from the sparing strategy navigate to the RAID Functions Î Delete Hot Spare screen This screen will list all spares in the system global and local and display relevant disk information of the spare disk To delete a disk from the sparing strategy click the radio button ...

Page 94: ... 8 3 Viewing Hot Spares To view the sparing strategy in the current system navigate to the RAID Functions Î View Sot Spares screen This screen will list all spares in the system global and local and display relevant disk information of the spare disk ...

Page 95: ...D ownership while RAID is initializing verifying rebuilding The RAID Functions Î RAID Ownership screen allows the user to view current RAID owners and also to modify the owners of a RAID Steps to modify RAID ownership 1 To modify the users of a RAID select the Modify button in the row of the RAID of interest ...

Page 96: ...FIBRE to SAS SATA RAID SUBSYSTEM 96 User Manual 2 In the following screen enter the board ID of the board that is to be the new owner of the RAID 3 Click the Save button to save the changes ...

Page 97: ...savings the administrator can select MAID Level 3 where a HDD or the RAID is completely powered down or put into a suspended standby sleep mode 6 10 1 Power Modes MAID Levels Level 0 No Power Management The device is capable of responding immediately to media access requests and commands complete execution in the shortest possible time Level 1 Idle Mode The disk is capable of responding immediatel...

Page 98: ...ws those disks to transition into a Low Speed Mode see Power Modes above if required To find out whether a disk in the system supports APM simply navigate to the Monitoring Î Disks screen and select the Disk Information tab The Disk Information table will display a column that indicates whether APM is supported by a disk or not ...

Page 99: ... user specified ports AND hosts Private volumes can have a set of ports enabled at which they can be accessible by selected hosts only Private volumes are only accessible by hosts that have been mapped to that volume at a specified LUN In addition the host also needs to be logged into a port that has been enabled for the private volume Hosts that are not mapped to a private volume will not be able...

Page 100: ...uch as Name Serial Number Capacity Status and parent RAID about each logical volume The second table provides specific mapping information on each private logical volume The table displays logical volume name host names of any hosts mapped to a particular volume port mask for each private volume and the LUN to which the private logical volume has been mapped to for a certain host The third table p...

Page 101: ...been mapped to a private LV Port 1A Indicates whether the port is enabled of disabled for the private volume Port 1B Indicates whether the port is enabled of disabled for the private volume Port 2A Indicates whether the port is enabled of disabled for the private volume Port 2B Indicates whether the port is enabled of disabled for the private volume LUN LUN to which the volume has been mapped for ...

Page 102: ...ing adjustments a Assign and enter a name for the Logical Volume in the Logical Volume text box b If the logical volume is to be a private volume tick the checkbox labeled Private If the logical volume is to be a global volume leave the checkbox un ticked c If the volume is a private volume enable or disable the ports of interest by selecting the appropriate value from the drop down box for each p...

Page 103: ...een created its global private status and port mappings can be modified at any stage on the Logical Volume Functions Î Modify Delete Volume screen In order to map a host to a private logical volume the user will need to navigate to the Logical Volume Functions Î Host Mapping screen ...

Page 104: ...ited to the capacity of the RAID itself If there is not enough capacity to expand the Logical Volume the RAID must be expanded first 3 Click on Add to create the Logical Volume 4 If the Logical Volume is a Private Volume the NEXT step is to map the Logical Volume to Host See Logical Volume Functions Æ Host Mapping ...

Page 105: ...e screen select the Modify button for the logical volume of interest 2 The following page will present you with a screen that allows you to modify or expand a logical volume a To change the name of the Logical Volume replace the current name with the new name in the Logical Volume Name field b To change the status of a volume from global to private or vice versa tick or un tick the checkbox labele...

Page 106: ...t of interest has been set to a value other than Unmapped A value of Unmapped disables or hides the global logical volume on the specified ports with the effect that no hosts will be able to access the volume irrelevant of login port To make a global volume visible on a specific port select a suitable LUN from the drop down list Specifying a LUN for a port means that the global logical volume will...

Page 107: ...FIBRE to SAS SATA RAID SUBSYSTEM User Manual 107 3 Click on Save to save your changes ...

Page 108: ...lete button for the logical volume of interest This will prompt the user to confirm the deletion of the logical volume If a logical volume global or private has any active LUN mapping the user will also be prompted to confirm the deletion of the logical volume WARNING If a Logical Volume is deleted all data in that Logical Volume will be lost ...

Page 109: ...a host is Unmapped the host is not mapped to the private logical volume A host can only access a private logical volume when 1 The host has been mapped to a LUN for that private logical volume 2 The host is logged into a port that is marked as Enabled for the private logical volume Finally a private logical volume can be converted to a global logical volume Converting a private volume to a global ...

Page 110: ...see private volume LV1 at LUN0 as the global volume mapping has precedence The following table gives an explanation of the Private Logical Volumes Mapping table Field Description Name Displays the name of a private logical volume Host Name Displays the name of a host mapped to the corresponding logical volume If none is displayed no host has been mapped to the volume Port1A Displays the mapping st...

Page 111: ...r logged in but are still mapped to a private logical volume Node Name Displays the host s node name Port Name Displays the host s port name Port1A Displays the login status of the host at port 1A Port1B Displays the login status of the host at port 1B Port2A Displays the login status of the host at port 2A Port2B Displays the login status of the host at port 2B Modify Host Name Select this if you...

Page 112: ...to disabled enabled or silenced To view detailed information on a specific enclosure in the system such as Temperature Probes Voltage Sensors Fans Power Supply Units and Battery Backup Units the user just needs to click on the View button next to the enclosure of interest To modify the buzzer setting the user can select from three options disabled enabled silenced on the Monitoring Æ Enclosures sc...

Page 113: ...FIBRE to SAS SATA RAID SUBSYSTEM User Manual 113 ...

Page 114: ...FIBRE to SAS SATA RAID SUBSYSTEM 114 User Manual ...

Page 115: ...formation screen is a read only screen and provides detail on all disks such as Status Usage Enclosure Bay Type Disk Model Serial Number Firmware Capacity APM Support and Power Status The Disk Information screen also shows the total number of disk errors for each disk To see the breakdown of disk errors the user has to navigate to the Disk Errors screen select the Disk Errors tab ...

Page 116: ...esent regardless of whether they are part of a RAID or a spare Access 0 or 1 or 2 Usage X Second Priority Disks which are missing but part of a RAID Access 4 Usage 1 Third Priority Disks which are missing but are spares Access 4 Usage 2 or 3 Fourth Priority Never displayed Disks which are missing and not part of a RAID or spare Access 4 Usage 0 NOTE When selecting disks for RAID creation expansion...

Page 117: ... the breakdown of disk errors The user can also choose to clear all errors for one individual disk by clicking the Clear button in the row of the disk of interest It is also possible to clear all disk errors of all the disks in the system This can be achieved by clicking on Clear All Disk Errors ...

Page 118: ...is a read only screen and displays the link statistics for the system Statistics are displayed for each port in each controller It will show information such as Port Name Node Name Link Speed Link Type and number of Bad RX Chars Bad CRC Chars Link Down Count Link Up Count Aborted Commands and Commands Timeout ...

Page 119: ...FIBRE to SAS SATA RAID SUBSYSTEM User Manual 119 ...

Page 120: ...he user to view all events that have occurred in the system In addition the user can choose to export a current snapshot of all the events that have occurred by clicking on the Export Events button This will then prompt the user to save the export file as a html file in a location as specified by the user ...

Page 121: ...FIBRE to SAS SATA RAID SUBSYSTEM User Manual 121 ...

Page 122: ...D SUBSYSTEM 122 User Manual Chapter 9 Administration 9 1 Clear Event Log The Administration Î Clear Event Log screen allows the user to delete all events in the event log Confirmation is required before any action is taken ...

Page 123: ...u encounter problems with your configuration Each controller has two ports which can either be connected directly to host s HBA or via a switch to the host systems Each port can be configured with different settings They can negotiate different link speeds ALPAs and requested topology Steps to configure Fibre Channel 1 On the Administration Æ Fibre Channel Config screen configure the Preferred Add...

Page 124: ...ferred Address Preferred ALPA that the port on the controller would like to use The preferred ALPA is only valid in loop mode A list of available addresses is listed in a drop down box Link Speed Current link speed of the connection to the port on the controller Requested Speed Preferred link speed of the connection to the port on the controller The actual link speed may be different to this value...

Page 125: ... the system Steps to configure Ethernet 1 On the Administration Æ Ethernet Configuration screen configure the system whether to use DHCP or not If not configure the IP Address Net Mask Primary DNS Alternate DNS Gateway IP Address and Domain as necessary 2 Click Save to save the IP connection information of the selected controller The screen can be updated with the Refresh Page button ...

Page 126: ...ry DNS The IP Address of the DNS Server that the system uses to resolve host names At least one IP Address is required if DNS is to be used for name resolution You must set this up if a host name is entered in the E mail Server Address field in the Email Event Configuration screen Alternate DNS Alternate DNS server to use for name resolution if the primary server is unavailable Gateway IP Address ...

Page 127: ... SMS and then redirects them to the SMS compatible device If you use this the SMTP messages should be sent to the e mail address provided by the third party provider Steps to setup Email Event Configuration 1 On the Administration Æ Email Event Configuration screen check Enable option to enable SMTP 2 Configure the SMTP Server IP SMTP Server Domain Sender Recipient s and Subject as necessary 3 If ...

Page 128: ... address assigned to the account used to administer the application Recipient 1 E mail address of the first person receiving the e mail Recipient 2 E mail address of a second person receiving the e mail Subject Text that will be displayed in the subject field of an Alert e mail Enable Authentication The mail server may require SMTP authentication It is used as a security mechanism to prevent membe...

Page 129: ...or the system Steps to setup SNMP Configuration 1 On the Administration Æ SNMP Configuration screen tick the Enable check box to enable SNMP 2 Enter the SNMP Client IP SNMP Client Name and select the type of alerts to be sent via SNMP 3 Click Save to apply the changes to the controller or click Save Test to apply the changes to the controller and send a test message ...

Page 130: ...ient Name Host name of the SNMP client system The SNMP name can be used if a valid Primary DNS or Alternate DNS is entered in the Ethernet Configuration screen Application Alerts Alerts generated by the GUI will be sent via SNMP when they occur Notification Alerts Information events in the Event Log will be sent via SNMP when they occur Warning Alerts Warning events in the Event Log will be sent v...

Page 131: ...he default password for the administrator user is admin We recommended that you change this password This screen contains the following details and options Field Description Username Username used to monitor and manage the system Current Password Password currently used by the system New Password Enter password that you want to change to Confirm Password Re enter password that you want to change t...

Page 132: ...ware 2 The installation will begin when the Upgrade button is clicked 3 Do not perform any other actions until a message is displayed confirming that the installation is finished 4 If a system reset is needed to run the new firmware you will be prompted to do so at this point WARNING This facility should only be used under the direction of our technical support team WARNING Upgrading the controlle...

Page 133: ... Using the dropdown box select which of the controllers the action should apply to Then click the Reset Now button to begin the reset In a dual controller system if Both Controllers are selected from the dropdown box and Reset Now button is clicked the two controllers are reset sequentially In this way the system s Logical Volumes remain accessible for the duration of the reset ...

Page 134: ...istration Î Telnet screen allows the user to interact with the controller via a command line interface A working Java plug in for your browser is required to use this facility Warning The telnet applet should only be used under the direction of our technical support team ...

Page 135: ...e RAID Manager App button to enable Java based RAID Manager Application NOTE Browser based RAID management functions cannot be accessed while connections with this application are allowed The Java application cannot be used simultaneously with this Web interface To switch back to using the Web GUI interface it must be explicitly enabled by opening the controller s legacy html homepage in a browser...

Page 136: ...res an automatically saved configuration from the disks currently available in the enclosures The system will reset itself when the restoration is complete Save Downloads one of two saved system configurations Restore Prompts the user for the location of a previously saved configuration The system will need to be reset for the restored configuration to take effect Warning This facility should only...

Page 137: ... Manual 137 9 12 Export Status The Administration Î Export Status screen allows the user to download a zip file containing a snapshot of HTML status screens This information can be used by our technical support team when debugging problems ...

Page 138: ...e The Administration Î Set Data and Time screen allows you to set the date and time of the system This screen contains the following details and options Field Description Date Set the date for the controller Time Set the time for the controller Save Saves the new settings ...

Page 139: ... guides the user through the following configuration screens Change Password Email Event Configuration SNMP Configuration Ethernet Configuration for each controller that is currently inserted Click Next to save any configuration changes and move to the next screen Clicking Previous will display the previous screen ...

Page 140: ...e is enabled System unavailable N A Event log Power BBU Not present Transient Loss Data may be lost if write cache is enabled System unavailable during power loss Controller takes 7 seconds to reboot and 60 seconds for the system to become available N A Event log Power BBU Present Total Loss No effect provided outage is shorter than BBU hold time System unavailable N A Event log Power BBU Present ...

Page 141: ... No effect Stripe will be rebuilt on alternate sectors Performance may drop Disk statistics updated in controller If threshold met Event log and E mail Disk RAID Level 0 Medium Error Data loss None except for the data loss None Disk statistics updated in controller If threshold met Event log and E mail Cable SCSI cable total failure No effect System unavailable unless alternate SCSI path is used i...

Page 142: ...ect Performance may drop Disk statistics updated in controller If threshold met Event log and E mail Backplane RAID Level 0 SATA link degraded No effect No effect Performance may drop Disk statistics updated in controller If threshold met Event log and E mail Enclosure Fan Failure No effect System availability at risk until fan replaced No effect Event log and E mail Enclosure PSU module failure N...

Page 143: ...ing controller reboot System is unavailable during controller reboot Controller takes 7 seconds to reboot and 60 seconds for the system to become available Performance may drop if command timeouts occur Event log and E mail NOTE E mail refers to an e mail notification sent by the controller over the Ethernet interface to an assigned e mail address Event log refers to an event logged in the Event L...

Page 144: ...ature in the system is now within the acceptable range Creating RAID name useable capacity capacity GB RAID name is now accessible Initialising RAID name Initialization of RAID name deferred for a higher priority RAID RAID name initialization complete Deleting RAID name Expanding RAID name by adding rows Expanding RAID name by adding number of columns column s Initialising expansion space on RAID ...

Page 145: ...gher priority RAID RAID name verification complete Logical volume name created Logical volume name deleted Logical volume name capacity expanded to capacity Logical volume name ID LUN changed to SCSI ID LUN Logical volume name changed to new name Starting Firmware version build time and date reboot reboot count Network up at IP address IP address netmask netmask ...

Page 146: ...eat the missing disk Backup data schedule a disk replacement Power Supply Module in slot number is not working properly Reseat the power cord on both ends Verify that power is being supplied from the power socket Schedule a PSU module replacement Fan in slot number is not working properly Schedule a fan module replacement NVRAM battery is exhausted and needs replacement Schedule NVRAM Battery repl...

Page 147: ...nd failed to complete Usually followed by another warning indicating reason Follow action for the other warning RAID name is degraded due to disk failures Backup data schedule a disk replacement RAID name is inaccessible due to disk failures Schedule multiple disk replacements Restore data from last backup RAID name has no spare available Assign a spare disk to the RAID Cannot start scheduled veri...

Page 148: ...FIBRE to SAS SATA RAID SUBSYSTEM 148 User Manual An attempt to write Flash memory failed If upgrading firmware retry upgrade Schedule controller replacement ...

Page 149: ...ons to be installed Controller Firmware Expander Firmware proSES Firmware proRAID Manager 1 10 v379 1 13 1 5 25 1 11 v379 1 13 1 5 25 1 20 v388 1 16 1 5 34 1 30 v389 1 18 1 5 35 support Web GUI Rules for Upgrading Firmware to Version 1 30 Uninstall current version of proRAID Manager then install the new version of proRAID Manager Upgrade proSES Firmware Power off then power on the subsystem Upgrad...

Page 150: ...ory of proRAID Manager and run the Uninstall program 2 Install the new proRAID Manager version 1 5 35 A Insert install CD B Select the proRAID Manager version for your OS and download the installation files C Run the install program Install exe 3 Upgrade the proSES Firmware Check proSES board version installed in your system Each proSES board version is upgraded differently PRO 90 6601 is SES vers...

Page 151: ...l port of your PC b Open HyperTerminal in your Windows PC and setup as follows Settings Baud Rate 115200 for SES board PRO 90 5601 Data Bits 8 Parity None Stop Bits 1 Flow Control None c To access the SES console press ENTER at least once to verify the SES console session has been established a prompt should appear if configured properly d At the prompt type proses upgrade followed by ENTER ...

Page 152: ...ayed f Go to the Transfer menu at the top of the HyperTerminal window and select the Send File option g In the Send File message box select Ymodem from the Protocol pull down menu h Select the Browse button and locate the new firmware image file Select firmware file EP95601_118 bin and click Open ...

Page 153: ...Click Send to start upgrade process The upgrade process will be shown j Check if firmware upgrade is completed successfully k Use LCD panel to check if the new SES firmware has been updated Use arrow down key until you see SES2 and its firmware version ...

Page 154: ...e RAID subsystem Power on RAID subsystem c Connect RS232 cable Phone Jack to DB9 from RS232 port of SES module to available serial port of your PC d Open HyperTerminal in your Windows PC and setup as follows Settings Baud Rate 38400 for SES board PRO 90 6601 Data Bits 8 Parity None Stop Bits 1 Flow Control None e To access the SES console press ENTER at least once to verify the SES console session...

Page 155: ... Go to the Transfer menu at the top of the HyperTerminal window and select the Send File option i In the Send File message box select Xmodem from the Protocol pull down menu j Select the Browse button and locate the new firmware image file Select firmware file EP96601_118 bin and click Open ...

Page 156: ...ade process will be shown l Check if firmware upgrade is ok m Power off RAID subsystem n Remove the SES module Remove the jumper in JP8 o Repeat steps b to m then continue with step p p Power on the RAID subsystem Use LCD panel to check if the new SES firmware has been updated Use arrow down key ...

Page 157: ...controllers in the RAID subsystem c Warning message will be displayed Click Yes to start upgrade process which takes several minutes d Select the controller firmware binary file version 1 21 e When Confirm Firmware Details message box is displayed select Yes to confirm upgrade f Upgrade process will start Verify if new firmware is downloaded successfully 5 Reset the controller s when prompted a Co...

Page 158: ...ile can be used only when upgrading the Expander s firmware via proRAID Manager c Double check if the new Expander Firmware is already displayed in the Expanders table in Monitoring Æ System Information 7 Power off the RAID subsystem Power on after several seconds 8 Upgrade Controller Firmware to Web GUI version 1 30 a Click menu Administration Service Options Controller Services Upgrade Controlle...

Page 159: ... reset the controller s select No 10 Power off the RAID subsystem Power on after several seconds 11 Open web browser and type the IP address of controller The proRAID Manager web GUI version will be displayed NOTE Default Username is admin and default Password is admin ...

Page 160: ...ated IP address within 15 minutes IMPORTANT ProSES board PRO 90 6601 will not show in the LCD the controller s IP address after upgrading the firmware to the web GUI version controller FW 1 30 expander FW V389 and proSES FW 1 18 If proSES board is PRO 90 5601 the LCD will display the controller s IP address after upgrade 13 For PRO 90 6601 SES board to see the controller IP address connect phone j...

Reviews: