Silicon Graphics InfiniteStorage 3000, User Manual

Page 1: ...SGI InfiniteStorage Server 3000 ISS3000 User s Guide 007 5721 001 ...

Page 2: ...ent of Defense units b 48 CFR 227 7202 of the DoD FAR Supplement or sections succeeding thereto Contractor manufacturer is SGI 46600 Landing Parkway Fremont CA 94538 TRADEMARKS AND ATTRIBUTIONS Silicon Graphics SGI the SGI logo Roamer Supportfolio and XFS are trademarks or registered trademarks of Silicon Graphics International Corp or its subsidiaries in the United States and or other countries w...

Page 3: ...007 5721 001 iii Record of Revision Version Description 001 March 2011 Original printing ...

Page 4: ......

Page 5: ...upport Services 3 Key Components of ISS3000 3U Servers 4 Power Supply Options 8 AC 8 DC 8 2 Pre Installation Guidelines 9 Server and Rack Positioning 9 Electrical Power 10 Operating Environment 10 Rack Stability 11 Cables 11 Security 11 3 Installation Guidelines 13 Getting Ready to Install 14 Determine Server Positioning in the Rack 14 Installing into a Rack or Cabinet 15 Installing into a Telco R...

Page 6: ...re RAID SATA 24 Configuring Software RAID 24 7 Software Installation and Tuning 25 Linux Server Configuration 25 Operating System Installation 25 Filesystem Selection 26 Data Drive Configuration Hardware RAID 26 Exporting Filesystems 27 Tuning Linux NFS Server Performance 27 Tuning Linux Client Performance 27 Using Smartmontools Software to Improve Availability 28 Windows Server Configuration 28 A...

Page 7: ...Contents 007 5721 001 vii JBOD Just a Bunch of Disks 36 RAID 1 36 RAID 5 37 RAID 6 Dual Parity 37 ...

Page 8: ......

Page 9: ...tem installation and general operation The appendices include technical specifications safety practices and an overview of RAID Audience This guide is written for owners installers system administrators and users of ISS3000 servers It is written with the assumption that the reader has a good working knowledge of computers and computer systems ...

Page 10: ... online You can obtain SGI documentation release notes or man pages in the following ways Refer to the SGI Technical Publications Library at http docs sgi com Various formats are available This library contains the most recent and most comprehensive set of online books release notes man pages and other information Refer to the SGI Supportfolio webpage for documents whose access require a support c...

Page 11: ...ca contact the Technical Assistance Center at 1 800 800 4SGI or contact your authorized service provider If you are outside North America contact the SGI subsidiary or authorized distributor in your country Be sure to have the following information before you call Technical Support Product serial number Product model name and number Applicable error messages Add on boards or hardware Third party h...

Page 12: ...front matter of the manual In printed manuals the document number is located at the bottom of each page You can contact SGI in any of the following ways Send e mail to the following address techpubs sgi com Contact your customer service representative and ask that an incident be filed in the SGI incident tracking system Send mail to the following address SGI Technical Publications 46600 Landing Pa...

Page 13: ...ISS3000 3U Server Series The ISS3000 3U server series consists of the following models Model Description 3006 A maximum of 6 hard drives 3009 A maximum of 9 hard drives 3012 A maximum of 12 hard drives 3118 A maximum of 18 hard drives If your server was ordered from SGI and was not constructed in one of the standard 3U form factors that are detailed in this manual then this manual will provide a g...

Page 14: ...o back for double density two post front or center mount Auto switching 100 240VAC or 48VDC 36 to 73VDC power supply options Three rack units 3RU high Configurable Options Supports up to two Intel Xeon or AMD Opteron processors Configurable number of hard drives Up to 6 removable hard drives ISS3006 model Up to 9 removable hard drives ISS3009 model Up to 12 removable hard drives ISS3012 model Up t...

Page 15: ...the following World class customer support and services Availability of our professional services team to help with solutions outside traditional support packages Flexibility of server configurations to accommodate customer specific operating system solutions Warranty options with full telephone and online support ...

Page 16: ...rs are quite similar Figure 1 1 shows the components of the front and rear panels of the ISS3012 server Figure 1 1 Front and Rear Panel Components CD or DVD drive Power button Front panel I O LCD display LED indicator lights RJ 45 management port PCI expansion slot Hard drive carriers 12 Power supply Rear fans ...

Page 17: ...this area is space for an LCD display that is used with a Roamer remote management module if one was purchased with the server Front panel I O The I O interface to the motherboard The configuration of the various I O ports is dependent on the motherboard used in your configuration For detailed I O specifications refer to the motherboard manual included with the documentation and accessory kit Typi...

Page 18: ...n be turned on or set to blink via Roamer so that a technician can easily identify a unit that may need service PCI expansion slot This slot is to accommodate add on PCIe cards Power button This single push push button is a power on off button When the system is in an off state pushing the button once powers the system on When the system is in an on state pushing and releasing the button power the...

Page 19: ...oamer remote management module is installed this port functions as an interface to the module When the Roamer remote management module is not installed the pinout for the serial connector is as shown in Table 1 2 Table 1 2 Pinouts for the Serial Connector J3 Pin Name Description 1 RTS Request To Send JP1 A CTS Clear To Send JP1 B 2 DSR Data Set Ready 3 RxD Receive Data 4 GND Ground Return 5 GND Gr...

Page 20: ... power supplies SGI offers a Redundant Power Supply RPS configuration option for some configurations AC For AC powered servers SGI typically uses a 250W or 450W power supply or a redundant supply for RPS systems The power supply provides a small footprint and can handle a peak of 450W DC output The input is 100 240VAC 43 63Hz DC For DC powered servers SGI uses a 250W or 450W power supply The power...

Page 21: ... Server and Rack Positioning Follow these guidelines to ensure that the server is safely and appropriately positioned for efficient operation and service When determining the location for the server position it so that there is adequate space for airflow and servicing When positioning the server in a rack be sure to allow adequate space for airflow and servicing from the front and the rear Clearan...

Page 22: ...e power supply for the rack is sufficient for the planned components When planning electrical power arrangements make sure you have more power available than specified for all components Also make sure the power load is distributed evenly among circuits to the location of the rack Make sure power connections for the server and all other components are grounded See the Appendix A Technical Specific...

Page 23: ... efficiency in server operation and ease of maintenance handling cables properly is required Arrange all component cables so they do not interfere with access to the rack To ensure full signal strength for Ethernet serial and other connections make sure the cables do not exceed established length limits Security The following are security considerations If using a server cabinet that is not in a s...

Page 24: ......

Page 25: ...top system Do not place a monitor on the server or place anything on top of the enclosure Additional weight on top of the server could cause damage to internal components Your server can be installed in these types of racks Open four post rack 19 wide 24 26 deep or 29 36 deep Cabinet with four post rack inside 19 wide and 29 36 deep Two post Telco rack 19 wide The server is three rack units 3RUs t...

Page 26: ... one of the following two English size 10 32 or 12 24 Metric size M5 for racks with metric holes Check the documentation for your rack and if screws are provided use those Clear a table cart or other flat surface near the rack You will need a space to temporarily place the server during installation Determine Server Positioning in the Rack Review the guidelines for positioning the server in the ra...

Page 27: ... as follows 1 Position the server so that the two ears on the side of the server are positioned equally and level in the rack 2 Install four screws through the mounting ears and into the rails of the rack Typical screw sizes are 10 32 and 12 24 Check the accessory kit for spare screws If your rack does not have threaded holes you will be required to provide threaded inserts to snap into the rails ...

Page 28: ...signed for use in a high capacity server Label each cable so that you can locate a specific cable quickly Ethernet ports on the server are numbered 0 and 1 0 is the primary ethernet port and 1 is the secondary Warning Because the server is being installed into a rack with other equipment be certain that the power used with the rack is designed to carry the electrical load of all of the devices in ...

Page 29: ...his chapter describes the drive insertion order and the procedure for inserting hard drives Drive Insertion Order Table 4 1 shows the drive insertion order for model ISS3006 Table 4 2 shows the drive insertion order for model ISS3009 The chassis for the ISS3006 and ISS3009 use a 1x3 backplane Drive slots 3 7 and 11 where applicable are skipped Table 4 1 Drive Insertion Order ISS3006 0 4 1 5 2 6 Ta...

Page 30: ...3012 Table 4 3 Drive Insertion Order ISS3012 6Gb Backplane SAS SATA with One 12 port SAS SATACard 0 1 2 3 4 5 6 7 8 9 10 11 Table 4 4 Drive Insertion Order ISS3012 6Gb Backplane SAS SATA with Two 8 port SAS SATA Cards 0 0 0 1 0 2 0 3 0 4 0 5 0 6 0 7 1 0 1 1 1 2 1 3 Table 4 5 Drive Insertion Order ISS3012 3Gb Backplane 3 2 1 0 7 6 5 4 11 10 9 8 ...

Page 31: ...he disk insertion order for configurations of the ISS3118 with 3Gb or 6Gb backplanes Table 4 6 Drive Insertion Order ISS3118 3Gb Backplane 3 2 1 0 7 6 5 4 11 10 9 8 15 14 13 12 Table 4 7 Drive Insertion Order ISS31118 6Gb Backplane 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 ...

Page 32: ...rrier with the printed circuit board side facing down see Figure 4 1 3 Carefully align the mounting holes in the hard drive and the carrier Make sure the bottom of the hard drive and bottom of the hard drive carrier are flush 4 Secure the hard drive using all four screws see Figure 4 1 5 Replace the drive carrier into the chassis Make sure to close the drive carrier using the drive carrier handle ...

Page 33: ...e server While the server is powering up the power LED on the front of the chassis is lit If a power failure occurs the server can be started automatically when power is restored This is only available if the Rackable Roamer remote management module was ordered for the server If the operating system you installed on the server supports the Wake on LAN feature the Wake on LAN feature can turn on th...

Page 34: ...is begins the shutdown of the operating system if this feature is supported by your system If the operating system stops functioning you can press and hold the power control button to turn off the server The Roamer remote management module if one is present in your server can be used to turn off the server Working with Roamer Remote Management If the server you purchased has the optional Roamer re...

Page 35: ...roller card configurations If your server does not have a 3ware or LSI card refer to the documentation that accompanied your RAID controller card for instructions LSI Hardware RAID SAS or SATA 1 During the boot up sequence access the LSI controller configuration screen by pressing Alt 3 The system displays instructions to guide you 2 Follow the instructions to create the RAID partition of choice o...

Page 36: ...trators to perform RAID diagnostics and performs automatic notification of drive failures Configuring Software RAID Software RAID arrays are configured through the server operating system To configure a RAID array using software RAID do the following 1 Follow the hardware RAID setup instructions above for the RAID card that is installed on the server 2 Enter the RAID card BIOS screen and erase any...

Page 37: ...the installation and tuning of Linux systems This section assumes a moderate level of Linux system administration skills Operating System Installation The system may include separate boot drives that are isolated from the RAID array s Install the operating system on the drives that are separate from the drives in the array When using software RAID on the data drives isolate the boot drive from the...

Page 38: ... BIOS configuration In Linux these devices will be visible as dev sdx where x is a letter Identify the correct device name that is to be configured Create a filesystem using the method applicable for the filesystem that was selected earlier For example to create an XFS filesystem on dev sda enter the following command mkfs xfs dev sda After the filesystems have been created create mount points Add...

Page 39: ...eadahead 128 Enter sysctl e p etc sysctl conf to apply the changes Tuning Linux Client Performance Client side optimization is required to achieve the most performance possible with a Linux server configuration Varying the mount options is the most effective way to optimize the Linux client Using NFS v3 over UDP with the RSIZE and WSIZE mount options set to 32768 will optimize the client for strea...

Page 40: ...ta availability You can schedule the tests to run without manual intervention Verify that the test has completed by entering the smartctl command with the appropriate port number and device specified as shown in the following example smartctl a d3ware 4 dev sda After test completion you can analyze the test data If any tests return errors submit the test data to SGI Support to determine the approp...

Page 41: ...ots One PCIe slot dedicated to RAID Up to 7 PCIe slots Controller support SAS or SATA SAS or SATA SAS or SATA SAS or SATA RAID levels supported 0 1 5 6 10 50 0 1 5 6 10 50 0 1 5 6 10 50 0 1 5 6 10 50 Chassis mount Half depth back to back or two post front or center Half depth back to back or two post front or center Half depth back to back or two post front or center Full depth with four post rack...

Page 42: ...0 F Operating humidity 8 80 8 80 8 80 8 80 Max thermal sustained output 1600BTU hr 1800BTU hr 2000BTU hr 2000BTU h Compliance US FCC CFR47 Part 15 Class B Europe CE EN55022 EN55024 Australia C TICK Japan VCCI US FCC CFR47 Part 15 Class B Europe CE EN55022 EN55024 Australia C TICK Japan VCCI US FCC CFR47 Part 15 Class B Europe CE EN55022 EN55024 Australia C TICK Japan VCCI US FCC CFR47 Part 15 Clas...

Page 43: ...ng or installing main system components such as the motherboard memory modules and drives When disconnecting power you should first power down the system with the operating system first and then unplug the power cords of all the power supply units in the system When working around exposed electrical circuits another person who is familiar with the power off controls should be nearby to switch off ...

Page 44: ...toned shirt sleeves which can come into contact with electrical circuits or be pulled into a cooling fan Remove any jewelry or metal objects from your body They are excellent metal conductors that can create short circuits and harm you if they come into contact with printed circuit boards or areas where power is present After accessing the inside of the system close the system back up and secure i...

Page 45: ...en connecting or disconnecting a cable always hold the cable by its connector Never force a connector into a port If the connector and port do not join with ease check the matching of the connector with the port Correct positioning when joining a connector to a port is also essential Protect the server and its components from direct sunlight and rain or other moisture Keep all ventilation openings...

Page 46: ......

Page 47: ...AID system has a write cache dedicated to managing the RAID A hardware implementation of RAID requires a RAID controller This may be a PCIe expansion card or may be a card onboard the system motherboard in some systems Disks may be of any type SAS or SATA The controller links to the system with a high speed SCSI or iSCSI connection The controller handles the management of disks including parity ca...

Page 48: ...is commonly used to turn several odd sized drives into one useful drive One advantage JBOD has over RAID 0 is in the case of drive failure When a single drive of a RAID 0 array fails usually it will result in the loss of all data in the array When a drive failure occurs in a JBOD array only the data on the affected drive is lost RAID 1 RAID 1 creates an exact copy or mirror of all the data on two ...

Page 49: ...lated and rewritten The disk used for the parity block is staggered from one stripe to the next The parity blocks are not read on data reads The parity blocks are used when a read of a data sector results in a CRC cyclic redundancy check error In a case like this the sector in the same relative position within each of the remaining data blocks in the stripe and within the parity block are used to ...

Page 50: ......