IBM 88553RX, Installation Manual

Page 1: ...anning and Installation Guide uide David Watts Aubrey Applewhaite Yonni Meza Describes the technical details of the new 64 bit server Covers supported Windows and Linux 64 bit operating systems Helps...

Page 2: ......

Page 3: ...IBM Eserver xSeries 455 Planning and Installation Guide February 2004 International Technical Support Organization SG24 7056 00...

Page 4: ...Restricted Rights Use duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp First Edition February 2004 This edition applies to the IBM Eserver xSeries 455 machine type 8855...

Page 5: ...assembly 13 1 4 3 PCI X board assembly 17 1 5 Remote Supervisor Adapter 19 1 6 RXE 100 Expansion Enclosure 21 1 7 Multinode scalable partitions 22 1 7 1 RXE 100 connectivity 24 1 7 2 Multinode configu...

Page 6: ...61 3 1 4 Broadcom Gigabit Ethernet controller 64 3 2 Cabling and connectivity 65 3 2 1 SMP Expansion connectivity 67 3 2 2 Remote Expansion Enclosure connectivity 70 3 2 3 Remote Supervisor Adapter co...

Page 7: ...tion about the installed system 163 4 4 7 Using the serial port for the Linux console 171 4 4 8 RXE 100 Expansion Enclosure 172 4 4 9 Upgrading drivers 173 Chapter 5 Management 175 5 1 IBM Director 17...

Page 8: ...vi IBM Eserver xSeries 455 Planning and Installation Guide IBM Redbooks 203 Other publications 203 Online resources 204 How to get IBM Redbooks 208 Help from IBM 208 Index 209...

Page 9: ...in this publication at any time without notice Any references in this information to non IBM Web sites are provided for convenience only and do not in any manner serve as an endorsement of those Web s...

Page 10: ...on and Rational Software Corporation in the United States other countries or both Rational The following terms are trademarks of other companies Intel Intel Inside logos MMX and Pentium are trademarks...

Page 11: ...Planning on page 55 describes the considerations when planning to purchase and planning to install the x455 It covers such topics as configuration operating system specifics scalability and physical s...

Page 12: ...ers implement new technology with particular emphasis on xSeries hardware He holds a Bachelor of Science Degree in Sociology and Politics from Aston University and is an MCSE for both Windows NT and W...

Page 13: ...n Raleigh Steve Powell Service and Support Education Team Raleigh Ken Rauch Delivery Project Manager Markham Jose Rodriquez Ruibal Advanced Technical Support EMEA Steve Russell EMEA ATS xSeries Produc...

Page 14: ...us your comments about this or other Redbooks in one of the following ways Use the online Contact us review redbook form found at ibm com redbooks Send your comments in an Internet note to redbook us...

Page 15: ...eries product family leveraging the proven Enterprise X Architecture to deliver robust and reliable 64 bit systems Features on page 2 The x455 base models on page 4 System assembly on page 6 IBM XA 64...

Page 16: ...de partition Scalable system partitioning in two node and four node configurations via three scalability ports Connectivity to an RXE 100 external enclosure for an additional 12 PCI X slots upgradeabl...

Page 17: ...0 Physical partitioning within a single node Partial mirroring of memory Hot add swap of the CD ROM or diskette drive if installed Inter Process Communications IPC over scalability ports Hot adding me...

Page 18: ...round the clock The initial models of the x455 are listed in Table 1 2 Table 1 2 Initial x455 base models The base models can also be connected together to form two node eight CPUs and four node 16 CP...

Page 19: ...light blue DVD CD RW drive Hot swap power supplies Blank media bay Light Path Diagnostics panel pulls out Hot swap drive bays System power connector 1 System power connector 2 RXE Expansion Port B con...

Page 20: ...the right of the midplane board and under the memory board assembly It houses the Itanium 2 processors Cache and Scalability Controller and the 64 MB of Xcel4 cache The memory board assembly This is l...

Page 21: ...hitecture chipset used initially in the x440 and applies the same technologies to the IA 64 architecture The XA 64 chipset comprises the following components Itanium 2 processor s Cache and Scalabilit...

Page 22: ...0 SCSI Gigabit Ethernet Video 3x USB Serial RSA 33 MHz 66 MHz 64 bit 66 MHz 64 bit 100 MHz 64 bit 133 MHz Bus A 66 MHz RXE Expansion Port A 1 GBps B 100 D 133 C 133 IBM XA 64 Summit core chipset 6 4 G...

Page 23: ...Intel Itanium Architecture processors are initialized and tested in parallel The first processor to complete initialization becomes the BSP The CPUs are connected together with a 200 MHz frontside bu...

Page 24: ...lows up to four processors in a 4U dense machine Table 1 4 outlines some of the differences between the Itanium and Itanium 2 processors both the Madison and the earlier McKinley processor Table 1 4 I...

Page 25: ...entium III Xeon processor had a 100 MHz frontside bus that equated to a burst throughput of 800 MBps With protocols such as TCP IP this had been shown to be a bottleneck in high throughput situations...

Page 26: ...ulations and data analysis Allows for faster storage and movement of large models CAD CAE Speeds up simulation and rendering times For more information about the features of the Itanium 2 processor go...

Page 27: ...ng system as the hardware Check with your operating system Help for details Figure 1 7 The memory board assembly showing the two memory ports The memory board assembly is also equipped with LEDs for l...

Page 28: ...rmed simultaneously from both ports two separate paths into the memory controller as shown in Figure 1 4 on page 8 leading to improved memory performance Figure 1 8 Memory DIMMs are divided into two p...

Page 29: ...rable errors An excessive rate of recoverable errors reported triggers Memory ProteXion to replace the failing locations Memory mirroring Memory mirroring is equivalent to RAID 1 in disk arrays in tha...

Page 30: ...ry error is detected during POST or memory configuration the server can automatically disable the failing DIMM and continue operating with reduced memory capacity You can manually re enable the memory...

Page 31: ...nsion I O RXE ports for connectivity to the RXE 100 Expansion Enclosure The RXE 100 provides up to an additional 12 PCI X slots and can be connected by a single cable to port A or to both ports A and...

Page 32: ...external port using the LSI 53C1030 chipset The internal port supports both single disks and RAID 1 mirrored pairs of disks The external port will support additional RAID configurations but this has...

Page 33: ...nect bus Serial port External power port There are no PS 2 keyboard or mouse ports on the x455 USB keyboard and mice are supported If you require KVM support the 1 5 M USB Conversion Option UCO part n...

Page 34: ...h no other software required Enhanced security features Graphics text console redirection for remote control Dedicated 10 100 Ethernet access port ASM interconnect bus for connection to other service...

Page 35: ...ared mode and have both RXE Expansion Ports connected Runtime failures will be logged in the System Error Log The broken connection is not re established at runtime A Reboot is required to recover fai...

Page 36: ...artition must have the following Same base model Processors that have the same core speed and cache Memory mirroring that is configured the same on all nodes that is either all enabled or all disabled...

Page 37: ...y fail at either runtime or boot time and the system will continue to operate properly Runtime failures will be logged in the System Error Log For properly configured four node systems one of the scal...

Page 38: ...requirements Memory 56 GB 112 GB 224 GB XceL4 Cache 64 MB 128 MB 256 MB Internal hard disks 2 4 8 Active 64 bit PCI X slots 2 x 66 MHz 2 x 100 MHz 2 x 133 MHz 4 x 66 MHz 4 x 100 MHz 4 x 133 MHz 8 x 6...

Page 39: ...e options are fairly self explanatory and allow you to configure the following Partition size two node or four node x455 Node A x455 Node B 1 3 2 2 3 1 RXE 100 A A RXE 100 B B A B 1 2 3 SMP Scalabilit...

Page 40: ...overy With a multinode configuration in the event there is a major problem with one of the nodes the remaining nodes will boot to EFI as single node partitions This is done to facilitate diagnostics a...

Page 41: ...for longer than two minutes The fan compartments need to be fully populated even if the fan is defective Therefore remove a defective fan only when a new fan is available for immediate replacement Tw...

Page 42: ...quires the server to be slid out of the rack For the fourth level of diagnostics LEDs on major system components indicate the component causing the error As the processor board assembly is not visible...

Page 43: ...em and platform firmware as shown in Figure 1 16 on page 30 The interface offers platform related information to the operating system as well as boot and runtime service calls that are available to th...

Page 44: ...dware and or operating system Consider for example the situation where a new type of boot device say a USB key is to be implemented First the legacy BIOS would have to offer an option to choose this n...

Page 45: ...ty features Tools are available from Intel s Web site to assist with this If you have not used an EFI system before you will come across a number of new acronyms These are listed in the table below wi...

Page 46: ...g this amount of disk space efficiently GPT disks use primary and backup partition tables for redundancy and CRC32 fields for improved partition data structure integrity For backward compatibility wit...

Page 47: ...e operating system installations create multiple data partitions An example directory structure for an EFI System Partition present on a hard disk with Linux and Windows Server 2003 installed is as fo...

Page 48: ...educed legacy concept The EFI is reduced legacy which means that it eliminates certain hardware and firmware elements of the original PC architecture while advancing the PC s stability and usability T...

Page 49: ...flexible pay as you grow approach to buying high end 32 bit and 64 bit xSeries systems that can be scaled quickly easily and inexpensively Enterprise X Architecture technology is designed to achieve u...

Page 50: ...evolutionary new economic model for servers through its flexible modular design The x455 Enterprise X Architecture based server allows customers to XpandOnDemand the ability to grow when you need to u...

Page 51: ...ory controller to bottleneck This happens when more than three or four processors are installed in the same system Non uniform Memory Access NUMA is an architecture designed to improve performance and...

Page 52: ...ves performance because it filters most snooping operations The IBM XceL4 cache improves scalability with more than four processors because it also caches remote data addresses So before any processor...

Page 53: ...x450 can be useful for your business The topics covered are Migrating to a 64 bit platform on page 40 Scalable system partitioning on page 41 Operating system support on page 42 Server consolidation...

Page 54: ...dowsserver2003 64bit ipf ia32el mspx A similar driver for Linux is also planned To fully take advantage of 64 bit computing it is important that your existing 32 bit applications are re written and or...

Page 55: ...This forms part of IBM s pay as you grow strategy that allows customers to only pay for what they need With the x455 you can start with a minimum configuration and scale up though several stages up t...

Page 56: ...ting the x455 supported hardware partitioning only Software partitioning using products such as those from VMware were not supported 2 2 1 RXE 100 Expansion Enclosure The RXE 100 forms part of IBM s X...

Page 57: ...perating system and applications from all the nodes Server consolidation has many interpretations and covers many areas There is no single strategy or methodology that can be applied that will yield a...

Page 58: ...ve ease of installation Reduce total cost of ownership IBM ServerProven Program participants agree to work closely with IBM engineers during product test cycles and over product life cycles This means...

Page 59: ...an Original Equipment Manufacturer OEM partner such as IBM When choosing Datacenter Edition a customer has the ability to choose the best and most appropriate qualified OEM to provide all hardware se...

Page 60: ...ironments These include Database applications Business logic e Business and security transactions In house developed compute intensive applications Science and technology Figure 2 1 xSeries 450 based...

Page 61: ...he need to go to memory or disk for database transaction elements is greatly reduced and this directly implies a performance increase faster access to data and improved throughput Itanium 2 systems ar...

Page 62: ...els of performance and reliability by exploiting the capabilities of the new systems As the adoption of IA 64 architecture continues to move forward with most major server system OEMs using Windows an...

Page 63: ...int engine capable of addressing much larger amounts of memory helps speed up data intensive BI applications that help companies to increase employee productivity Enterprise Resource Planning ERP is a...

Page 64: ...d new customers In order to achieve these goals e business requires a highly scalable reliable and secure server platform The x455 is a strong candidate for an application integration server that inte...

Page 65: ...ce benefits IA 64 parallelism is managed by the compiler itself Application development does not require special techniques before it is compiled Currently available compilers optimized for Itanium 2...

Page 66: ...er of technologies developed in previous xSeries models and other IBM developed technology The mainframe inspired x445 that provides reliable and scalable partitioning The x380 the first 64 bit xSerie...

Page 67: ...e required to read this implied parallelism from the machine code re build it and execute it The parallelism is there but it is not as obvious to the processor and more work has to be done by the hard...

Page 68: ...data storage and manipulation Databases can store more of their data in the physical memory of the system Data access is faster because disk reads are not necessary Applications can manipulate large a...

Page 69: ...ation of your x455 system and before you begin implementing the system The topics covered are System hardware on page 56 Cabling and connectivity on page 65 Storage considerations on page 79 Rack inst...

Page 70: ...x455 One two three or four processors can be installed Each processor must be the same speed and cache size Each processor option includes the processor with heatsink pre assembled and its associated...

Page 71: ...mory modules http www pc ibm com us compat machines x455 html When installing memory DIMMs they must be installed in matched pairs size and technology in the order shown in Table 3 3 Table 3 3 DIMM or...

Page 72: ...tolerance and high levels of availability Key configuration rules relating to memory mirroring are Memory mirroring must be enabled in the System Setup in the EFI it is disabled by default See Enablin...

Page 73: ...roring must be enabled in the Configuration Setup utility The configuration rules for memory mirroring apply here specifically that the DIMMs in partner banks across the two ports must be identical Se...

Page 74: ...should install four DIMMs of the same size at a time into a bank see Table 3 4 on page 59 In this configuration all memory addresses are spread across all four DIMMs in the bank and when accessed both...

Page 75: ...pters in a single bus will operate at the slowest of three speeds The rated speed of adapter 1 The rated speed of adapter 2 if the bus the adapter is installed in has two slots The maximum speed of th...

Page 76: ...n the same bus However those two adapters will both operate in PCI mode In addition if you have a PCI X adapter installed you cannot hot add a PCI adapter to the same bus This is because with just the...

Page 77: ...brackets installed Before installing the adapter you must remove the extension handle or bracket The system scans PCI X slots to assign system resources The system attempts to start the first device...

Page 78: ...abit Ethernet connection ensure that your network infrastructure is capable of the necessary throughput to match the server s I O capacity Adapter teaming The Broadcom controller is capable of partici...

Page 79: ...trix html 3 2 Cabling and connectivity There are a number of unique factors to consider when cabling the x455 server These are discussed as follows SMP Expansion connectivity on page 67 Remote Expansi...

Page 80: ...iary console for the EFI After the operating system has booted the port is dedicated to the operating system as COM1 The RXE Expansion Ports provide connectivity to a RXE 100 Either a single cable in...

Page 81: ...mes with three 2 5 m SMP Expansion cables and one 3 5 m SMP Expansion cable part number 73P9715 Follow these recommendations in each server before cabling Update the system abstraction layer extensibl...

Page 82: ...k or to each other with an Ethernet crossover cable This connection is needed so that the Remote Supervisor Adapters can communicate and manage scalable partitions Four node configuration A four node...

Page 83: ...erver 3 Connect the cables according Table 3 7 Table 3 7 Connecting four nodes From To Node A Port 1 Node C Port 1 Node A Port 2 Node D Port 2 Node A Port 3 Node B Port 3 Node B Port 1 Node D Port 1 N...

Page 84: ...nal six or 12 PCI X slots to the server Only one RXE 100 can be connected to the x455 although this can be with either one or two data cables The RXE 100 has six 133 MHz 64 bit PCI X slots as standard...

Page 85: ...coexist in 64 bit slots in the same bus The 32 bit adapters will run in 32 bit mode and the 64 bit adapters will run in 64 bit mode When installing a 133 MHz PCI X adapter it must be installed in the...

Page 86: ...connecting to a six slot RXE 100 One server connecting to a 12 slot RXE 100 A two node server connecting to one shared RXE 100 Two standalone servers connecting to one shared RXE 100 Four nodes conne...

Page 87: ...e I O data cable is optional in this configuration However it is recommended because it provides redundancy if the other Remote I O cable fails The second cable also improves performance Tip The short...

Page 88: ...100 is supported in a shared configuration where six RXE slots are connected to each node The cabling is shown in Figure 3 10 Figure 3 10 8 way configuration with a shared RXE 100 6 PCI X slots to eac...

Page 89: ...n page 74 except that the cable between the x455s is not present Each independent server sees six slots in the RXE 100 Figure 3 11 Single RXE shared between to x455s Four nodes connecting to one or tw...

Page 90: ...anagement ASM family It provides around the clock remote access and system management of your server and supports the following features Remote management regardless of the status of the server Remote...

Page 91: ...hich supports systems management functions through null modem or modem connections This port is dedicated and can only be used for RSA purposes Ethernet port which provides system management functions...

Page 92: ...n program such as HyperTerminal in Windows or minicom in Linux First connect the RS 232 cable between the two systems The cable should be connected to the serial port of the server not the serial port...

Page 93: ...Area Networks SANs Network Attached Storage NAS SCSI over IP iSCSI IBM Enterprise Storage Server ESS ESCON connectivity to a zSeries server 3 3 1 xSeries storage solutions This section discusses some...

Page 94: ...P400 is optimized for Ultra320 SCSI with a sustained data transfer rate of 320 MBps For more information on IBM SCSI RAID storage solutions go to http ibm com pc ww eserver xseries scsi_raid html For...

Page 95: ...re supported on the FAStT200 This means that the maximum supported number of disk drives is 60 Hot swappable and redundant components provide high availability for the FAStT200 Storage Server A fan or...

Page 96: ...onto a multi node configuration of x455 systems The FAStT700 is a 4U rack mountable Fibre Channel RAID controller device with higher performance controllers These controllers are 2 Gbps and connect v...

Page 97: ...AID controller redundant hot swap power supplies redundant hot swap fans and supports RAID levels such as 0 implemented as a RAID level 10 1 3 and 5 and global hot spares It also supports four host si...

Page 98: ...gical volume that is implemented using multiple disk drives This allows ESS to connect to all IBM servers from zSeries to iSeries pSeries and xSeries directly or through a SAN thus helping the x455 fi...

Page 99: ...for xSeries servers For detailed information on these products go to http ibm com pc ww eserver xseries tape html The following IBM Redbooks discuss IBM tape solutions in greater detail IBM Tape Solut...

Page 100: ...e space approximately two inches for the front bezel and one inch for air flow must be maintained from the slide assembly to the front door of the rack cabinet to allow sufficient space for the door t...

Page 101: ...f the power supplies Connect each of these power connectors to separate power circuits to ensure availability if one circuit should fail The x455 ships with two 2 8 m 9 ft IEC 320 C13 to IEC 320 C14 p...

Page 102: ...that hardware drivers and firmware have been Microsoft Certified The HCL can be found at http www microsoft com whdc hcl search mspx For information about Windows Server 2003 Enterprise and Datacente...

Page 103: ...solely out of band with the service processor to create and manage static hardware partitions in the x455 These static partitions are referred to as scalable partitions throughout the Scalable Systems...

Page 104: ...on on what is required refer to the Solution Assurance Web sites EMEA and Americas information is available Procedures for Asia Pacific countries are currently in development 3 8 1 Trigger Tool The SA...

Page 105: ...operating system installation procedures that are specific to the x455 The following topics are discussed Using The Extensible Firmware Interface on page 92 Configuring scalable partitions on page 13...

Page 106: ...the Remote Supervisor Adapter Boot from Remote Supervisor Adapter CD ROM or diskette and run the configuration utility Run the Remote Supervisor utility from the EFI shell See Remote Supervisor Adapte...

Page 107: ...configuration this screen will reflect the information pertaining to the partition and partition node members After the checkpoints the hardware components are listed while this proceeds a number of...

Page 108: ...ary Master failed Not Found Paused press any key to continue If a bootable CD is in the drive then always choose the first option the other two will also fail with the message as described above When...

Page 109: ...te Configuration Setup utility Error logging Boot Option Maintenance 4 1 2 The EFI shell The EFI shell allows the loading of EFI applications including booting installed operating systems from any EFI...

Page 110: ...he content of the NVRAM assigned to the server diagnostics Loading EFI Shell Built in EFI Shell version 1 10 14 61 Device Mapping Table fs0 MemMap 0 FF000000 FFFFFFFF fs1 MemMap 0 FF800200 FFBFFFFF fs...

Page 111: ...two entries is because EFI separates the EFI bootable part of the CD Entry1 and the data part Entry0 The two entries show that this CD is bootable If the CD was non bootable only one entry would exis...

Page 112: ...in Figure 4 4 If the appropriate mapping does not appear run map r where parameter r forces EFI to refresh the device mapping table Figure 4 4 Map command Tip All the EFI executable files have an exte...

Page 113: ...60 El Torito or Joliet format This differs from the x455 that only supported ISO9660 Writing to the DVD CD RW drive is not supported from the EFI shell If Joliet format is used then we recommend that...

Page 114: ...nnot be deleted by other means for example a Microsoft Reserved Partition see Microsoft Reserved Partition on page 137 Tip If you need to perform a low level format of the disk use the LSI Configurati...

Page 115: ...Version 1 0 Based on EFI core release Version 1 2 1 0 DiskPart 3 Issue the following commands list List all the disks in the system that can be deleted select dd Select the disk you will delete clean...

Page 116: ...cal disk size EFI tips and tricks By default the EFI has a basic set of tools to get you up and running However it is possible to enhance this by installing additional tools and making some basic modi...

Page 117: ...s that any attached keyboard or mouse can be used There are a number of EFI executables that are worth copying to the system partition so that they are available for maintenance and emergency purposes...

Page 118: ...rs See figure Figure 4 9 for an example Figure 4 9 Configuring PCI IDE ATAPI Bus Driver When this is complete you will be prompted to press Enter to restart the controller This restarts the controller...

Page 119: ...ry disk the disk marked as Primary in the Mirroring Properties menu to stay intact The contents are copied to the secondary disk during the first synchronization This feature means that the installati...

Page 120: ...ion Pro LSI RAID IRQ Bus Dev Fnc Alert duct Control Status 53C1030 01 03 00 None 1 03 08 00 IME Enabled Optimal 0 F1 Shift 1 Help ArrowKeys H J K L Select Item Change Item Esc Exit Menu Home I End O S...

Page 121: ...nce all the configuration changes are made press Esc The following message appears Warning Data on Secondary or Hot Spare Mirroring will overwrite 6 Confirm by pressing Enter and continue 7 Save the c...

Page 122: ...ns in the background You can begin the operating system installation at any time even while the synchronization is running During the synchronization the server may be restarted or turned off as neede...

Page 123: ...ion Main Menu From here you can view the controller status view the logical drive status or select more advanced functions Figure 4 14 shows an example of controller status Figure 4 14 Controller stat...

Page 124: ...allows you to configure your RAID cards either from a bootable CD or from the operating system For the x455 it provides the same functions as the LSI Driver Setup utility but presents a graphical fro...

Page 125: ...h the machine It will be disconnected at both ends 3 Disconnect both ends of the short SCSI cable and store it in a safe place 4 Connect one end of the long SCSI cable to the back plane of the interna...

Page 126: ...ated LSI chipset the operating system will need to be reinstalled should the customer decide to move to a ServeRAID adapter For more information see RETAIN tip H177072 http www ibm com pc support site...

Page 127: ...it finds that is the EFI System Partition This is not the one you want To resolve the issue you have to delete the firmware update files from the system partition and repeat the procedure If you want...

Page 128: ...nd that you do both at once follow these steps 1 Select Flash Update from the EFI Firmware Boot Manager menu Figure 4 2 on page 94 The following screen will be displayed Figure 4 18 Flash Update Utili...

Page 129: ...shown in Figure 4 3 on page 96 the backup file would be saved on fs4 Do not try to specify the full path to the file name because the utility does not accept full path syntax 5 At this point the Flas...

Page 130: ...sible file system but the update program FLASH2 EFI and data files must reside in the same directory The following files are required to be in the same directory to successfully update the Remote Supe...

Page 131: ...rvisor Adapter update utility 4 Select Update System Management Firmware from the main menu and press Enter 5 Read the warning window and press Enter You will be presented with the Firmware Update Opt...

Page 132: ...o return to the main menu and quit the utility 4 1 5 Configuration Setup utility Select Configuration and Setup Utility from the EFI Firmware Boot Manager menu see Figure 4 2 on page 94 to configure i...

Page 133: ...mware Boot Manager menu 2 Start the Setup program by selecting the Configuration Setup Utility from the EFI Firmware Boot Manager menu Figure 4 22 on page 118 appears 3 Select Advanced Set Up The foll...

Page 134: ...s can be turned on that can be used for general information or to diagnose problems These are for Debug information Debug trace Debug warning Debug error Tip Note the following tips When memory is add...

Page 135: ...et of the logs to be enabled to suit your desired outcome 3 Press Esc then save your settings 4 1 6 Diagnostic utility The ROM based diagnostics package can be started from the EFI Firmware Boot Manag...

Page 136: ...e Hidden Test Display 4 1 7 Boot Option Maintenance The Boot Maintenance Manager menu allows you to modify the EFI boot menu options including the ability to add to change or delete from the boot menu...

Page 137: ...Manager select EFI Shell Built in 2 Change to the file system where you want to save the file for example fs5 3 Run the command backup filename where filename is a valid filename A screen similar to t...

Page 138: ...18 backup Variable NV RT BS Efi ConOut DataSize 16 backup Variable NV RT BS Efi ErrOut DataSize 16 backup Variable NV RT BS blkio EDD30 DataSize 1 backup Variable NV RT BS Efi Driver0000 DataSize C6 b...

Page 139: ...ables y n y restore Variable NV RT BS Efi Lang DataSize 3 restore Variable NV RT BS Efi ConIn DataSize 18 restore Variable NV RT BS Efi ConOut DataSize 16 restore Variable NV RT BS Efi ErrOut DataSize...

Page 140: ...ady done so 8 The new option may or may not appear as a boot option at this stage If it has this is now complete If it does not appear follow the steps below 9 Select Boot Option Maintenance 10 Exit f...

Page 141: ...down press D 5 Select Save Settings to NVRAM and exit back to the EFI Firmware Boot Manager The EFI Firmware Boot Manager will now look like Figure 4 31 on page 128 and will PXE boot by default EFI Bo...

Page 142: ...boot option backup using the nvrboot efi utility Proceed with caution To delete an option follow the steps below 1 Select Delete Boot Option s from the EFI Boot Maintenance Manager The following scre...

Page 143: ...Option s Select an Option Windows Server 2003 Datacenter EFI Shell Built in Acpi PNP0A03 0 Pci 5 1 Ata Primary Master Acpi PNP0A03 0 Pci 5 1 Ata Primary Master CDROM Entry0 Acpi PNP0A03 0 Pci 5 1 Ata...

Page 144: ...d are not able to get back the default options then connect an auxiliary console ANSI terminal connected to the serial port and press Shift R when prompted to restore the EFI defaults EFI Boot Mainten...

Page 145: ...d continues with the secondary nodes in numeric order of the logical node IDs To change the primary node delete the scalable partition from the current primary node if it exists Then create a new scal...

Page 146: ...de Figure 4 34 Advanced Setup option 4 Select Scalable Partition Settings 5 Select Create Scalable Partition Settings See Figure 4 35 Figure 4 35 Create Scalable Partition Settings option 6 Use one of...

Page 147: ...teps i Select the number of PCI X slots available to each RXE Expansion Port on the remote I O enclosure ii Select the destination of Expansion Port A on the remote I O enclosure iii Select the destin...

Page 148: ...ort on the remote I O enclosure ii Select the destination of Expansion Port A on the remote I O enclosure iii Select the destination of Expansion Port B on the remote I O enclosure 7 Select Write Scal...

Page 149: ...lected in the position of the figure 4 in the second memory field Checkpoint 29 44 This is the last checkpoint reached on a secondary node The boot process will stop on this node at this point Node 1...

Page 150: ...ty cable fault on port 3 check cable performance degraded 4 3 Installing Windows Server 2003 In this section we guide you through the installation procedure for Windows Server 2003 Enterprise Edition...

Page 151: ...her primary data partitions The order of partitions on the Windows boot disk is shown in Figure 4 39 Figure 4 39 Windows boot GPT disk structure For information on the partitioning required by a Windo...

Page 152: ...ansion units are connected 2 Ensure that firmware levels of the following devices have been updated to the latest levels System EFI SAL Diagnostics Remote Supervisor Adapter RXE 100 refer to Remote Su...

Page 153: ...the installation CD in the drive 2 From the EFI Firmware Boot Manager menu select the CD ROM entry in the list as shown in Figure 4 40 on page 140 and press Enter Note Earlier problems that affected t...

Page 154: ...ROM drive is mapped as fs2 and fs3 the command line looks similar to fs3 setupldr Tip With a bootable CD there will be two file system entries typically fs2 and fs3 The first of the two entries will...

Page 155: ...ing Windows installation Allow Setup to create the EFI System Partition by pressing Enter If the disk you are installing on is still the old Master Boot Record MBR partitioning structure you should de...

Page 156: ...rver 2003 Datacenter Edition Setup Setup could not create a system partition automatically System partitions contains diagnostic or hardware configuration programs programs to start operating systems...

Page 157: ...k is recommended if you have both internal and external disks The sizes of the ESP and the MSR partition are calculated according to the rules described in EFI System Partition on page 33 and Microsof...

Page 158: ...2003 on IA 32 platforms 4 3 4 Post setup phase Once Windows has been installed you should perform the following steps Installing additional drivers Specific device drivers are available for the x455 t...

Page 159: ...igure 4 45 Some device drivers released for use with Windows Server 2003 may not be digitally signed Therefore when you install the drivers you may have to accept the warning that you are about to ins...

Page 160: ...should be at the same level as the installed ServeRAID firmware Figure 4 46 shows Device Manager after the Active PCI RSA and Broadcom Gigabit Ethernet controllers drivers have been installed Figure...

Page 161: ...ations see the devices from both nodes Accessing EFI System Partition from Windows To access the EFI System Partition from within the operating system use the following utility mountvol DriveLetter s...

Page 162: ...nager records are stored in NVRAM If the boot record is deleted from EFI NVRAM there is no other way to start Windows except by restoring the boot record from backups To back up and restore Windows bo...

Page 163: ...Windows EFI boot menu record perform the following steps 1 Invoke the EFI shell from the EFI Firmware Boot Manager menu Change to fsn where n is the system partition see The EFI shell on page 95 2 Cha...

Page 164: ...import was successful by booting from the newly created boot entry NVRBOOT OS Boot Options Maintenance Tool Version 5 2 3683 1 Windows Server 2003 Datacenter 2 EFI Shell Built in 3 Acpi PNP0A03 0 Pci...

Page 165: ...to achieve the best results The main tasks were Port the kernel itself Initial port of GNU Compiler Collection GCC to IA 64 architecture Port of GAS emacs ld GNUPro toolkit Port of performance measur...

Page 166: ...ce code and not an installable package Data types In 1996 The Open Group decided to extend the Single UNIX Specification for 64 bit Systems to create a new standard on 64 bit for any UNIX operating sy...

Page 167: ...istribution Unlike other operating systems when we talk about Linux we are not talking about one company one version or one distributor Linux is the kernel the base of the system and there are many co...

Page 168: ...The SCO Group SUSE LINUX and Turbolinux announced that they will work together to build a unique base for a Linux distribution The primary idea is to create a base system from which each company will...

Page 169: ...use Linux but do not have a unified distribution across their systems For more information about the UnitedLinux initiative go to http www unitedlinux com en info faqs html The IPF IA 64 Linux plans f...

Page 170: ...first CD of SLES 8 the requirements to use this Linux distribution are An Itanium or Itanium 2 processor At least 256 MB of main memory A hard disk larger than 10 GB Firmware version EFI 1 0 2 or 1 1...

Page 171: ...Installation procedure The installation procedure of SLES Version 8 is like any other SUSE LINUX installation except that you work on a different architecture so the bootable CD ROM will not boot dir...

Page 172: ...oot Manager menu loaded do the following 1 Insert SUSE LINUX Disk 1 into the drive 2 Select EFI Shell and press Enter 3 Enter the command map r to remap all file systems 4 Enter exit to go back to the...

Page 173: ...s any key the system will automatically boot SLES You can modify your boot settings EFI boot maintenance menu and the elilo conf file as we discuss later in Example 4 1 on page 162 The remainder of th...

Page 174: ...Although it is not necessary to insert the CD at this point it makes the installation process easier because the CD ROM file system is automatically detected and mapped 2 Wait for the EFI Firmware Boo...

Page 175: ...Network Configuration Firewall Configuration Additional Language Support Time Zone Selection Set Root Password Select packages for the installation 4 Follow the instructions for video card setup and m...

Page 176: ...s configured to boot on initlevel 5 by default etc If you do not press any key before the delay estimated on the elilo conf file Linux will start loading automatically To reduce the delay or remove it...

Page 177: ...source code or you do not want to recompile it to IA 64 4 4 6 Information about the installed system Our recently installed Linux system can offer us some information about the x455 such as CPU detail...

Page 178: ...ut it was never used during our tests Example 4 3 shows the output of the meminfo file on the proc virtual file system and more details about the memory Example 4 3 proc meminfo output root x455 root...

Page 179: ...er man rmmod for more information about rmmod options and parameters Example 4 4 proc modules output root x455 root cat proc modules usb storage 155624 1 soundcore 13632 0 autoclean autofs 30864 0 aut...

Page 180: ...GB 18117296128 bytes 255 heads 63 sectors track 2202 cylinders Units cylinders of 16065 512 8225280 bytes Device Boot Start End Blocks Id System dev sda1 1 2203 17692671 ee EFI GPT Disk dev sdb 18 1 G...

Page 181: ...e Flags 1 0 031 172 573 fat16 EFI system partition boot 2 172 573 298 081 Microsoft reserved partition 3 298 081 10299 484 ntfs Basic data partition 4 10299 485 10353 750 fat32 boot 5 10353 750 11381...

Page 182: ...he following partitions EFI System Partition FAT16 assigned as sda1 Two Microsoft Reserved Partitions one assigned as sda2 and the another as sdb1 See Microsoft Reserved Partition on page 137 for more...

Page 183: ...ion 169 Figure 4 50 Expert Partitioner SLES 8 Red Hat EL AS 3 0 in disk sdb ESP FAT16 named boot assigned as sdb3 Swap partition assigned as sdb4 Root or data partition ext3 assigned as sdb5 See Figur...

Page 184: ...4 51 Partitions in Hardware Browser Red Hat EL AS 3 0 The FAT16 and FAT32 partitions are the EFI System Partitions one per operating system where the kernel images and other files needed to boot Linux...

Page 185: ...nd var log messages on other Linux distributions to the serial port To do so you must use the syslog daemon This daemon controls the flow of system messages and redirects them wherever we want them to...

Page 186: ...he 12 RXE 100 slots You do not need to disconnect the RXE 100 before installing Linux As you can see in Figure 4 52 on page 173 all the PCI slots are recognized including the 12 external PCI slots Tip...

Page 187: ...n File Edit View Terminal Go Help YaST linux ui ncurses 2 6 24 Hardware info IBM Host bridge Close Has PCMCIA No Has SMP No Keyboard Memory Network card Network interface PCI IBM Host bridge Rage XL I...

Page 188: ...ati driver This driver supports almost all the ATI graphics controllers ATI controllers are supported on both major versions of XFree86 the 3 3 6 and the 4 2 1 To follow the status of any supported A...

Page 189: ...sed to manage the x455 The topics covered are IBM Director on page 176 The Remote Supervisor Adapter on page 177 Management using the Remote Supervisor Adapter on page 187 Windows System Resource Mana...

Page 190: ...ardware in an IBM Director environment can be divided into the following groups Management servers One or more servers on which IBM Director Server is installed Managed systems Servers workstations de...

Page 191: ...delete unassigned scalable nodes to and from IBM Director insert and remove scalable nodes to and from a scalable partition view information about and configure the remote I O enclosures attached to...

Page 192: ...ocol PPP support Simple Network Management Protocol SNMP support Domain Name System DNS and Dynamic Host Configuration Protocol DHCP support Remote power control Remote firmware update and access to c...

Page 193: ...nterconnect port 5 2 1 Connecting via a Web browser To use a Web browser to access the Remote Supervisor Adapter remotely ensure that your browser meets the following requirements Microsoft Internet E...

Page 194: ...er a valid user ID and password By default only one user ID is configured User ID USERID all caps Password PASSW0RD all caps and zero not the letter O 8 Once you are connected the main menu should app...

Page 195: ...com support Once you have downloaded it you will need to copy it to a USB memory key see EFI tips and tricks on page 102 or a CD R or copy it directly to the EFI system partition Only the FLASH2 EFI...

Page 196: ...he changes 11 Press Esc After the Warning window opens press Enter to restart the Remote Supervisor Adapter 12 Exit the utility and return to the EFI Boot Manager menu 13 You should now be able to con...

Page 197: ...Figure 5 3 Figure 5 3 Remote Supervisor Adapter Web interface Important We strongly recommend that you disable this default user ID and create new more secure user IDs before you put your server into...

Page 198: ...Solutions using IBM Director SG24 6188 Once you have connected the x455 Remote Supervisor Adapter to other service processors including another Remote Supervisor Adapter do the following 1 From your W...

Page 199: ...r Adapter should appear 5 2 3 Installing the device driver You should install the ASM device driver once the operating system is installed The device driver enables communication between the adapter a...

Page 200: ...the remote control features of the Remote Supervisor Adapter Web interface you must configure the remote control password using the Configuration Setup utility program To set up a remote control pass...

Page 201: ...to act upon those events in a variety of ways for example by sending e mail or a pager alert The Remote Supervisor Adapter supports the following methods of forwarding alerts to IBM Director Simple Ne...

Page 202: ...nu click Alerts in the navigation bar 2 Scroll to the Monitored Alerts section There are three types of events listed as follows Critical Alerts These are hard disk drive multiple fan failure power fa...

Page 203: ...he Monitored Alerts section is the Monitored Local Alerts section These options are applicable only when the IBM Director Agent is installed on the x455 When the agent is installed and those options a...

Page 204: ...Web browser on page 179 or Connecting via the ASM interconnect on page 184 2 Connect to the adapter using the Web browser From the home page click Network Protocols 3 In the SNMP section see Figure 5...

Page 205: ...me listed in IBM Director is Remote Supervisor Adapter IP address where IP Address is the address of the Remote Supervisor Adapter you configured You can choose to make this name more descriptive for...

Page 206: ...e lists those recipients configured for remote alerts By default this list is empty Click an empty link labeled not used to configure a remote recipient 4 To configure IBM Director as a remote recipie...

Page 207: ...con located in the IBM Director Console 3 The Event Action Plan Builder window will appear Right click Event Action Plan in the left hand pane and select New to create a new plan 4 Provide a descripti...

Page 208: ...Figure 5 9 Customize action configuration window 9 Click the Save icon in the upper left hand corner of the window it looks like a diskette to save the changes 10 Your new customized action should app...

Page 209: ...IBM Director Console click and drag your completed test configuration to the Remote Supervisor Adapter for the x455 located in the middle pane 15 In either case a pop up window will appear notifying...

Page 210: ...r environment 5 4 Windows System Resource Manager Microsoft Windows System Resource Manager WSRM is a utility used for managing CPU and memory resource allocation among multiple applications that run...

Page 211: ...mory leaks also present significant problems to the function of the system and to other applications that are installed All of these circumstances can cause the application or the operating system to...

Page 212: ...ed by WSRM must be defined using process matching criteria This criteria specifies the logic used to match and group processes When a process is started WSRM tries to match that process with process m...

Page 213: ...and can also be saved as an HTML file Accounting Accounting logs information based on the behavior of managed processes The information logged is stored in the accounting database By default informat...

Page 214: ...200 IBM Eserver xSeries 455 Planning and Installation Guide Figure 5 14 Connect to the x455...

Page 215: ...tocol DIMM dual inline memory module DLT Digital Linear Tape DNS Domain Name System DOS disk operating system DRDA Distributed Relational Database Architecture Abbreviations and acronyms EB Exabytes E...

Page 216: ...s memory RCM remote console manager RDIMM registered dual inline memory module RDM Remote Deployment Manager RETAIN remote technical assistance information network RH Red Hat RISC reduced instruction...

Page 217: ...r Storage Area Networks and FICON SG24 5474 Netfinity Tape Solutions SG24 5218 The IBM LTO Ultrium Tape Libraries Guide SG24 5946 Windows Server 2003 Datacenter Edition on the IBM Eserver xSeries 445...

Page 218: ...www pc ibm com us eserver xseries xarchitecture enterprise Windows Datacenter from IBM http www pc ibm com ww eserver xseries windows datacenter html xSeries configuration tools http www pc ibm com eu...

Page 219: ...http www ibm com support assure esar RETAIN tip H18505 use of ServeRAID on IA 64 systems http www ibm com pc support site wss MIGR 53247 html Linux operating system installation instructions IBM empl...

Page 220: ...operating systems http www microsoft com technet prodtechnol winxppro reskit prkb_cn c_helm asp Windows System Resource Manager http www microsoft com windowsserver2003 downloads wsrm mspx Linux Serv...

Page 221: ...nux products http www turbolinux com products GNU Parted modifying disk partitions and file systems http www gnu org software parted ATI video driver support from The XFree86 Project http www xfree86...

Page 222: ...ou can search for view or download Redbooks Redpapers Hints and Tips draft publications and Additional materials as well as order hardcopy Redbooks or CD ROMs at this Web site ibm com redbooks Help fr...

Page 223: ...ty Kit 67 8855 1RX 4 56 8855 2RX 4 56 8855 3RX 4 56 A Active Memory 14 mirroring 15 Active PCI driver Windows 2000 145 Adaptec RAID Driver 108 adapter speeds 62 adapter teaming 64 alerts 188 applicati...

Page 224: ...RAID 1 creating 105 remote control password 186 RSA firmware 116 SCSI controller 105 ServeRAID 108 shell 95 system partition 97 147 tasks 92 TimeOut value 130 Windows boot record 148 EFI System Parti...

Page 225: ...a SCO Linux 155 Conectiva Linux 155 CPU information 163 data types 152 distributions 153 drivers 173 IA 32 applications 163 kernel 151 memory information 164 modules used 165 partitions 166 Red Hat Li...

Page 226: ...de 23 26 processor board assembly LEDs 10 processors installation order 9 56 option part numbers 56 processor board assembly 6 9 upgrades 56 protective MBR 32 PS 2 keyboard and mouse 3 PXE boot 94 R r...

Page 227: ...anagement 49 SUSE LINUX installing 156 system partition EFI 97 T tape 84 teaming 64 time stamp counter 67 tornado chip 7 TotalStorage solutions 81 Trigger Tool 90 Turbolinux 155 two node configuration...

Page 228: ...214 IBM Eserver xSeries 455 Planning and Installation Guide...

Page 229: ...IBM Eserver xSeries 455 Planning and Installation Guide...

Page 230: ......

Page 231: ......

Page 232: ...ng the 64 bit IBM XA 64 chipset and the Intel Itanium 2 processor Unlike the x450 its predecessor the x455 supports the merging of four server chassis to form a single 16 way image providing even grea...